是否有任何Python库允许我解析类似于jQuery的HTML文档？
即我希望能够使用CSS选择器语法从文档中获取任意节点集,读取其内容/属性等.
我之前使用的唯一的Python HTML解析库是BeautifulSoup,即使它很好,我仍然认为如果我有jQuery语法,我的解析会更快.:d
sys*_*out 59
如果你能流利使用BeautifulSoup,你可以在你的libs中添加soupselect.
Soupselect是BeautifulSoup的CSS选择器扩展.
用法:
>>> from BeautifulSoup import BeautifulSoup as Soup
>>> from soupselect import select
>>> import urllib
>>> soup = Soup(urllib.urlopen('http://slashdot.org/'))
>>> select(soup, 'div.title h3')
[<h3><span><a href='//science.slashdot.org/'>Science</a>:</span></h3>,
<h3><a href='//slashdot.org/articles/07/02/28/0120220.shtml'>Star Trek</h3>,
..]
Luk*_*ley 43
考虑PyQuery:
http://packages.python.org/pyquery/
>>> from pyquery import PyQuery as pq
>>> from lxml import etree
>>> import urllib
>>> d = pq("<html></html>")
>>> d = pq(etree.fromstring("<html></html>"))
>>> d = pq(url='http://google.com/')
>>> d = pq(url='http://google.com/', opener=lambda url: urllib.urlopen(url).read())
>>> d = pq(filename=path_to_html_file)
>>> d("#hello")
[<p#hello.hello>]
>>> p = d("#hello")
>>> p.html()
'Hello world !'
>>> p.html("you know <a href='http://python.org/'>Python</a> rocks")
[<p#hello.hello>]
>>> p.html()
u'you know <a href="http://python.org/">Python</a> rocks'
>>> p.text()
'you know Python rocks'
css selectorsimport requests
from bs4 import BeautifulSoup as Soup
html = requests.get('/sf/ask/213590681/').content
soup = Soup(html)
这个问题的标题
soup.select('h1.grid--cell :first-child')[0].text
问题投票数
# first item
soup.select_one('[itemprop="upvoteCount"]').text
使用Python Requests获取 html 页面