使用Python3和BeautifulSoup解析xml文件

Question

我知道有关使用 Python 3 解析 xml 的问题有几个答案，但我找不到两个答案。我正在尝试从 BoardGameGeek xml 文件中解析和提取信息，如下所示（它太长了，无法粘贴到此处）：

\n\n

https://www.boardgamegeek.com/xmlapi/boardgame/10

\n\n

1）我无法从这两行中提取主要游戏名称：

\n\n

<name sortindex="1" primary="true">Elfenland</name>\n<name sortindex="1">Elfenland (\xd0\x92\xd0\xbe\xd0\xbb\xd1\x88\xd0\xb5\xd0\xb1\xd0\xbd\xd0\xbe\xd0\xb5 \xd0\x9f\xd1\x83\xd1\x82\xd0\xb5\xd1\x88\xd0\xb5\xd1\x81\xd1\x82\xd0\xb2\xd0\xb8\xd0\xb5)</name>\n

\n\n

2）我在提取数据列表时也遇到问题，例如在这个xml中：

\n\n

<poll title="User Suggested Number of Players" totalvotes="96"  name="suggested_numplayers">\n    <results numplayers="1">\n        <result numvotes="0" value="Best"/>\n        <result numvotes="0" value="Recommended"/>\n        <result numvotes="58" value="Not Recommended"/>\n    </results>\n    <results numplayers="2">\n        <result numvotes="2" value="Best"/>\n        <result numvotes="21" value="Recommended"/>\n        <result numvotes="53" value="Not Recommended"/>\n    </results>\n    <results numplayers="3">\n        <result numvotes="10" value="Best"/>\n        <result numvotes="46" value="Recommended"/>\n        <result numvotes="17" value="Not Recommended"/>\n    </results>\n        <results numplayers="4">\n        <result numvotes="47" value="Best"/>\n        <result numvotes="36" value="Recommended"/>\n        <result numvotes="1" value="Not Recommended"/>\n    </results>\n    <results numplayers="5">\n        <result numvotes="35" value="Best"/>\n        <result numvotes="44" value="Recommended"/>\n        <result numvotes="2" value="Not Recommended"/>\n    </results>\n    <results numplayers="6">\n        <result numvotes="23" value="Best"/>\n        <result numvotes="48" value="Recommended"/>\n        <result numvotes="11" value="Not Recommended"/>\n    </results>\n    <results numplayers="6+">\n        <result numvotes="0" value="Best"/>\n        <result numvotes="1" value="Recommended"/>\n        <result numvotes="46" value="Not Recommended"/>\n    </results>\n</poll>\n

\n\n

目前，我的代码非常简单，如下所示。它仅提取简单的单值 xml 行。任何有关如何提取更复杂信息的帮助都会很棒。谢谢。

\n\n

url = \'https://www.boardgamegeek.com/xmlapi/boardgame/10\'\nresponse = urllib.request.urlopen(url)\ndata = response.read()      # a `bytes` object\ntext = data.decode(\'utf-8\') # a `str`; \nsoup = BeautifulSoup(text,\'xml\')\nyearpublished = soup.find_all(\'yearpublished\')\n

\n

Answer 1

对于第一部分，尝试搜索存在属性“primary”的元素“name”，如下所示：

from bs4 import BeautifulSoup
import urllib

url = 'https://www.boardgamegeek.com/xmlapi/boardgame/10'
response = urllib.request.urlopen(url)
data = response.read()      # a `bytes` object
text = data.decode('utf-8') # a `str`;
soup = BeautifulSoup(text,'xml')
name = soup.find('name', primary = True)

print (name.get_text())

输出：

Elfenland

对于“结果”元素的第二个循环并提取所需的数据：

text = """
<poll title="User Suggested Number of Players" totalvotes="96"  name="suggested_numplayers">
    <results numplayers="1">
        <result numvotes="0" value="Best"/>
...
        <result numvotes="46" value="Not Recommended"/>
    </results>
</poll>
"""
soup = BeautifulSoup(text,'xml')

for result in soup.find_all('results'):
    numplayers = result['numplayers']
    best = result.find('result', {'value': 'Best'})['numvotes']
    recommended = result.find('result', {'value': 'Recommended'})['numvotes']
    not_recommended = result.find('result', {'value': 'Not Recommended'})['numvotes']
    print (numplayers, best, recommended, not_recommended)

输出：

1 0 0 58
2 2 21 53
3 10 46 17
4 47 36 1
5 35 44 2
6 23 48 11
6+ 0 1 46

或者，如果您想更优雅地找到所有每个属性并压缩它们：

soup = BeautifulSoup(text,'xml')
numplayers = [tag['numplayers'] for tag in soup.find_all('results')]
best = [tag['numvotes'] for tag in soup.find_all('result', {'value': 'Best'})]
recommended = [tag['numvotes'] for tag in soup.find_all('result', {'value': 'Recommended'})]
not_recommended = [tag['numvotes'] for tag in soup.find_all('result', {'value': 'Not Recommended'})]
print(list(zip(numplayers, best, recommended, not_recommended)))

输出：

[('1', '0', '0', '58'), ('2', '2', '21', '53'), ('3', '10', '46', '17'), ('4', '47', '36', '1'), ('5', '35', '44', '2'), ('6', '23', '48', '11'), ('6+', '0', '1', '46')]