lmm*_*mml 3 html python beautifulsoup pandas
我正在尝试使用 pandas 将抓取的 HTML 表转换为 python 中的数据框read_html。问题是,read_html不间断地引入一列数据,这使得这些单元格的内容难以解析。在原始 HTML 中,列中的每个“单词”均由换行符分隔。有没有办法在转换为数据框时保持这种格式或以其他方式保持“单词”分开?
import requests
from bs4 import BeautifulSoup
import pandas as pd
url="https://www.who.int/en/activities/tracking-SARS-CoV-2-variants/"
html_content = requests.get(url).text
# Parse the html content
soup = BeautifulSoup(html_content, "lxml")
voc_html = soup.find("table")
#convert to dataframe
voc_df = pd.read_html(str(voc_html))[0]
#retain list of variants
voc_list=voc_df['Pango lineages']
Run Code Online (Sandbox Code Playgroud)
voc_list单独的项目被挤在一起的
示例:voc_list[1]
`B.1.351\xa0B.1.351.2B.1.351.3`
Run Code Online (Sandbox Code Playgroud)
我希望它看起来像什么:(B.1.3510 B.1.351.2 B.1.351.3或者将每个项目放在自己的行上)
摘自原始 html 版本,其中包括中断:
import requests
from bs4 import BeautifulSoup
import pandas as pd
url="https://www.who.int/en/activities/tracking-SARS-CoV-2-variants/"
html_content = requests.get(url).text
# Parse the html content
soup = BeautifulSoup(html_content, "lxml")
voc_html = soup.find("table")
#convert to dataframe
voc_df = pd.read_html(str(voc_html))[0]
#retain list of variants
voc_list=voc_df['Pango lineages']
Run Code Online (Sandbox Code Playgroud)
感谢您的指导!
或许...
import pandas as pd
import requests
url = r'https://www.who.int/en/activities/tracking-SARS-CoV-2-variants/'
page = requests.get(url)
table = pd.read_html(page.text.replace('<br />',' '))
df = table[0]
Run Code Online (Sandbox Code Playgroud)
输出:
WHO label Pango lineages GISAID clade Nextstrain clade \
0 Alpha B.1.1.7 GRY 20I (V1)
1 Beta B.1.351 B.1.351.2 B.1.351.3 GH/501Y.V2 20H (V2)
2 Gamma P.1 P.1.1 P.1.2 GR/501Y.V3 20J (V3)
3 Delta B.1.617.2 AY.1 AY.2 G/478K.V1 21A
Additional amino acid changes monitored* Earliest documented samples \
0 +S:484K +S:452R United Kingdom, Sep-2020
1 +S:L18F South Africa, May-2020
2 +S:681H Brazil, Nov-2020
3 +S:417N India, Oct-2020
Date of designation
0 18-Dec-2020
1 18-Dec-2020
2 11-Jan-2021
3 VOI: 4-Apr-2021 VOC: 11-May-2021
print(df)
Run Code Online (Sandbox Code Playgroud)
同样,您可以将 替换<br />为\n。
| 归档时间: |
|
| 查看次数: |
2194 次 |
| 最近记录: |