Art*_*rty 8 html python tags selenium beautifulsoup
我想遍历我在 html 页面的某些部分中的所有标签。我应用了 BeautifulSoup,但我可以没有它,只有 Selenium 库。假设我有以下 html 代码:
<table id="myBSTable">
<tr>
<th>Column A1</th>
<th>Column B1</th>
<th>Column C1</th>
<th>Column D1</th>
<th>Column E1</th>
</tr>
<tr>
<td data="First Column Data"></td>
<td data="Second Column Data"></td>
<td title="Title of the First Row">Value of Row 1</td>
<td>Beautiful 1</td>
<td>Soup 1</td>
</tr>
<tr>
<td></td>
<td data-g="Second Column Data"></td>
<td title="Title of the Second Row">Value of Row 2</td>
<td>Selenium 1</td>
<td>Rocks 1</td>
</tr>
<tr>
<td></td>
<td></td>
<td title="Title of the Third Row">Value of Row 3</td>
<td>Pyhon 1</td>
<td>Boulder 1</td>
</tr>
<tr>
<th>Column A2</th>
<th>Column B2</th>
<th>Column C2</th>
<th>Column D2</th>
<th>Column E2</th>
</tr>
<tr>
<td data="First Column Data"></td>
<td data="Second Column Data"></td>
<td title="Title of the First Row">Value of Row 1</td>
<td>Beautiful 2</td>
<td>Soup 2</td>
</tr>
<tr>
<td></td>
<td data-g="Second Column Data"></td>
<td title="Title of the Second Row">Value of Row 2</td>
<td>Selenium 2</td>
<td>Rocks 2</td>
</tr>
<tr>
<td></td>
<td></td>
<td title="Title of the Third Row">Value of Row 3 2</td>
<td>Pyhon 2</td>
<td>Boulder 2</td>
</tr>
</table>
Run Code Online (Sandbox Code Playgroud)
我让这部分工作完美:
#Selenium libraries
from selenium import webdriver
from selenium.webdriver.common.keys import Keys
from selenium.common.exceptions import NoSuchElementException
#BeautifulSoup
from bs4 import BeautifulSoup
browser = webdriver.Firefox()
browser.get('http://urltoget.com')
table = browser.find_element_by_id('myBSTable')
bs_table = BeautifulSoup(table.get_attribute('innerHTML'), 'lxml')
#So far so good
rows = bs_table.findAll('tr')
for tr in rows:
#Here is where I need help
#I want to iterate through all tags
#but I don't know if is going to be a th or a td
#At the same time I need to do something
#if is a td or a th
Run Code Online (Sandbox Code Playgroud)
这就是我想要完成的:
#The following is a pseudo code
for col in tr.tags:
print col.name, col.value
for attribute in col.attrs:
print " ", attribute.name, attribute.value
#End pseudo code
Run Code Online (Sandbox Code Playgroud)
谢谢,阿蒂
您可以定位td或th通过指定要查找的标签列表。要获取所有元素属性,请使用.attrsattribute:
rows = bs_table.find_all('tr')
for row in rows:
cells = row.find_all(['td', 'th'])
for cell in cells:
print(cell.name, cell.attrs)
Run Code Online (Sandbox Code Playgroud)