Tyl*_*312 1 python selenium urllib2 beautifulsoup xlsxwriter
每当我在CMD中运行程序时,我都会出现缩进错误.对我来说,整个程序的缩进看起来很完美所以我完全不知道为什么我收到错误.
CMD错误:
scraper9.py", line 50
browser.get(url2)
^
IndentationError: unexpected unindent
Run Code Online (Sandbox Code Playgroud)
我已经完全删除了所有的缩进并重新缩进了行的行以到达当前的迭代但我仍然出错.
导入os导入sys导入csv从bs4导入BeautifulSoup导入urllib2导入xlsxwriter从selenium导入webdriver
reload(sys)
sys.setdefaultencoding("utf8")
key_stats_on_main = ["Market Cap", "PE Ratio (TTM)"]
key_stats_on_stat = ["Enterprise Value", "Trailing P/E"]
stocks_arr =[]
pfolio_file = open("tickers.csv", "r")
for line in pfolio_file:
indv_stock_arr = line.strip().split(",")
stocks_arr.append(indv_stock_arr)
print(stocks_arr)
browser = webdriver.PhantomJS()
stock_info_arr = []
for stock in stocks_arr:
stock_info = []
ticker = stock[0]
stock_info.append(ticker)
url="https://finance.yahoo.com/quote/{0}?p={0}".format(ticker)
url2="https://finance.yahoo.com/quote/{0}/key-statistics?p={0}".format(ticker)
browser.get(url)
innerHTML = browser.execute_script("return document.body.innerHTML")
soup = BeautifulSoup(innerHTML, "html.parser")
for stat in key_stats_on_main:
page_stat1 = soup.find(text = stat)
try:
page_row1 = page_stat1.find_parent("tr")
try:
page_statnum1 = page_row1.find_all("span")[1].contents[1]
except:
page_statnum1 = page_row1.find_all("td")[1].contents[0]
except:
print("Invalid parent for this element")
page_statnum1 = "N/A"
stock_info.append(page_statnum1)
browser.get(url2)
innerHTML2 = browser.execute_script("return document.body.innerHTML2")
soup2 = BeautifulSoup(innerHTML2, "html.parser")
for stat in key_stats_on_stat:
page_stat2 = soup2.find(text=stat)
try:
page_row2 = page_stat2.find_parent("tr")
try:
page_statnum2 = page_row2.find_all("span")[1].contents[0]
except:
page_statnum2 = page_row2.find_all("td")[1].content[0]
except:
print("Invalid pareent for this element")
page_statnum2 = "N/A"
stock_info.append(page_statnum2)
stock_info_arr.append(stock_info)
print(stock_info_arr)
key_stats_on_main.extend(key_stats_on_stat)
workbook = xlsxwriter.Workbook("Stocks01.xlsx")
worksheet = workbook.add_worksheet()
row = 0
col = 2
for stat in key_stats_on_main:
worksheet.write(row, col, stat)
col +=1
row = 1
col = 0
for our_stock in stock_info_arr:
col = 0
for info_bit in our_stock:
worksheet.write(row, col, info_bit)
col += 1
row += 1
workbook.close()
print("Script completed")
Run Code Online (Sandbox Code Playgroud)
我希望代码在没有Ineation错误的情况下执行.
它出错了.我迷路了.
你try:缺少一个except:或finally:.
for stat in key_stats_on_main:
page_stat1 = soup.find(text = stat)
try: # <--------------- this one here
page_row1 = page_stat1.find_parent("tr")
try:
page_statnum1 = page_row1.find_all("span")[1].contents[1]
except:
page_statnum1 = page_row1.find_all("td")[1].contents[0]
except:
print("Invalid parent for this element")
page_statnum1 = "N/A"
stock_info.append(page_statnum1)
# <---------------- needs something here
browser.get(url2)
Run Code Online (Sandbox Code Playgroud)
你可能意味着第二个except:在第一个的缩进级别try::
for stat in key_stats_on_main:
page_stat1 = soup.find(text = stat)
try: # <--------------- this one here
page_row1 = page_stat1.find_parent("tr")
try:
page_statnum1 = page_row1.find_all("span")[1].contents[1]
except:
page_statnum1 = page_row1.find_all("td")[1].contents[0]
except:
print("Invalid parent for this element")
page_statnum1 = "N/A"
stock_info.append(page_statnum1)
browser.get(url2)
Run Code Online (Sandbox Code Playgroud)
试试吧!
顺便说一句,你应该减少你的try:子句中的代码的大小,并只捕获你正在处理的异常.在你的情况下,第一个AttributeError(如果.contents失败)将被捕获except:.更好:
try:
found = page_row1.find_all("span")
index = 1
except XError: # should be the one .find_all() can raise
found = page_row1.find_all("td")
index = 0
page_statnum1 = found[1].contents[index]
Run Code Online (Sandbox Code Playgroud)
和外部try/ 类似的东西except.
这样你就不会掩盖你从未打算处理的其他异常.如果你做那个隐形衣,你将很难弄清楚出了什么问题,所以要避免它.
| 归档时间: |
|
| 查看次数: |
46 次 |
| 最近记录: |