Ari*_*tar 3 python pdf web-scraping
我有这个链接:
我想下载嵌入的 PDF。
我已经尝试了urllib
和的正常方法,request
但它们不起作用。
import urllib2
url = "http://www.equibase.com/premium/chartEmb.cfm?track=ALB&raceDate=06/17/2002&cy=USA&rn=1"
response = urllib2.urlopen(url)
file = open("document.pdf", 'wb')
file.write(response.read())
file.close()
Run Code Online (Sandbox Code Playgroud)
此外,我也试图找到pdf的原始链接,但也没有用。
内部链接:
使用Selenium
特定的,ChromeProfile
您可以使用以下代码下载嵌入的 pdf:
代码:
def download_pdf(lnk):
from selenium import webdriver
from time import sleep
options = webdriver.ChromeOptions()
download_folder = "C:\\"
profile = {"plugins.plugins_list": [{"enabled": False,
"name": "Chrome PDF Viewer"}],
"download.default_directory": download_folder,
"download.extensions_to_open": ""}
options.add_experimental_option("prefs", profile)
print("Downloading file from link: {}".format(lnk))
driver = webdriver.Chrome(chrome_options = options)
driver.get(lnk)
filename = lnk.split("/")[4].split(".cfm")[0]
print("File: {}".format(filename))
print("Status: Download Complete.")
print("Folder: {}".format(download_folder))
driver.close()
Run Code Online (Sandbox Code Playgroud)
当我调用这个函数时:
download_pdf("http://www.equibase.com/premium/eqbPDFChartPlus.cfm?RACE=1&BorP=P&TID=ALB&CTRY=USA&DT=06/17/2002&DAY=D&STYLE=EQB")
Run Code Online (Sandbox Code Playgroud)
这就是输出:
>>> Downloading file from link: http://www.equibase.com/premium/eqbPDFChartPlus.cfm?RACE=1&BorP=P&TID=ALB&CTRY=USA&DT=06/17/2002&DAY=D&STYLE=EQB
>>> File: eqbPDFChartPlus
>>> Status: Download Complete.
>>> Folder: C:\
Run Code Online (Sandbox Code Playgroud)
看一下具体的简介:
profile = {"plugins.plugins_list": [{"enabled": False,
"name": "Chrome PDF Viewer"}],
"download.default_directory": download_folder,
"download.extensions_to_open": ""}
Run Code Online (Sandbox Code Playgroud)
它禁用Chrome PDF Viewer
插件(在网页上嵌入 pdf),将默认下载文件夹download_folder
设置为变量定义的文件夹,并设置不允许 Chrome 自动打开任何扩展程序。
之后,当您打开所谓的“内部链接”时,您的网络驱动程序将自动将.pdf
文件下载到download_folder
.