ken*_*way 1 python proxy http-get beautifulsoup http-post
from bs4 import BeautifulSoup
import requests
from requests.auth import HTTPProxyAuth
url = "http://www.transtats.bts.gov/Data_Elements.aspx?Data=2"
proxies = {"http":"xxx.xxx.x.xxx: port"}
auth = HTTPProxyAuth("username", "password")
r = requests.get(url, proxies=proxies, auth=auth)
soup = BeautifulSoup(r.text,"html.parser")
viewstate_element = soup.find(id = "__VIEWSTATE").attrs
viewstate = viewstate_element["value"]
eventvalidation_element = soup.find(id="__EVENTVALIDATION").attrs
eventvalidation = eventvalidation_element["value"]
data = {'AirportList':"BOS",'CarrierList':"VX",'Submit':'Submit',"__EVENTTARGET":"","__EVENTARGUMENT":"","__EVENTVALIDATION":eventvalidation,"}
r = requests.post(url, proxies, auth, data )
print r
Run Code Online (Sandbox Code Playgroud)
这个代码在我使用时工作正常requests.get(url, proxies=proxies, auth=auth),但是当有一些数据必须通过requests.post()代理身份验证发送时该怎么办?
Sha*_*y89 11
代表Vikas Neha Ojha,所有人都可以看到
proxies = {'http': 'http://username:password@ip:port', 'https': 'http://usernamepassword@ip:port'}
Run Code Online (Sandbox Code Playgroud)
然后
requests.post(url, proxies=proxies, data=data)
Run Code Online (Sandbox Code Playgroud)
| 归档时间: |
|
| 查看次数: |
13485 次 |
| 最近记录: |