python 3.5 urllib.request.Request POST数据到网站.做GET而不是POST

Question

在Python Urllib中执行POST而不是GET时遇到问题.我跑3.5.我试图POST到形成字段.

我读到如果数据参数存在,urllib.request.Request将默认为POST.我在https://docs.python.org/3/howto/urllib2.html上看到了这个

我复制这些设置,当我启动wireshark时,我看到的是GET和Never a Post,即使看起来代码正在执行.

这是我的代码:

values = {"field1" : z[2:-1], "Submit":"Save"}
print(values)
data = urllib.parse.urlencode(values)
data = data.encode('utf-8')
print(data)
req = urllib.request.Request("http://www.randomsite.com/myprocessingscript.php", data)
with urllib.request.urlopen(req) as response:
    the_page = response.read()
print(the_page)

当我启动wireshark时,这是req行的结果:

GET /myprocessingscript.php HTTP/1.1 Accept-Encoding:identity主机:ec2-52-91-45-113.compute-1.amazonaws.com连接:close User-Agent:Python-urllib/3.5

HTTP/1.1 200 OK日期:2015年10月28日星期三02:47:22 GMT服务器:Apache/2.4.17(Unix)OpenSSL/1.0.1p PHP/5.5.30 mod_perl/2.0.8-dev Perl/v5.16.3 X-Powered-By:PHP/5.5.30内容长度:23连接:关闭内容类型:text/html

没有要处理的帖子数据

另外当我运行脚本时,这是我从print语句得到的:

{'Submit':'save','field1':'hostlab\chris'} b'Submit = Save&field1 = hostlab%5Cchris%5Cr%5Cn'b'no post post data to process'Trackback(最近一次呼叫最后):File "C:\ Users\chris\Desktop\test.py",第20行,time.sleep(random.randint(5,10))

他们正在访问两个Web文件.Index.html和myprocessingscript.php:

Index.html:

<h1>randomsite.com.</h1>

####<p>whoami</p>

<form action="myprocessingscript.php" method="POST">
    <input name="field1" type="text" />
    <input type="submit" name="submit" value="Save">
</form>

</body>
</html>

myprocessingscript.php:

<?php if(isset($_POST['field1'])) {
    $data = $_POST['field1'] . "\n";
    $ret = file_put_contents('/tmp/mydata.txt', $data);
    if($ret === false) {
        die('There was an error writing this file');
    }
    else {
        echo "$ret bytes written to file";
    }
}
else {
   die('no post data to process');
}

Answer 1

HTTP POST按预期工作:

#!/usr/bin/env python
from contextlib import closing
try:
    from urllib.parse import urlencode
    from urllib.request import urlopen
except ImportError: # Python 2
    from urllib import urlencode
    from urllib2 import urlopen

url = 'http://httpbin.org/post'
data = urlencode({"field1" : "value", "Submit": "Save"}).encode()
with closing(urlopen(url, data)) as response:
    print(response.read().decode())

您可能GET只在http重定向后看到(如rfc建议的那样 - 在没有提示用户的情况下,不应在重定向上发布数据).

例如,这是一个重定向POST /请求的http服务器:

#!/usr/bin/env python
from flask import Flask, redirect, request, url_for # $ pip install flask

app = Flask(__name__)

@app.route('/', methods=['GET', 'POST'])
def index():
    if request.method == 'POST':
        return redirect(url_for('post'))
    return '<form method="POST"><input type="submit">'


@app.route('/post', methods=['GET', 'POST'])
def post():
    return 'Hello redirected %s!' % request.method

if __name__ == '__main__':
    import sys
    port = int(sys.argv[1]) if len(sys.argv) > 1 else None
    app.run(host='localhost', port=port)

使用相同的代码(urlopen(url, data))发出HTTP POST请求会导致重定向,第二个请求是GET:

"POST / HTTP/1.1" 302 -
"GET /post HTTP/1.1" 200 -

同样,第一个请求POST不是GET.如果您访问/并单击submit按钮(浏览器发出POST请求,然后是GET请求),行为完全相同.

Python问题:"文档如何在重定向上转发POST数据"包含一个链接到HTTPRedirectHandler子类,该子类在重定向上发布数据:

#!/usr/bin/env python
from contextlib import closing
try:
    from urllib.parse import urlencode
    from urllib.request import (HTTPError, HTTPRedirectHandler, Request,
                                build_opener, urlopen)
except ImportError: # Python 2
    from urllib import urlencode
    from urllib2 import (HTTPError, HTTPRedirectHandler, Request,
                         build_opener, urlopen)

class PostHTTPRedirectHandler(HTTPRedirectHandler):
    """Post data on redirect unlike urrlib2.HTTPRedirectHandler."""
    def redirect_request(self, req, fp, code, msg, headers, newurl):
        m = req.get_method()
        if (code in (301, 302, 303, 307) and m in ("GET", "HEAD")
            or code in (301, 302, 303) and m == "POST"):
            newurl = newurl.replace(' ', '%20')
            CONTENT_HEADERS = ("content-length", "content-type")
            newheaders = dict((k, v) for k, v in req.headers.items()
                              if k.lower() not in CONTENT_HEADERS)
            return Request(newurl,
                           data=req.data,
                           headers=newheaders,
                           origin_req_host=req.origin_req_host,
                           unverifiable=True)
        else:
            raise HTTPError(req.get_full_url(), code, msg, headers, fp)


urlopen = build_opener(PostHTTPRedirectHandler).open

url = 'http://localhost:5000'
data = urlencode({"field1" : "value", "Submit": "Save"}).encode()
with closing(urlopen(url, data)) as response:
    print(response.read().decode())

在这种情况下,访问日志显示两个POST请求(第二个请求是POST):

"POST / HTTP/1.1" 302 -
"POST /post HTTP/1.1" 200 -

注意:您可以自定义HTTPRedirectHandler以遵循rfc 2616行为.