python请求 - 使用“idna”编解码器编码失败（UnicodeError：标签为空或太长）错误

Question

我一直在使用请求包的 api 调用突然返回以下错误：“UnicodeError: encoding with 'idna' codec failed (UnicodeError: label empty or too long)”

我不知道如何解决这个问题。我的代码如下所示，在此示例中伪造了某些凭据：

api_key= '123abc'
password = '12345' #password that only idiots use on their luggage
shop_name = 'myshopname'
shop_url = 'https://%s:%s@%s.myecommercesite.com/admin/customers/1234567.json' %(api_key, password, shop_name)

a = requests.get(shop_url)

当我打印 shop_url 并将其粘贴到我的浏览器时，我得到了我期望在 json 中返回的数据。但是当我运行这个请求时，我收到了 idna 编解码器错误。

这曾经可以正常工作，但显然某处发生了变化，我不确定是电子商务网站还是请求或导致此问题的原因。

有没有人遇到过这种类型的错误或知道如何修复它？

如果我打印网址，它看起来像：https://123abc:12345@myshopname.myecommercesite.com/admin/customers/1234567.json

edit2：忘记在我的代码示例中包含 %(api_key, password, shop_name) 编辑：下面的整个错误消息：

UnicodeError                              Traceback (most recent call last)
~/anaconda3/lib/python3.6/encodings/idna.py in encode(self, input, errors)
    164                 if not (0 < len(label) < 64):
--> 165                     raise UnicodeError("label empty or too long")
    166             if len(labels[-1]) >= 64:

UnicodeError: label empty or too long

The above exception was the direct cause of the following exception:

UnicodeError                              Traceback (most recent call last)
<ipython-input-15-f834b116b751> in <module>()
----> 1 a = requests.get(shop_url)

~/anaconda3/lib/python3.6/site-packages/requests/api.py in get(url, params, **kwargs)
     70 
     71     kwargs.setdefault('allow_redirects', True)
---> 72     return request('get', url, params=params, **kwargs)
     73 
     74 

~/anaconda3/lib/python3.6/site-packages/requests/api.py in request(method, url, **kwargs)
     56     # cases, and look like a memory leak in others.
     57     with sessions.Session() as session:
---> 58         return session.request(method=method, url=url, **kwargs)
     59 
     60 

~/anaconda3/lib/python3.6/site-packages/requests/sessions.py in request(self, method, url, params, data, headers, cookies, files, auth, timeout, allow_redirects, proxies, hooks, stream, verify, cert, json)
    497 
    498         settings = self.merge_environment_settings(
--> 499             prep.url, proxies, stream, verify, cert
    500         )
    501 

~/anaconda3/lib/python3.6/site-packages/requests/sessions.py in merge_environment_settings(self, url, proxies, stream, verify, cert)
    670             # Set environment's proxies.
    671             no_proxy = proxies.get('no_proxy') if proxies is not None else None
--> 672             env_proxies = get_environ_proxies(url, no_proxy=no_proxy)
    673             for (k, v) in env_proxies.items():
    674                 proxies.setdefault(k, v)

~/anaconda3/lib/python3.6/site-packages/requests/utils.py in get_environ_proxies(url, no_proxy)
    690     :rtype: dict
    691     """
--> 692     if should_bypass_proxies(url, no_proxy=no_proxy):
    693         return {}
    694     else:

~/anaconda3/lib/python3.6/site-packages/requests/utils.py in should_bypass_proxies(url, no_proxy)
    674     with set_environ('no_proxy', no_proxy_arg):
    675         try:
--> 676             bypass = proxy_bypass(netloc)
    677         except (TypeError, socket.gaierror):
    678             bypass = False

~/anaconda3/lib/python3.6/urllib/request.py in proxy_bypass(host)
   2610             return proxy_bypass_environment(host, proxies)
   2611         else:
-> 2612             return proxy_bypass_macosx_sysconf(host)
   2613 
   2614     def getproxies():

~/anaconda3/lib/python3.6/urllib/request.py in proxy_bypass_macosx_sysconf(host)
   2587     def proxy_bypass_macosx_sysconf(host):
   2588         proxy_settings = _get_proxy_settings()
-> 2589         return _proxy_bypass_macosx_sysconf(host, proxy_settings)
   2590 
   2591     def getproxies_macosx_sysconf():

~/anaconda3/lib/python3.6/urllib/request.py in _proxy_bypass_macosx_sysconf(host, proxy_settings)
   2560             if hostIP is None:
   2561                 try:
-> 2562                     hostIP = socket.gethostbyname(hostonly)
   2563                     hostIP = ip2num(hostIP)
   2564                 except OSError:

UnicodeError: encoding with 'idna' codec failed (UnicodeError: label empty or too long)

Answer 1

这似乎是socket模块的问题。当 URL 超过 64 个字符时失败。这仍然是一个悬而未决的问题https://bugs.python.org/issue32958

当 url 主机名的第一个子字符串长度大于 64 个字符时，该错误可以一致地重现，如“012345678901234567890123456789012345678901234567890123”。这不会是一个问题，只是它似乎没有从主机名的第一个子字符串中分离出凭据，因此整个“[user]:[secret]@XXX”部分的长度必须少于 65 个字符。这对于使用较长 API 密钥并期望通过基本身份验证提交的服务是有问题的。

有一个替代解决方案：

您似乎正在尝试使用 Shopify API，因此我将其作为示例。

编码{api_key}:{password}在base64发送您的请求，例如头这个值。{'Authorization': 'Basic {token_base_64}'}

请参阅下面的示例：

import base64
import requests

auth = "[API KEY]:[PASSWORD]"
b64_auth = base64.b64encode(auth.encode()).decode("utf-8")

headers = {
    "Authorization": f"Basic {b64_auth}"
}

response = requests.get(
    url="https://[YOUR-SHOP].myshopify.com/admin/[ENDPOINT]",
    headers=headers
)