小编Jam*_*Guo的帖子

最近我用Python 3.4编写了一个多进程代码来下载一些图像，一开始它运行得非常快，然后我收到以下错误并且无法再启动程序。

Traceback (most recent call last):
  File "multiprocessing_d.py", line 23, in <module>
    main()
  File "multiprocessing_d.py", line 16, in main
    p.map(download, lines)
  File "/usr/local/lib/python3.4/multiprocessing/pool.py", line 260, in map
    return self._map_async(func, iterable, mapstar, chunksize).get()
  File "/usr/local/lib/python3.4/multiprocessing/pool.py", line 608, in get
    raise self._value
multiprocessing.pool.MaybeEncodingError: Error sending result: '<multiprocessing.pool.ExceptionWithTraceback object at 0x7f1e047f32e8>'. Reason: 'TypeError("cannot serialize '_io.BufferedReader' object",)'

我的代码如下
download_helper.py

        import sys
        import os
        from pathlib import Path

        url_prefix = r"Some prefix"

        def setup_download_dir(dictionary):
            download_dir = Path(dictionary)
            if not download_dir.exists():
                download_dir.mkdir()
            return dictionary

        def …