当我多次运行爬网过程时出现此错误。我正在使用 scrapy 2.6 这是我的代码:
from scrapy.crawler import CrawlerProcess
from football.spiders.laliga import LaligaSpider
from scrapy.utils.project import get_project_settings
process = CrawlerProcess(settings=get_project_settings())
for i in range(1, 29):
process.crawl(LaligaSpider, **{'week': i})
process.start()
Run Code Online (Sandbox Code Playgroud)
小智 7
对我来说这有效,我把它放在 CrawlerProcess 之前
import sys
if "twisted.internet.reactor" in sys.modules:
del sys.modules["twisted.internet.reactor"]
Run Code Online (Sandbox Code Playgroud)