Scrapy没有“爬行”命令

Question

我开始学习 Scrapy 但马上就出现错误Unknown command: crawl。我不知道为什么我得到这个，但在 py Scrapy 命令中我没有这个命令。我使用python 3.6andpycharm作为编辑。

(venv) C:\Users\Pc\PycharmProjects\web skreper\venv\Scripts>scrapy crawl quotes
Scrapy 1.7.3 - no active project

Unknown command: crawl

Use "scrapy" to see available commands

(venv) C:\Users\Pc\PycharmProjects\web skreper\venv\Scripts>scrapy
Scrapy 1.7.3 - no active project

Usage:
  scrapy <command> [options] [args]

Available commands:
  bench         Run quick benchmark test
  fetch         Fetch a URL using the Scrapy downloader
  genspider     Generate new spider using pre-defined templates
  runspider     Run a self-contained spider (without creating a project)
  settings      Get settings values
  shell         Interactive scraping console
  startproject  Create new project
  version       Print Scrapy version
  view          Open URL in browser, as seen by Scrapy

这是我写的基本代码：

import scrapy

class My_Scraper(scrapy.Spider):

    name = 'quotes'

    #url sajtova koje scrapujem
    start_urls = [
        'https://www.nekretnine.rs/'
        ]

    def parse(self, response):

        title = response.css('title').extract()

        yield {'title text': title}

Answer 1

您需要位于 Scrapy 文件夹内的项目文件夹内。

您当前正在尝试从 C:\Users\Pc\PycharmProjects\web skreper\venv\Scripts 运行命令

但它应该类似于 C:\Users\Pc\PycharmProjects\web skreper\venv\Scripts\Scrapy\My_Scraper

Answer 2

您必须退出脚本文件夹并移动到scrapy.cfg放置文件的项目目录。

从那里运行 scrapy 爬行它将起作用。