小编The*_*ler的帖子

如何从命令行使用Scrapy传递表单数据?

我怎么能从命令行传递用户名和密码?谢谢!

class LoginSpider(Spider):
    name = 'example.com'
    start_urls = ['http://www.example.com/users/login.php']

    def parse(self, response):
        return [FormRequest.from_response(response,
                    formdata={'username': 'john', 'password': 'secret'},
                    callback=self.after_login)]

    def after_login(self, response):
        # check login succeed before going on
        if "authentication failed" in response.body:
            self.log("Login failed", level=log.ERROR)
            return

        # continue scraping with authenticated session...
Run Code Online (Sandbox Code Playgroud)

python screen-scraping scrapy scrapyd

3
推荐指数
2
解决办法
3434
查看次数

标签 统计

python ×1

scrapy ×1

scrapyd ×1

screen-scraping ×1