小编Ved*_*mle的帖子

如何使用 snscrape 抓取 Twitter 列表?

我必须使用此链接https://twitter.com/i/lists/777955586638053376抓取推文snscrape

到目前为止我已经尝试过使用这个:

from snscrape.modules.twitter import *
Run Code Online (Sandbox Code Playgroud)
search = TwitterListPostsScraper("Abgeordnetenhaus #agh").get_items()
for item in search:
    print(item)
Run Code Online (Sandbox Code Playgroud)
search = TwitterListPostsScraper("https://twitter.com/i/lists/777955586638053376").get_items()
for item in search:
    print(item)
Run Code Online (Sandbox Code Playgroud)
search = TwitterListPostsScraper("777955586638053376").get_items()
for item in search:
    print(item)
Run Code Online (Sandbox Code Playgroud)

每次,我都会遇到这个错误

Error retrieving https://api.twitter.com/2/search/adaptive.json?include_profile_interstitial_type=1&include_blocking=1&include_blocked_by=1&include_followed_by=1&include_want_retweets=1&include_mute_edge=1&include_can_dm=1&include_can_media_tag=1&include_ext_has_nft_avatar=1&skip_status=1&cards_platform=Web-12&include_cards=1&include_ext_alt_text=true&include_quote_count=true&include_reply_count=1&tweet_mode=extended&include_entities=true&include_user_entities=true&include_ext_media_color=true&include_ext_media_availability=true&include_ext_sensitive_media_warning=true&include_ext_trusted_friends_metadata=true&send_error_codes=true&simple_quoted_tweet=true&q=list%3Ahttps%3A%2F%2Ftwitter.com%2Fi%2Flists%2F777955586638053376&tweet_search_mode=live&count=20&query_source=spelling_expansion_revert_click&pc=1&spelling_corrections=1&ext=mediaStats%2ChighlightedLabel%2ChasNftAvatar%2CvoiceInfo%2Cenrichments%2CsuperFollowMetadata%2CunmentionInfo: 
non-200 status code
4 requests to https://api.twitter.com/2/search/adaptive.json?include_profile_interstitial_type=1&include_blocking=1&include_blocked_by=1&include_followed_by=1&include_want_retweets=1&include_mute_edge=1&include_can_dm=1&include_can_media_tag=1&include_ext_has_nft_avatar=1&skip_status=1&cards_platform=Web-12&include_cards=1&include_ext_alt_text=true&include_quote_count=true&include_reply_count=1&tweet_mode=extended&include_entities=true&include_user_entities=true&include_ext_media_color=true&include_ext_media_availability=true&include_ext_sensitive_media_warning=true&include_ext_trusted_friends_metadata=true&send_error_codes=true&simple_quoted_tweet=true&q=list%3Ahttps%3A%2F%2Ftwitter.com%2Fi%2Flists%2F777955586638053376&tweet_search_mode=live&count=20&query_source=spelling_expansion_revert_click&pc=1&spelling_corrections=1&ext=mediaStats%2ChighlightedLabel%2ChasNftAvatar%2CvoiceInfo%2Cenrichments%2CsuperFollowMetadata%2CunmentionInfo 
failed, giving up.
Run Code Online (Sandbox Code Playgroud)

我在这里还能做什么?

编辑:更新模块解决了问题

python web-scraping

2
推荐指数
1
解决办法
899
查看次数

标签 统计

python ×1

web-scraping ×1