带有tweepy的流式传输api仅返回最后一条推文,而不是最后一条推文

Question

我不仅是python的新手,而是完全编程所以我非常感谢你的帮助!

我试图使用Tweepy过滤来自twitter流API的所有推文.

我已按用户ID进行过滤,并确认正在实时收集推文.

然而,似乎只有第二张最后一条推文是实时收集而不是最新的推文.

你们能帮忙吗？

import tweepy
import webbrowser
import time
import sys

consumer_key = 'xyz'
consumer_secret = 'zyx'


## Getting access key and secret
auth = tweepy.OAuthHandler(consumer_key, consumer_secret)
auth_url = auth.get_authorization_url()
print 'From your browser, please click AUTHORIZE APP and then copy the unique PIN: ' 
webbrowser.open(auth_url)
verifier = raw_input('PIN: ').strip()
auth.get_access_token(verifier)
access_key = auth.access_token.key
access_secret = auth.access_token.secret


## Authorizing account privileges
auth.set_access_token(access_key, access_secret)


## Get the local time
localtime = time.asctime( time.localtime(time.time()) )


## Status changes
api = tweepy.API(auth)
api.update_status('It worked - Current time is %s' % localtime)
print 'It worked - now go check your status!'


## Filtering the firehose
user = []
print 'Follow tweets from which user ID?'
handle = raw_input(">")
user.append(handle)

keywords = []
print 'What keywords do you want to track? Separate with commas.'
key = raw_input(">")
keywords.append(key)

class CustomStreamListener(tweepy.StreamListener):

    def on_status(self, status):

        # We'll simply print some values in a tab-delimited format
        # suitable for capturing to a flat file but you could opt 
        # store them elsewhere, retweet select statuses, etc.



        try:
            print "%s\t%s\t%s\t%s" % (status.text, 
                                      status.author.screen_name, 
                                      status.created_at, 
                                      status.source,)
        except Exception, e:
            print >> sys.stderr, 'Encountered Exception:', e
            pass

    def on_error(self, status_code):
        print >> sys.stderr, 'Encountered error with status code:', status_code
        return True # Don't kill the stream

    def on_timeout(self):
        print >> sys.stderr, 'Timeout...'
        return True # Don't kill the stream

# Create a streaming API and set a timeout value of ??? seconds.

streaming_api = tweepy.streaming.Stream(auth, CustomStreamListener(), timeout=None)

# Optionally filter the statuses you want to track by providing a list
# of users to "follow".

print >> sys.stderr, "Filtering public timeline for %s" % keywords

streaming_api.filter(follow=handle, track=keywords)

Answer 1

我有同样的问题.答案并不像在我的情况下运行python unbuffered那么简单,我认为它也没有解决原始海报的问题.问题实际上是在一个名为streaming.py和function _read_loop()的文件中的tweepy包的代码中,我认为需要更新它以反映twitter从其流式api输出数据的格式的变化.

我的解决方案是从github下载最新的tweepy代码,https://github.com/tweepy/tweepy 特别是streaming.py文件.您可以查看最近进行的更改,以尝试在此文件的提交历史记录中解决此问题.

我查看了tweepy类的详细信息,并且streaming.py类在json tweet流中读取的方式存在问题.我认为它与twitter更新其流式api有关,包括传入状态的位数.长话短说,这是我在streaming.py中替换的函数来解决这个问题.

def _read_loop(self, resp):

    while self.running and not resp.isclosed():

        # Note: keep-alive newlines might be inserted before each length value.
        # read until we get a digit...
        c = '\n'
        while c == '\n' and self.running and not resp.isclosed():
            c = resp.read(1)
        delimited_string = c

        # read rest of delimiter length..
        d = ''
        while d != '\n' and self.running and not resp.isclosed():
            d = resp.read(1)
            delimited_string += d

        try:
            int_to_read = int(delimited_string)
            next_status_obj = resp.read( int_to_read )
            # print 'status_object = %s' % next_status_obj
            self._data(next_status_obj)
        except ValueError:
            pass 

    if resp.isclosed():
        self.on_closed(resp)

此解决方案还需要学习如何下载tweepy包的源代码,修改它,然后将修改后的库安装到python中.这是通过进入你的顶级tweepy目录并输入类似sudo setup.py install的东西来完成的,具体取决于你的系统.

我还对github上的编码员评论了这个包,让他们知道最新情况.