mko*_*cek 0 twitter scala playframework twitter-streaming-api playframework-2.5
如何从 Twitter Streaming API - POST statuses/filter 读取响应数据?我已建立连接并收到 200 状态代码,但我不知道如何阅读推文。我只想在推文到来时打印它们。
ws.url(url)
.sign(OAuthCalculator(consumerKey, requestToken))
.withMethod("POST")
.stream()
.map { response =>
if(response.headers.status == 200)
println(response.body)
}
Run Code Online (Sandbox Code Playgroud)
编辑:我找到了这个解决方案
ws.url(url)
.sign(OAuthCalculator(consumerKey, requestToken))
.withMethod("POST")
.stream()
.map { response =>
if(response.headers.status == 200){
response.body
.scan("")((acc, curr) => if (acc.contains("\r\n")) curr.utf8String else acc + curr.utf8String)
.filter(_.contains("\r\n"))
.map(json => Try(parse(json).extract[Tweet]))
.runForeach {
case Success(tweet) =>
println("-----")
println(tweet.text)
case Failure(e) =>
println("-----")
println(e.getStackTrace)
}
}
}
Run Code Online (Sandbox Code Playgroud)
流式 WS 请求的响应主体是 AkkaSource
字节流。由于 Twitter Api 响应是用换行符分隔的(通常),您可以使用Framing.delimiter
它们将它们分成字节块,将块解析为 JSON,然后对它们执行您想要的操作。这样的事情应该工作:
import akka.stream.scaladsl.Framing
import scala.util.{Success, Try}
import akka.util.ByteString
import play.api.libs.json.{JsSuccess, Json, Reads}
import play.api.libs.oauth.{ConsumerKey, OAuthCalculator, RequestToken}
case class Tweet(id: Long, text: String)
object Tweet {
implicit val reads: Reads[Tweet] = Json.reads[Tweet]
}
def twitter = Action.async { implicit request =>
ws.url("https://stream.twitter.com/1.1/statuses/filter.json?track=Rio2016")
.sign(OAuthCalculator(consumerKey, requestToken))
.withMethod("POST")
.stream().flatMap { response =>
response.body
// Split up the byte stream into delimited chunks. Note
// that the chunks are quite big
.via(Framing.delimiter(ByteString.fromString("\n"), 20000))
// Parse the chunks into JSON, and then to a Tweet.
// A better parsing strategy would be to account for all
// the different possible responses, but here we just
// collect those that match a Tweet.
.map(bytes => Try(Json.parse(bytes.toArray).validate[Tweet]))
.collect {
case Success(JsSuccess(tweet, _)) => tweet.text
}
// Print out each chunk
.runForeach(println).map { _ =>
Ok("done")
}
}
}
Run Code Online (Sandbox Code Playgroud)
注意:要实现流,您需要将隐式Materializer
注入控制器。
归档时间: |
|
查看次数: |
738 次 |
最近记录: |