小编Rit*_*rma的帖子

org.apache.kafka.common.network.InvalidReceiveException:接收无效(大小= 30662099大于30662028)

我正在尝试使用Kafka接收器将数据从Flume通道推送到Kafka集群,我可以将相关数据看到相关主题,但同时我在Kafka日志中过于频繁地观察下面提到的异常跟踪,

[2017-03-21 16:47:56,250] WARN Unexpected error from /10.X.X.X; closing connection (org.apache.kafka.common.network.Selector)
org.apache.kafka.common.network.InvalidReceiveException: Invalid receive (size = 30662099 larger than 30662028)
        at org.apache.kafka.common.network.NetworkReceive.readFromReadableChannel(NetworkReceive.java:91)
        at org.apache.kafka.common.network.NetworkReceive.readFrom(NetworkReceive.java:71)
        at org.apache.kafka.common.network.KafkaChannel.receive(KafkaChannel.java:153)
        at org.apache.kafka.common.network.KafkaChannel.read(KafkaChannel.java:134)
        at org.apache.kafka.common.network.Selector.poll(Selector.java:286)
        at kafka.network.Processor.run(SocketServer.scala:413)
        at java.lang.Thread.run(Thread.java:745)  
Run Code Online (Sandbox Code Playgroud)

初步分析让我看到我的Flume日志,并在其中观察到异常跟踪,

21 Mar 2017 16:25:32,560 ERROR [SinkRunner-PollingRunner-DefaultSinkProcessor] (org.apache.flume.SinkRunner$PollingRunner.run:158)  - Unable to deliver event. Exception follows.
org.apache.flume.EventDeliveryException: Failed to publish events
        at org.apache.flume.sink.kafka.KafkaSink.process(KafkaSink.java:252)
        at org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:67)
        at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:145)
        at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.ExecutionException: org.apache.kafka.common.errors.NetworkException: The server disconnected before a response was received.
        at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.valueOrError(FutureRecordMetadata.java:56)
        at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:43)
        at org.apache.kafka.clients.producer.internals.FutureRecordMetadata.get(FutureRecordMetadata.java:25) …
Run Code Online (Sandbox Code Playgroud)

bigdata apache-kafka flume-ng devops elastic-stack

7
推荐指数
0
解决办法
4869
查看次数

Gatling Feeder 问题:未定义属性名称“CSVFieldName”问题

我是 Gatling 的新手,并试图从 CSV 中读取一些字段并在我的 Gatling 场景中使用它们,但面临

未定义属性名称“CSVFieldName”

问题 ;

一些细节:

加特林版本:bundle-2.2.3

CSV 名称:memId.csv

CSV 内容:

memid
CKABC123
Run Code Online (Sandbox Code Playgroud)

Scala 文件内容:

//Class Declaration 
{

     //some http configuration 


val memId_feeder = csv("memId.csv").circular                  

val scn = scenario("Scn name").during( 10 seconds ) {
     feed(memId_feeder)
     exec(http("Req_01_Auth")
           .post("/auth")
           .check(status.is(200))
           .headers(header_1)
           .formParam("memberId","${memid}"))
}

setup(scn.inject(atOnceUsers(1)).protocols(httpConf))
}   
Run Code Online (Sandbox Code Playgroud)

任何解决此问题的帮助或线索都是非常可观的。

PS:输入的 csv 文件中没有空格。

csv performance scala gatling

2
推荐指数
1
解决办法
3069
查看次数