小编sma*_*eon的帖子

使用kafka-producer-perf-test.sh如何在kafka_2.10-0.8.2.0设置生产者配置

bin/kafka-producer-perf-test.sh --messages 1000000 --message-size 1000 --topics kafka_producertest_1replication_1partitions --broker-list mesos006:9092,mesos007:9092,mesos008:9092 --threads 1 --compression-codec 3 --batch-size 100000
Run Code Online (Sandbox Code Playgroud)

例外:

Exception in thread "main" kafka.common.InvalidConfigException: Batch size = 100000 can't be larger than queue size = 10000
        at kafka.producer.ProducerConfig$.validateBatchSize(ProducerConfig.scala:39)
        at kafka.producer.ProducerConfig$.validate(ProducerConfig.scala:29)
        at kafka.producer.ProducerConfig.<init>(ProducerConfig.scala:116)
        at kafka.producer.ProducerConfig.<init>(ProducerConfig.scala:56)
        at kafka.producer.OldProducer.<init>(BaseProducer.scala:59)
        at kafka.tools.ProducerPerformance$ProducerThread.<init>(ProducerPerformance.scala:210)
        at kafka.tools.ProducerPerformance$$anonfun$main$1.apply$mcVI$sp(ProducerPerformance.scala:58)
        at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
        at kafka.tools.ProducerPerformance$.main(ProducerPerformance.scala:57)
        at kafka.tools.ProducerPerformance.main(ProducerPerformance.scala)
Run Code Online (Sandbox Code Playgroud)

config / producer.properties:

queue.buffering.max.messages=100000
Run Code Online (Sandbox Code Playgroud)

使用kafka-producer-perf-test.sh时,如何设置生产者的所有参数。还是给它一个配置文件(例如:config / producer.properties)如何使config / producer.properties生效?

kafka-producer-perf-test.sh参数

[root@mesos006 kafka_2.10-0.8.2.0]# bin/kafka-producer-perf-test.sh 
Missing required argument "[topics]"
Option                                  Description                            
------                                  -----------                            
--batch-size <Integer: size>            Number of messages …
Run Code Online (Sandbox Code Playgroud)

apache-kafka kafka-producer-api

2
推荐指数
1
解决办法
6417
查看次数

标签 统计

apache-kafka ×1

kafka-producer-api ×1