bin/kafka-producer-perf-test.sh --messages 1000000 --message-size 1000 --topics kafka_producertest_1replication_1partitions --broker-list mesos006:9092,mesos007:9092,mesos008:9092 --threads 1 --compression-codec 3 --batch-size 100000
Run Code Online (Sandbox Code Playgroud)
例外:
Exception in thread "main" kafka.common.InvalidConfigException: Batch size = 100000 can't be larger than queue size = 10000
at kafka.producer.ProducerConfig$.validateBatchSize(ProducerConfig.scala:39)
at kafka.producer.ProducerConfig$.validate(ProducerConfig.scala:29)
at kafka.producer.ProducerConfig.<init>(ProducerConfig.scala:116)
at kafka.producer.ProducerConfig.<init>(ProducerConfig.scala:56)
at kafka.producer.OldProducer.<init>(BaseProducer.scala:59)
at kafka.tools.ProducerPerformance$ProducerThread.<init>(ProducerPerformance.scala:210)
at kafka.tools.ProducerPerformance$$anonfun$main$1.apply$mcVI$sp(ProducerPerformance.scala:58)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at kafka.tools.ProducerPerformance$.main(ProducerPerformance.scala:57)
at kafka.tools.ProducerPerformance.main(ProducerPerformance.scala)
Run Code Online (Sandbox Code Playgroud)
config / producer.properties:
queue.buffering.max.messages=100000
Run Code Online (Sandbox Code Playgroud)
使用kafka-producer-perf-test.sh时,如何设置生产者的所有参数。还是给它一个配置文件(例如:config / producer.properties)如何使config / producer.properties生效?
kafka-producer-perf-test.sh参数
[root@mesos006 kafka_2.10-0.8.2.0]# bin/kafka-producer-perf-test.sh
Missing required argument "[topics]"
Option Description
------ -----------
--batch-size <Integer: size> Number of messages …Run Code Online (Sandbox Code Playgroud)