Apache-Kafka 的 Zookeeper：Ubuntu 18.04.01 服务器中端口 2181 的问题

Question

我正在尝试弄清楚如何成功完成本教程的安装和首次运行 Apache-Kafka ：如何在 Ubuntu 18.04 LTS 上安装 Apache Kafka

\n\n

在杀死之前运行的zookeeper实例后，我再次尝试启动zookeeper服务器，但是当该过程到达端口绑定阶段时，它永远停止了..：KafkaActivationFailed

\n\n

marco@PC:/usr/share/zookeeper$ sudo lsof -i :2181\nCOMMAND  PID      USER   FD   TYPE DEVICE SIZE/OFF NODE NAME\njava    4545 zookeeper   32u  IPv6  43042      0t0  TCP *:2181 (LISTEN)\nmarco@PC:/usr/share/zookeeper$ sudo kill 4545\n\n\nmarco@PC:/usr/local/kafka$ bin/zookeeper-server-start.sh   \nconfig/zookeeper.properties\n[2018-09-04 12:18:14,608] INFO Reading configuration from:  \nconfig/zookeeper.properties  \n(org.apache.zookeeper.server.quorum.QuorumPeerConfig)\n[2018-09-04 12:18:14,609] INFO autopurge.snapRetainCount set to 3  \n(org.apache.zookeeper.server.DatadirCleanupManager)\n[2018-09-04 12:18:14,609] INFO autopurge.purgeInterval set to 0  \n(org.apache.zookeeper.server.DatadirCleanupManager)\n[2018-09-04 12:18:14,609] INFO Purge task is not scheduled. \n(org.apache.zookeeper.server.DatadirCleanupManager)\n[2018-09-04 12:18:14,610] WARN Either no config or no quorum defined in  \nconfig, running  in standalone mode    \n(org.apache.zookeeper.server.quorum.QuorumPeerMain)\n[2018-09-04 12:18:14,620] INFO Reading configuration from:  \nconfig/zookeeper.properties   \n(org.apache.zookeeper.server.quorum.QuorumPeerConfig)\n[2018-09-04 12:18:14,620] INFO Starting server       \n(org.apache.zookeeper.server.ZooKeeperServerMain)\n[2018-09-04 12:18:14,624] INFO Server  \nenvironment:zookeeper.version=3.4.13-2d71af4dbe22557fda74f9a9b4309b15a7487f03 \nbuilt on 06/29/2018 00:39 GMT (org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,624] INFO Server environment:host.name=PC.station  \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:java.version=1.8.0_181 \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:java.vendor=Oracle \nCorporation (org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:java.home=/usr/lib/jvm\n/java-8-oracle/jre (org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:java.class.path=/usr/local\n/kafka/bin/../libs/activation-1.1.1.jar:/usr/local/kafka/bin/..\n/libs/aopalliance-repackaged-2.5.0-b42.jar:/usr/local/kafka/bin/..\n/libs/argparse4j-0.7.0.jar:/usr/local/kafka/bin/../libs/audience-annotations-\n0.5.0.jar:/usr/local/kafka/bin/../libs/commons-lang3-3.5.jar:/usr/local/kafka\n/bin/../libs/connect-api-2.0.0.jar:/usr/local/kafka/bin/../libs/connect-\nbasic-auth-extension-2.0.0.jar:/usr/local/kafka/bin/../libs/connect-\nfile-2.0.0.jar:/usr/local/kafka/bin/../libs/connect-json-2.0.0.jar:/usr/local\n/kafka/bin/../libs/connect-runtime-2.0.0.jar:/usr/local/kafka/bin/..\n/libs/connect-transforms-2.0.0.jar:/usr/local/kafka/bin/../libs/guava-\n20.0.jar:/usr/local/kafka/bin/../libs/hk2-api-2.5.0-b42.jar:/usr/local/kafka\n/bin/../libs/hk2-locator-2.5.0-b42.jar:/usr/local/kafka/bin/../libs/hk2-\nutils-2.5.0-b42.jar:/usr/local/kafka/bin/../libs/jackson-annotations-\n2.9.6.jar:/usr/local/kafka/bin/../libs/jackson-core-2.9.6.jar:/usr/local\n/kafka/bin/../libs/jackson-databind-2.9.6.jar:/usr/local/kafka/bin/..\n/libs/jackson-jaxrs-base-2.9.6.jar:/usr/local/kafka/bin/../libs/jackson-\njaxrs-json-provider-2.9.6.jar:/usr/local/kafka/bin/../libs/jackson-module-\njaxb-annotations-2.9.6.jar:/usr/local/kafka/bin/../libs/javassist-3.22.0-\nCR2.jar:/usr/local/kafka/bin/../libs/javax.annotation-api-1.2.jar:/usr/local\n/kafka/bin/../libs/javax.inject-1.jar:/usr/local/kafka/bin/.. \n/libs/javax.inject-2.5.0-b42.jar:/usr/local/kafka/bin/../libs/javax.servlet-\napi-3.1.0.jar:/usr/local/kafka/bin/../libs/javax.ws.rs-api-2.1.jar:/usr/local\n/kafka/bin/../libs/jaxb-api-2.3.0.jar:/usr/local/kafka/bin/../libs/jersey-\nclient-2.27.jar:/usr/local/kafka/bin/../libs/jersey-common-2.27.jar:\n/usr/local/kafka/bin/../libs/jersey-container-servlet-2.27.jar:/usr/local\n/kafka/bin/../libs/jersey-container-servlet-core-2.27.jar:/usr/local/kafka\n/bin/../libs/jersey-hk2-2.27.jar:/usr/local/kafka/bin/../libs/jersey-media-\njaxb-2.27.jar:/usr/local/kafka/bin/../libs/jersey-server-2.27.jar:/usr/local\n/kafka/bin/../libs/jetty-client-9.4.11.v20180605.jar:/usr/local/kafka/bin/..\n/libs/jetty-continuation-9.4.11.v20180605.jar:/usr/local/kafka/bin/..\n/libs/jetty-http-9.4.11.v20180605.jar:/usr/local/kafka/bin/../libs/jetty-\nio-9.4.11.v20180605.jar:/usr/local/kafka/bin/../libs/jetty-security-\n9.4.11.v20180605.jar:/usr/local/kafka/bin/../libs/jetty-server-\n9.4.11.v20180605.jar:/usr/local/kafka/bin/../libs/jetty-servlet-\n9.4.11.v20180605.jar:/usr/local/kafka/bin/../libs/jetty-servlets-\n9.4.11.v20180605.jar:/usr/local/kafka/bin/../libs/jetty-\nutil-9.4.11.v20180605.jar:/usr/local/kafka/bin/../libs/jopt-simple-5.0.4.jar:\n/usr/local/kafka/bin/../libs/kafka_2.11-2.0.0.jar:/usr/local/kafka/bin/..\n/libs/kafka_2.11-2.0.0-sources.jar:/usr/local/kafka/bin/../libs/kafka-\nclients-2.0.0.jar:/usr/local/kafka/bin/../libs/kafka-log4j-appender-\n2.0.0.jar:/usr/local/kafka/bin/../libs/kafka-streams-2.0.0.jar:/usr/local\n/kafka/bin/../libs/kafka-streams-examples-2.0.0.jar:/usr/local/kafka/bin/..\n/libs/kafka-streams-scala_2.11-2.0.0.jar:/usr/local/kafka/bin/../libs/kafka-\nstreams-test-utils-2.0.0.jar:/usr/local/kafka/bin/../libs/kafka-tools-\n2.0.0.jar:/usr/local/kafka/bin/../libs/log4j-1.2.17.jar:/usr/local/kafka\n/bin/../libs/lz4-java-1.4.1.jar:/usr/local/kafka/bin/../libs/maven-artifact-\n3.5.3.jar:/usr/local/kafka/bin/../libs/metrics-core-2.2.0.jar:/usr/local\n/kafka/bin/../libs/osgi-resource-locator-1.0.1.jar:/usr/local/kafka/bin/..\n/libs/plexus-utils-3.1.0.jar:/usr/local/kafka/bin/../libs/reflections-\n0.9.11.jar:/usr/local/kafka/bin/../libs/rocksdbjni-5.7.3.jar:/usr/local/kafka\n/bin/../libs/scala-library-2.11.12.jar:/usr/local/kafka/bin/../libs/scala-\nlogging_2.11-3.9.0.jar:/usr/local/kafka/bin/../libs/scala-reflect-\n2.11.12.jar:/usr/local/kafka/bin/../libs/slf4j-api-1.7.25.jar:/usr/local\n/kafka/bin/../libs/slf4j-log4j12-1.7.25.jar:/usr/local/kafka/bin/..\n/libs/snappy-java-1.1.7.1.jar:/usr/local/kafka/bin/../libs/validation-\napi-1.1.0.Final.jar:/usr/local/kafka/bin/../libs/zkclient-0.10.jar:/usr/local\n/kafka/bin/../libs/zookeeper-3.4.13.jar \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:java.library.path=/usr\n/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib   \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:java.io.tmpdir=/tmp\n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:java.compiler=<NA>  \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:os.name=Linux  \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:os.arch=amd64 \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:os.version=4.15.0-33-\ngeneric (org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:user.name=marco \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:user.home=/home/marco \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,625] INFO Server environment:user.dir=/usr/local/kafka \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,630] INFO tickTime set to 3000 \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,630] INFO minSessionTimeout set to -1 \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,630] INFO maxSessionTimeout set to -1 \n(org.apache.zookeeper.server.ZooKeeperServer)\n[2018-09-04 12:18:14,634] INFO Using  \norg.apache.zookeeper.server.NIOServerCnxn Factory as server connection  \nfactory (org.apache.zookeeper.server.ServerCnxnFactory)\n[2018-09-04 12:18:14,636] INFO binding to port 0.0.0.0/0.0.0.0:2181   \n(org.apache.zookeeper.server.NIOServerCnxnFactory)\n

\n\n

问题是重新启动 Zookeeper 似乎处于活动状态：

\n\n

marco@PC:~$ netstat -ant | grep :2181\ntcp6       0      0 :::2181                 :::*                      \nLISTEN\nmarco@PC:~$ systemctl status zookeeper\n\xe2\x97\x8f zookeeper.service - LSB: centralized coordination service\n   Loaded: loaded (/etc/init.d/zookeeper; generated)\n   Active: active (running) since Tue 2018-09-04 15:51:24 CEST; 2min 19s\n   ago\n     Docs: man:systemd-sysv-generator(8)\n  Process: 1919 ExecStart=/etc/init.d/zookeeper start (code=exited, \nstatus=0/SUCCESS)\n    Tasks: 25 (limit: 4915)\n   CGroup: /system.slice/zookeeper.service\n           \xe2\x94\x94\xe2\x94\x801997 /usr/bin/java -cp /etc/zookeeper/conf:/usr/share\n/java/jline.jar:/usr/share/java/log4j-1.2.jar:/usr/share   \n/java/xercesImpl.jar:/usr/share/java/xmlParserAPIs.jar:/usr/share\n/java/netty.jar:/usr/share/java/slf4j-api.jar:/usr\n\nSep 04 15:51:24 PC systemd[1]: Starting LSB: centralized coordination \nservice...\nSep 04 15:51:24 PC systemd[1]: Started LSB: centralized coordination \nservice.\n

\n\n

但是当尝试运行卡夫卡时......：

\n\n

marco@PC:~$ cd /usr/local/kafka\nmarco@PC:/usr/local/kafka$ bin/zookeeper-server-start.sh   \nconfig/zookeeper.properties\n[2018-09-04 15:54:29,981] INFO Reading configuration from:  \nconfig/zookeeper.properties  \n(org.apache.zookeeper.server.quorum.QuorumPeerConfig)\n[2018-09-04 15:54:29,982] INFO autopurge.snapRetainCount set to 3  \n(org.apache.zookeeper.server.DatadirCleanupManager)\n[2018-09-04 15:54:29,983] INFO autopurge.purgeInterval set to 0 \n(org.apache.zookeeper.server.DatadirCleanupManager)\n...\n[2018-09-04 15:54:30,012] INFO binding to port 0.0.0.0/0.0.0.0:2181  \n(org.apache.zookeeper.server.NIOServerCnxnFactory)\n[2018-09-04 15:54:30,013] ERROR Unexpected exception, exiting abnormally \n(org.apache.zookeeper.server.ZooKeeperServerMain)\njava.net.BindException: Address already in use\n        at sun.nio.ch.Net.bind0(Native Method)\n        at sun.nio.ch.Net.bind(Net.java:433)\n        at sun.nio.ch.Net.bind(Net.java:425)\n        at \n\nsun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)\n    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)\n    at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:67)\n

\n

Answer 1

$ bin/zookeeper-server-start.sh  config/zookeeper.properties

如果你查看日志，这开始没问题

[2018-09-04 12:18:14,636] INFO 绑定到端口 0.0.0.0/0.0.0.0:2181
(org.apache.zookeeper.server.NIOServerCnxnFactory)

此消息将一直保留在那里，直到 Kafka 等 Zookeeper 客户端连接到 Zookeeper。

当您说“尝试运行 kafka”时，您是在zookeeper-server-start再次运行，而不是kafka-server-start，因此 Zookeeper 已经绑定到端口 2181，并且不会启动第二个端口。