1)我们有3个节点kafka和kafka连接集群
2)我们仅在分布式模式下在kafka节点上运行kafka-connect
3)当我尝试使用以下配置创建连接器时:
{
"name": "connector-state-0",
"config": {
"connector.class": "io.debezium.connector.mysql.MySqlConnector",
"database.user": "user",
"database.server.id": "5023",
"database.hostname": "hostname",
"database.password": "password",
"database.history.kafka.bootstrap.servers": "ip:9092",
"database.history.kafka.topic": "topicname",
"database.server.name": "prod",
"database.port": "3306",
"snapshot.mode": "when_needed",
"include.schema.changes": "false",
"table.whitelist": "country.state"
}
}
Run Code Online (Sandbox Code Playgroud)
在创建连接器的请求中,它在3个节点中的2个上给我以下错误:
{"error_code":409,"message":"Cannot complete request because of a conflicting operation (e.g. worker rebalance)"}
Run Code Online (Sandbox Code Playgroud)
在节点之一上:我能够创建连接器,但任务未启动,并且我可以在日志中看到以下错误:
[2019-01-23 10:50:06,455] INFO 127.0.0.1 - - [23/Jan/2019:10:50:06 +0000] "POST /connectors/birdeye-connector-state-0/tasks?forward=true HTTP/1.1" 409 113 8 (org.apache.kafka.connect.runtime.rest.RestServer:60)
[2019-01-23 10:50:06,462] INFO 127.0.0.1 - - [23/Jan/2019:10:50:06 +0000] "POST /connectors/birdeye-connector-state-0/tasks HTTP/1.1" 409 113 21 (org.apache.kafka.connect.runtime.rest.RestServer:60)
[2019-01-23 10:50:06,466] ERROR …Run Code Online (Sandbox Code Playgroud)