在Kafka中解释复制偏移检查点和恢复点偏移

Question

有些人可以解释这些文件的含义,存在于kafka代理日志中.

root @ a2md23297l:/ tmp/kafka-logs-1#cat recovery-point-offset-checkpoint
0
5
my-topic 0 0
kafkatopic_R2P1_1 0 0
my-topic 1 0
kafkatopic_R2P1 0 0
test 0 0
root @ a2md23297l:/ tmp/kafka -logs-1#cat replication-offset-checkpoint
0
5
my-topic 0 0
kafkatopic_R2P1_1 0 2
my-topic 1 0
kafkatopic_R2P1 0 2
test 0 57

Fyi,my-topic,kafkatopic_R2P1_1,my-topic,kafkatopic_R2P1,test是创建的主题.提前致谢.

Answer 1

AFAIK:recovery-point-offset-checkpoint是内部代理日志,Kafka跟踪哪些消息(从 - 到偏移)成功检查点到磁盘.

replication-offset-checkpoint 是内部代理日志,Kafka跟踪哪些消息(从 - 到偏移)成功复制到其他代理.

有关详细信息,您可以深入了解:kafka/core/src/main/scala/kafka/server/LogOffsetMetadata.scala和ReplicaManager.scala.代码评论很好.