Kafka警告：No checkpointed highwatermark is found for partition

栏目: 后端 · 发布时间: 7年前

内容简介：测试环境使用的Kafka出现了点儿问题，服务器被停止，所有的topic日志不知怎的被清空。一番大清洗（清理zookeeper节点、kafka topic log）、重启Kafka、创建分区后发现报了如下的错误：日志中提到的high watermark指的是一个partition中上一次提交的消息的offset。报警是因为topic刚创建、消费已开始、但是还没有生产者推送消息过来、对应topic没有任何offset的记录导致的。

测试环境使用的Kafka出现了点儿问题，服务器被停止，所有的topic日志不知怎的被清空。一番大清洗（清理zookeeper节点、kafka topic log）、重启Kafka、创建分区后发现报了如下的错误：

[2018-10-24 19:34:31,834] WARN Partition [test_topic_xxx,30] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,30] (kafka.cluster.Partition)
[2018-10-24 19:34:31,839] WARN Partition [test_topic_xxx,27] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,27] (kafka.cluster.Partition)
[2018-10-24 19:34:31,843] WARN Partition [test_topic_xxx,24] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,24] (kafka.cluster.Partition)
[2018-10-24 19:34:31,846] WARN Partition [test_topic_xxx,21] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,21] (kafka.cluster.Partition)
[2018-10-24 19:34:31,850] WARN Partition [test_topic_xxx,18] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,18] (kafka.cluster.Partition)
[2018-10-24 19:34:31,854] WARN Partition [test_topic_xxx,15] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,15] (kafka.cluster.Partition)
[2018-10-24 19:34:31,857] WARN Partition [test_topic_xxx,12] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,12] (kafka.cluster.Partition)
[2018-10-24 19:34:31,860] WARN Partition [test_topic_xxx,9] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,9] (kafka.cluster.Partition)
[2018-10-24 19:34:31,863] WARN Partition [test_topic_xxx,6] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,6] (kafka.cluster.Partition)
[2018-10-24 19:34:31,866] WARN Partition [test_topic_xxx,3] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,3] (kafka.cluster.Partition)
[2018-10-24 19:34:31,870] WARN Partition [test_topic_xxx,0] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,0] (kafka.cluster.Partition)
[2018-10-24 19:34:31,873] WARN Partition [test_topic_xxx,10] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,10] (kafka.cluster.Partition)

找了些资料知道了报警的原因。

日志中提到的high watermark指的是一个partition中上一次提交的消息的offset。报警是因为topic刚创建、消费已开始、但是还没有生产者推送消息过来、对应topic没有任何offset的记录导致的。

所以该警告可以忽略，待有消息推送过来即可。

鸟哥的Linux私房菜

鸟哥 / 人民邮电出版社 / 2010-6-28 / 88.00元

本书是最具知名度的Linux入门书《鸟哥的Linux私房菜基础学习篇》的最新版，全面而详细地介绍了Linux操作系统。全书分为5个部分：第一部分着重说明Linux的起源及功能，如何规划和安装Linux主机；第二部分介绍Linux的文件系统、文件、目录与磁盘的管理；第三部分介绍文字模式接口 shell和管理系统的好帮手shell脚本，另外还介绍了文字编辑器vi和vim的使用方法；第四部分介绍了对于系......一起来看看《鸟哥的Linux私房菜》这本书的介绍吧!

码农工具