Kafka警告:No checkpointed highwatermark is found for partition

栏目: 后端 · 发布时间: 7年前

内容简介:测试环境使用的Kafka出现了点儿问题,服务器被停止,所有的topic日志不知怎的被清空。一番大清洗(清理zookeeper节点、kafka topic log)、重启Kafka、创建分区后发现报了如下的错误:日志中提到的high watermark指的是一个partition中上一次提交的消息的offset。报警是因为topic刚创建、消费已开始、但是还没有生产者推送消息过来、对应topic没有任何offset的记录导致的。

测试环境使用的Kafka出现了点儿问题,服务器被停止,所有的topic日志不知怎的被清空。一番大清洗(清理zookeeper节点、kafka topic log)、重启Kafka、创建分区后发现报了如下的错误:

[2018-10-24 19:34:31,834] WARN Partition [test_topic_xxx,30] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,30] (kafka.cluster.Partition)
[2018-10-24 19:34:31,839] WARN Partition [test_topic_xxx,27] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,27] (kafka.cluster.Partition)
[2018-10-24 19:34:31,843] WARN Partition [test_topic_xxx,24] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,24] (kafka.cluster.Partition)
[2018-10-24 19:34:31,846] WARN Partition [test_topic_xxx,21] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,21] (kafka.cluster.Partition)
[2018-10-24 19:34:31,850] WARN Partition [test_topic_xxx,18] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,18] (kafka.cluster.Partition)
[2018-10-24 19:34:31,854] WARN Partition [test_topic_xxx,15] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,15] (kafka.cluster.Partition)
[2018-10-24 19:34:31,857] WARN Partition [test_topic_xxx,12] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,12] (kafka.cluster.Partition)
[2018-10-24 19:34:31,860] WARN Partition [test_topic_xxx,9] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,9] (kafka.cluster.Partition)
[2018-10-24 19:34:31,863] WARN Partition [test_topic_xxx,6] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,6] (kafka.cluster.Partition)
[2018-10-24 19:34:31,866] WARN Partition [test_topic_xxx,3] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,3] (kafka.cluster.Partition)
[2018-10-24 19:34:31,870] WARN Partition [test_topic_xxx,0] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,0] (kafka.cluster.Partition)
[2018-10-24 19:34:31,873] WARN Partition [test_topic_xxx,10] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,10] (kafka.cluster.Partition)

找了些资料 知道了报警的原因。

日志中提到的high watermark指的是一个partition中上一次提交的消息的offset。报警是因为topic刚创建、消费已开始、但是还没有生产者推送消息过来、对应topic没有任何offset的记录导致的。

所以该警告可以忽略,待有消息推送过来即可。

相关资料

Intra-cluster Replication in Apache Kafka

#####


以上所述就是小编给大家介绍的《Kafka警告:No checkpointed highwatermark is found for partition》,希望对大家有所帮助,如果大家有任何疑问请给我留言,小编会及时回复大家的。在此也非常感谢大家对 码农网 的支持!

查看所有标签

猜你喜欢:

本站部分资源来源于网络,本站转载出于传递更多信息之目的,版权归原作者或者来源机构所有,如转载稿涉及版权问题,请联系我们

ES6 标准入门(第2版)

ES6 标准入门(第2版)

阮一峰 / 电子工业出版社 / 2016-1 / 69.00元

ES6(又名 ES2105)是 JavaScript 语言的新标准,2015 年 6 月正式发布后,得到了迅速推广,是目前业界超级活跃的计算机语言。《ES6标准入门(第2版)》是国内仅有的一本 ES6 教程,在前版基础上增补了大量内容——对标准进行了彻底的解读,所有新增的语法知识(包括即将发布的 ES7)都给予了详细介绍,并且紧扣业界开发实践,给出了大量简洁易懂、可以即学即用的示例代码。 《......一起来看看 《ES6 标准入门(第2版)》 这本书的介绍吧!

JSON 在线解析
JSON 在线解析

在线 JSON 格式化工具

MD5 加密
MD5 加密

MD5 加密工具

SHA 加密
SHA 加密

SHA 加密工具