Kafka警告:No checkpointed highwatermark is found for partition

栏目: 后端 · 发布时间: 7年前

内容简介:测试环境使用的Kafka出现了点儿问题,服务器被停止,所有的topic日志不知怎的被清空。一番大清洗(清理zookeeper节点、kafka topic log)、重启Kafka、创建分区后发现报了如下的错误:日志中提到的high watermark指的是一个partition中上一次提交的消息的offset。报警是因为topic刚创建、消费已开始、但是还没有生产者推送消息过来、对应topic没有任何offset的记录导致的。

测试环境使用的Kafka出现了点儿问题,服务器被停止,所有的topic日志不知怎的被清空。一番大清洗(清理zookeeper节点、kafka topic log)、重启Kafka、创建分区后发现报了如下的错误:

[2018-10-24 19:34:31,834] WARN Partition [test_topic_xxx,30] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,30] (kafka.cluster.Partition)
[2018-10-24 19:34:31,839] WARN Partition [test_topic_xxx,27] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,27] (kafka.cluster.Partition)
[2018-10-24 19:34:31,843] WARN Partition [test_topic_xxx,24] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,24] (kafka.cluster.Partition)
[2018-10-24 19:34:31,846] WARN Partition [test_topic_xxx,21] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,21] (kafka.cluster.Partition)
[2018-10-24 19:34:31,850] WARN Partition [test_topic_xxx,18] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,18] (kafka.cluster.Partition)
[2018-10-24 19:34:31,854] WARN Partition [test_topic_xxx,15] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,15] (kafka.cluster.Partition)
[2018-10-24 19:34:31,857] WARN Partition [test_topic_xxx,12] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,12] (kafka.cluster.Partition)
[2018-10-24 19:34:31,860] WARN Partition [test_topic_xxx,9] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,9] (kafka.cluster.Partition)
[2018-10-24 19:34:31,863] WARN Partition [test_topic_xxx,6] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,6] (kafka.cluster.Partition)
[2018-10-24 19:34:31,866] WARN Partition [test_topic_xxx,3] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,3] (kafka.cluster.Partition)
[2018-10-24 19:34:31,870] WARN Partition [test_topic_xxx,0] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,0] (kafka.cluster.Partition)
[2018-10-24 19:34:31,873] WARN Partition [test_topic_xxx,10] on broker 3: No checkpointed highwatermark is found for partition [test_topic_xxx,10] (kafka.cluster.Partition)

找了些资料 知道了报警的原因。

日志中提到的high watermark指的是一个partition中上一次提交的消息的offset。报警是因为topic刚创建、消费已开始、但是还没有生产者推送消息过来、对应topic没有任何offset的记录导致的。

所以该警告可以忽略,待有消息推送过来即可。

相关资料

Intra-cluster Replication in Apache Kafka

#####


以上所述就是小编给大家介绍的《Kafka警告:No checkpointed highwatermark is found for partition》,希望对大家有所帮助,如果大家有任何疑问请给我留言,小编会及时回复大家的。在此也非常感谢大家对 码农网 的支持!

查看所有标签

猜你喜欢:

本站部分资源来源于网络,本站转载出于传递更多信息之目的,版权归原作者或者来源机构所有,如转载稿涉及版权问题,请联系我们

自媒体之道

自媒体之道

吴晨光 / 中国人民大学出版社有限公司 / 2018-7-31 / CNY 49.80

内容简介: 《自媒体之道》为你解决四个问题: 1. 一篇10万+的刷屏文章是怎么写出来的? 2. 一支10万+的爆款视频是怎么做出来的? 3. 一个100万+粉丝的大号是怎么运营的? 4. 神秘的人工智能(AI)和备受争议的算法是怎么运行的? 这部超过30万字的著作,集纳了中国顶尖自媒体人和平台运营者3年的实操经验。全书13章,详解案例150+,提炼“锦囊秒句”......一起来看看 《自媒体之道》 这本书的介绍吧!

CSS 压缩/解压工具
CSS 压缩/解压工具

在线压缩/解压 CSS 代码

Markdown 在线编辑器
Markdown 在线编辑器

Markdown 在线编辑器

RGB HSV 转换
RGB HSV 转换

RGB HSV 互转工具