Options

Bulk warning in kafka

name_tanwarname_tanwar
edited July 2023 in General Discussion

Hi #kafka-streams, I have one question regarding warning message in kafka logs "WARN Received a PartitionLeaderEpoch assignment for an epoch < latestEpoch. This implies messages have arrived out of order. New: {epoch:1, offset:5684029657}, Current: {epoch:9, offset5670020569} for Partition:-0 (kafka.server.epoch.LeaderEpochFileCache)". I have cleared kafka consumer logs and which stopped these warnings. How can i resolve this issue permanently?

Tagged:

Answers

  • Options
    moshegmosheg Vertica Employee Administrator
    edited July 2023

    You might have hit a bug mentioned here https://issues.apache.org/jira/browse/KAFKA-7415
    After an upgrade to 2.0.1 it was mentioned that the leader-epoch-checkpoint for each topic updated to the correct values.

    You can also open a support case.

  • Options
    SergeBSergeB - Select Field - Employee

    This seems to be a Kafka server related warning. Does it impact the Vertica integration ?

  • Options
    name_tanwarname_tanwar

    We are using kafka version 2.12-0.11.0.1, we haven't upgraded the kafka version, also it doesn't impacting vertica integration.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...