We're Moving!

The Vertica Forum is moving to a new OpenText Analytics Database (Vertica) Community.

Join us there to post discussion topics, learn about

product releases, share tips, access the blog, and much more.

Create My New Community Account Now


Bulk warning in kafka — Vertica Forum

Bulk warning in kafka

Hi #kafka-streams, I have one question regarding warning message in kafka logs "WARN Received a PartitionLeaderEpoch assignment for an epoch < latestEpoch. This implies messages have arrived out of order. New: {epoch:1, offset:5684029657}, Current: {epoch:9, offset5670020569} for Partition:-0 (kafka.server.epoch.LeaderEpochFileCache)". I have cleared kafka consumer logs and which stopped these warnings. How can i resolve this issue permanently?

Tagged:

Answers

  • moshegmosheg Vertica Employee Administrator
    edited July 2023

    You might have hit a bug mentioned here https://issues.apache.org/jira/browse/KAFKA-7415
    After an upgrade to 2.0.1 it was mentioned that the leader-epoch-checkpoint for each topic updated to the correct values.

    You can also open a support case.

  • SergeBSergeB - Select Field - Employee

    This seems to be a Kafka server related warning. Does it impact the Vertica integration ?

  • We are using kafka version 2.12-0.11.0.1, we haven't upgraded the kafka version, also it doesn't impacting vertica integration.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file