Answers

• Jim_Knicely - Select Field - Administrator

  April 2021 edited April 2021

  You should be able to use KAFKACAT to list the messages sent to Kafka from Vertica.

  Something like:

  ./kafkacat -C -t <Topic> -b <Broker>

  See:
  https://www.vertica.com/docs/latest/HTML/Content/Authoring/KafkaIntegrationGuide/TroubleShooting/UsingKafkacatToTroubleShootIssues.htm

  0
• SergeB - Select Field - Employee

  April 2021

  The number of messages produced to Kafka should match the number of rows returned by the query used in KafkaExport MINUS any error reported by KafkaExport.

  0
• HyeontaeJu Vertica Customer ✭

  April 2021 edited April 2021

  @Jim_Knicely, @SergeB
  Then,, Is it impossible return the number of message sent to Kafka topic immediately after KafkaExport query executing?

  0
• SergeB - Select Field - Employee

  April 2021

  You could determine the number of rows from your select statement (select count(*)....) immediately before or after calling KafkaExport

  0