Please take this survey to help us learn more about how you use third party tools. Your input is greatly appreciated!

Kafka not consuming messages

I've run the following steps, but there is no data in my target table, or error in the log:

 

/opt/vertica/packages/kafka/bin/vkconfig scheduler --add —-username dbadmin —-password pass

CREATE FLEX TABLE public.kafka_tgt();

/opt/vertica/packages/kafka/bin/vkconfig topic --add --target public.kafka_tgt --rejection-table public.kafka_rej --topic testiaTest --num-partitions 1 --username dbadmin --password pass

/opt/vertica/packages/kafka/bin/vkconfig kafka-cluster --add --brokers (IP HERE):9092 --cluster K_cluster_1 --username dbadmin --password pass

/opt/vertica/packages/kafka/bin/vkconfig launch --conf /home/dbadmin/config.properties

 

Any ideas how to debug this?

 

thanks

Comments

  • I've been able to consume messages from that endpoint and topic from another system, so I know that's working.  Do I need to tell Vertica to start from the beginning of the topic?

  • We've just encountered the same problem with Vertica 8.0.1 against Kafka 0.8 and we've tried against Kafka 0.9 and it seems to be working.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file

Can't find what you're looking for? Search the Vertica Documentation, Knowledge Base, or Blog for more information.