Please take this survey to help us learn more about how you use third party tools. Your input is greatly appreciated!

increase performance when using kafka with vertica

I have a Kafka cluster and use Vertica scheduler for sync Vertica with Kafka ...

when I monitor Copy commands I get this :

COPY my_table SOURCE KafkaSource(stream='kafka_topic|0|1, executionparallelism=1,
message_max_bytes=1048576 )

this command take too long and I want to increase performance of that.

I Know kafka_default_pool is the pool when Vertica runs copy commands and I want to increase executionparallelism

I run this commands to change that:
ALTER RESOURCE POOL kafka_default_pool executionparallelism 5

but when I Monitor Copy commands, executionparallelism is still 1.

how can I increase perfomance Of this type of commands ?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file

Can't find what you're looking for? Search the Vertica Documentation, Knowledge Base, or Blog for more information.