increase performance when using kafka with vertica
I have a Kafka cluster and use Vertica scheduler for sync Vertica with Kafka ...
when I monitor Copy commands I get this :
COPY my_table SOURCE KafkaSource(stream='kafka_topic|0|1, executionparallelism=1,
message_max_bytes=1048576 )
this command take too long and I want to increase performance of that.
I Know kafka_default_pool is the pool when Vertica runs copy commands and I want to increase executionparallelism
I run this commands to change that:
ALTER RESOURCE POOL kafka_default_pool executionparallelism 5
but when I Monitor Copy commands, executionparallelism is still 1.
how can I increase perfomance Of this type of commands ?
0