We're Moving!

The Vertica Forum is moving to a new OpenText Analytics Database (Vertica) Community.

Join us there to post discussion topics, learn about

product releases, share tips, access the blog, and much more.

Create My New Community Account Now


increase performance when using kafka with vertica — Vertica Forum

increase performance when using kafka with vertica

hoseineyhoseiney
in General Discussion

I have a Kafka cluster and use Vertica scheduler for sync Vertica with Kafka ...

when I monitor Copy commands I get this :

COPY my_table SOURCE KafkaSource(stream='kafka_topic|0|1, executionparallelism=1,
message_max_bytes=1048576 )

this command take too long and I want to increase performance of that.

I Know kafka_default_pool is the pool when Vertica runs copy commands and I want to increase executionparallelism

I run this commands to change that:
ALTER RESOURCE POOL kafka_default_pool executionparallelism 5

but when I Monitor Copy commands, executionparallelism is still 1.

how can I increase perfomance Of this type of commands ?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...