performance consideration for bulk loading

hoseineyhoseiney
in General Discussion

We have 1 Node Vertica Database ...
how can we increase performance for loading data using COPY command in vertica?
based on our tests, in a server with 2 CPU core and 8 GB RAM, loading a json file with 1 million (900 MB size) takes 70 seconds, same file in a server with 128 GB RAM and 32 CPU core takes 30 seconds...
if we want for example loading this file takes 10 seconds what we should do ?

Answers

  • emorenoemoreno Employee

    One of the thing that you can do is to put the COPY command in a specific pool and give it a big query budget. You can see the query_budget in resource_pool_status.
    Hope this helps,
    Eugenia

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...