What is the fastest way to load a file from S3 into Vertica?

Nicholas_ChammaNicholas_Chamma
in General Discussion
A critical but also slow part of our data pipeline involves loading large files from S3 into Vertica.

What is the fastest way to do that?

Does Vertica offer some way to automatically break input files into pieces and load them in parallel (a la distcp/s3distcp)?

Comments

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...