COPY Files from NFS Mount

This is the use case I'm trying to solve:  We have files coming from HDFS and we want to load them into a set of Vertica tables.  I think we're going to opt for a solution that involves a flex table that we then parse into a set of persisted tables.

 

Here is my question:  When we do the COPY command against the JSON files coming from Hadoop can I put the files on an NFS that is mounted to all the nodes in our Vertica cluster and do a COPY ON ANY NODE?  Will that achieve parallelism across the entire cluster?  What is the fastest method to load data as I've described above?

 

Cheers,

Eric

Comments

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file

Can't find what you're looking for? Search the Vertica Documentation, Knowledge Base, or Blog for more information.