load from hadoop

Navneet_1

Hi,

I have a requirement to copy data from Hadoop to Vertica 6.1. Data is certainly quite large. What is the best way out (by performance) - 

- Using copy command ? - Can I use on any node feature with Copy from hdfs and where can I find details of the copy from hdfs
- Using connectors and then mapred or streaming ?
- Any other way out ...

Thanks
NJ

eli_revach

Hi 
You can use HCatLoader and HCatStorer interfaces   with Pig scripts to read data from Hive  HCatalog-managed tables and dumped it into Vertica .

Attach is good example to start with -> http://www.research.janahang.com/load-hive-tables-into-vertica/

Thanks 

Daniel_Leybovic

Thanks!