Hadoop for Archiving

Vertica_User · December 2017

Hi,
We have 36 node vertica cluster with 10% free disk space. We would like to keep 6 months data in vertica and archive rest to other locations and restore when required.
Can you suggest if hadoop is fine or any other storage locations is preferable?

kguan · December 2017

Yes, Hadoop if fine. Using HDFS storage locations to store lower-priority data is suggested by Vertica:
https://my.vertica.com/docs/9.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/StorageLocations/HPVerticaStorageLocationForHDFS.htm

Jim_Knicely · December 2017

@Vertica_User:

Fyi ...

"If you use any HDFS storage locations, the HDFS data must be available at the time you start Vertica. Your HDFS cluster must be operational, and the ROS files must be present. If you have moved data files, or if they have become corrupted, or if your HDFS cluster is not responsive, Vertica cannot start."

See:
https://my.vertica.com/docs/9.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/StorageLocations/HPVerticaStorageLocationForHDFS.htm

We're Moving!

Create My New Community Account Now

Hadoop for Archiving

Comments

Leave a Comment