number of ROS containers using COPY DIRECT

eychih

Hi,

 

From my understanding, the Vertica COPY DIRECT command is designed for many small files.  If data of these files belong to one table, I would like to know if each of these files will create a ROS container, using COPY DIRECT.  If this is the case, will the number of ROS containers exceed limitation quickly?  How to avoid it (copy a large file)?  Thanks.    

Rahul_Choudhary

Hi 

 

Copy with direct is ideally designed for loading large amounts of data (100MB or more) at a time & not for smaller loads.

 

Using the DIRECT keyword in the COPY statement results in bypassing  loading data into WOS, and instead, load data directly into ROS containers.

 

So if you try to load data with no. of small files it can lead to "too many ros container" issue that is the reason why Vertica always suggest to load into WOS if you have smaller loads to avoid this situation.

 

Regards

Rahul Choudhary