number of ROS containers using COPY DIRECT



From my understanding, the Vertica COPY DIRECT command is designed for many small files.  If data of these files belong to one table, I would like to know if each of these files will create a ROS container, using COPY DIRECT.  If this is the case, will the number of ROS containers exceed limitation quickly?  How to avoid it (copy a large file)?  Thanks.    


  • Options



    Copy with direct is ideally designed for loading large amounts of data (100MB or more) at a time & not for smaller loads.


    Using the DIRECT keyword in the COPY statement results in bypassing  loading data into WOS, and instead, load data directly into ROS containers.


    So if you try to load data with no. of small files it can lead to "too many ros container" issue that is the reason why Vertica always suggest to load into WOS if you have smaller loads to avoid this situation.



    Rahul Choudhary

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file