We're Moving!

The Vertica Forum is moving to a new OpenText Analytics Database (Vertica) Community.

Join us there to post discussion topics, learn about

product releases, share tips, access the blog, and much more.

Create My New Community Account Now


Drop partition Problem — Vertica Forum

Drop partition Problem

I have a daily partitioned table which is having  1 month data (30 partitions). 

Now i want to drop and insert again 2 different days data of the month. I followed below steps.

1. Drop day 1 partition 
2. Insert data for Day1 
3. Drop day2 partition  
4. Insert Day2 data
while performing 3rd step i got below error.
java.sql.SQLException: [Vertica][VJDBC](2083) ERROR: A Moveout operation is already in progress
I thought while performing 3rd step , some data is been shifted from WOS to ROS for day1 .
How to solve above problem ...
Thanks in advance

Comments

  • HI,
    I have been facing the same daily partitioning issue.

    I have created a table X with daily partition which contains one month data ( 1st Jan 2013 to 31st jan 2013).
    I have a talend job which does the following steps:

    1. I receive 1st Jan 2013 data i drop the partition in table X for 20130101.
    2. Insert 1st Jan 2013 data in table X.
    3. I receive 2nd Jan 2013 data i drop the partition in table X for 20130102.
    4. Insert 2nd Jan 2013 data in table X.

    When i perform the step 3 i get the error stated above by bhanu

    java.sql.SQLException: [Vertica][VJDBC](2083) ERROR: A Moveout operation is already in progress

    Please help to resolve the same.

    Some quick questions.

    1. Is it a good practice to create daily partition on a single table containing 1-2 years data ?
    2. Will there be any performance difference with daily partition and how frequently we can drop this daily partition , in my case it can drop in every 2-5 seconds ?

    Thanks,
    Suhrid R. Ghosh

  • Nimmi_guptaNimmi_gupta - Select Field - Employee

    The error message is indicating that there is an existing tuple mover
    operation (moveout) running. When you drop a partition, we check if
    there is any data in WOS for that table. To ensure all data that belongs
    to the partition is included, the drop_partition runs a moveout
    operation. Since only one moveout can be run at a time, the new moveout
    request will fail, causing the drop_partition to fail. You will need to
    wait for the first moveout on that projection to finish before dropping.
  • HI Nimmi,


    Thanks for replying.
    How can i check whether first move out has been completed successfully so that i can run drop_partition command.


    Thanks,
    Suhrid R. Ghosh
  • Thanks Nimmi,
              Is there any way to wait for moveout operation to complete before running drop partition command for second day.
  • Nimmi_guptaNimmi_gupta - Select Field - Employee
    How to check moveout operation has been done? Yes you can check this by querying to system table. Select * from system; and look for column wos_row_count. If this column value is zero that means moveout process is done.

  • Thank You very much Nimmi :)
  • Hi Nimmi ,

    Thanks for your suggestion will try this method . :)

    Thanks,
    Suhrid R. Ghosh
  • Hi Nimmi,

        when i drop partition in table X .. it will do moveout only for table X or for all tables.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file