Options

Drop partition Problem

I have a daily partitioned table which is having  1 month data (30 partitions). 

Now i want to drop and insert again 2 different days data of the month. I followed below steps.

1. Drop day 1 partition 
2. Insert data for Day1 
3. Drop day2 partition  
4. Insert Day2 data
while performing 3rd step i got below error.
java.sql.SQLException: [Vertica][VJDBC](2083) ERROR: A Moveout operation is already in progress
I thought while performing 3rd step , some data is been shifted from WOS to ROS for day1 .
How to solve above problem ...
Thanks in advance

Comments

  • Options
    HI,
    I have been facing the same daily partitioning issue.

    I have created a table X with daily partition which contains one month data ( 1st Jan 2013 to 31st jan 2013).
    I have a talend job which does the following steps:

    1. I receive 1st Jan 2013 data i drop the partition in table X for 20130101.
    2. Insert 1st Jan 2013 data in table X.
    3. I receive 2nd Jan 2013 data i drop the partition in table X for 20130102.
    4. Insert 2nd Jan 2013 data in table X.

    When i perform the step 3 i get the error stated above by bhanu

    java.sql.SQLException: [Vertica][VJDBC](2083) ERROR: A Moveout operation is already in progress

    Please help to resolve the same.

    Some quick questions.

    1. Is it a good practice to create daily partition on a single table containing 1-2 years data ?
    2. Will there be any performance difference with daily partition and how frequently we can drop this daily partition , in my case it can drop in every 2-5 seconds ?

    Thanks,
    Suhrid R. Ghosh

  • Options
    Nimmi_guptaNimmi_gupta - Select Field - Employee

    The error message is indicating that there is an existing tuple mover
    operation (moveout) running. When you drop a partition, we check if
    there is any data in WOS for that table. To ensure all data that belongs
    to the partition is included, the drop_partition runs a moveout
    operation. Since only one moveout can be run at a time, the new moveout
    request will fail, causing the drop_partition to fail. You will need to
    wait for the first moveout on that projection to finish before dropping.
  • Options
    HI Nimmi,


    Thanks for replying.
    How can i check whether first move out has been completed successfully so that i can run drop_partition command.


    Thanks,
    Suhrid R. Ghosh
  • Options
    Thanks Nimmi,
              Is there any way to wait for moveout operation to complete before running drop partition command for second day.
  • Options
    Nimmi_guptaNimmi_gupta - Select Field - Employee
    How to check moveout operation has been done? Yes you can check this by querying to system table. Select * from system; and look for column wos_row_count. If this column value is zero that means moveout process is done.

  • Options
    Thank You very much Nimmi :)
  • Options
    Hi Nimmi ,

    Thanks for your suggestion will try this method . :)

    Thanks,
    Suhrid R. Ghosh
  • Options
    Hi Nimmi,

        when i drop partition in table X .. it will do moveout only for table X or for all tables.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file