We're Moving!

The Vertica Forum is moving to a new OpenText Analytics Database (Vertica) Community.

Join us there to post discussion topics, learn about

product releases, share tips, access the blog, and much more.

Create My New Community Account Now


Unable to load the data using COPY STREAM when table has multiple partitions — Vertica Forum

Unable to load the data using COPY STREAM when table has multiple partitions

edited January 2019 in General Discussion

Hi Team,

I am using vertica as my database, I have created a table with multiple partitions using the below query in vertica.

CREATE TABLE employee ( EmpNameFirstName VARCHAR NOT NULL, EmpNameLastName VARCHAR NOT NULL, EmpCity VARCHAR NOT NULL, EmpState VARCHAR NOT NULL) PARTITION BY HASH (EmpCity, EmpState);

Now i am trying to load the data using my program which will create the below copy query to load the data using stream.

COPY employee FROM local STDIN GZIP DELIMITER '|' DIRECT STREAM NAME 'employee -224-0-20190120170125394' returnrejected NO COMMIT

I am unable to see the data in the employee table.
But when i have created the table with one partitions and trying to load the data with same program then data is populating in the table and i can see the data in the table.

Request your expertise to solve this issue.

Thanks,
Khaja

Answers

  • Jim_KnicelyJim_Knicely - Select Field - Administrator

    Hi,

    This similar example works okay:

     [dbadmin@s18384357 ~]$ cat gzip.txt
     jim|knicely|pittsburgh|pa
     jack|demo|pittsburgh|pa
     dave|darcey|new york|ny
    
     [dbadmin@s18384357 ~]$ gzip gzip.txt
     gzip.txt.gz
    
     [dbadmin@s18384357 ~]$ vsql -c "CREATE TABLE employee2 ( EmpNameFirstName VARCHAR NOT NULL, EmpNameLastName VARCHAR NOT NULL, EmpCity VARCHAR NOT NULL, EmpState VARCHAR NOT NULL) PARTITION BY HASH (EmpCity, EmpState);"
     CREATE TABLE
    
     [dbadmin@s18384357 ~]$ vsql -c "COPY employee2 FROM local STDIN GZIP DELIMITER '|' DIRECT STREAM NAME 'employee -224-0-20190120170125394' returnrejected NO COMMIT;" < /home/dbadmin/gzip.txt.gz
      Rows Loaded
     -------------
                3
     (1 row)
    

    Three records were loaded.

    But note I used a COPY command with the NO COMMIT option. So the data is not there anymore!

    [dbadmin@s18384357 ~]$ vsql -c "SELECT * FROM employee2;"
     EmpNameFirstName | EmpNameLastName | EmpCity | EmpState
    ------------------+-----------------+---------+----------
    (0 rows)
    

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file