>> What kind of throughput should I expect?
30-50GB/hour/node for a 1-Ksafe projection design for COPY from file.
>> I need to copy table1(col1, col2) to table2(col1, col2, date_trunc(col1))
Define DEFAULT value for date_trunc(col1) and transfer only 2 columns - it will reduce raw size of data.
daniel=> create table may (id int, name varchar, born date, age int default age_in_years(born));CREATE TABLE
daniel=> copy may(id, name, born) from stdin delimiter ' ';Enter data to be copied followed by a newline.End with a backslash and a period on a line by itself.>> 1 Anna 1985-01-01>> 2 John 1978-03-17>> \.
daniel=> select * from may; id | name | born | age ----+------+------------+----- 1 | Anna | 1985-01-01 | 28 2 | John | 1978-03-17 | 35(2 rows)
>> fastest way to copy a Vertica database
If you are using in COPY FROM VERTICA/EXPORT FROM VERTICA, so compress traffic.
CompressNetworkDataWhen enabled (set to value 1), Vertica will compress all of the data it sends over the network. This speeds up network traffic at the expense of added CPU load. You can enable this if you find that the network is throttling your database performance.