Slow copy performance
I'm having slow performance while getting data from Oracle database through Talend tool. Select query on Oracle side completed pretty quickly (around 5 mins). But inserting selected data into Vertica is taking so long time.
I have 3 jobs running on Talend and they're still working since yesterday 5pm. First job shows 155 rows/s, second is 553 rows/s, third is 257 rows/s.
Checked server resource usage with below result.
Memory : Total 64GB used 5GB
CPU : 80% used
Storage : 15GB used, enough free space left.
Network : 12mbps on receive side, server has 10G connection. But talend host has 1G connection.
I have a cluster with 1 node and 1 database. 3 jobs inserting data into 3 separate tables.
I think there's something preventing to work copy command with full resource. Have you ever face similar situation?