Does DataStage works well with Vertica?
Does anyone use DataStage to load data in Vertica? What connection has been used? How fast is the load comparing with Vertica's COPY?
What other ETL tool would you suggest to use with Vertica?
What other ETL tool would you suggest to use with Vertica?
0
Comments
>>Does anyone use DataStage to load data in Vertica
DataStage works good with Vertica.
Any ETL works good with Vertica.
>>What connection has been used?
Connections that can be used are JDBC or ODBC.
I prefer JDBC over ODBC when it comes to ETL talking with databases.
>> How fast is the load comparing with Vertica's COPY?
In any case, Vertica's COPY command is the fastest way to load data.
COPY is meant for bulk loading and it is file to db loading, whereas ETL can help you with Source to Target Loading.
But for sure in both case COPY will be ahead in terms of time.
>>What other ETL tool would you suggest to use with Vertica?
Two good options.
1. Informatica :
Vertica provides a native connector for informatica tool.
A native connector means special support for the ETL tool which is always above the ODBC or JDBC connection and is faster.
2. Syncsort: (Don't get surprised)
Syncsort holds a world record for loading maximum data with Vertica.
Syncsort and Vertica
Hope this helps.
NC
Hi ,
I used Datastage to insert and select data from vertica using ODBC driver and connector. But when i started performing update / delete for 100 records its taking 2 minutes. The same is taking seconds in VSQL. Please help.
Data Stage is the ETL tool not ELT.
Sometime it is better to use ELT instead of ETL.
If you age going to use batch loading try to use Vertica COPY DIRECT not Data Stage insert
We have published Datastage document in the community.
https://my.vertica.com/kb/DataStageCG_HTML/Content/Partner/DataStageCG_HTML.htm
Take away ... Vertica understands ODBC, JDBC, OLEDB, ADO.NET, etc
See:
https://my.vertica.com/docs/8.1.x/HTML/index.htm#Authoring/ConnectingToVertica/ClientDriverMisc/HPVerticaClientLibraryOverview.htm
We offer the best platform.
Here's an article on our Knowledge Base about connecting to DataStage:
https://my.vertica.com/kb/DataStageCG_HTML/Content/Partner/DataStageCG_HTML.htm