Options

Does DataStage works well with Vertica?

Does anyone use DataStage to load data in Vertica? What connection has been used? How fast is the load comparing with Vertica's COPY?
What other ETL tool would you suggest to use with Vertica?

Comments

  • Options
    Navin_CNavin_C Vertica Customer
    Hi Oleg,


    >>Does anyone use DataStage to load data in Vertica
    DataStage works good with Vertica.
    Any ETL works good with Vertica.

    >>What connection has been used?
    Connections that can be used are JDBC or ODBC.
    I prefer JDBC over ODBC when it comes to ETL talking with databases.

    >> How fast is the load comparing with Vertica's COPY?
    In any case, Vertica's COPY command is the fastest way to load data.
    COPY is meant for bulk loading and it is file to db loading, whereas ETL can help you with Source to Target Loading.
    But for sure in both case COPY will be ahead in terms of time.


    >>What other ETL tool would you suggest to use with Vertica?
    Two good options.
    1. Informatica :
    Vertica provides a native connector for informatica tool.
    A native connector means special support for the ETL tool which is always above the ODBC or JDBC connection and is faster.
    2. Syncsort: (Don't get surprised)
    Syncsort holds a world record for loading maximum data with Vertica.
    Syncsort and Vertica

    Hope this helps.
    NC






  • Options
    Thanks Navin. Will check Syncsort, never knew before
  • Options

    Hi ,

     

    I used Datastage to insert and select data from vertica using ODBC driver and connector. But when i started performing update / delete for 100 records its taking 2 minutes. The same is taking seconds in VSQL. Please help.

  • Options

    Data Stage is the ETL tool not ELT.

    Sometime it is better to use ELT instead of ETL.

    If you age going to use batch loading try to use Vertica COPY DIRECT not Data Stage insert

  • Options
    siddyashsiddyash Vertica Employee Employee

    We have published Datastage document in the community.
    https://my.vertica.com/kb/DataStageCG_HTML/Content/Partner/DataStageCG_HTML.htm

  • Options
    Jim_KnicelyJim_Knicely - Select Field - Administrator
    edited August 2017

    Take away ... Vertica understands ODBC, JDBC, OLEDB, ADO.NET, etc

    See:

    https://my.vertica.com/docs/8.1.x/HTML/index.htm#Authoring/ConnectingToVertica/ClientDriverMisc/HPVerticaClientLibraryOverview.htm

    We offer the best platform.

  • Options

    Here's an article on our Knowledge Base about connecting to DataStage:

    https://my.vertica.com/kb/DataStageCG_HTML/Content/Partner/DataStageCG_HTML.htm

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file