Options

Error (Sort Buffer failed)

Hi,
When i executed transformations pdi, vertica returns this error:
**2019/09/02 12:16:16 - Table output.0 - Caused by: org.pentaho.di.core.exception.KettleDatabaseException:
2019/09/02 12:16:16 - Table output.0 - Error inserting/updating row
2019/09/02 12:16:16 - Table output.0 - [Vertica]VJDBC ERROR: Malloc of 399458304 bytes for Sort Buffer failed
**
It's necessary up the pool parameters in vertica?

Thanks.

Answers

  • Options
    Jim_KnicelyJim_Knicely - Select Field - Administrator
    edited September 2019

    Check out the "Vertica Integration with Pentaho Data Integration (PDI): Tips and Techniques" guide here:
    https://www.vertica.com/kb/PentahoPDI_Tips/Content/Partner/PentahoPDI_Tips.htm

    In particular, if you are doing a large data load:

    1. When using the Standard Output Table component, add the DirectBatchInsert parameter to the connection and set it to true
    2. To specify that the Vertica Bulk Loader write data directly to the ROS, select Insert direct to ROS.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file