Default DataBuffer Size

mti

Hi friends,

 

Context : I have written a UDS which reads data from a given source and copies them into Vertica. The data objects are quite big so I divide them into chunks which are copied into Vertica in parallel.

 

Probelem : Even after the division each individual chunk is still ~5MB. Now when I am trying to read this data inside

public StreamState process(ServerInterface srvInterface, DataBuffer output) method it always reads just 16KB out if this 1MB data.

 

Quesiton : Is DataBuffer.buf of 16KB? Is it possible to increase it some how? If not, could there be any alternative?

 

Thank you so much for your precious time.