Default DataBuffer Size
Context : I have written a UDS which reads data from a given source and copies them into Vertica. The data objects are quite big so I divide them into chunks which are copied into Vertica in parallel.
Probelem : Even after the division each individual chunk is still ~5MB. Now when I am trying to read this data inside
public StreamState process(ServerInterface srvInterface, DataBuffer output) method it always reads just 16KB out if this 1MB data.
Quesiton : Is DataBuffer.buf of 16KB? Is it possible to increase it some how? If not, could there be any alternative?
Thank you so much for your precious time.