import BSON directly into VMap


Looking at implementation of VMap here https://github.com/vertica/FlexTable/blob/master/src/VMap.h
I'm wondering if it is possible to directly load BSON data into vertica.

I have data in mongodb stored as bsons. So in order to import it into vertica I have to parse it into JSON and load using copy with specific parser (which basically I dont because it is too slow; instead I'm reading mongodb bsons into python, convert into csv and copy into sparse global temp table with pinned projection).

So instead of all of thansformations in between it looks like BSON is so much alike VMap. It would be much faster to load BSON into binary representation of VMap colum directly.

Did anybody try it?
Does it look possible?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file