The Vertica Forum is getting a makeover! The site will be undergoing maintenance from Tuesday 8/13 to Friday 8/16. We appreciate your patience and cooperation during this time.

Data ingestion from MapR Streams to Vertica

Can Vertica get the data from MapR Streams using Vertica's kafka-related components directly ?

Thanks in advance?

Kaito Tonooka

Comments

  • Hi Kaito

    I don't think this will work. While there is some compatibility between kafka & mapr streams, Vertica uses the low-level kafka consumer C API, and that not supported by mapr streams according to http://maprdocs.mapr.com/home/MapR_Streams/MapRStreamsCApplications.html.

    Beyond that, I see there are some other differences in semantics, such as the way offsets are managed (mapr streams starts at 1 vs 0 in kafka) and the way security is done. Those may not be deal breakers for you, but those differences would probably break some scheduler use cases.

    Tom

  • RaviRavi Employee

    Is there any plan to Test this or support this?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file

Can't find what you're looking for? Search the Vertica Documentation, Knowledge Base, or Blog for more information.