Data ingestion from MapR Streams to Vertica

KaitoKaito Employee
in General Discussion

Can Vertica get the data from MapR Streams using Vertica's kafka-related components directly ?

Thanks in advance?

Kaito Tonooka

Comments

  • twalltwall Vertica Employee Employee

    Hi Kaito

    I don't think this will work. While there is some compatibility between kafka & mapr streams, Vertica uses the low-level kafka consumer C API, and that not supported by mapr streams according to http://maprdocs.mapr.com/home/MapR_Streams/MapRStreamsCApplications.html.

    Beyond that, I see there are some other differences in semantics, such as the way offsets are managed (mapr streams starts at 1 vs 0 in kafka) and the way security is done. Those may not be deal breakers for you, but those differences would probably break some scheduler use cases.

    Tom

  • RaviRavi Vertica Employee Employee

    Is there any plan to Test this or support this?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...