Data ingestion from MapR Streams to Vertica

KaitoKaito Employee, Registered User

Can Vertica get the data from MapR Streams using Vertica's kafka-related components directly ?

Thanks in advance?

Kaito Tonooka

Comments

  • twalltwall Employee, Registered User, VerticaPartners, AskTools

    Hi Kaito

    I don't think this will work. While there is some compatibility between kafka & mapr streams, Vertica uses the low-level kafka consumer C API, and that not supported by mapr streams according to http://maprdocs.mapr.com/home/MapR_Streams/MapRStreamsCApplications.html.

    Beyond that, I see there are some other differences in semantics, such as the way offsets are managed (mapr streams starts at 1 vs 0 in kafka) and the way security is done. Those may not be deal breakers for you, but those differences would probably break some scheduler use cases.

    Tom

  • RaviRavi Employee, Registered User

    Is there any plan to Test this or support this?

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file