AvroParser

How are you using AvroParser to optimize your big data? Share your opinions here!

Comments

  • I have trouble building it.  CentOS release 6.2 (Final), Linux dvert1 2.6.32-220.17.1.el6.x86_64 #1 SMP Wed May 16 00:01:37 BST 2012 x86_64 x86_64 x86_64 GNU/Linux


    Here's what I get when I do a "make build"

    make[1]: Entering directory '/home/users/david/VERTICA_EXTENSION_PACKAGES/Vertica-Extension-Packages/avro_parser/tparty'
    make[1]: Nothing to be done for 'all'.
    make[1]: Leaving directory '/home/users/david/VERTICA_EXTENSION_PACKAGES/Vertica-Extension-Packages/avro_parser/tparty'
    g++ -c -I ../include -Wall -Wno-unused-value -shared -fno-strict-aliasing -fPIC -I /opt/vertica/sdk/include -I build/include -I build/include/avro -I /opt/vertica/sdk/examples/HelperLibraries src/CRStream.cc -o build/CRStream.o
    In file included from src/CRStream.hh:5,
                     from src/CRStream.cc:2:
    /opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h: In member function ‘void Coroutine::switchBack()’:
    /opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h:109: error: ‘coroutine_exception’ was not declared in this scope
    /opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h: In member function ‘std::exception* Coroutine::throw_in_coroutine(std::exception*)’:
    /opt/vertica/sdk/examples/HelperLibraries/CoroutineHelpers.h:131: error: ‘coroutine_exception’ was not declared in this scope
    make: *** [build/CRStream.o] Error 1



  • We're considering switching from the JSON to Avro for some of our data source streams.  The self describing schema in Avro along with the binary data transfer to eliminate text parsing are the very attractive driving features.  However, loosing the OOB FlexZone  capability in Vertica we have with a JSON source is negative.  We'd like to see FlexZone include Avro OOB.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file