We're Moving!

The Vertica Forum is moving to a new OpenText Analytics Database (Vertica) Community.

Join us there to post discussion topics, learn about

product releases, share tips, access the blog, and much more.

Create My New Community Account Now


HCatalog Connector error — Vertica Forum

HCatalog Connector error

Hello, Vertica Experts.

 

I’ve read Hcatalog connector requirement in the Vertica document as below.

https://my.vertica.com/docs/7.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/HadoopIntegrationGuide.htm%3FTocPath%3DHadoop%20Integration%20Guide%7C_____0

  • HCatalog 0.5
  • Hive 0.10 and 0.11
  • Hadoop 2.0

However from my customer’s request,

I’d like to install following Hadoop version on the vertica.

·   Hive 0.13(including Hcatalog)

·   Hadoop 2.4

·   Protobuf 2.5.0

Vertica Software version being installed on my “CS300 for Vertica” platform is :

r001vn002:/home/dbadmin$ rpm -qa |grep -i vertica

vertica-7.0.1-4.x86_64

 

And when I do below input, error happened as below.

 

dbadmin=> SELECT * from hcat.rest_info limit 10;

ERROR 3399:  Failure in UDx RPC call InvokePlanUDL(): Error in User Defined Object [VHCatSource], error code: 0

com.vertica.sdk.UdfException: Error: [org.apache.hcatalog.common.HCatException : 2004 : HCatOutputFormat not initialized, setOutput has to be called. Cause : java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status; Host Details : local host is: "r001vn001/16.1.8.1"; destination host is: "ver-1":8020; ] HINT: Vertica HCatalog Hadoop and ProtoBuf versions are not compatible with Hive metatsore service and HDFS service. You may update hadoop-*.jar and proto*.jar archives in  packages/hcat/lib to be compatible with Hive and HDFS. Supported versions: Hive 0.10, 0.11, Hadoop 2.0 and protobuf 2.4.

        at com.vertica.hcatalogudl.HCatalogSplitsNoOpSourceFactory.plan(HCatalogSplitsNoOpSourceFactory.java:82)

        at com.vertica.udxfence.UDxExecContext.planUDSource(UDxExecContext.java:898)

        at com.vertica.udxfence.UDxExecContext.planCurrentUDLType(UDxExecContext.java:876)

        at com.vertica.udxfence.UDxExecContext.planUDL(UDxExecContext.java:836)

        at com.vertica.udxfence.UDxExecContext.run(UDxExecContext.java:242)

        at java.lang.Thread.run(Thread.java:662)

 

Could anyone give a comment or advice?

 

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file