HCatalog Connector error

Hyun

Hello, Vertica Experts.

 

I’ve read Hcatalog connector requirement in the Vertica document as below.

https://my.vertica.com/docs/7.0.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/HadoopIntegrationGuide.htm%3FTocPath%3DHadoop%20Integration%20Guide%7C_____0

• HCatalog 0.5
• Hive 0.10 and 0.11
• Hadoop 2.0

However from my customer’s request,

I’d like to install following Hadoop version on the vertica.

·   Hive 0.13(including Hcatalog)

·   Hadoop 2.4

·   Protobuf 2.5.0

Vertica Software version being installed on my “CS300 for Vertica” platform is :

r001vn002:/home/dbadmin$ rpm -qa |grep -i vertica

vertica-7.0.1-4.x86_64

 

And when I do below input, error happened as below.

 

dbadmin=> SELECT * from hcat.rest_info limit 10;

ERROR 3399:  Failure in UDx RPC call InvokePlanUDL(): Error in User Defined Object [VHCatSource], error code: 0

com.vertica.sdk.UdfException: Error: [org.apache.hcatalog.common.HCatException : 2004 : HCatOutputFormat not initialized, setOutput has to be called. Cause : java.io.IOException: Failed on local exception: com.google.protobuf.InvalidProtocolBufferException: Message missing required fields: callId, status; Host Details : local host is: "r001vn001/16.1.8.1"; destination host is: "ver-1":8020; ] HINT: Vertica HCatalog Hadoop and ProtoBuf versions are not compatible with Hive metatsore service and HDFS service. You may update hadoop-*.jar and proto*.jar archives in  packages/hcat/lib to be compatible with Hive and HDFS. Supported versions: Hive 0.10, 0.11, Hadoop 2.0 and protobuf 2.4.

        at com.vertica.hcatalogudl.HCatalogSplitsNoOpSourceFactory.plan(HCatalogSplitsNoOpSourceFactory.java:82)

        at com.vertica.udxfence.UDxExecContext.planUDSource(UDxExecContext.java:898)

        at com.vertica.udxfence.UDxExecContext.planCurrentUDLType(UDxExecContext.java:876)

        at com.vertica.udxfence.UDxExecContext.planUDL(UDxExecContext.java:836)

        at com.vertica.udxfence.UDxExecContext.run(UDxExecContext.java:242)

        at java.lang.Thread.run(Thread.java:662)

 

Could anyone give a comment or advice?