Options

Sqoop 1.4.4-cdh5.0.1 and vertica-jdk5-6.1.3-0.jar and jdbc4 compatibility

We have migrated to cloudera cdh5 hadoop (from cdh4) and have problems importing sql query results to hdfs using sqoop v1. The worker map reduce job throws an exception telling that com.vertica.jdbc.VerticaPreparedStatementImpl.isClosed() method is not implemented. The documentation for vertica6 driver says that it's jdbc4 compatible. Looks like it's not. Any suggestions how to fix the problem? Can you implement isClosed in vertica6 driver please?

thanks!

The exception:
2014-07-09 16:50:52,534 INFO [main] org.apache.sqoop.mapreduce.db.DBInputFormat: Using read commited transaction isolation  2014-07-09 16:50:52,937 INFO [main] org.apache.hadoop.mapred.MapTask: Processing split: 1=1 AND 1=1  2014-07-09 16:50:53,017 INFO [main] org.apache.hadoop.io.compress.zlib.ZlibFactory: Successfully loaded & initialized native-zlib library  2014-07-09 16:50:53,028 INFO [main] org.apache.sqoop.mapreduce.db.DBRecordReader: Working on split: 1=1 AND 1=1  2014-07-09 16:50:53,058 INFO [main] org.apache.sqoop.mapreduce.db.DBRecordReader: Executing query: select platform, audience_id, count_direct, count_indirect from tapestry.audience_hits  where snapshot_date='2014/07/04' and ( 1=1 ) AND ( 1=1 )  2014-07-09 16:51:07,192 INFO [Thread-12] org.apache.sqoop.mapreduce.AutoProgressMapper: Auto-progress thread is finished. keepGoing=false  2014-07-09 16:51:07,200 FATAL [main] org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.AbstractMethodError: com.vertica.jdbc.VerticaPreparedStatementImpl.isClosed()Z   at org.apache.sqoop.mapreduce.db.DBRecordReader.close(DBRecordReader.java:163)   at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.close(MapTask.java:500)   at org.apache.hadoop.mapred.MapTask.closeQuietly(MapTask.java:1975)   at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:773)   at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)   at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)   at java.security.AccessController.doPrivileged(Native Method)   at javax.security.auth.Subject.doAs(Subject.java:415)   at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)   at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file