webhdfs copy rejected data as table getting error

kannan_1

Hi ,

Could some one please provide the necessary steps to set up a rejected data table for a COPY using WEBHDFS, and the rejected table should recide in a non-default location.

Thanks,
Kannan 

id10t

Hi!

Kannan Kalimuthu:

• HP Accredited Technical Professional
• Cloudera certified Administrator/Developer for Apache Hadoop.

With these skills I was hoping that you will clarify it to us

kannan_1

@ id10t ..... I guess you have a different kannan mentioned here .... :-) .. i am kannan nagaraj

Prasanta_Pal

What syntax you are using for COPY from HDFS and write the reject data to a table?

are you using

=> COPY <table_name> SOURCE-> Hdfs(url=....) rejected data as table <table_name>_rejects;

Did you check if the data is also written in the below folder?

<path>node000x_data/RejectionTableData

Are you able to see the rejected data in the files as per the below?

http://my.vertica.com/docs/7.1.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/HDFSConnector/Loadi...

Viewing Rejected Rows and Exceptions COPY statements that use the HP Vertica Connector for HDFS use the same method for recording rejections and exceptions as other COPY statements. Rejected rows and exceptions are saved to log files. These log files are stored by default in the CopyErrorLogs subdirectory in the database's catalog directory.

id10t

@kannan

Im apologize for mistake. What do you want? Im an idiot