Please take this survey to help us learn more about how you use third party tools. Your input is greatly appreciated!

webhdfs copy rejected data as table getting error

Hi ,

Could some one please provide the necessary steps to set up a rejected data table for a COPY using WEBHDFS, and the rejected table should recide in a non-default location.

Thanks,
Kannan 

Comments

  • Hi!

    Kannan Kalimuthu:
    • HP Accredited Technical Professional
    • Cloudera certified Administrator/Developer for Apache Hadoop.
    With these skills I was hoping that you will clarify it to us :(
  • id10t ..... I guess you have a different kannan mentioned here .... :-) .. i am kannan nagaraj
  • What syntax you are using for COPY from HDFS and write the reject data to a table?

    are you using
    => COPY <table_name> SOURCE-> Hdfs(url=....) rejected data as table <table_name>_rejects;
    Did you check if the data is also written in the below folder?
    <path>node000x_data/RejectionTableData
    Are you able to see the rejected data in the files as per the below?

    http://my.vertica.com/docs/7.1.x/HTML/index.htm#Authoring/HadoopIntegrationGuide/HDFSConnector/Loadi...

    Viewing Rejected Rows and Exceptions COPY statements that use the HP Vertica Connector for HDFS use the same method for recording rejections and exceptions as other COPY statements. Rejected rows and exceptions are saved to log files. These log files are stored by default in the CopyErrorLogs subdirectory in the database's catalog directory.








  • @kannan

    Im apologize for mistake. What do you want? Im an idiot :)

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file

Can't find what you're looking for? Search the Vertica Documentation, Knowledge Base, or Blog for more information.