Please take this survey to help us learn more about how you use third party tools. Your input is greatly appreciated!

ERROR 4368: Permission denied for storage location(From Hadoop to Vertica )

Hi ,
I am facing the below issue : while loading the data from hadoop to vertic for a ORC File
ERROR 4368: Permission denied for storage location.

PFB the steps i have perfomed :
An ORC table created in hadoop cluster in iibaeihp owner
e.g

Detailed Table Information

Database: imap_loc
Owner: iibaeihp/[email protected]

I have logged in to hadoop from the machine xa2iiblap103.xxx.xxx.com

Now i am trying to load this ORC table to vertica

Logged to vertica from machine : la-tigersp-iap01.corp.xxxx.com
then i have logged in to my vertica DB
/opt/vertica/bin/vsql -U tiger_owner -w TigerMDN** -h ma1-tigerp-lvdb01.xxx.xxx.com

Then i am trying to run the copy statement from Vertica to load the ORC file located in hadoop as
COPY tiger.my_tables
(
orange_id
,orange_txt ) FROM
'webhdfs://xa2iiblap103.xxx.xxx.com:8020/user/hive/imap/imap_app/test_table/*'
ON ANY NODE ORC;

ERROR 4368: Permission denied for storage location [webhdfs://......]

Could you please help me on this .

Thanks,

Answers

  • Have you checked for the Kerberos Authentication ? Does you Hadoop cluster authenticate using Kerberos if yes that's something needed to be setup on vertica cluster to pass on the authentication.

  • What version of Vertica are you using? For older versions you will need to create storage location usage 'USER' for that HDFS directory.

  • As mentioned by Xiaowei, you might have to setup a USER storage location if you are loading as non-dbadmin user. You should not have this problem if your load user is 'dbadmin'. This restriction was removed in the newer versions of Vertica .

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file

Can't find what you're looking for? Search the Vertica Documentation, Knowledge Base, or Blog for more information.