The Vertica Forum recently got a makeover! Let us know what you think by filling out this short, anonymous survey.
Please take this survey to help us learn more about how you use third party tools. Your input is greatly appreciated!

COPY from STORAGE LOCATION works but S3EXPORT doesn't

PoslanikPoslanik Vertica Customer


Vertica Analytic Database v9.3.0-0 nodes are on AWS EC2 instances with AmazonS3FullAccess policy.
On Vertica there is a storage location created pointing to an S3 bucket on the same AWS account.

Without setting AWS_SET_CONFIG for aws_id and aws_secret I am able to COPY from storage location, but when I want to do S3EXPORT to the same storage location I get an error:

SQL Error [5861] [VP001]: [Vertica]VJDBC ERROR: Error calling processPartition() in User Function s3export at [/data/qb_workspaces/jenkins2/ReleaseBuilds/Grader/REL-9_3_x-x_grader/build/udx/supported/AWS/src/S3.cpp:780], error code: 0, message: Unknown exception: Anonymous users cannot initiate multipart uploads. Please authenticate.

After I set AWS_SET_CONFIG aws_id and aws_secret of an AWS user with the same policy as Vertica EC2 instances, S3EXPORT finishes successfully.

Am I missing something? How come S3EXPORT function doesn't work without setting aws_id and aws_secret and COPY function works?


Best Answer

  • SruthiASruthiA Vertica Employee Employee
    Answer ✓

    @Poslanik What you are seeing is an expected behaviour. S3EXPORT and copy from S3 are different functions... They use different configuration parameters as well. aws_id and aws_secret are to be set explicitly for S3EXPORT to work.


Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file