S3EnableVirtualAddressing setting is not working

I am using localstack to mock s3 and running a COPY from mocked S3 localstack as below

ALTER SESSION SET AWSAuth='test:test';
ALTER SESSION SET AWSRegion='us-east-1';
ALTER SESSION SET AWSEndpoint='localhost:4566';
ALTER SESSION SET S3EnableVirtualAddressing=1;

COPY test.test(start,advertiser) FROM 's3://reports/*.csv' ON ANY NODE PARSER FCSVParser(type='traditional', reject_on_materialized_type_error='true', header='false', delimiter=E'\t') TRAILING NULLCOLS ABORT ON ERROR NO COMMIT;

this copy is failing with error 'Cannot expand glob pattern due to error, unable to connect to endpoint'

The debug log shows
CurlHttpClient [140639308084992] Making request to http://reports.localhost:4566?encoding-type=url&list-type=2&prefix=saf_fact_kvp_emr/fact_exchange_wins/

instead of request

can someone help me understand the issue and how to fix it?


  • Bryan_HBryan_H Vertica Employee Administrator

    S3EnableVirtualAddressing rewrites URL to include bucket name as part of the host name so it is not required in this configuration. Please try again with S3EnableVirtualAddressing=0 to connect to endpoint in the form http://host:port/bucketname

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file