Fastest way to export to S3

Comments

• Options

  Casey_S

  February 2017 edited February 2017

  Hi sarangp,

  The best way to export your data to S3 is to use the S3EXPORT function in the Vertica AWS Library. This function requires you to configure your Vertica database with your AWS credentials. So make sure to do that before you try exporting.
  Below is a quick example and some links to the documentation to get you started:

  -- Configure Vertica so it can authenticate with AWS => ALTER SESSION SET UDPARAMETER FOR awslib aws_id='ABYHGDGDGDGDGDGD'; => ALTER SESSION SET UDPARAMETER FOR awslib aws_secret='not-a-real-secret7778hfhfhf'; => ALTER SESSION SET UDPARAMETER FOR awslib aws_region='us-east-1'; -- Export to an S3 bucket => SELECT S3EXPORT( * USING PARAMETERS url='s3://exampleBucket/object') OVER(PARTITION BEST) FROM your_table;

  Links:

  • https://my.vertica.com/docs/8.0.x/HTML/index.htm#Authoring/AdministratorsGuide/BulkLoadCOPY/AWSLibrary/AWSLibrary.htm
  • https://my.vertica.com/docs/8.0.x/HTML/index.htm#Authoring/SQLReferenceManual/Functions/VerticaFunctions/s3export.htm
  • https://my.vertica.com/docs/8.0.x/HTML/index.htm#Authoring/AdministratorsGuide/BulkLoadCOPY/AWSLibrary/exportAWSlibrary.htm

  Let me know if this helps.

  -C

  0