We're Moving!

The Vertica Forum is moving to a new OpenText Analytics Database (Vertica) Community.

Join us there to post discussion topics, learn about

product releases, share tips, access the blog, and much more.

Create My New Community Account Now


How to access identical bucket on two different S3 — Vertica Forum

How to access identical bucket on two different S3

scherepanovscherepanov ✭✭
in General Discussion

Hi,
I got two instances of S3, and bucket with same name on both.

Config parameters S3BucketConfig and S3BucketCredentials allow to specify bucket only once.

Question: how I can access data from Vertica on two buckets with same name, residing on different S3's?

Thank you
Sergey

Answers

  • SergeBSergeB - Select Field - Employee
    edited September 2024

    I think you can specify multiple buckets in the JSON properties

    https://docs.vertica.com/24.3.x/en/sql-reference/config-parameters/s3-parameters/

    but bucket names have to be unique.

    Unless you need to acces both uniquely named buckets at the same time, you could probably set appropriate session parameters when accessing one or the other?

  • scherepanovscherepanov ✭✭

    Hi @SergeB

    Thanks for taking time to answer.

    Your suggestion is to avoid bucket definition on database level, and delegate bucket definition to user session level, on as-need basis. That would work, although users will have access to bucket credentials.

    That immediately create problem with permissions on buckets. Vertica do manage grants on storage location that can be linked to buckets. With defining buckets on session level, I have to give users credentials for bucket access, effectively rendering all vertica grants control obsolete. That would be highly undesirable.

    I think correct solution would be to allow duplicate bucket names. We can add "alias" to bucket definition, default to bucket name. Alias will be unique, bucket name can repeat. Grant swill be working on alias instead of bucket name.
    That will keep compatibility with existing bucket definition, and extend bucket definition to allow for duplicate buckets.

    Please discuss with Vertica team.

    Sergey.

  • SruthiASruthiA Administrator

    @scherepanov : I have created a JIRA with engineering. I will keep you posted.

  • SruthiASruthiA Administrator

    @scherepanov : Engineering has responded. To dicuss further on this, please create a support case.

  • scherepanovscherepanov ✭✭

    @SruthiA thanks!

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...