We're Moving!

The Vertica Forum is moving to a new OpenText Analytics Database (Vertica) Community.

Join us there to post discussion topics, learn about

product releases, share tips, access the blog, and much more.

Create My New Community Account Now


S3 Bucket Size for EON — Vertica Forum

S3 Bucket Size for EON

Hello All,

I need little guidance about S3 Bucket size for the EON.
I have 1 one EON database with S3 bucket size about 256TB.
We have requirement to add data in S3 for EON database approx 400TB.
May I know ,
Can we increase size of S3 bucket ?
Is there any limit for S3 bucket Size.

I see S3 bucket size 256TB added to my database.

Can you please suggest how I can manage 400TB data ?

Thanks in advance.

Mujeef

Tagged:

Answers

  • Bryan_HBryan_H Vertica Employee Administrator

    It's not really the bucket size that will be an issue if this is AWS S3. If it's an on-prem or non-AWS service, then network bandwidth may become an issue.
    The greater issue is division of data on the S3 bucket, and amount of compute resources to process up to ~700TB. How many nodes will be running on the data, and how many shards?
    Please also review the latest sizing guidelines at https://www.vertica.com/docs/9.3.x/HTML/Content/Authoring/Eon/SizingEonCluster.htm

  • LenoyJLenoyJ - Select Field - Employee

    AWS S3 has unlimited data storage. According to AWS's FAQ [emphasis mine]:

    Q: How much data can I store in Amazon S3?
    The total volume of data and number of objects you can store are unlimited. Individual Amazon S3 objects can range in size from a minimum of 0 bytes to a maximum of 5 terabytes.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file