Options

S3 Bucket Size for EON

MujeefMujeef ✭
in General Discussion

Hello All,

I need little guidance about S3 Bucket size for the EON.
I have 1 one EON database with S3 bucket size about 256TB.
We have requirement to add data in S3 for EON database approx 400TB.
May I know ,
Can we increase size of S3 bucket ?
Is there any limit for S3 bucket Size.

I see S3 bucket size 256TB added to my database.

Can you please suggest how I can manage 400TB data ?

Thanks in advance.

Mujeef

Tagged:

Answers

  • Options
    Bryan_HBryan_H Vertica Employee Administrator

    It's not really the bucket size that will be an issue if this is AWS S3. If it's an on-prem or non-AWS service, then network bandwidth may become an issue.
    The greater issue is division of data on the S3 bucket, and amount of compute resources to process up to ~700TB. How many nodes will be running on the data, and how many shards?
    Please also review the latest sizing guidelines at https://www.vertica.com/docs/9.3.x/HTML/Content/Authoring/Eon/SizingEonCluster.htm

  • Options
    LenoyJLenoyJ - Select Field - Employee

    AWS S3 has unlimited data storage. According to AWS's FAQ [emphasis mine]:

    Q: How much data can I store in Amazon S3?
    The total volume of data and number of objects you can store are unlimited. Individual Amazon S3 objects can range in size from a minimum of 0 bytes to a maximum of 5 terabytes.

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...