The Vertica Forum recently got a makeover! Let us know what you think by filling out this short, anonymous survey.
S3 Bucket Size for EON
Hello All,
I need little guidance about S3 Bucket size for the EON.
I have 1 one EON database with S3 bucket size about 256TB.
We have requirement to add data in S3 for EON database approx 400TB.
May I know ,
Can we increase size of S3 bucket ?
Is there any limit for S3 bucket Size.
I see S3 bucket size 256TB added to my database.
Can you please suggest how I can manage 400TB data ?
Thanks in advance.
Mujeef
Tagged:
0
Leave a Comment
Can't find what you're looking for? Search the Vertica Documentation, Knowledge Base, or Blog for more information.
Answers
It's not really the bucket size that will be an issue if this is AWS S3. If it's an on-prem or non-AWS service, then network bandwidth may become an issue.
The greater issue is division of data on the S3 bucket, and amount of compute resources to process up to ~700TB. How many nodes will be running on the data, and how many shards?
Please also review the latest sizing guidelines at https://www.vertica.com/docs/9.3.x/HTML/Content/Authoring/Eon/SizingEonCluster.htm
AWS S3 has unlimited data storage. According to AWS's FAQ [emphasis mine]: