S3 Bucket Size for EON
Mujeef
✭
Hello All,
I need little guidance about S3 Bucket size for the EON.
I have 1 one EON database with S3 bucket size about 256TB.
We have requirement to add data in S3 for EON database approx 400TB.
May I know ,
Can we increase size of S3 bucket ?
Is there any limit for S3 bucket Size.
I see S3 bucket size 256TB added to my database.
Can you please suggest how I can manage 400TB data ?
Thanks in advance.
Mujeef
Tagged:
0
Answers
It's not really the bucket size that will be an issue if this is AWS S3. If it's an on-prem or non-AWS service, then network bandwidth may become an issue.
The greater issue is division of data on the S3 bucket, and amount of compute resources to process up to ~700TB. How many nodes will be running on the data, and how many shards?
Please also review the latest sizing guidelines at https://www.vertica.com/docs/9.3.x/HTML/Content/Authoring/Eon/SizingEonCluster.htm
AWS S3 has unlimited data storage. According to AWS's FAQ [emphasis mine]: