vertica scheduler how use all memory for the pool after adding physical memory
maks
Community Edition User ✭
Hello, Could you please help me? I have vertica's scheduler, it reads data from apache kafka's topic. Sometimes the scheduler stops working because there was not enough memory and I see in log error: Insufficient resources to execute plan on pool mypool [Timedout waiting for resource request: Request exceeds limits: Memory(KB) Exceeded: Requested = 30333842, Free = 22275670 (Limit = 52609512, Used = 30333842) (queueing threshold)]
I added physical memory (from 64 Gb till 96 Gb) but I have same error. I think that new memory has not been added to the scheduler' pool (I see in error's log that it is still free about 22 GB as it was before I increased the memory). How can I use all memory for the pool? Restarting scheduler and host doesn't help.
That is log after adding memory:ERROR: Insufficient resources to execute plan on pool mypool [Timedout waiting for resource request: Request exceeds limits: Memory(KB) Exceeded: Requested = 30333842, Free = 22275670 (Limit = 52609512, Used = 30333842) (queueing threshold)]
Answers
Hi,
to add memory available for the scheduler you shd create the resource pool : Vertica recommends you always create a resource pool specifically for your scheduler.
The page which wd help you is this: https://www.vertica.com/docs/10.0.x/HTML/Content/Authoring/KafkaIntegrationGuide/SettingUpAScheduler.htm?tocpath=Integrating with Apache Kafka|Automatically Copying Data From Kafka|_____1
hope this helps.
I have resource pool mypool and this pool has this error "Insufficient resources to execute plan on pool mypool" (the pool has memory size 50%). How can I add memory to this resource pool after added added physical memory?
try to set memorysize '0%'. if this helps, you can alter it to smth else.