Resource manager - custom pools
Hi, We currently have everyone assigned to general_pool and it seemed to have worked so far, but we do see etl jobs or reports fail at times with resource limit, it's always the memory, we have a 3-node cluster with 128GB memory on each node and would like to create the following custom pools and assign to those respective users?
Idea is to make etl jobs to have higher priority when resources are allocated, followed by reports user and individual users.
CREATE RESOURCE POOL etl_pool
CREATE RESOURCE POOL tableau_pool
CREATE RESOURCE POOL adhoc_pool
RUNTIMECAP 'minutes 30'
But I was reading best practices article and found that sum of all custom pools should not exceed 20% above of max physical memory?
"We typically recommend that the sum of the MAXMEMORYSIZE of user-defined pools does not exceed 20% above the available physical memory."