Request Too Large:File Handles Exceeded

vcarusi

Hi,
I have the following error:

java.sql.SQLTransientException: [Vertica]VJDBC ERROR: Insufficient resources to execute plan on pool my_pool [Request Too Large:File Handles Exceeded: Requested = 28490, Free = 27496 (Limit = 27496, Used = 0)]
at com.vertica.util.ServerErrorData.buildException(Unknown Source)

I obtain this error when I execute
select max(col_1), max(col_2) ....., max(col_1287) from

decreasing the number of columns , the value of 'Requested (File Handles)' decreases, also

What should be done in order to increase the 'Limit = 27496' ?

ulimit -n
65536

/etc/security/limits.conf

• • as unlimited
• hard nofile 65536
• soft nofile 65536
  dbadmin - nice 0
  dbadmin - nofile 65536

Thank you,
Veronica

vcarusi

Here is an interesting description
https://forum.vertica.com/discussion/234883/file-handle-count-calculation

skeswani

for dbadmin run the following command. It will show how many file descriptors are available

ulimit -a

They can be increased in /etc/security/limits.conf as you have shown above.

note, the increase requires either a reboot or a relogin by the dbadmin user.

ulimit -a will tell you how many FDs are available

vcarusi

Yes, it worked.

https://www.vertica.com/docs/9.2.x/HTML/Content/Authoring/InstallationGuide/BeforeYouInstall/openfilelimits.htm
The open file limit should be at least 1 file open per MB of RAM, 65536, or the amount of RAM in MB.

1. In my case, I use a virtual machine and I could increase the amount of RAM, from 60 GB to 122 GB.
2. I modified /etc/security/limits.conf, changing
   hard nofile 65536 -> 122000
   soft nofile 65536 -> 122000
   dbadmin - nofile 65536 -> 122000
3. restarted the machine

My conclusion is: there is a connection between number of ROS containers, number of columns and the amount of RAM. More columns I need to select, more RAM I need.

vcarusi

Also, I used
lsof | wc -l <- to see the number of open files
lsof | grep "vertica" | wc -l <- files open by vertica

vcarusi

https://forum.vertica.com/discussion/234883/file-handle-count-calculation

vcarusi

https://forum.vertica.com/discussion/234883/file-handle-count-calculation

vcarusi

https://forum.vertica.com/discussion/234883/file-handle-count-calculation