Exception: RODBC issue when Loading Data From Vertica
These items work:
> library(vRODBC)
> connect <- odbcConnect("Test")
> segment <- sqlQuery(connect, "select * from RND LIMIT 2")
When I was using db2dframe, I got:
distributedR Exception: there is no package called ‘RODBC’
Then, I installed RODBC on all the Worker Nodes.
After that I got:
distributedR Exception: first argument is not an open RODBC channel
I tried to address it by setting up the odbc.ini and vertica.ini files on each computer.
If that was the correct thing to do, then I must have another issue because I am still receiving the same result.
My only other suspicion is that the port specified in odbc.ini is not open to the other nodes
> library(vRODBC)
> connect <- odbcConnect("Test")
> segment <- sqlQuery(connect, "select * from RND LIMIT 2")
When I was using db2dframe, I got:
distributedR Exception: there is no package called ‘RODBC’
Then, I installed RODBC on all the Worker Nodes.
After that I got:
distributedR Exception: first argument is not an open RODBC channel
I tried to address it by setting up the odbc.ini and vertica.ini files on each computer.
If that was the correct thing to do, then I must have another issue because I am still receiving the same result.
My only other suspicion is that the port specified in odbc.ini is not open to the other nodes
0
Comments
2014-May-20 18:03:27.042547 [INFOR] Starting worker.
2014-May-20 18:03:27.049574 [INFOR] Creating Executors in Worker
2014-May-20 18:03:27.049896 [INFOR] Created new Executor 0 with Process ID 23652
2014-May-20 18:03:27.050134 [INFOR] Created new Executor 1 with Process ID 23653
2014-May-20 18:03:27.050420 [INFOR] Created HandleRequest threads to listen requests from Master
2014-May-20 18:03:27.050469 [INFOR] Worker server19:2020 with 2 executors and 1794491596 Shared Memory
2014-May-20 18:03:27.057900 [INFOR] Creating a connection for handshake with master 192.168.100.18:61841
2014-May-20 18:03:27.058313 [INFOR] Worker opened connection to Master at 192.168.100.18:61841
2014-May-20 18:03:27.058441 [INFOR] Sending reply with worker info: 192.168.100.19 2020
2014-May-20 18:03:27.058629 [INFOR] HELLO Handshaking reply sent to Master. Master 192.168.100.18:61841 registered with Worker
2014-May-20 18:03:27.079246 [DEBUG] Connected to master at tcp://192.168.100.18:61841
2014-May-20 18:03:57.446336 [INFOR] New Request from Master of type HELLO received
2014-May-20 18:03:57.446467 [INFOR] New HELLO Request received from Worker
2014-May-20 18:03:57.446525 [INFOR] Sending reply with worker info: 192.168.100.19 2020
2014-May-20 18:04:02.982289 [INFOR] New Request from Master of type NEWEXECR received
2014-May-20 18:04:02.982414 [INFOR] New EXECUTE TaskID 7 - Received from Master
2014-May-20 18:04:02.982879 [DEBUG] EXECUTE TaskID 7 - Waiting for an Available Executor
2014-May-20 18:04:02.982947 [DEBUG] EXECUTE TaskID 7 - Will be excuted at Executor Id 0
2014-May-20 18:04:02.982984 [DEBUG] EXECUTE TaskID 7 - Sending dobject Arguments to Executor.
2014-May-20 18:04:02.983050 [DEBUG] EXECUTE TaskID 7 - Sending Function body to Executor.
2014-May-20 18:04:02.983092 [INFOR] EXECUTE TaskID 7 - Executing Function sent to Executor Id 0
2014-May-20 18:04:02.983397 [INFOR] New Request from Master of type NEWEXECR received
2014-May-20 18:04:02.983487 [INFOR] New EXECUTE TaskID 35 - Received from Master
2014-May-20 18:04:02.983538 [DEBUG] EXECUTE TaskID 35 - Waiting for an Available Executor
2014-May-20 18:04:02.983577 [DEBUG] EXECUTE TaskID 35 - Will be excuted at Executor Id 1
2014-May-20 18:04:02.983610 [DEBUG] EXECUTE TaskID 35 - Sending dobject Arguments to Executor.
2014-May-20 18:04:02.983662 [DEBUG] EXECUTE TaskID 35 - Sending Function body to Executor.
2014-May-20 18:04:02.983701 [INFOR] EXECUTE TaskID 35 - Executing Function sent to Executor Id 1
2014-May-20 18:04:02.988456 [INFOR] EXECUTE TaskID 7 - Task Execution complete.
2014-May-20 18:04:02.988471 [INFOR] EXECUTE TaskID 35 - Task Execution complete.
2014-May-20 18:04:02.988538 [DEBUG] EXECUTE TaskID 7 - Updated variables read.
2014-May-20 18:04:02.988551 [DEBUG] EXECUTE TaskID 35 - Updated variables read.
2014-May-20 18:04:02.988619 [INFOR] EXECUTE TaskID 7 - Sent TASKDONE message to Master
2014-May-20 18:04:02.988685 [INFOR] New Request from Master of type NEWEXECR received
2014-May-20 18:04:02.988620 [INFOR] EXECUTE TaskID 35 - Sent TASKDONE message to Master
2014-May-20 18:04:02.988728 [INFOR] New EXECUTE TaskID 63 - Received from Master
2014-May-20 18:04:02.988772 [DEBUG] EXECUTE TaskID 63 - Waiting for an Available Executor
2014-May-20 18:04:02.988752 [INFOR] New Request from Master of type NEWEXECR received
2014-May-20 18:04:02.988813 [DEBUG] EXECUTE TaskID 63 - Will be excuted at Executor Id 0
2014-May-20 18:04:02.988826 [INFOR] New EXECUTE TaskID 91 - Received from Master
2014-May-20 18:04:02.988862 [DEBUG] EXECUTE TaskID 63 - Sending dobject Arguments to Executor.
2014-May-20 18:04:02.988880 [DEBUG] EXECUTE TaskID 91 - Waiting for an Available Executor
2014-May-20 18:04:02.988917 [DEBUG] EXECUTE TaskID 91 - Will be excuted at Executor Id 1
2014-May-20 18:04:02.988971 [DEBUG] EXECUTE TaskID 91 - Sending dobject Arguments to Executor.
2014-May-20 18:04:02.989017 [DEBUG] EXECUTE TaskID 91 - Sending Function body to Executor.
2014-May-20 18:04:02.988905 [DEBUG] EXECUTE TaskID 63 - Sending Function body to Executor.
2014-May-20 18:04:02.989056 [INFOR] EXECUTE TaskID 91 - Executing Function sent to Executor Id 1
2014-May-20 18:04:02.989078 [INFOR] EXECUTE TaskID 63 - Executing Function sent to Executor Id 0
2014-May-20 18:04:03.101355 [INFOR] EXECUTE TaskID 63 - Task Execution complete.
2014-May-20 18:04:03.101414 [DEBUG] EXECUTE TaskID 63 - Updated variables read.
2014-May-20 18:04:03.101458 [INFOR] EXECUTE TaskID 63 - Sent TASKDONE message to Master
2014-May-20 18:04:03.101495 [INFOR] New Request from Master of type NEWEXECR received
2014-May-20 18:04:03.101519 [INFOR] New EXECUTE TaskID 119 - Received from Master
2014-May-20 18:04:03.101548 [DEBUG] EXECUTE TaskID 119 - Waiting for an Available Executor
2014-May-20 18:04:03.101572 [DEBUG] EXECUTE TaskID 119 - Will be excuted at Executor Id 0
2014-May-20 18:04:03.101594 [DEBUG] EXECUTE TaskID 119 - Sending dobject Arguments to Executor.
2014-May-20 18:04:03.101621 [DEBUG] EXECUTE TaskID 119 - Sending Function body to Executor.
2014-May-20 18:04:03.101645 [INFOR] EXECUTE TaskID 119 - Executing Function sent to Executor Id 0
2014-May-20 18:04:03.101881 [INFOR] EXECUTE TaskID 91 - Task Execution complete.
2014-May-20 18:04:03.101923 [DEBUG] EXECUTE TaskID 91 - Updated variables read.
2014-May-20 18:04:03.101958 [INFOR] EXECUTE TaskID 91 - Sent TASKDONE message to Master
2014-May-20 18:04:03.212236 [INFOR] EXECUTE TaskID 119 - Task Execution complete.
2014-May-20 18:04:03.212307 [DEBUG] EXECUTE TaskID 119 - Updated variables read.
2014-May-20 18:04:03.212351 [INFOR] EXECUTE TaskID 119 - Sent TASKDONE message to Master
2014-May-20 18:04:03.244535 [INFOR] New Request from Master of type NEWEXECR received
2014-May-20 18:04:03.244627 [INFOR] New EXECUTE TaskID 135 - Received from Master
2014-May-20 18:04:03.244697 [DEBUG] EXECUTE TaskID 135 - Waiting for an Available Executor
2014-May-20 18:04:03.244726 [DEBUG] EXECUTE TaskID 135 - Will be excuted at Executor Id 0
2014-May-20 18:04:03.244747 [DEBUG] EXECUTE TaskID 135 - Sending dobject Arguments to Executor.
2014-May-20 18:04:03.244794 [DEBUG] EXECUTE TaskID 135 - Sending Raw Arguments to Executor.
2014-May-20 18:04:03.245855 [DEBUG] EXECUTE TaskID 135 - Sending Function body to Executor.
2014-May-20 18:04:03.245915 [INFOR] EXECUTE TaskID 135 - Executing Function sent to Executor Id 0
2014-May-20 18:04:03.250157 [INFOR] New Request from Master of type NEWEXECR received
2014-May-20 18:04:03.250246 [INFOR] New EXECUTE TaskID 163 - Received from Master
2014-May-20 18:04:03.250308 [DEBUG] EXECUTE TaskID 163 - Waiting for an Available Executor
2014-May-20 18:04:03.250336 [DEBUG] EXECUTE TaskID 163 - Will be excuted at Executor Id 1
2014-May-20 18:04:03.250358 [DEBUG] EXECUTE TaskID 163 - Sending dobject Arguments to Executor.
2014-May-20 18:04:03.250390 [DEBUG] EXECUTE TaskID 163 - Sending Raw Arguments to Executor.
2014-May-20 18:04:03.251438 [DEBUG] EXECUTE TaskID 163 - Sending Function body to Executor.
2014-May-20 18:04:03.251497 [INFOR] EXECUTE TaskID 163 - Executing Function sent to Executor Id 1
2014-May-20 18:04:03.312418 [INFOR] EXECUTE TaskID 163 - Task Execution complete.
2014-May-20 18:04:03.312517 [ERROR] TASK_EXCEPTION : TaskID 163 execution failed at Executor 1 with message: first argument is not an open RODBC channel
2014-May-20 18:04:03.312591 [DEBUG] EXECUTE TaskID 163 - Updated variables read.
2014-May-20 18:04:03.312671 [INFOR] EXECUTE TaskID 163 - Sent TASKDONE message to Master
2014-May-20 18:04:03.312810 [INFOR] New Request from Master of type NEWEXECR received
2014-May-20 18:04:03.312891 [INFOR] New EXECUTE TaskID 191 - Received from Master
2014-May-20 18:04:03.312966 [DEBUG] EXECUTE TaskID 191 - Waiting for an Available Executor
2014-May-20 18:04:03.313019 [DEBUG] EXECUTE TaskID 191 - Will be excuted at Executor Id 1
2014-May-20 18:04:03.313047 [DEBUG] EXECUTE TaskID 191 - Sending dobject Arguments to Executor.
2014-May-20 18:04:03.313083 [DEBUG] EXECUTE TaskID 191 - Sending Raw Arguments to Executor.
2014-May-20 18:04:03.314269 [DEBUG] EXECUTE TaskID 191 - Sending Function body to Executor.
2014-May-20 18:04:03.314319 [INFOR] EXECUTE TaskID 191 - Executing Function sent to Executor Id 1
2014-May-20 18:04:03.317986 [INFOR] Received Shutdown message from Master. Shutting down.
2014-May-20 18:04:03.318058 [INFOR] Worker Shutdown triggered.
2014-May-20 18:04:03.318113 [DEBUG] Total MB fetched: 0.00 MB
Total fetch time: 0.00 s
Total MB sent: 0.00 MB
Total send time: 0.00 s
Total cc time: 0.00 s
2014-May-20 18:04:03.318136 [DEBUG] PrestoWorker shutdown - joining threads
2014-May-20 18:04:03.318163 [DEBUG] PrestoWorker shutdown - joining threads for 0:0
2014-May-20 18:04:03.361034 [INFOR] EXECUTE TaskID 135 - Task Execution complete.
2014-May-20 18:04:03.361093 [ERROR] TASK_EXCEPTION : TaskID 135 execution failed at Executor 0 with message: first argument is not an open RODBC channel
2014-May-20 18:04:03.361120 [DEBUG] EXECUTE TaskID 135 - Updated variables read.
2014-May-20 18:04:03.361162 [INFOR] EXECUTE TaskID 135 - Sent TASKDONE message to Master
2014-May-20 18:04:03.423548 [INFOR] EXECUTE TaskID 191 - Task Execution complete.
2014-May-20 18:04:03.423608 [ERROR] TASK_EXCEPTION : TaskID 191 execution failed at Executor 1 with message: first argument is not an open RODBC channel
2014-May-20 18:04:03.423637 [DEBUG] EXECUTE TaskID 191 - Updated variables read.
2014-May-20 18:04:03.423678 [INFOR] EXECUTE TaskID 191 - Sent TASKDONE message to Master
2014-May-20 18:04:03.423831 [DEBUG] PrestoWorker shutdown - joining threads for 0:1
2014-May-20 18:04:03.423879 [DEBUG] PrestoWorker shutdown - joining threads for 1:0
2014-May-20 18:04:03.423988 [DEBUG] PrestoWorker shutdown - joining threads for 2:0
2014-May-20 18:04:03.424113 [DEBUG] PrestoWorker shutdown - joining threads for 2:1
2014-May-20 18:04:03.424154 [DEBUG] PrestoWorker shutdown - joining threads for 2:2
2014-May-20 18:04:03.424186 [DEBUG] PrestoWorker shutdown - joining threads for 2:3
2014-May-20 18:04:03.424222 [DEBUG] PrestoWorker shutdown - joining threads for 3:0
2014-May-20 18:04:03.424309 [DEBUG] PrestoWorker shutdown - joining threads for 3:1
2014-May-20 18:04:03.424345 [DEBUG] PrestoWorker shutdown - joining threads for 3:2
2014-May-20 18:04:03.424377 [DEBUG] PrestoWorker shutdown - joining threads for 3:3
2014-May-20 18:04:03.424411 [DEBUG] PrestoWorker shutdown - joining threads for 4:0
2014-May-20 18:04:03.424454 [DEBUG] PrestoWorker shutdown - joining threads for 5:0
2014-May-20 18:04:03.424521 [DEBUG] PrestoWorker shutdown - joining threads for 5:1
2014-May-20 18:04:03.424555 [INFOR] Worker shutdown - destroying executorpool
2014-May-20 18:04:03.424594 [DEBUG] Executorpool destructor: Waiting for child processes to join
2014-May-20 18:04:04.424751 [DEBUG] ExecutorPool desctructor: All child processes are terminated
2014-May-20 18:04:04.424874 [DEBUG] Executorpool destructor: Closing pipe descriptor
2014-May-20 18:04:04.424976 [DEBUG] Executorpool destructor: Closing semaphores
2014-May-20 18:04:04.425014 [DEBUG] Executorpool destructor: Removing shared memory segments
2014-May-20 18:04:04.425045 [INFOR] Worker shutdown - Removing shared memory segments
2014-May-20 18:04:04.425089 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_44_1
2014-May-20 18:04:04.425184 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_30_1
2014-May-20 18:04:04.425232 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_44_0
2014-May-20 18:04:04.425273 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_16_1
2014-May-20 18:04:04.425314 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_2_1
2014-May-20 18:04:04.425356 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_16_0
2014-May-20 18:04:04.425393 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_58_1
2014-May-20 18:04:04.425433 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_58_0
2014-May-20 18:04:04.425469 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_30_0
2014-May-20 18:04:04.425504 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_2_0
2014-May-20 18:04:04.425543 [INFOR] Worker shutdown - Removing sem lock : -1
2014-May-20 18:04:04.441980 [INFOR] Worker shutdown - Closing connection to other workers
2014-May-20 18:04:04.442421 [INFOR] Worker Shutdown complete.
Master Log:
...
2014-May-20 18:04:02.987563 [DEBUG] EXECUTE TaskID 119 - Initializing
2014-May-20 18:04:02.987613 [INFOR] EXECUTE TaskID 119 - Sent to Worker 192.168.100.19
2014-May-20 18:04:02.987645 [DEBUG] EXECUTE TaskID 121 - Initializing
2014-May-20 18:04:02.987700 [INFOR] EXECUTE TaskID 121 - Sent to Worker 192.168.100.22
2014-May-20 18:04:02.987733 [DEBUG] EXECUTE TaskID 123 - Initializing
2014-May-20 18:04:02.987781 [INFOR] EXECUTE TaskID 123 - Sent to Worker 192.168.100.24
2014-May-20 18:04:02.987810 [DEBUG] EXECUTE TaskID 125 - Initializing
2014-May-20 18:04:02.987868 [INFOR] EXECUTE TaskID 125 - Sent to Worker 192.168.100.20
2014-May-20 18:04:02.987898 [DEBUG] EXECUTE TaskID 127 - Initializing
2014-May-20 18:04:02.987944 [INFOR] EXECUTE TaskID 127 - Sent to Worker 192.168.100.25
2014-May-20 18:04:02.987977 [DEBUG] EXECUTE TaskID 129 - Initializing
2014-May-20 18:04:02.988025 [INFOR] EXECUTE TaskID 129 - Sent to Worker 192.168.100.23
2014-May-20 18:04:02.989353 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.989513 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.989551 [DEBUG] EXECUTE TaskID 9 - Received TASKDONE from Worker
2014-May-20 18:04:02.989580 [DEBUG] Adding Split R-shm-62544-1892232443_3_1 to 192.168.100.22:2020
2014-May-20 18:04:02.989622 [INFOR] EXECUTE TaskID 9 is complete.
2014-May-20 18:04:02.989674 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.989758 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.989786 [DEBUG] EXECUTE TaskID 37 - Received TASKDONE from Worker
2014-May-20 18:04:02.989810 [DEBUG] Adding Split R-shm-62544-1892232443_17_1 to 192.168.100.22:2020
2014-May-20 18:04:02.989857 [INFOR] EXECUTE TaskID 37 is complete.
2014-May-20 18:04:02.989934 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.990044 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.990082 [DEBUG] EXECUTE TaskID 31 - Received TASKDONE from Worker
2014-May-20 18:04:02.990107 [DEBUG] Adding Split R-shm-62544-1892232443_14_1 to 192.168.100.21:2020
2014-May-20 18:04:02.990138 [INFOR] EXECUTE TaskID 31 is complete.
2014-May-20 18:04:02.990179 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.990266 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.990294 [DEBUG] EXECUTE TaskID 19 - Received TASKDONE from Worker
2014-May-20 18:04:02.990321 [DEBUG] Adding Split R-shm-62544-1892232443_8_1 to 192.168.100.28:2020
2014-May-20 18:04:02.990351 [INFOR] EXECUTE TaskID 19 is complete.
2014-May-20 18:04:02.990391 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.990476 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.990504 [DEBUG] EXECUTE TaskID 15 - Received TASKDONE from Worker
2014-May-20 18:04:02.990529 [DEBUG] Adding Split R-shm-62544-1892232443_6_1 to 192.168.100.25:2020
2014-May-20 18:04:02.990561 [INFOR] EXECUTE TaskID 15 is complete.
2014-May-20 18:04:02.990602 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.990690 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.990718 [DEBUG] EXECUTE TaskID 21 - Received TASKDONE from Worker
2014-May-20 18:04:02.990743 [DEBUG] Adding Split R-shm-62544-1892232443_9_1 to 192.168.100.27:2020
2014-May-20 18:04:02.990772 [INFOR] EXECUTE TaskID 21 is complete.
2014-May-20 18:04:02.990811 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.990906 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.990935 [DEBUG] EXECUTE TaskID 23 - Received TASKDONE from Worker
2014-May-20 18:04:02.990960 [DEBUG] Adding Split R-shm-62544-1892232443_10_1 to 192.168.100.30:2020
2014-May-20 18:04:02.990989 [INFOR] EXECUTE TaskID 23 is complete.
2014-May-20 18:04:02.991029 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.991118 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.991147 [DEBUG] EXECUTE TaskID 13 - Received TASKDONE from Worker
2014-May-20 18:04:02.991172 [DEBUG] Adding Split R-shm-62544-1892232443_5_1 to 192.168.100.20:2020
2014-May-20 18:04:02.991201 [INFOR] EXECUTE TaskID 13 is complete.
2014-May-20 18:04:02.991240 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.991327 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.991354 [DEBUG] EXECUTE TaskID 3 - Received TASKDONE from Worker
2014-May-20 18:04:02.991379 [DEBUG] Adding Split R-shm-62544-1892232443_0_1 to 192.168.100.21:2020
2014-May-20 18:04:02.991408 [INFOR] EXECUTE TaskID 3 is complete.
2014-May-20 18:04:02.991447 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.991533 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.991561 [DEBUG] EXECUTE TaskID 47 - Received TASKDONE from Worker
2014-May-20 18:04:02.991585 [DEBUG] Adding Split R-shm-62544-1892232443_22_1 to 192.168.100.28:2020
2014-May-20 18:04:02.991614 [INFOR] EXECUTE TaskID 47 is complete.
2014-May-20 18:04:02.991653 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.991739 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.991766 [DEBUG] EXECUTE TaskID 43 - Received TASKDONE from Worker
2014-May-20 18:04:02.991791 [DEBUG] Adding Split R-shm-62544-1892232443_20_1 to 192.168.100.25:2020
2014-May-20 18:04:02.991819 [INFOR] EXECUTE TaskID 43 is complete.
2014-May-20 18:04:02.991858 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.991945 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.991972 [DEBUG] EXECUTE TaskID 49 - Received TASKDONE from Worker
2014-May-20 18:04:02.991996 [DEBUG] Adding Split R-shm-62544-1892232443_23_1 to 192.168.100.27:2020
2014-May-20 18:04:02.992026 [INFOR] EXECUTE TaskID 49 is complete.
2014-May-20 18:04:02.992069 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.992155 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.992182 [DEBUG] EXECUTE TaskID 51 - Received TASKDONE from Worker
2014-May-20 18:04:02.992207 [DEBUG] Adding Split R-shm-62544-1892232443_24_1 to 192.168.100.30:2020
2014-May-20 18:04:02.992235 [INFOR] EXECUTE TaskID 51 is complete.
2014-May-20 18:04:02.992274 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.992359 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.992386 [DEBUG] EXECUTE TaskID 41 - Received TASKDONE from Worker
2014-May-20 18:04:02.992411 [DEBUG] Adding Split R-shm-62544-1892232443_19_1 to 192.168.100.20:2020
2014-May-20 18:04:02.992439 [INFOR] EXECUTE TaskID 41 is complete.
2014-May-20 18:04:02.992484 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.992572 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.992600 [DEBUG] EXECUTE TaskID 7 - Received TASKDONE from Worker
2014-May-20 18:04:02.992625 [DEBUG] Adding Split R-shm-62544-1892232443_2_1 to 192.168.100.19:2020
2014-May-20 18:04:02.992654 [INFOR] EXECUTE TaskID 7 is complete.
2014-May-20 18:04:02.992698 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.992784 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.992812 [DEBUG] EXECUTE TaskID 45 - Received TASKDONE from Worker
2014-May-20 18:04:02.992837 [DEBUG] Adding Split R-shm-62544-1892232443_21_1 to 192.168.100.23:2020
2014-May-20 18:04:02.992866 [INFOR] EXECUTE TaskID 45 is complete.
2014-May-20 18:04:02.992904 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.992992 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.993020 [DEBUG] EXECUTE TaskID 11 - Received TASKDONE from Worker
2014-May-20 18:04:02.993045 [DEBUG] Adding Split R-shm-62544-1892232443_4_1 to 192.168.100.24:2020
2014-May-20 18:04:02.993080 [INFOR] EXECUTE TaskID 11 is complete.
2014-May-20 18:04:02.993119 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.993207 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.993234 [DEBUG] EXECUTE TaskID 29 - Received TASKDONE from Worker
2014-May-20 18:04:02.993259 [DEBUG] Adding Split R-shm-62544-1892232443_13_1 to 192.168.100.32:2020
2014-May-20 18:04:02.993287 [INFOR] EXECUTE TaskID 29 is complete.
2014-May-20 18:04:02.993325 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
2014-May-20 18:04:02.993442 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
2014-May-20 18:04:02.993475 [DEBUG] EXECUTE TaskID 35 - Received TASKDONE from Worker
2014-May-20 18:04:02.993503 [DEBUG] Adding Split R-shm-62544-1892232443_16_
> connect <- odbcConnect("Test")
Warning messages:
1: In odbcDriverConnect("DSN=Test") :
[vRODBC] ERROR: state IM002, code 0, message [unixODBC][Driver Manager]Data source name not found, and no default driver specified
2: In odbcDriverConnect("DSN=Test") : ODBC connection failed
Thanks for your report.
To clarify some of your queries.
1. No, it is not required to have Vertica installed on distributedR nodes. vRODBC is used for fetching data into R from Vertica DB on a remote cluster.
2. When you are trying to connect to the db you are getting:
"[vRODBC] ERROR: state IM002, code 0, message [unixODBC][Driver Manager]Data source name not found, and no default driver specified".
This suggests that its not able to find your DSN "Test". Can you confirm if you have set the $ODBCINI and $VERTICAINI environment variables on all worker nodes? $ODBCINI should contain the path of ODBC.INI file while $VERTICAINI should contain path of VERTICA.INI file.
3. Please ensure that vRODBC is installed and setup correctly on All worker nodes as provided in vRODBC Installation document provided with the vRODBC tarball. You can also test your vRODBC connection on each worker nodes on standard R before trying to run db2dframe().
4. It might happen connection requests and subsequent queries succeed from each Worker but upon running HPdata functions you still encounter "distributedR Exception: first argument is not an open vRODBC channel"
This is because in Vertica DB there is a configuration parameter: MaxClientSessions, which defines the number of active connections that Vertica can accept simultaneously.
SELECT GET_CONFIG_PARAMETER('MaxClientSessions');
If this number is less than Total number of instances in your distributedR session (which is distributedR_status()$Inst), then you may encounter "distributedR Exception: first argument is not an open vRODBC channel"
Please make sure that you set configuration parameter 'MaxClientSessions' to a number greater than the Total number of instances in your distributedR cluster. You can do this by issuing following query:
SELECT SET_CONFIG_PARAMETER('MaxClientSessions', <n>);
Lastly, if you are still facing issues with vRODBC connection, please share
- your odbc.ini and vertica.ini files which we can take a look at
- if you were able to test your vRODBC connection on each worker nodes and the result
Thanks,
Shreya
and everything worked. Thanks a bunch.
> loadedData <- db2dframe("RND", r, conf="Test", nSplits=90)
progress: 100%
distributedR Exception: first argument is not an open vRODBC channel
[Jesse@server18 ~]$ cat odbc.ini
[Test]
Description = vRODBC Test
Driver = /opt/vertica/lib64/libverticaodbc.so
Database = Test
Servername = server18
UserName = Jesse
Password = password
Port = 5433
ConnSettings =
Locale = en_US
[Jesse@server18 ~]$ cat vertica.ini
[Driver]
DriverManagerEncoding = UTF-16
ODBCInstLib = /usr/lib64/libodbcinst.so
ErrorMessagesPath = /opt/vertica/lib64
LogLevel = 0
LogPath = /tmp