Exception: RODBC issue when Loading Data From Vertica

These items work:
> library(vRODBC)
> connect <- odbcConnect("Test")
> segment <- sqlQuery(connect, "select * from RND LIMIT 2")

When I was using db2dframe, I got:
distributedR Exception: there is no package called ‘RODBC’

Then, I installed RODBC on all the Worker Nodes.
After that I got:
distributedR Exception: first argument is not an open RODBC channel

I tried to address it by setting up the odbc.ini and vertica.ini files on each computer.
If that was the correct thing to do, then I must have another issue because I am still receiving the same result.

My only other suspicion is that the port specified in odbc.ini is not open to the other nodes


Comments

  • Worker Log:
    2014-May-20 18:03:27.042547 [INFOR] Starting worker.
    2014-May-20 18:03:27.049574 [INFOR] Creating Executors in Worker
    2014-May-20 18:03:27.049896 [INFOR] Created new Executor 0 with Process ID 23652
    2014-May-20 18:03:27.050134 [INFOR] Created new Executor 1 with Process ID 23653
    2014-May-20 18:03:27.050420 [INFOR] Created HandleRequest threads to listen requests from Master
    2014-May-20 18:03:27.050469 [INFOR] Worker server19:2020 with 2 executors and 1794491596 Shared Memory
    2014-May-20 18:03:27.057900 [INFOR] Creating a connection for handshake with master 192.168.100.18:61841
    2014-May-20 18:03:27.058313 [INFOR] Worker opened connection to Master at 192.168.100.18:61841
    2014-May-20 18:03:27.058441 [INFOR] Sending reply with worker info: 192.168.100.19 2020
    2014-May-20 18:03:27.058629 [INFOR] HELLO Handshaking reply sent to Master. Master 192.168.100.18:61841 registered with Worker
    2014-May-20 18:03:27.079246 [DEBUG] Connected to master at tcp://192.168.100.18:61841
    2014-May-20 18:03:57.446336 [INFOR] New Request from Master of type HELLO received
    2014-May-20 18:03:57.446467 [INFOR] New HELLO Request received from Worker
    2014-May-20 18:03:57.446525 [INFOR] Sending reply with worker info: 192.168.100.19 2020
    2014-May-20 18:04:02.982289 [INFOR] New Request from Master of type NEWEXECR received
    2014-May-20 18:04:02.982414 [INFOR] New EXECUTE TaskID              7 - Received from Master
    2014-May-20 18:04:02.982879 [DEBUG] EXECUTE TaskID                  7 - Waiting for an Available Executor
    2014-May-20 18:04:02.982947 [DEBUG] EXECUTE TaskID                  7 - Will be excuted at Executor Id 0
    2014-May-20 18:04:02.982984 [DEBUG] EXECUTE TaskID                  7 - Sending dobject Arguments to Executor.
    2014-May-20 18:04:02.983050 [DEBUG] EXECUTE TaskID                  7 - Sending Function body to Executor.
    2014-May-20 18:04:02.983092 [INFOR] EXECUTE TaskID                  7 - Executing Function sent to Executor Id 0
    2014-May-20 18:04:02.983397 [INFOR] New Request from Master of type NEWEXECR received
    2014-May-20 18:04:02.983487 [INFOR] New EXECUTE TaskID             35 - Received from Master
    2014-May-20 18:04:02.983538 [DEBUG] EXECUTE TaskID                 35 - Waiting for an Available Executor
    2014-May-20 18:04:02.983577 [DEBUG] EXECUTE TaskID                 35 - Will be excuted at Executor Id 1
    2014-May-20 18:04:02.983610 [DEBUG] EXECUTE TaskID                 35 - Sending dobject Arguments to Executor.
    2014-May-20 18:04:02.983662 [DEBUG] EXECUTE TaskID                 35 - Sending Function body to Executor.
    2014-May-20 18:04:02.983701 [INFOR] EXECUTE TaskID                 35 - Executing Function sent to Executor Id 1
    2014-May-20 18:04:02.988456 [INFOR] EXECUTE TaskID                  7 - Task Execution complete.
    2014-May-20 18:04:02.988471 [INFOR] EXECUTE TaskID                 35 - Task Execution complete.
    2014-May-20 18:04:02.988538 [DEBUG] EXECUTE TaskID                  7 - Updated variables read.
    2014-May-20 18:04:02.988551 [DEBUG] EXECUTE TaskID                 35 - Updated variables read.
    2014-May-20 18:04:02.988619 [INFOR] EXECUTE TaskID                  7 - Sent TASKDONE message to Master
    2014-May-20 18:04:02.988685 [INFOR] New Request from Master of type NEWEXECR received
    2014-May-20 18:04:02.988620 [INFOR] EXECUTE TaskID                 35 - Sent TASKDONE message to Master
    2014-May-20 18:04:02.988728 [INFOR] New EXECUTE TaskID             63 - Received from Master
    2014-May-20 18:04:02.988772 [DEBUG] EXECUTE TaskID                 63 - Waiting for an Available Executor
    2014-May-20 18:04:02.988752 [INFOR] New Request from Master of type NEWEXECR received
    2014-May-20 18:04:02.988813 [DEBUG] EXECUTE TaskID                 63 - Will be excuted at Executor Id 0
    2014-May-20 18:04:02.988826 [INFOR] New EXECUTE TaskID             91 - Received from Master
    2014-May-20 18:04:02.988862 [DEBUG] EXECUTE TaskID                 63 - Sending dobject Arguments to Executor.
    2014-May-20 18:04:02.988880 [DEBUG] EXECUTE TaskID                 91 - Waiting for an Available Executor
    2014-May-20 18:04:02.988917 [DEBUG] EXECUTE TaskID                 91 - Will be excuted at Executor Id 1
    2014-May-20 18:04:02.988971 [DEBUG] EXECUTE TaskID                 91 - Sending dobject Arguments to Executor.
    2014-May-20 18:04:02.989017 [DEBUG] EXECUTE TaskID                 91 - Sending Function body to Executor.
    2014-May-20 18:04:02.988905 [DEBUG] EXECUTE TaskID                 63 - Sending Function body to Executor.
    2014-May-20 18:04:02.989056 [INFOR] EXECUTE TaskID                 91 - Executing Function sent to Executor Id 1
    2014-May-20 18:04:02.989078 [INFOR] EXECUTE TaskID                 63 - Executing Function sent to Executor Id 0
    2014-May-20 18:04:03.101355 [INFOR] EXECUTE TaskID                 63 - Task Execution complete.
    2014-May-20 18:04:03.101414 [DEBUG] EXECUTE TaskID                 63 - Updated variables read.
    2014-May-20 18:04:03.101458 [INFOR] EXECUTE TaskID                 63 - Sent TASKDONE message to Master
    2014-May-20 18:04:03.101495 [INFOR] New Request from Master of type NEWEXECR received
    2014-May-20 18:04:03.101519 [INFOR] New EXECUTE TaskID            119 - Received from Master
    2014-May-20 18:04:03.101548 [DEBUG] EXECUTE TaskID                119 - Waiting for an Available Executor
    2014-May-20 18:04:03.101572 [DEBUG] EXECUTE TaskID                119 - Will be excuted at Executor Id 0
    2014-May-20 18:04:03.101594 [DEBUG] EXECUTE TaskID                119 - Sending dobject Arguments to Executor.
    2014-May-20 18:04:03.101621 [DEBUG] EXECUTE TaskID                119 - Sending Function body to Executor.
    2014-May-20 18:04:03.101645 [INFOR] EXECUTE TaskID                119 - Executing Function sent to Executor Id 0
    2014-May-20 18:04:03.101881 [INFOR] EXECUTE TaskID                 91 - Task Execution complete.
    2014-May-20 18:04:03.101923 [DEBUG] EXECUTE TaskID                 91 - Updated variables read.
    2014-May-20 18:04:03.101958 [INFOR] EXECUTE TaskID                 91 - Sent TASKDONE message to Master
    2014-May-20 18:04:03.212236 [INFOR] EXECUTE TaskID                119 - Task Execution complete.
    2014-May-20 18:04:03.212307 [DEBUG] EXECUTE TaskID                119 - Updated variables read.
    2014-May-20 18:04:03.212351 [INFOR] EXECUTE TaskID                119 - Sent TASKDONE message to Master
    2014-May-20 18:04:03.244535 [INFOR] New Request from Master of type NEWEXECR received
    2014-May-20 18:04:03.244627 [INFOR] New EXECUTE TaskID            135 - Received from Master
    2014-May-20 18:04:03.244697 [DEBUG] EXECUTE TaskID                135 - Waiting for an Available Executor
    2014-May-20 18:04:03.244726 [DEBUG] EXECUTE TaskID                135 - Will be excuted at Executor Id 0
    2014-May-20 18:04:03.244747 [DEBUG] EXECUTE TaskID                135 - Sending dobject Arguments to Executor.
    2014-May-20 18:04:03.244794 [DEBUG] EXECUTE TaskID                135 - Sending Raw Arguments to Executor.
    2014-May-20 18:04:03.245855 [DEBUG] EXECUTE TaskID                135 - Sending Function body to Executor.
    2014-May-20 18:04:03.245915 [INFOR] EXECUTE TaskID                135 - Executing Function sent to Executor Id 0
    2014-May-20 18:04:03.250157 [INFOR] New Request from Master of type NEWEXECR received
    2014-May-20 18:04:03.250246 [INFOR] New EXECUTE TaskID            163 - Received from Master
    2014-May-20 18:04:03.250308 [DEBUG] EXECUTE TaskID                163 - Waiting for an Available Executor
    2014-May-20 18:04:03.250336 [DEBUG] EXECUTE TaskID                163 - Will be excuted at Executor Id 1
    2014-May-20 18:04:03.250358 [DEBUG] EXECUTE TaskID                163 - Sending dobject Arguments to Executor.
    2014-May-20 18:04:03.250390 [DEBUG] EXECUTE TaskID                163 - Sending Raw Arguments to Executor.
    2014-May-20 18:04:03.251438 [DEBUG] EXECUTE TaskID                163 - Sending Function body to Executor.
    2014-May-20 18:04:03.251497 [INFOR] EXECUTE TaskID                163 - Executing Function sent to Executor Id 1
    2014-May-20 18:04:03.312418 [INFOR] EXECUTE TaskID                163 - Task Execution complete.
    2014-May-20 18:04:03.312517 [ERROR] TASK_EXCEPTION : TaskID 163 execution failed at Executor 1 with message: first argument is not an open RODBC channel
    2014-May-20 18:04:03.312591 [DEBUG] EXECUTE TaskID                163 - Updated variables read.
    2014-May-20 18:04:03.312671 [INFOR] EXECUTE TaskID                163 - Sent TASKDONE message to Master
    2014-May-20 18:04:03.312810 [INFOR] New Request from Master of type NEWEXECR received
    2014-May-20 18:04:03.312891 [INFOR] New EXECUTE TaskID            191 - Received from Master
    2014-May-20 18:04:03.312966 [DEBUG] EXECUTE TaskID                191 - Waiting for an Available Executor
    2014-May-20 18:04:03.313019 [DEBUG] EXECUTE TaskID                191 - Will be excuted at Executor Id 1
    2014-May-20 18:04:03.313047 [DEBUG] EXECUTE TaskID                191 - Sending dobject Arguments to Executor.
    2014-May-20 18:04:03.313083 [DEBUG] EXECUTE TaskID                191 - Sending Raw Arguments to Executor.
    2014-May-20 18:04:03.314269 [DEBUG] EXECUTE TaskID                191 - Sending Function body to Executor.
    2014-May-20 18:04:03.314319 [INFOR] EXECUTE TaskID                191 - Executing Function sent to Executor Id 1
    2014-May-20 18:04:03.317986 [INFOR] Received Shutdown message from Master. Shutting down.
    2014-May-20 18:04:03.318058 [INFOR] Worker Shutdown triggered.
    2014-May-20 18:04:03.318113 [DEBUG] Total MB fetched:    0.00 MB
    Total fetch time:    0.00 s
    Total MB   sent:    0.00 MB
    Total send time:    0.00 s
    Total cc time:    0.00 s
    2014-May-20 18:04:03.318136 [DEBUG] PrestoWorker shutdown - joining threads
    2014-May-20 18:04:03.318163 [DEBUG] PrestoWorker shutdown - joining threads for 0:0
    2014-May-20 18:04:03.361034 [INFOR] EXECUTE TaskID                135 - Task Execution complete.
    2014-May-20 18:04:03.361093 [ERROR] TASK_EXCEPTION : TaskID 135 execution failed at Executor 0 with message: first argument is not an open RODBC channel
    2014-May-20 18:04:03.361120 [DEBUG] EXECUTE TaskID                135 - Updated variables read.
    2014-May-20 18:04:03.361162 [INFOR] EXECUTE TaskID                135 - Sent TASKDONE message to Master
    2014-May-20 18:04:03.423548 [INFOR] EXECUTE TaskID                191 - Task Execution complete.
    2014-May-20 18:04:03.423608 [ERROR] TASK_EXCEPTION : TaskID 191 execution failed at Executor 1 with message: first argument is not an open RODBC channel
    2014-May-20 18:04:03.423637 [DEBUG] EXECUTE TaskID                191 - Updated variables read.
    2014-May-20 18:04:03.423678 [INFOR] EXECUTE TaskID                191 - Sent TASKDONE message to Master
    2014-May-20 18:04:03.423831 [DEBUG] PrestoWorker shutdown - joining threads for 0:1
    2014-May-20 18:04:03.423879 [DEBUG] PrestoWorker shutdown - joining threads for 1:0
    2014-May-20 18:04:03.423988 [DEBUG] PrestoWorker shutdown - joining threads for 2:0
    2014-May-20 18:04:03.424113 [DEBUG] PrestoWorker shutdown - joining threads for 2:1
    2014-May-20 18:04:03.424154 [DEBUG] PrestoWorker shutdown - joining threads for 2:2
    2014-May-20 18:04:03.424186 [DEBUG] PrestoWorker shutdown - joining threads for 2:3
    2014-May-20 18:04:03.424222 [DEBUG] PrestoWorker shutdown - joining threads for 3:0
    2014-May-20 18:04:03.424309 [DEBUG] PrestoWorker shutdown - joining threads for 3:1
    2014-May-20 18:04:03.424345 [DEBUG] PrestoWorker shutdown - joining threads for 3:2
    2014-May-20 18:04:03.424377 [DEBUG] PrestoWorker shutdown - joining threads for 3:3
    2014-May-20 18:04:03.424411 [DEBUG] PrestoWorker shutdown - joining threads for 4:0
    2014-May-20 18:04:03.424454 [DEBUG] PrestoWorker shutdown - joining threads for 5:0
    2014-May-20 18:04:03.424521 [DEBUG] PrestoWorker shutdown - joining threads for 5:1
    2014-May-20 18:04:03.424555 [INFOR] Worker shutdown - destroying executorpool
    2014-May-20 18:04:03.424594 [DEBUG] Executorpool destructor: Waiting for child processes to join
    2014-May-20 18:04:04.424751 [DEBUG] ExecutorPool desctructor: All child processes are terminated
    2014-May-20 18:04:04.424874 [DEBUG] Executorpool destructor: Closing pipe descriptor
    2014-May-20 18:04:04.424976 [DEBUG] Executorpool destructor: Closing semaphores
    2014-May-20 18:04:04.425014 [DEBUG] Executorpool destructor: Removing shared memory segments
    2014-May-20 18:04:04.425045 [INFOR] Worker shutdown - Removing shared memory segments
    2014-May-20 18:04:04.425089 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_44_1
    2014-May-20 18:04:04.425184 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_30_1
    2014-May-20 18:04:04.425232 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_44_0
    2014-May-20 18:04:04.425273 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_16_1
    2014-May-20 18:04:04.425314 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_2_1
    2014-May-20 18:04:04.425356 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_16_0
    2014-May-20 18:04:04.425393 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_58_1
    2014-May-20 18:04:04.425433 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_58_0
    2014-May-20 18:04:04.425469 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_30_0
    2014-May-20 18:04:04.425504 [DEBUG] Removing shared memory object: R-shm-62544-1892232443_2_0
    2014-May-20 18:04:04.425543 [INFOR] Worker shutdown - Removing sem lock : -1
    2014-May-20 18:04:04.441980 [INFOR] Worker shutdown - Closing connection to other workers
    2014-May-20 18:04:04.442421 [INFOR] Worker Shutdown complete.

    Master Log:
    ...
    2014-May-20 18:04:02.987563 [DEBUG] EXECUTE TaskID            119 - Initializing
    2014-May-20 18:04:02.987613 [INFOR] EXECUTE TaskID            119 - Sent to Worker 192.168.100.19
    2014-May-20 18:04:02.987645 [DEBUG] EXECUTE TaskID            121 - Initializing
    2014-May-20 18:04:02.987700 [INFOR] EXECUTE TaskID            121 - Sent to Worker 192.168.100.22
    2014-May-20 18:04:02.987733 [DEBUG] EXECUTE TaskID            123 - Initializing
    2014-May-20 18:04:02.987781 [INFOR] EXECUTE TaskID            123 - Sent to Worker 192.168.100.24
    2014-May-20 18:04:02.987810 [DEBUG] EXECUTE TaskID            125 - Initializing
    2014-May-20 18:04:02.987868 [INFOR] EXECUTE TaskID            125 - Sent to Worker 192.168.100.20
    2014-May-20 18:04:02.987898 [DEBUG] EXECUTE TaskID            127 - Initializing
    2014-May-20 18:04:02.987944 [INFOR] EXECUTE TaskID            127 - Sent to Worker 192.168.100.25
    2014-May-20 18:04:02.987977 [DEBUG] EXECUTE TaskID            129 - Initializing
    2014-May-20 18:04:02.988025 [INFOR] EXECUTE TaskID            129 - Sent to Worker 192.168.100.23
    2014-May-20 18:04:02.989353 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.989513 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.989551 [DEBUG] EXECUTE TaskID              9 - Received TASKDONE from Worker
    2014-May-20 18:04:02.989580 [DEBUG] Adding Split R-shm-62544-1892232443_3_1 to 192.168.100.22:2020
    2014-May-20 18:04:02.989622 [INFOR] EXECUTE TaskID              9 is complete.
    2014-May-20 18:04:02.989674 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.989758 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.989786 [DEBUG] EXECUTE TaskID             37 - Received TASKDONE from Worker
    2014-May-20 18:04:02.989810 [DEBUG] Adding Split R-shm-62544-1892232443_17_1 to 192.168.100.22:2020
    2014-May-20 18:04:02.989857 [INFOR] EXECUTE TaskID             37 is complete.
    2014-May-20 18:04:02.989934 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.990044 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.990082 [DEBUG] EXECUTE TaskID             31 - Received TASKDONE from Worker
    2014-May-20 18:04:02.990107 [DEBUG] Adding Split R-shm-62544-1892232443_14_1 to 192.168.100.21:2020
    2014-May-20 18:04:02.990138 [INFOR] EXECUTE TaskID             31 is complete.
    2014-May-20 18:04:02.990179 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.990266 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.990294 [DEBUG] EXECUTE TaskID             19 - Received TASKDONE from Worker
    2014-May-20 18:04:02.990321 [DEBUG] Adding Split R-shm-62544-1892232443_8_1 to 192.168.100.28:2020
    2014-May-20 18:04:02.990351 [INFOR] EXECUTE TaskID             19 is complete.
    2014-May-20 18:04:02.990391 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.990476 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.990504 [DEBUG] EXECUTE TaskID             15 - Received TASKDONE from Worker
    2014-May-20 18:04:02.990529 [DEBUG] Adding Split R-shm-62544-1892232443_6_1 to 192.168.100.25:2020
    2014-May-20 18:04:02.990561 [INFOR] EXECUTE TaskID             15 is complete.
    2014-May-20 18:04:02.990602 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.990690 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.990718 [DEBUG] EXECUTE TaskID             21 - Received TASKDONE from Worker
    2014-May-20 18:04:02.990743 [DEBUG] Adding Split R-shm-62544-1892232443_9_1 to 192.168.100.27:2020
    2014-May-20 18:04:02.990772 [INFOR] EXECUTE TaskID             21 is complete.
    2014-May-20 18:04:02.990811 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.990906 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.990935 [DEBUG] EXECUTE TaskID             23 - Received TASKDONE from Worker
    2014-May-20 18:04:02.990960 [DEBUG] Adding Split R-shm-62544-1892232443_10_1 to 192.168.100.30:2020
    2014-May-20 18:04:02.990989 [INFOR] EXECUTE TaskID             23 is complete.
    2014-May-20 18:04:02.991029 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.991118 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.991147 [DEBUG] EXECUTE TaskID             13 - Received TASKDONE from Worker
    2014-May-20 18:04:02.991172 [DEBUG] Adding Split R-shm-62544-1892232443_5_1 to 192.168.100.20:2020
    2014-May-20 18:04:02.991201 [INFOR] EXECUTE TaskID             13 is complete.
    2014-May-20 18:04:02.991240 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.991327 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.991354 [DEBUG] EXECUTE TaskID              3 - Received TASKDONE from Worker
    2014-May-20 18:04:02.991379 [DEBUG] Adding Split R-shm-62544-1892232443_0_1 to 192.168.100.21:2020
    2014-May-20 18:04:02.991408 [INFOR] EXECUTE TaskID              3 is complete.
    2014-May-20 18:04:02.991447 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.991533 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.991561 [DEBUG] EXECUTE TaskID             47 - Received TASKDONE from Worker
    2014-May-20 18:04:02.991585 [DEBUG] Adding Split R-shm-62544-1892232443_22_1 to 192.168.100.28:2020
    2014-May-20 18:04:02.991614 [INFOR] EXECUTE TaskID             47 is complete.
    2014-May-20 18:04:02.991653 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.991739 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.991766 [DEBUG] EXECUTE TaskID             43 - Received TASKDONE from Worker
    2014-May-20 18:04:02.991791 [DEBUG] Adding Split R-shm-62544-1892232443_20_1 to 192.168.100.25:2020
    2014-May-20 18:04:02.991819 [INFOR] EXECUTE TaskID             43 is complete.
    2014-May-20 18:04:02.991858 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.991945 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.991972 [DEBUG] EXECUTE TaskID             49 - Received TASKDONE from Worker
    2014-May-20 18:04:02.991996 [DEBUG] Adding Split R-shm-62544-1892232443_23_1 to 192.168.100.27:2020
    2014-May-20 18:04:02.992026 [INFOR] EXECUTE TaskID             49 is complete.
    2014-May-20 18:04:02.992069 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.992155 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.992182 [DEBUG] EXECUTE TaskID             51 - Received TASKDONE from Worker
    2014-May-20 18:04:02.992207 [DEBUG] Adding Split R-shm-62544-1892232443_24_1 to 192.168.100.30:2020
    2014-May-20 18:04:02.992235 [INFOR] EXECUTE TaskID             51 is complete.
    2014-May-20 18:04:02.992274 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.992359 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.992386 [DEBUG] EXECUTE TaskID             41 - Received TASKDONE from Worker
    2014-May-20 18:04:02.992411 [DEBUG] Adding Split R-shm-62544-1892232443_19_1 to 192.168.100.20:2020
    2014-May-20 18:04:02.992439 [INFOR] EXECUTE TaskID             41 is complete.
    2014-May-20 18:04:02.992484 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.992572 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.992600 [DEBUG] EXECUTE TaskID              7 - Received TASKDONE from Worker
    2014-May-20 18:04:02.992625 [DEBUG] Adding Split R-shm-62544-1892232443_2_1 to 192.168.100.19:2020
    2014-May-20 18:04:02.992654 [INFOR] EXECUTE TaskID              7 is complete.
    2014-May-20 18:04:02.992698 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.992784 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.992812 [DEBUG] EXECUTE TaskID             45 - Received TASKDONE from Worker
    2014-May-20 18:04:02.992837 [DEBUG] Adding Split R-shm-62544-1892232443_21_1 to 192.168.100.23:2020
    2014-May-20 18:04:02.992866 [INFOR] EXECUTE TaskID             45 is complete.
    2014-May-20 18:04:02.992904 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.992992 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.993020 [DEBUG] EXECUTE TaskID             11 - Received TASKDONE from Worker
    2014-May-20 18:04:02.993045 [DEBUG] Adding Split R-shm-62544-1892232443_4_1 to 192.168.100.24:2020
    2014-May-20 18:04:02.993080 [INFOR] EXECUTE TaskID             11 is complete.
    2014-May-20 18:04:02.993119 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.993207 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.993234 [DEBUG] EXECUTE TaskID             29 - Received TASKDONE from Worker
    2014-May-20 18:04:02.993259 [DEBUG] Adding Split R-shm-62544-1892232443_13_1 to 192.168.100.32:2020
    2014-May-20 18:04:02.993287 [INFOR] EXECUTE TaskID             29 is complete.
    2014-May-20 18:04:02.993325 [DEBUG] Updating new value of darray split R-shm-62544-1892232443
    2014-May-20 18:04:02.993442 [DEBUG] New value of darray split R-shm-62544-1892232443 updated
    2014-May-20 18:04:02.993475 [DEBUG] EXECUTE TaskID             35 - Received TASKDONE from Worker
    2014-May-20 18:04:02.993503 [DEBUG] Adding Split R-shm-62544-1892232443_16_
  • Hi Jesse, Thanks for reporting the issue. To use data loader in DistributedR, you need to make sure that RODBC or vRODBC is installed on each node of the D.R cluster. Even though you verified the vRODBC connection was opened initially, it's only open on the node you initiated. For DistributedR to load data to the cluster, each node must install RODBC or vRODBC and have the same vertica.ini and odbc.ini setup. Can you please check if each node is set up correctly?
  • I am currently trying to set up vRODBC on all worker nodes. I am having some trouble. If you know how to fix it off-hand, that would be very helpful. The error that I get when I test on a worker node is:

    > connect <- odbcConnect("Test")
    Warning messages:
    1: In odbcDriverConnect("DSN=Test") :
      [vRODBC] ERROR: state IM002, code 0, message [unixODBC][Driver Manager]Data source name not found, and no default driver specified
    2: In odbcDriverConnect("DSN=Test") : ODBC connection failed


  • Also, does Vertica need to be installed on every node because even though I installed vRODBC I cannot connect to vertica on the head node.
  • I believe that Vertica does not need to be installed on every node. But I'm curious as to what exactly the vertica.ini and odbc.ini are expected to be doing. I have researched unix-ODBC and have found that its odbc.ini and odbcinst.ini don't exactly match up. I'm afraid that I may have a port issue. But, I can't be sure of it or what to do next.
  • Basically I would just like some help in accessing my Vertica DB from another node using vRODBC, but I'm not sure the best way to go about trouble shooting it.
  • Hi Jesse,

    Thanks for your report.

    To clarify some of your queries.

    1. No, it is not required to have Vertica installed on distributedR nodes. vRODBC is used for fetching data into R from Vertica DB on a remote cluster.

    2. When you are trying to connect to the db you are getting:
    "[vRODBC] ERROR: state IM002, code 0, message [unixODBC][Driver Manager]Data source name not found, and no default driver specified".

    This suggests that its not able to find your DSN "Test". Can you confirm if you have set the $ODBCINI and $VERTICAINI environment variables on all worker nodes? $ODBCINI should contain the path of ODBC.INI file while $VERTICAINI should contain path of VERTICA.INI file.

    3. Please ensure that vRODBC is installed and setup correctly on All worker nodes as provided in vRODBC Installation document provided with the vRODBC tarball. You can also test your vRODBC connection on each worker nodes on standard R before trying to run db2dframe().

    4. It might happen connection requests and subsequent queries succeed from each Worker but upon running HPdata functions you still encounter "distributedR Exception: first argument is not an open vRODBC channel"
    This is because in Vertica DB there is a configuration parameter: MaxClientSessions, which defines the number of active connections that Vertica can accept simultaneously.
    SELECT GET_CONFIG_PARAMETER('MaxClientSessions');

    If this number is less than Total number of instances in your distributedR session (which is distributedR_status()$Inst), then you may encounter "distributedR Exception: first argument is not an open vRODBC channel"

    Please make sure that you set configuration parameter 'MaxClientSessions' to a number greater than the Total number of instances in your distributedR cluster. You can do this by issuing following query:
    SELECT SET_CONFIG_PARAMETER('MaxClientSessions', <n>);


    Lastly, if you are still facing issues with vRODBC connection, please share
    - your odbc.ini and vertica.ini files which we can take a look at
    - if you were able to test your vRODBC connection on each worker nodes and the result

    Thanks,
    Shreya
  • Thanks for the detailed response. I was setting the environment variable paths, but when I would log out they would disappear. I set them by editing the ~/.bash_profile
    and everything worked. Thanks a bunch.



  • Although I've managed to get vRODBC working on all workers. I have MaxClientSessions  = 50 > 30 = dr$Inst. I still get:
    > loadedData <- db2dframe("RND", r, conf="Test", nSplits=90)
    progress:  100%
    distributedR Exception: first argument is not an open vRODBC channel

    [Jesse@server18 ~]$ cat odbc.ini
    [Test]
    Description = vRODBC Test
    Driver = /opt/vertica/lib64/libverticaodbc.so
    Database = Test
    Servername = server18
    UserName = Jesse
    Password =  password
    Port = 5433
    ConnSettings =
    Locale = en_US

    [Jesse@server18 ~]$ cat vertica.ini
    [Driver]
    DriverManagerEncoding = UTF-16
    ODBCInstLib = /usr/lib64/libodbcinst.so
    ErrorMessagesPath = /opt/vertica/lib64
    LogLevel = 0
    LogPath = /tmp






Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file