Error creating a 3-node DB using Vertica 23.4.0

aoropezaaoropeza Vertica Customer ✭
edited March 2025 in General Discussion

I'm installing Vertica 23.4.0 and creating a 3-node database using the following commands:

rpm -Uvh "${V_RPM}"
/opt/vertica/sbin/install_vertica --hosts "${V_NODES}" --rpm "${V_RPM}" --data-dir "${V_DATA}" --dba-user-password ${U_PASS} --accept-eula --ssh-password "${U_PASS}" --license CE --clean --failure-threshold HINT
admintools --debug -t create_db -d "${V_DB}" -p "${V_PASS}" -D "${V_DATA}" -c "${V_CATALOG}" -s "${V_NODES}"

    Distributing changes to cluster.
            Creating database produccion
            Starting bootstrap node v_produccion_node0001 (X.X.X.X)
            Starting nodes: 
                    v_produccion_node0001 (X.X.X.X)
            Starting Vertica on all nodes. Please wait, databases with a large catalog may take a while to initialize.
            Creating database nodes
            Creating node v_produccion_node0002 (host X.X.X.X)
            Creating node v_produccion_node0003 (host X.X.X.X)
            Generating new configuration information
            Stopping single node db before adding additional nodes.
                    Database shutdown complete
            Starting all nodes
    Start hosts = ['X.X.X.X', 'X.X.X.X', 'X.X.X.X']
            Starting nodes: 
                    v_produccion_node0001 (X.X.X.X)
                    v_produccion_node0002 (X.X.X.X)
                    v_produccion_node0003 (X.X.X.X)
            Starting Vertica on all nodes. Please wait, databases with a large catalog may take a while to initialize.
            Node Status: v_produccion_node0001: (DOWN) v_produccion_node0002: (DOWN) v_produccion_node0003: (DOWN)

But I got stuck with the next prompt:

It is suggested that you continue waiting.
Do you want to continue waiting? You have 120 seconds to answer (yes/no) [yes]

Checking admintools.log I just see this:

2025-03-07 19:07:44.091 admintools/92319:0x7fe6238b2740 [ATDispatcher.exec_module] <INFO> PROFILE_MARKER dispatcher|end of execution for module<vertica.engine.api.db_client.module.DbClientModule object at 0x7fe618260490> time: 1741396064.0918708 Time taken: 0.6013238430023193
2025-03-07 19:07:44.092 admintools/92319:0x7fe6238b2740 [ATDispatcher.exec_module] <INFO> PROFILE_MARKER dispatcher|begin execution of <vertica.engine.api.db_client.module.DbClientModule object at 0x7fe618260790> time: 1741396064.092068
2025-03-07 19:07:44.092 admintools/92319:0x7fe6137fe700 [SSHConnection._exec_module_impl] <INFO> Running command X.X.X.X /opt/vertica/oss/python3/bin/python3 -m vertica.engine.api.at_runner --module=vertica.engine.api.db_client.module --semver=1.0.0  --debug-hosts= --debug-module=
#{"description": "get cluster status", "cluster_status": true, "database": "produccion", "port": 5433, "__rollback__": false, "__protocol__": "2.0"}
2025-03-07 19:17:31.800 at_exec/100397:0x7fafbf4d8740 [compute_vdatabase._get_spread_encryption_in_use] <INFO> ps output: Return code 0: Standard Out: '/opt/vertica/bin/vertica -D /catalog/produccion/v_produccion_node0001_catalog -C produccion -n v_produccion_node0001 -h X.X.X.X -p 5433 -P 4803 -Y ipv4
' Standard Error: ''
2025-03-07 19:17:31.800 at_exec/100397:0x7fafbf4d8740 [ATRunner.exec_module] <INFO> result: <ATResult> status=Completed host=None version=vertica.engine.api.compute_vdatabase/1.0.0 content={"vdatabase": {"nodes": [{"name": "v_produccion_node0001", "oid": "45035996273704982", "catalogpath": "/catalog/produccion/v_produccion_node0001_catalog", "storagelocs": ["/data/produccion/v_produccion_node0001_data"], "_vstorage_locations": [], "_communal_storage_location": null, "host": "X.X.X.X", "port": "5433", "controlnode": "45035996273704982", "startcmd": "\"/opt/vertica/bin/vertica\" \"-D\" \"/catalog/produccion/v_produccion_node0001_catalog\" \"-C\" \"produccion\" \"-n\" \"v_produccion_node0001\" \"-h\" \"X.X.X.X\" \"-p\" \"5433\" \"-P\" \"4803\" \"-Y\" \"ipv4\"", "isprimary": true}, {"name": "v_produccion_node0002", "oid": "45035996273707526", "catalogpath": "/catalog/produccion/v_produccion_node0002_catalog", "storagelocs": ["/data/produccion/v_produccion_node0002_data"], "_vstorage_locations": [], "_communal_storage_location": null, "host": "X.X.X.X", "port": "5433", "controlnode": "45035996273707526", "startcmd": "\"/opt/vertica/bin/vertica\" \"-D\" \"/catalog/produccion/v_produccion_node0002_catalog\" \"-C\" \"produccion\" \"-n\" \"v_produccion_node0002\" \"-h\" \"X.X.X.X\" \"-p\" \"5433\" \"-P\" \"4803\" \"-Y\" \"ipv4\"", "isprimary": true}, {"name": "v_produccion_node0003", "oid": "45035996273707530", "catalogpath": "/catalog/produccion/v_produccion_node0003_catalog", "storagelocs": ["/data/produccion/v_produccion_node0003_data"], "_vstorage_locations": [], "_communal_storage_location": null, "host": "X.X.X.X", "port": "5433", "controlnode": "45035996273707530", "startcmd": "\"/opt/vertica/bin/vertica\" \"-D\" \"/catalog/produccion/v_produccion_node0003_catalog\" \"-C\" \"produccion\" \"-n\" \"v_produccion_node0003\" \"-h\" \"X.X.X.X\" \"-p\" \"5433\" \"-P\" \"4803\" \"-Y\" \"ipv4\"", "isprimary": true}], "flags": {}, "name": "produccion", "version": 822, "spreadversion": 822, "controlmode": "broadcast", "deps": [["v_produccion_node0001"]], "willupgrade": false, "spreadEncryption": null, "spreadEncryptionInUse": false}, "runner_ack": true} error_message=None
2025-03-07 19:17:32.218 admintools/100286:0x7facb3ea7740 [ATDispatcher.exec_module] <INFO> PROFILE_MARKER dispatcher|end of execution for module<vertica.engine.api.compute_vdatabase.compute_vdatabase object at 0x7faca9045a10> time: 1741396652.2184615 Time taken: 0.7018287181854248
2025-03-07 19:17:32.218 admintools/100286:0x7facb3ea7740 [NewSSH.computeVDatabase] <WARNING> There was a problem running the catalog editor on host X.X.X.X. If all hosts have problems, then the database will not be able to start. Problem details: <ATResult> status=Error host=X.X.X.X version=Exception/100.0.0 error_type=<class 'KeyError'> error_message='oid'

        Stack Trace from Executor follows
Traceback (most recent call last):
  File "/opt/vertica/oss/python3/lib/python3.11/site-packages/vertica/engine/api/at_runner.py", line 75, in exec_module
    result = instance.execute(command)
             ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/opt/vertica/oss/python3/lib/python3.11/site-packages/vertica/engine/api/at_module_base.py", line 155, in wrapper
    result = func(*args, **kwargs)
             ^^^^^^^^^^^^^^^^^^^^^
  File "/opt/vertica/oss/python3/lib/python3.11/site-packages/vertica/engine/api/compute_vdatabase.py", line 91, in execute
    vdb_as_map = self._load_vdb(
                 ^^^^^^^^^^^^^^^
  File "/opt/vertica/oss/python3/lib/python3.11/site-packages/vertica/engine/api/compute_vdatabase.py", line 115, in _load_vdb
    db.loadFromCatalog(ce)
  File "/opt/vertica/oss/python3/lib/python3.11/site-packages/vertica/config/VDatabase.py", line 542, in loadFromCatalog
    vn.createFromEditor(ce,nodename)
  File "/opt/vertica/oss/python3/lib/python3.11/site-packages/vertica/config/VDatabase.py", line 99, in createFromEditor
    self.oid = nodedeets['oid']
               ~~~~~~~~~^^^^^^^
KeyError: 'oid'

Some ideas to resolve this?

Tagged:

Answers

  • SruthiASruthiA Administrator

    we need to review your environment. please create a support case.

This discussion has been closed.