database doesn't start after server reboot. Can you say where is problem?

I install vertica 7.0.0-0, create database, set it's restart policy to always, but it doesn't start after server reboot. Can you say where is problem?

Comments

  • Hi Alexandra

    Kindly provide us the admintool-root.log, admintools-vertica.log files from the server in order to drill this down further.

    Also provide us the output of the below command:

    $ admintools -t view_cluster

    Regards
    Rahul


  • Hi Rahul

    adminTools-root.log
    Jan 24 11:35:50  [adminExec.__init__] Unique Ports: False  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: ['[ -f /etc/fedora-release ]']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: (rc=1) []  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: ['[ -f /etc/redhat-release ]']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: ['egrep "release (5|6)" /etc/redhat-release']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: (rc=0) ['CentOS release 6.5 (Final)']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: ['LANG=C /sbin/ifconfig']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: (rc=0) ['eth0      Link encap:Ethernet  HWaddr 00:50:56:9B:2C:01  ', '          inet addr:192.168.1.33  Bcast:192.168.1.255  Mask:255.255.255.0', '          inet6 addr: fe80::250:56ff:fe9b:2c01/64 Scope:Link', '          UP BROADCAST RUNNING MULTICAST  MTU:1500  Metric:1', '          RX packets:1756 errors:0 dropped:0 overruns:0 frame:0', '          TX packets:817 errors:0 dropped:0 overruns:0 carrier:0', '          collisions:0 txqueuelen:1000 ', '          RX bytes:151751 (148.1 KiB)  TX bytes:146596 (143.1 KiB)', '', 'lo        Link encap:Local Loopback  ', '          inet addr:127.0.0.1  Mask:255.0.0.0', '          inet6 addr: ::1/128 Scope:Host', '          UP LOOPBACK RUNNING  MTU:16436  Metric:1', '          RX packets:2 errors:0 dropped:0 overruns:0 frame:0', '          TX packets:2 errors:0 dropped:0 overruns:0 carrier:0', '          collisions:0 txqueuelen:0 ', '          RX bytes:100 (100.0 b)  TX bytes:100 (100.0 b)']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: ['rpm -q vertica --qf "%{NAME} %{VERSION} %{RELEASE} %{ARCH}\\n"']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: (rc=0) ['vertica 7.0.0 0 x86_64']  Jan 24 11:35:50  [Profile.VerticaRelease] query results 'vertica 7.0.0 0 x86_64'  Jan 24 11:35:50  Hosts to add: ['192.168.1.33']  Jan 24 11:35:50  Hosts to remove: []  Jan 24 11:35:50  Hosts to update: []  Jan 24 11:35:50  Resulting cluster: ['192.168.1.33']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: ['echo 'if [ -e "/opt/vertica" ]; then cd /tmp; find /opt/vertica -perm -755 -type d | grep "/opt/vertica\\$"; else echo /opt/vertica; fi'']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: (rc=0) ['/opt/vertica']  Jan 24 11:35:50  RPM Check,  The same version is already installed  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:50  backing up admintools.conf on 192.168.1.33   Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: ['id dbadmin']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: (rc=0) ['uid=500(dbadmin) gid=500(verticadba) \xd0\xb3\xd1\x80\xd1\x83\xd0\xbf\xd0\xbf\xd1\x8b=500(verticadba)']  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:50  <BashAdapter: root@192.168.1.33>: ['VERT_DBA_USR=dbadmin VERT_DBA_HOME=/home/dbadmin VERT_DBA_GRP=verticadba /opt/vertica/oss/python/bin/python -m vertica.local_coerce']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['install --owner root --mode 700 -d /tmp/vstage-8fc0d59a-2da1-429b-8a6b-6a8b6b5321ff']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['cp -T /opt/vertica/log/verify-latest.xml /tmp/vstage-8fc0d59a-2da1-429b-8a6b-6a8b6b5321ff/file']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown root /tmp/vstage-8fc0d59a-2da1-429b-8a6b-6a8b6b5321ff/file']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['rm -rf /tmp/vstage-8fc0d59a-2da1-429b-8a6b-6a8b6b5321ff']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['install --owner dbadmin --mode 700 -d /tmp/vstage-73992b75-5ba2-47c8-b3a8-161391ccedbd']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ["su --login dbadmin --command '/opt/vertica/share/binlib/util/create-or-export-ssh-key -f /tmp/vstage-73992b75-5ba2-47c8-b3a8-161391ccedbd/id_rsa -u dbadmin'"]  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ["su --login dbadmin --command '/opt/vertica/share/binlib/util/install-ssh-key -f /tmp/vstage-73992b75-5ba2-47c8-b3a8-161391ccedbd/id_rsa -u dbadmin'"]  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) ['Backing up /home/dbadmin/.ssh/id_rsa.pub as /home/dbadmin/.ssh/id_rsa.pub.bak.1390548952']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['rm -rf /tmp/vstage-73992b75-5ba2-47c8-b3a8-161391ccedbd']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['/opt/vertica/sbin/vertica_service_setup.sh stop /opt/vertica RHEL5 spread']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['/opt/vertica/sbin/vertica_service_setup.sh remove /opt/vertica RHEL5 spread']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown dbadmin:verticadba  /opt/vertica/config']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown dbadmin:verticadba  /opt/vertica/config/share']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown dbadmin:verticadba  /opt/vertica/log']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['/opt/vertica/sbin/vertica_service_setup.sh stop /opt/vertica RHEL5 agent']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33> (Removing old agent links): ['/opt/vertica/sbin/vertica_service_setup.sh remove /opt/vertica RHEL5 agent']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33> (Setting up agent daemon): <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown dbadmin:verticadba /opt/vertica/config/share/agent.key']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown dbadmin:verticadba /opt/vertica/config/share/agent.cert']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown dbadmin:verticadba /opt/vertica/config/share/agent.pem']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chmod 400 /opt/vertica/config/share/agent.key']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chmod 400 /opt/vertica/config/share/agent.cert']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chmod 400 /opt/vertica/config/share/agent.pem']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33> (Setting up verticad autorestart): <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  Creating node node0001 definition for host 192.168.1.33  Jan 24 11:35:52  [adminExec.do_create_node] creating node w/ ['node0001', '192.168.1.33', '/home/dbadmin', '/home/dbadmin']  Jan 24 11:35:52  [adminExec.do_create_node] creating node w/ ['node0001', '192.168.1.33', '/home/dbadmin', '/home/dbadmin']  Jan 24 11:35:52  [adminExec.isNodeDefined] qry: '['node0001', '192.168.1.33', '/home/dbadmin', '/home/dbadmin']'  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: <command hidden>  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown dbadmin:verticadba /opt/vertica/config/admintools.conf']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chmod 0664 /opt/vertica/config/admintools.conf']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=0) []  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chown root:verticadba  /opt/vertica/config/d5415f948449e9d4c421b568f2411140.dat']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=1) ['chown: \xd0\xbd\xd0\xb5\xd0\xb2\xd0\xbe\xd0\xb7\xd0\xbc\xd0\xbe\xd0\xb6\xd0\xbd\xd0\xbe \xd0\xbf\xd0\xbe\xd0\xbb\xd1\x83\xd1\x87\xd0\xb8\xd1\x82\xd1\x8c \xd0\xb4\xd0\xbe\xd1\x81\xd1\x82\xd1\x83\xd0\xbf \xd0\xba \xc2\xab/opt/vertica/config/d5415f948449e9d4c421b568f2411140.dat\xc2\xbb: \xd0\x9d\xd0\xb5\xd1\x82 \xd1\x82\xd0\xb0\xd0\xba\xd0\xbe\xd0\xb3\xd0\xbe \xd1\x84\xd0\xb0\xd0\xb9\xd0\xbb\xd0\xb0 \xd0\xb8\xd0\xbb\xd0\xb8 \xd0\xba\xd0\xb0\xd1\x82\xd0\xb0\xd0\xbb\xd0\xbe\xd0\xb3\xd0\xb0']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: ['chmod 664 /opt/vertica/config/d5415f948449e9d4c421b568f2411140.dat']  Jan 24 11:35:52  <BashAdapter: root@192.168.1.33>: (rc=1) ['chmod: \xd0\xbd\xd0\xb5\xd0\xb2\xd0\xbe\xd0\xb7\xd0\xbc\xd0\xbe\xd0\xb6\xd0\xbd\xd0\xbe \xd0\xbf\xd0\xbe\xd0\xbb\xd1\x83\xd1\x87\xd0\xb8\xd1\x82\xd1\x8c \xd0\xb4\xd0\xbe\xd1\x81\xd1\x82\xd1\x83\xd0\xbf \xd0\xba \xc2\xab/opt/vertica/config/d5415f948449e9d4c421b568f2411140.dat\xc2\xbb: \xd0\x9d\xd0\xb5\xd1\x82 \xd1\x82\xd0\xb0\xd0\xba\xd0\xbe\xd0\xb3\xd0\xbe \xd1\x84\xd0\xb0\xd0\xb9\xd0\xbb\xd0\xb0 \xd0\xb8\xd0\xbb\xd0\xb8 \xd0\xba\xd0\xb0\xd1\x82\xd0\xb0\xd0\xbb\xd0\xbe\xd0\xb3\xd0\xb0']  Jan 24 11:35:52  Running upgrade logic  Jan 24 11:35:53  <BashAdapter: root@192.168.1.33>: ['[ -e /opt/vertica/config/vspread.conf ]']  Jan 24 11:35:53  <BashAdapter: root@192.168.1.33>: (rc=1) []  Jan 24 11:35:53  No spread upgrade required: /opt/vertica/config/vspread.conf not found on any node
     I can't find admintools-vertica.log. There is no files with name like this.

    The output of this command (admintools -t view_cluster), but I started database from admintools before:
     DB   | Host | State
    ------+------+------- 
    main | ALL  | UP

    main is the name of my database
  • Hi Alexndra

    The output of the below command clearly indicates that your database is currently up & running 

    $admintools -t view_cluster

    DB   | Host | State
    ------+------+------- 
    main | ALL  | UP


    Can you kindly let me now whether you are able to invoke the admintools &  check the View Database Cluster state?


    Regards
    Rahul
  • Hi Alexndra

    The output of the below command clearly indicates that your database is currently up & running 

    $admintools -t view_cluster

    DB   | Host | State
    ------+------+------- 
    main | ALL  | UP


    Can you kindly let me now whether you are able to invoke the admintools &  check the View Database Cluster state?


    Regards
    Rahul
  • Hi Rahul
    Yes, now my database is currently up and running, but if I restart my server, the result of command "admintools -t view_cluster" is:
      DB   | Host | State
    ------+------+------- 
    main | ALL  | DOWN
  • Alexndra

    Can you kindly let me know how many nodes you have in your cluster?Also is your database K-safe?

    Provide me the output of below command:

    $ admintools -t list_allnodes


    Regards
    Rahul
  • I have just one node, so it is mean that my database is not K-safe, isn't it?
     admintools -t list_allnodes
     Node                     |        Host         |   State   | Version           | DB
    ------------------------+------------------+-----------+-------------------+------ 
    v_main_node0001 | 192.168.1.33  | DOWN  | vertica-7.0.0.000 | main

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Emoji
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file