vertica(docker) crashes in loop

rajatpaliwal86

The Vertica docker is crashing continuously
Below are the stack trace and error logged in the file. Pl

tail -f docker/catalog/athenadb/v_athenadb_node0001_catalog/vertica.log
2020-11-17 11:40:10.006 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11115 [Txn] Rollback Txn: a0000000b11115 'get the license'
2020-11-17 11:40:10.006 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11116 [Txn] Begin Txn: a0000000b11116 'figure out object oids'
2020-11-17 11:40:10.006 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11116 [Txn] Rollback Txn: a0000000b11116 'figure out object oids'
2020-11-17 11:40:10.009 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11117 [Txn] Begin Txn: a0000000b11117 'executing audit'
2020-11-17 11:40:10.019 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11117 [Main] Handling signal: 11
2020-11-17 11:40:11.270 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11117 [Main] Core dumped to /home/dbadmin/docker/catalog/athenadb/v_athenadb_node0001_catalog
2020-11-17 11:40:11.423 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11117 [Main] Received fatal signal SIGSEGV.
2020-11-17 11:40:11.423 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11117 [Main] Info: si_code: 1, si_pid: 0, si_uid: 0, si_addr: (nil)
2020-11-17 11:40:11.424 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11117 @v_athenadb_node0001: 01000/5440: Vertica suggests allowing 1 process/thread per MB of memory; see 'ulimit -u'
2020-11-17 11:40:11.424 LicenseSizeAuditor:0x7f2aa2fff700-a0000000b11117 @v_athenadb_node0001: 01000/5432: Vertica recommends allowing one memory map per 16KB of system memory; see 'max_map_count'

Below is the stacktrace as reported in the ErrorReport.txt
Backtrace Generated by Error
Signal: [0x000000000000000b] PID: [0x0000000000004fe4] PC: [0x0000000002275319] FP: [0x00007f2aa2febf50] SIGSEGV: SEGV_MAPERR SI_ADDR : [0x0000000000000000]
(ZN6Basics9Backtrace11DoBacktraceEiiPvS1+0x8bd) [0x47b5f9d]
(ZN6Basics20GlobalSignalHandlers14logFatalSignalEiPvS1+0xd0) [0x482a240]
(_ZN6BasicsL26sigHandler_withinATryCatchEiP7siginfoPv+0x467) [0x482b977]
(_ZN6BasicsL10sigHandlerEiP7siginfoPv+0xe) [0x482ba9e]
(_L_unlock_13+0x34) [0x7f2c546a3630]
(_ZN3CMD15isAuditedColumnEPKN3CAT10ProjColumnEPKNS0_5TableEsPKcRbb+0x189) [0x2275319]
(_ZN3CMD18getTotalCellCountsEbjyb+0x8b8) [0x227aa28]
(_ZN3CMD18getTotalCellCountsEbjyb+0x55b) [0x227a6cb]
(_ZN4Dist24GetNodeCellCountsMessage6invokeEv+0x3f) [0xd971af]
(_ZN4Dist9DistCalls27dispatchIncomingCallMessageERNS_14CallWireFormatERN6Basics10ByteBufferEPb+0x851) [0x9f3751]
(_ZN4Dist9DistCalls8sendCallEPNS_11DistMessageESt6vectorIySaIyEESs+0x5c60) [0x9fdc20]
(_ZN4Dist11DistMessage4sendESt6vectorIySaIyEESs+0xbd) [0xa18dad]
(_ZN4Dist9DistCalls17getNodeCellCountsEbjyb+0x94e) [0xa6c73e]
(_ZN3CMD12executeAuditERNS_19AuditCancelCallbackEddjybb+0x472) [0x22826f2]
(_ZN3CMD20internalAuditAndSaveEv+0x181) [0x2283cf1]
(_ZN3Mon18LicenseSizeAuditor15runTaskInternalEb+0x47) [0x3b29837]
(_ZN4Util16TimerServiceTask7runTaskEb+0x66) [0x4b268d6]
(_ZN4Util20TimerServiceTaskList18TaskSchedulingInfo10threadShimEPv+0x363) [0x4b29203]
(_ZN7Session13ThreadManager12launchThreadERKN5boost9function0IvEEPKc+0x86a) [0x45f57ba]
(_ZN7SessionL21doLaunchThreadWrapperEPv+0x13) [0x45f62b3]
(start_thread+0xc5) [0x7f2c5469bea5]
(clone+0x6d) [0x7f2c53fb88dd]
END BACKTRACE
THREAD CONTEXT
Thread type: Timer Thread
Request: Unknown request
Transaction: [0x00a0000000b111

Ariel_Cary

Hi. What Vertica version are you using? Did you upgrade recently?

Ariel_Cary

This is a known issue with the license auditor in 9.3.1. It was fixed in Vertica 9.3.1-4.

rajatpaliwal86

Vertica 9.3.1

rajatpaliwal86

@Ariel_Cary said:
Hi. What Vertica version are you using? Did you upgrade recently?

Vertica 9.3.1