Verica received <PANIC> Received fatal signal SIGSEGV.
I'm trying to ingest data from kafka to vertica using vkconfig. After working some time I got ~46 M reconds in flex table.After that vertica crashes receiving SIGSEGV. After restart and starting ingesting again vertica crashes again. Part of log in /home/dbadmin/testdb/v_testdb_node0001_catalog/vertica.log
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE] (a000000004e788) TM moveout: Wos row count = 1, Wos delete row count = 0
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE] (a000000004e788) Skipping replay delete due to lack of deletes.
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE] (a000000004e788) Executing DVWos moveout plans
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE] (a000000004e788) getMiniROSsForDVWosMoveout: No DVWOSs to moveout
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE] (a000000004e788) Deleting Wos and DV contents
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE] (a000000004e788) Dropping source WOSs
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE] 45035996273870675
2015-11-25 14:08:08.557 TM Moveout:0x7fe90c012940-a000000004e788 [EE] (a000000004e788) Moved out 16384 bytes
2015-11-25 14:08:08.559 TM Moveout:0x7fe90c012940-a000000004e788 [EE] Moveout projection kafka_config.kafka_events_super - done
2015-11-25 14:08:08.559 TM Moveout:0x7fe90c012940-a000000004e788 [Txn] Starting Commit: Txn: a000000004e788 'Moveout: (Table: kafka_config.kafka_events) (Projection: kafka_config.kafka_events_super)'
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940 [Txn] Commit Complete: Txn: a000000004e788 at epoch 0x8c
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940 [TM] Tuple Mover: moved out projection kafka_events_super
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940-a000000004e78c [Txn] Begin Txn: a000000004e78c 'Moveout: Tuple Mover'
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940-a000000004e78c [Txn] Rollback Txn: a000000004e78c 'Moveout: Tuple Mover'
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940 [Util] Task 'TM Moveout' enabled
2015-11-25 14:08:09.037 EEcmdq:0x7fe8e80060b0 [Main] Handling signal: 11
2015-11-25 14:08:09.168 EEcmdq:0x7fe8e80060b0 [Main] Received fatal signal SIGSEGV.
2015-11-25 14:08:09.168 EEcmdq:0x7fe8e80060b0 [Main] Info: si_code: 2, si_pid: -1675866112, si_uid: 32743, si_addr: 0x7fe79c1c5000
Part of /home/dbadmin/testdb/v_testdb_node0001_catalog/ErrorReport.txt
Backtrace Generated by Error
Signal: [0x000000000000000b] PID: [0x000000000000987b] PC: [0x00007fe33f8a3665] FP: [0x00007fe26a43ba90] SIGSEGV: SEGV_ACCERR SI_ADDR : [0x00007fe15c6a0ffc]
/opt/vertica/bin/vertica[0x2fca8f7]
/opt/vertica/bin/vertica[0x3017084]
/opt/vertica/bin/vertica[0x30182e9]
/lib/x86_64-linux-gnu/libc.so.6(+0x36150)[0x7fe33f78b150]
/lib/x86_64-linux-gnu/libc.so.6(+0x14e665)[0x7fe33f8a3665]
/opt/vertica/bin/vertica[0x12cbca4]
/opt/vertica/bin/vertica[0x1138779]
/opt/vertica/bin/vertica[0x12ce4f7]
/opt/vertica/bin/vertica[0x12cb039]
/opt/vertica/bin/vertica[0x12cb4c2]
/opt/vertica/bin/vertica[0x113b567]
/opt/vertica/bin/vertica[0x111de7a]
/opt/vertica/bin/vertica[0xff048a]
/opt/vertica/bin/vertica[0xff4680]
/opt/vertica/bin/vertica[0xa935c7]
/lib/x86_64-linux-gnu/libc.so.6(+0x48300)[0x7fe33f79d300]
END BACKTRACE
THREAD CONTEXT
Thread type: EE Internal Command Queue Thread
Request: COPY "public"."kafka_tgt" SOURCE KafkaSource(stream='click_user_input|0|126338314,click_user_input|1|-2,click_user_input|2|-2,click_user_input|3|-2,click_user_input|4|-2', brokers='datahub-23:9092', duration=interval '9930 milliseconds', stop_on_eof=true, executionparallelism=1 ) PARSER KafkaParser( ) REJECTED DATA AS TABLE public.kafka_rej TRICKLE NO COMMIT
0: Root
85: GroupByNothing
84: DataTarget
FAULT => 1: NewEENode
2) ExprEval depth=(0) parent=0, peer#0; outTup nCol=3,nkey=0,inlSz=130024,fixSz=24
3) LoadUnion (1) 2, #0; nInputs=40; out 1,0,130008,8
4) ExprEval (2) 3, #0; out 1,0,130008,8
5) Load (3) 4, #0; CRPstate=2; out 1,0,130008,8
6) ExprEval (2) 3, #1; out 1,0,130008,8
(PPFAULT) => Load (id=7) (3) 6, #1; CRPstate=2; out 1,0,130008,8
8) ExprEval (2) 3, #2; out 1,0,130008,8
9) Load (3) 8, #2; CRPstate=2; out 1,0,130008,8
10) ExprEval (2) 3, #3; out 1,0,130008,8
11) Load (3) 10, #3; CRPstate=2; out 1,0,130008,8
12) ExprEval (2) 3, #4; out 1,0,130008,8
13) Load (3) 12, #4; CRPstate=2; out 1,0,130008,8
14) ExprEval (2) 3, #5; out 1,0,130008,8
15) Load (3) 14, #5; CRPstate=2; out 1,0,130008,8
16) ExprEval (2) 3, #6; out 1,0,130008,8
17) Load (3) 16, #6; CRPstate=2; out 1,0,130008,8
18) ExprEval (2) 3, #7; out 1,0,130008,8
19) Load (3) 18, #7; CRPstate=2; out 1,0,130008,8
20) ExprEval (2) 3, #8; out 1,0,130008,8
21) Load (3) 20, #8; CRPstate=2; out 1,0,130008,8
22) ExprEval (2) 3, #9; out 1,0,130008,8
23) Load (3) 22, #9; CRPstate=2; out 1,0,130008,8
24) ExprEval (2) 3, #10; out 1,0,130008,8
25) Load (3) 24, #10; CRPstate=2; out 1,0,130008,8
26) ExprEval (2) 3, #11; out 1,0,130008,8
27) Load (3) 26, #11; CRPstate=2; out 1,0,130008,8
28) ExprEval (2) 3, #12; out 1,0,130008,8
29) Load (3) 28, #12; CRPstate=2; out 1,0,130008,8
30) ExprEval (2) 3, #13; out 1,0,130008,8
31) Load (3) 30, #13; CRPstate=2; out 1,0,130008,8
32) ExprEval (2) 3, #14; out 1,0,130008,8
33) Load (3) 32, #14; CRPstate=2; out 1,0,130008,8
34) ExprEval (2) 3, #15; out 1,0,130008,8
35) Load (3) 34, #15; CRPstate=2; out 1,0,130008,8
36) ExprEval (2) 3, #16; out 1,0,130008,8
37) Load (3) 36, #16; CRPstate=2; out 1,0,130008,8
38) ExprEval (2) 3, #17; out 1,0,130008,8
39) Load (3) 38, #17; CRPstate=2; out 1,0,130008,8
40) ExprEval (2) 3, #18; out 1,0,130008,8
41) Load (3) 40, #18; CRPstate=2; out 1,0,130008,8
42) ExprEval (2) 3, #19; out 1,0,130008,8
43) Load (3) 42, #19; CRPstate=2; out 1,0,130008,8
44) ExprEval (2) 3, #20; out 1,0,130008,8
45) Load (3) 44, #20; CRPstate=2; out 1,0,130008,8
46) ExprEval (2) 3, #21; out 1,0,130008,8
dbadmin@datahub-20:~$ ulimit -n
128812
dbadmin@datahub-20:~$ ps -ef | grep vertica
dbadmin 2424 1 0 Oct09 ? 04:32:34 /opt/vconsole/vendor/oracle/java/jre/1.7.0_51/bin/java -Dvertica.home=/opt/vertica -Dvconsole.home=/opt/vconsole -Djava.library.path=/opt/vconsole/lib -Dderby.system.home=/opt/vconsole/mcdb/derby -Xmx2048m -Xms1024m -XX:MaxPermSize=256m -jar /opt/vconsole/lib/webui.war
dbadmin 4258 1 0 15:12 pts/0 00:00:00 /opt/vertica/spread/sbin/spread -c /home/dbadmin/testdb/v_testdb_node0001_catalog/spread.conf -D /opt/vertica/spread/tmp
dbadmin 4260 1 1 15:12 ? 00:00:22 /opt/vertica/bin/vertica -D /home/dbadmin/testdb/v_testdb_node0001_catalog -C testdb -n v_testdb_node0001 -h 127.0.0.1 -p 5433 -P 4803 -Y ipv4
dbadmin 4268 4260 0 15:12 ? 00:00:00 /opt/vertica/bin/vertica-udx-zygote 15 14 4260 debug-log-off /home/dbadmin/testdb/v_testdb_node0001_catalog/UDxLogs 60 16
dbadmin 8336 8050 0 15:31 pts/0 00:00:00 grep --color=auto vertica
dbadmin 29493 1 0 Oct26 ? 00:00:00 /bin/bash /opt/vertica/agent/agent.sh /opt/vertica/config/users/dbadmin/agent.conf
dbadmin 29506 29493 0 Oct26 ? 04:39:59 /opt/vertica/oss/python/bin/python ./simply_fast.py
0
Comments
Sorry about this issue, we are currently working to resolve it. Current work-around (caveat: degraded performance) is to run this SQL command:
alter database <dbname> set EnableCooperativeParse=0;