Options

Verica received <PANIC> Received fatal signal SIGSEGV.

ViacheslavViacheslav
in General Discussion

I'm trying to ingest data from kafka to vertica using vkconfig. After working some time I got ~46 M reconds in flex table.After that vertica crashes receiving SIGSEGV. After restart and starting ingesting again vertica crashes again. Part of log in /home/dbadmin/testdb/v_testdb_node0001_catalog/vertica.log

2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE]  (a000000004e788) TM moveout: Wos row count = 1, Wos delete row count = 0
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE]  (a000000004e788) Skipping replay delete due to lack of deletes.
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE]  (a000000004e788) Executing DVWos moveout plans
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE]  (a000000004e788) getMiniROSsForDVWosMoveout: No DVWOSs to moveout
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE]  (a000000004e788) Deleting Wos and DV contents
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE]  (a000000004e788) Dropping source WOSs
2015-11-25 14:08:08.556 TM Moveout:0x7fe90c012940-a000000004e788 [EE]     45035996273870675
2015-11-25 14:08:08.557 TM Moveout:0x7fe90c012940-a000000004e788 [EE]  (a000000004e788) Moved out 16384 bytes
2015-11-25 14:08:08.559 TM Moveout:0x7fe90c012940-a000000004e788 [EE]  Moveout projection kafka_config.kafka_events_super - done
2015-11-25 14:08:08.559 TM Moveout:0x7fe90c012940-a000000004e788 [Txn]  Starting Commit: Txn: a000000004e788 'Moveout: (Table: kafka_config.kafka_events) (Projection: kafka_config.kafka_events_super)'
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940 [Txn]  Commit Complete: Txn: a000000004e788 at epoch 0x8c
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940 [TM]  Tuple Mover: moved out projection kafka_events_super
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940-a000000004e78c [Txn]  Begin Txn: a000000004e78c 'Moveout: Tuple Mover'
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940-a000000004e78c [Txn]  Rollback Txn: a000000004e78c 'Moveout: Tuple Mover'
2015-11-25 14:08:08.560 TM Moveout:0x7fe90c012940 [Util]  Task 'TM Moveout' enabled
2015-11-25 14:08:09.037 EEcmdq:0x7fe8e80060b0 [Main]  Handling signal: 11
2015-11-25 14:08:09.168 EEcmdq:0x7fe8e80060b0 [Main]  Received fatal signal SIGSEGV.
2015-11-25 14:08:09.168 EEcmdq:0x7fe8e80060b0 [Main]  Info: si_code: 2, si_pid: -1675866112, si_uid: 32743, si_addr: 0x7fe79c1c5000

Part of /home/dbadmin/testdb/v_testdb_node0001_catalog/ErrorReport.txt

Backtrace Generated by Error
Signal: [0x000000000000000b] PID: [0x000000000000987b] PC: [0x00007fe33f8a3665] FP: [0x00007fe26a43ba90] SIGSEGV: SEGV_ACCERR SI_ADDR : [0x00007fe15c6a0ffc]
/opt/vertica/bin/vertica[0x2fca8f7]
/opt/vertica/bin/vertica[0x3017084]
/opt/vertica/bin/vertica[0x30182e9]
/lib/x86_64-linux-gnu/libc.so.6(+0x36150)[0x7fe33f78b150]
/lib/x86_64-linux-gnu/libc.so.6(+0x14e665)[0x7fe33f8a3665]
/opt/vertica/bin/vertica[0x12cbca4]
/opt/vertica/bin/vertica[0x1138779]
/opt/vertica/bin/vertica[0x12ce4f7]
/opt/vertica/bin/vertica[0x12cb039]
/opt/vertica/bin/vertica[0x12cb4c2]
/opt/vertica/bin/vertica[0x113b567]
/opt/vertica/bin/vertica[0x111de7a]
/opt/vertica/bin/vertica[0xff048a]
/opt/vertica/bin/vertica[0xff4680]
/opt/vertica/bin/vertica[0xa935c7]
/lib/x86_64-linux-gnu/libc.so.6(+0x48300)[0x7fe33f79d300]
END BACKTRACE
THREAD CONTEXT
Thread type: EE Internal Command Queue Thread
Request: COPY "public"."kafka_tgt" SOURCE KafkaSource(stream='click_user_input|0|126338314,click_user_input|1|-2,click_user_input|2|-2,click_user_input|3|-2,click_user_input|4|-2', brokers='datahub-23:9092', duration=interval '9930 milliseconds', stop_on_eof=true, executionparallelism=1 ) PARSER KafkaParser( ) REJECTED DATA AS TABLE public.kafka_rej TRICKLE NO COMMIT
           0: Root
          85: GroupByNothing
          84: DataTarget
FAULT =>   1: NewEENode
           2) ExprEval         depth=(0) parent=0, peer#0; outTup nCol=3,nkey=0,inlSz=130024,fixSz=24
           3) LoadUnion        (1) 2, #0; nInputs=40; out 1,0,130008,8
           4) ExprEval         (2) 3, #0; out 1,0,130008,8
           5) Load             (3) 4, #0; CRPstate=2; out 1,0,130008,8
           6) ExprEval         (2) 3, #1; out 1,0,130008,8
 (PPFAULT) => Load             (id=7) (3) 6, #1; CRPstate=2; out 1,0,130008,8
           8) ExprEval         (2) 3, #2; out 1,0,130008,8
           9) Load             (3) 8, #2; CRPstate=2; out 1,0,130008,8
          10) ExprEval         (2) 3, #3; out 1,0,130008,8
          11) Load             (3) 10, #3; CRPstate=2; out 1,0,130008,8
          12) ExprEval         (2) 3, #4; out 1,0,130008,8
          13) Load             (3) 12, #4; CRPstate=2; out 1,0,130008,8
          14) ExprEval         (2) 3, #5; out 1,0,130008,8
          15) Load             (3) 14, #5; CRPstate=2; out 1,0,130008,8
          16) ExprEval         (2) 3, #6; out 1,0,130008,8
          17) Load             (3) 16, #6; CRPstate=2; out 1,0,130008,8
          18) ExprEval         (2) 3, #7; out 1,0,130008,8
          19) Load             (3) 18, #7; CRPstate=2; out 1,0,130008,8
          20) ExprEval         (2) 3, #8; out 1,0,130008,8
          21) Load             (3) 20, #8; CRPstate=2; out 1,0,130008,8
          22) ExprEval         (2) 3, #9; out 1,0,130008,8
          23) Load             (3) 22, #9; CRPstate=2; out 1,0,130008,8
          24) ExprEval         (2) 3, #10; out 1,0,130008,8
          25) Load             (3) 24, #10; CRPstate=2; out 1,0,130008,8
          26) ExprEval         (2) 3, #11; out 1,0,130008,8
          27) Load             (3) 26, #11; CRPstate=2; out 1,0,130008,8
          28) ExprEval         (2) 3, #12; out 1,0,130008,8
          29) Load             (3) 28, #12; CRPstate=2; out 1,0,130008,8
          30) ExprEval         (2) 3, #13; out 1,0,130008,8
          31) Load             (3) 30, #13; CRPstate=2; out 1,0,130008,8
          32) ExprEval         (2) 3, #14; out 1,0,130008,8
          33) Load             (3) 32, #14; CRPstate=2; out 1,0,130008,8
          34) ExprEval         (2) 3, #15; out 1,0,130008,8
          35) Load             (3) 34, #15; CRPstate=2; out 1,0,130008,8
          36) ExprEval         (2) 3, #16; out 1,0,130008,8
          37) Load             (3) 36, #16; CRPstate=2; out 1,0,130008,8
          38) ExprEval         (2) 3, #17; out 1,0,130008,8
          39) Load             (3) 38, #17; CRPstate=2; out 1,0,130008,8
          40) ExprEval         (2) 3, #18; out 1,0,130008,8
          41) Load             (3) 40, #18; CRPstate=2; out 1,0,130008,8
          42) ExprEval         (2) 3, #19; out 1,0,130008,8
          43) Load             (3) 42, #19; CRPstate=2; out 1,0,130008,8
          44) ExprEval         (2) 3, #20; out 1,0,130008,8
          45) Load             (3) 44, #20; CRPstate=2; out 1,0,130008,8
          46) ExprEval         (2) 3, #21; out 1,0,130008,8
dbadmin@datahub-20:~$ ulimit -n
128812

dbadmin@datahub-20:~$ ps -ef | grep vertica
dbadmin   2424     1  0 Oct09 ?        04:32:34 /opt/vconsole/vendor/oracle/java/jre/1.7.0_51/bin/java -Dvertica.home=/opt/vertica -Dvconsole.home=/opt/vconsole -Djava.library.path=/opt/vconsole/lib -Dderby.system.home=/opt/vconsole/mcdb/derby -Xmx2048m -Xms1024m -XX:MaxPermSize=256m -jar /opt/vconsole/lib/webui.war
dbadmin   4258     1  0 15:12 pts/0    00:00:00 /opt/vertica/spread/sbin/spread -c /home/dbadmin/testdb/v_testdb_node0001_catalog/spread.conf -D /opt/vertica/spread/tmp
dbadmin   4260     1  1 15:12 ?        00:00:22 /opt/vertica/bin/vertica -D /home/dbadmin/testdb/v_testdb_node0001_catalog -C testdb -n v_testdb_node0001 -h 127.0.0.1 -p 5433 -P 4803 -Y ipv4
dbadmin   4268  4260  0 15:12 ?        00:00:00 /opt/vertica/bin/vertica-udx-zygote 15 14 4260 debug-log-off /home/dbadmin/testdb/v_testdb_node0001_catalog/UDxLogs 60 16
dbadmin   8336  8050  0 15:31 pts/0    00:00:00 grep --color=auto vertica
dbadmin  29493     1  0 Oct26 ?        00:00:00 /bin/bash /opt/vertica/agent/agent.sh /opt/vertica/config/users/dbadmin/agent.conf
dbadmin  29506 29493  0 Oct26 ?        04:39:59 /opt/vertica/oss/python/bin/python ./simply_fast.py

Comments

  • Options
    mdfaymdfay

    Sorry about this issue, we are currently working to resolve it. Current work-around (caveat: degraded performance) is to run this SQL command:

     

    alter database <dbname> set EnableCooperativeParse=0;

Leave a Comment

BoldItalicStrikethroughOrdered listUnordered list
Format
SpoilerCodeQuote
Heading 2Heading 1
Emoji
:):D:(;):/:o:s:p:'(:|B):#:*<3o:)>:)
Url
Image
Align leftAlign centerAlign rightToggle HTML viewToggle full pageToggle lights
Drop image/file
Home • General DiscussionComment As ...