[SR-Users] Kamailio 4.2 crash

Daniel-Constantin Mierla miconda at gmail.com
Mon Dec 8 09:54:06 CET 2014


Hello,

the crash is different, no longer the one in dialog that was fixed --
now it is inside corex module, at corex_nio.c line 411.

I checked the source code and that line doesn't exist in 4.2 or master
branches. I guess you have custom development done to corex module --
check your code there.

Cheers,
Daniel

On 08/12/14 09:35, Rahul MathuR wrote:
> Hello Daniel,
>
> I upgraded to latest version - 
>
> [root at h5-152-217-138 /]# kamailio -v
> version: kamailio 4.2.1 (x86_64/linux) 868a34
> flags: STATS: Off, USE_TCP, USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST,
> DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, F_MALLOC, DBG_F_MALLOC,
> USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE, USE_DNS_FAILOVER,
> USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES
> ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16,
> MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB
> poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.
> id: 868a34
> compiled on 00:20:15 Dec  2 2014 with gcc 4.4.7
>
>
>
> BUT even then, after 8 days it crashed and again in futex_get( ) 
>
> Program terminated with signal 11, Segmentation fault.
> #0  0x00007f970a39fae6 in futex_get (lock=0x7fffbf91f160) at
> ../../parser/../mem/../futexlock.h:101
> 101             v=atomic_cmpxchg(lock, 0, 1); /* lock if 0 */
> (gdb) bt
> #0  0x00007f970a39fae6 in futex_get (lock=0x7fffbf91f160) at
> ../../parser/../mem/../futexlock.h:101
> #1  0x00007f970a3a4369 in nio_intercept_init () at corex_nio.c:411
> #2  0x00007f970a3a58bd in next_proto (proto=32767) at
> ../../socket_info.h:119
> #3  0x000000000047d4e9 in sr_event_exec (type=2, data=0x7fffbf91fb10)
> at events.c:218
> #4  0x000000000048151e in msg_send (dst=0x7fffbf91fe00,
>     buf=0x7f970b09e310
> "\367\204\223\024)i\277aזn7a\307nȜ[yK9\\\035\356]\277\304w\365\362U\207ԕ\365d\303\024'\245`!v\032\334\347\221\323\023\020\213\271A\rz\336\315&Z\023\335۶%\016\263\260=:\261]؊\037\245:\bg\227y<\217\270Zȍ\317\376\240\a\365h\f[\214\212SB\326\343\216\345\323\"\r\360%\210k\351!\373\323\a]\017-\214q\257\023,\210\342:\277\203\217\313W at w\300d\021\070\262\254ǫ\373\374\217\033\060\241\267+`\277>M\233\262\246=\\\016-\253Ӷ\325(
> \365yo\354J\221\021\211R3\325M\333\b\277\021\340\344\337\036<=\026&\314m\016\324]\bG`Ȅ\b"...,
> len=3176) at forward.h:175
> #5  0x00000000004894b3 in forward_request (msg=0x7f970b09dbf0,
> dst=0x7fffbf91fde0, port=7878, send_info=0x7fffbf91fe00) at forward.c:633
> #6  0x00007f970a0b5ad0 in init_avp_params (fr_timer_param=0x6f5758
> "/usr/local/etc/kamailio/kamailio.cfg", fr_inv_timer_param=0x27957d0
> "\001") at t_funcs.c:421
> #7  0x00007f970a0f3d58 in t_set_disable_internal_reply
> (msg=0x7f970b09dbf0, p1=0x7fffbf9200b0 "\365\252O\a\227\177",
> p2=0x7f970b09dbf0 "\001") at tm.c:1891
> #8  0x00007f970a0f4dad in t_any_timeout (msg=0x7f970a0f4dad,
> foo=0x7fffbf91ff40 "@\005\222\277\377\177", bar=0x7fffbf923970 "\002")
> at tm.c:1981
> #9 0x000000000041ce76 in do_action (h=0x7fffbf920640,
> a=0x7f970b044e28, msg=0x7f970b09dbf0) at action.c:1088
> #10 0x000000000042957a in run_actions (h=0x7fffbf920640,
> a=0x7f970b044e28, msg=0x7f970b09dbf0) at action.c:1583
> #11 0x0000000000429bdf in run_actions_safe (h=0x7fffbf922da0,
> a=0x7f970b044e28, msg=0x7f970b09dbf0) at action.c:1648
> #12 0x000000000053f61c in rval_get_int (h=0x7fffbf922da0,
> msg=0x7f970b09dbf0, i=0x7fffbf920b18, rv=0x7f970b045280, cache=0x0) at
> rvalue.c:924
> #13 0x0000000000543854 in rval_expr_eval_int (h=0x7fffbf922da0,
> msg=0x7f970b09dbf0, res=0x7fffbf920b18, rve=0x7f970b045278) at
> rvalue.c:1918
> #14 0x0000000000543c4a in rval_expr_eval_int (h=0x7fffbf922da0,
> msg=0x7f970b09dbf0, res=0x7fffbf920fa8, rve=0x7f970b045978) at
> rvalue.c:1926
> #15 0x000000000041c960 in do_action (h=0x7fffbf922da0,
> a=0x7f970b046308, msg=0x7f970b09dbf0) at action.c:1064
> #16 0x000000000042957a in run_actions (h=0x7fffbf922da0,
> a=0x7f970b040c10, msg=0x7f970b09dbf0) at action.c:1583
> #17 0x0000000000419905 in do_action (h=0x7fffbf922da0,
> a=0x7f970b04e220, msg=0x7f970b09dbf0) at action.c:712
> #18 0x000000000042957a in run_actions (h=0x7fffbf922da0,
> a=0x7f970b04b098, msg=0x7f970b09dbf0) at action.c:1583
> #19 0x000000000041cddf in do_action (h=0x7fffbf922da0,
> a=0x7f970b051b78, msg=0x7f970b09dbf0) at action.c:1079
>
>
>
> On Sat, Nov 29, 2014 at 2:16 PM, Daniel-Constantin Mierla
> <miconda at gmail.com <mailto:miconda at gmail.com>> wrote:
>
>     Hello,
>
>     upgrade to use the latest stable version from 4.2 branch,
>     respectively 4.2.1 at this time -- you are running a pre-release
>     version, which was not supposed to be ready for production anyhow,
>     and there was a fix to this issue already.
>
>     Cheers,
>     Daniel
>
>
>     On 28/11/14 19:59, Rahul MathuR wrote:
>>
>>
>>
>>     Hello,
>>
>>     I have recently moved some traffic to kamailio-4.2 (installed on
>>     a seperate box) and it crashes quite often. Below is the
>>     backtrace of the core files - 
>>
>>     <CORE#1>
>>     (gdb) bt
>>     #0  0x00000033d8c32635 in raise () from /lib64/libc.so.6
>>     #1  0x00000033d8c33e15 in abort () from /lib64/libc.so.6
>>     #2  0x000000000049add5 in sig_alarm_abort (signo=14) at main.c:689
>>     #3  <signal handler called>
>>     #4  0x00000033d8ce50c7 in syscall () from /lib64/libc.so.6
>>     #5  0x00007f7ca2ea0a1e in futex_get (lock=0x7f7ca3334388) at
>>     ../../mem/../futexlock.h:110
>>     #6  0x00007f7ca2ea1e99 in remove_dialog_timer (tl=0x7f7ca3384c98)
>>     at dlg_timer.c:168
>>     #7  0x00007f7ca2e83e9b in destroy_dlg (dlg=0x7f7ca3384c40) at
>>     dlg_hash.c:357
>>     #8  0x00007f7ca2e84e19 in destroy_dlg_table () at dlg_hash.c:438
>>     #9  0x00007f7ca2e50b89 in mod_destroy () at dialog.c:773
>>     #10 0x000000000058dfd5 in destroy_modules () at sr_module.c:818
>>     #11 0x0000000000499ad3 in cleanup (show_status=1) at main.c:564
>>     #12 0x000000000049b096 in shutdown_children (sig=15,
>>     show_status=1) at main.c:706
>>     #13 0x000000000049d66c in handle_sigs () at main.c:797
>>     #14 0x00000000004a4e57 in main_loop () at main.c:1757
>>     #15 0x00000000004a8a43 in main (argc=2, argv=0x7fff58d21368) at
>>     main.c:2609
>>     (gdb) quit
>>
>>
>>     <CORE#2>
>>     (gdb) bt
>>     #0  0x00007f7ca2ea22d7 in update_dlg_timer (tl=0x58, timeout=10)
>>     at dlg_timer.c:203
>>     #1  0x00007f7ca2e824f3 in dlg_clean_run (ti=44865910) at
>>     dlg_hash.c:253
>>     #2  0x00007f7ca2e566fc in dlg_clean_timer_exec (ticks=44865910,
>>     param=0x0) at dialog.c:1250
>>     #3  0x00000000005f93e8 in fork_sync_timer (child_id=-1,
>>     desc=0x7f7ca2eb3a71 "Dialog Clean Timer", make_sock=1,
>>     f=0x7f7ca2e566e3 <dlg_clean_timer_exec>, param=0x0,
>>         interval=90) at timer_proc.c:232
>>     #4  0x00007f7ca2e50476 in child_init (rank=0) at dialog.c:730
>>     #5  0x000000000058e385 in init_mod_child (m=0x7f7ca8c09eb8,
>>     rank=0) at sr_module.c:930
>>     #6  0x000000000058e0c0 in init_mod_child (m=0x7f7ca8c0b000,
>>     rank=0) at sr_module.c:927
>>     #7  0x000000000058e68f in init_child (rank=0) at sr_module.c:957
>>     #8  0x00000000004a435c in main_loop () at main.c:1705
>>     #9  0x00000000004a8a43 in main (argc=2, argv=0x7fff58d21368) at
>>     main.c:2609
>>     (gdb) quit
>>
>>
>>     kamailio -v
>>     version: kamailio 4.2.0-pre0 (x86_64/linux) a78764-dirty
>>     flags: STATS: Off, USE_TCP, USE_RAW_SOCKS, DISABLE_NAGLE,
>>     USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, F_MALLOC,
>>     DBG_F_MALLOC, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE,
>>     USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES
>>     ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN
>>     16, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 4MB
>>     poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.
>>     id: a78764 -dirty
>>
>>
>>     Kindly let me know which version to move.
>>
>>
>>     -- 
>>     Warm Regds.
>>     MathuRahul
>>
>>
>>
>>     -- 
>>     Warm Regds.
>>     MathuRahul
>>
>>
>>
>>     _______________________________________________
>>     SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
>>     sr-users at lists.sip-router.org <mailto:sr-users at lists.sip-router.org>
>>     http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
>
>     -- 
>     Daniel-Constantin Mierla
>     http://twitter.com/#!/miconda <http://twitter.com/#%21/miconda> - http://www.linkedin.com/in/miconda
>
>
>     _______________________________________________
>     SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing
>     list
>     sr-users at lists.sip-router.org <mailto:sr-users at lists.sip-router.org>
>     http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
>
>
>
>
> -- 
> Warm Regds.
> MathuRahul

-- 
Daniel-Constantin Mierla
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sip-router.org/pipermail/sr-users/attachments/20141208/0d41e820/attachment.html>


More information about the sr-users mailing list