[SR-Users] Segfault in dialog.so with 4.4.2 stable

Fri Jul 15 10:06:54 CEST 2016

Hi,

Running Kamailio on Debian from the Kamailio repository with 4.4.2
stable (unpatched). Getting some random segfaults with it now, here's
the relevant backtrace from the generated core.

Core was generated by `/usr/sbin/kamailio -f /etc/kamailio/kamailio.cfg
-P /var/run/kamailio/kamailio.'.
Program terminated with signal 11, Segmentation fault.
#0  run_dlg_callbacks (type=type at entry=64, dlg=dlg at entry=0x7fceb400e2f0,
req=req at entry=0x7fced4f093c8, rpl=rpl at entry=0x0, dir=<optimized out>,
dlg_data=dlg_data at entry=0x0) at dlg_cb.c:253
253			if ( (cb->types)&type ) {
(gdb) bt
#0  run_dlg_callbacks (type=type at entry=64, dlg=dlg at entry=0x7fceb400e2f0,
req=req at entry=0x7fced4f093c8, rpl=rpl at entry=0x0, dir=<optimized out>,
dlg_data=dlg_data at entry=0x0) at dlg_cb.c:253
#1  0x00007fcead3648f9 in dlg_terminated (dir=<optimized out>,
dlg=0x7fceb400e2f0, req=0x7fced4f093c8) at dlg_handlers.c:368
#2  dlg_onroute (req=0x7fced4f093c8, route_params=<optimized out>,
param=<optimized out>) at dlg_handlers.c:1354
#3  0x00007fceb10ab0e2 in run_rr_callbacks
(req=req at entry=0x7fced4f093c8, rr_param=rr_param at entry=0x7fceb12b77a0)
at rr_cb.c:96
#4  0x00007fceb10952c5 in after_loose (_m=0x7fced4f093c8, preloaded=0)
at loose.c:919
#5  0x000000000042b618 in do_action (h=h at entry=0x7ffeb0b3ed80,
a=a at entry=0x7fced4cb4338, msg=msg at entry=0x7fced4f093c8) at action.c:1060
#6  0x000000000042a10a in run_actions (h=h at entry=0x7ffeb0b3ed80,
a=0x7fced4cb4338, msg=0x7fced4f093c8) at action.c:1549
#7  0x0000000000437544 in run_actions_safe (h=h at entry=0x7ffeb0b402b0,
a=<optimized out>, msg=<optimized out>) at action.c:1614
#8  0x000000000053b2e8 in rval_get_int (h=0x7ffeb0b402b0, msg=<optimized
out>, i=0x7ffeb0b3f1e0, rv=rv at entry=0x7fced4cb4d58,
cache=cache at entry=0x0) at rvalue.c:912
#9  0x000000000054261c in rval_expr_eval_int (h=h at entry=0x7ffeb0b402b0,
msg=msg at entry=0x7fced4f093c8, res=res at entry=0x7ffeb0b3f1e0,
rve=rve at entry=0x7fced4cb4d50) at rvalue.c:1910
#10 0x000000000042bc91 in do_action (h=h at entry=0x7ffeb0b402b0,
a=a at entry=0x7fced4cb8f88, msg=msg at entry=0x7fced4f093c8) at action.c:1030
#11 0x000000000042a10a in run_actions (h=h at entry=0x7ffeb0b402b0,
a=0x7fced4cb8f88, msg=msg at entry=0x7fced4f093c8) at action.c:1549
#12 0x000000000042bcf2 in do_action (h=h at entry=0x7ffeb0b402b0,
a=a at entry=0x7fced4cb91e8, msg=msg at entry=0x7fced4f093c8) at action.c:1049
#13 0x000000000042a10a in run_actions (h=h at entry=0x7ffeb0b402b0,
a=0x7fced4cb3f48, msg=msg at entry=0x7fced4f093c8) at action.c:1549
#14 0x000000000042bde0 in do_action (h=h at entry=0x7ffeb0b402b0,
a=a at entry=0x7fced4ac3d70, msg=msg at entry=0x7fced4f093c8) at action.c:678
#15 0x000000000042a10a in run_actions (h=h at entry=0x7ffeb0b402b0,
a=a at entry=0x7fced4ac1698, msg=msg at entry=0x7fced4f093c8) at action.c:1549
#16 0x00000000004375d0 in run_top_route (a=0x7fced4ac1698,
msg=msg at entry=0x7fced4f093c8, c=c at entry=0x0) at action.c:1635
#17 0x0000000000504386 in receive_msg (buf=<optimized out>,
len=<optimized out>, rcv_info=<optimized out>) at receive.c:240
#18 0x00000000005f5bd4 in udp_rcv_loop () at udp_server.c:495
#19 0x00000000004b2625 in main_loop () at main.c:1600
#20 0x0000000000427e2b in main (argc=<optimized out>, argv=<optimized
out>) at main.c:2616

And from syslog the relevant messages before this dump:

Jul 15 08:55:03 server /usr/sbin/kamailio[16470]: WARNING: dialog
[dlg_handlers.c:1219]: dlg_onroute(): unable to find dialog for BYE with
route param 'd4c.26d1' [3149:7522]
Jul 15 08:56:01 server /usr/sbin/kamailio[16481]: WARNING: dialog
[dlg_handlers.c:1219]: dlg_onroute(): unable to find dialog for BYE with
route param 'fc.99f1' [207:8089]
Jul 15 08:56:27 server /usr/sbin/kamailio[16470]: CRITICAL: dialog
[dlg_timer.c:200]: update_dlg_timer(): Trying to update a bogus dlg
tl=0x7fceb3f7d920 tl->next=(nil) tl->prev=(nil)
Jul 15 08:56:27 server /usr/sbin/kamailio[16470]: ERROR: dialog
[dlg_handlers.c:1377]: dlg_onroute(): failed to update dialog lifetime
Jul 15 08:57:01 server /usr/sbin/kamailio[16482]: ERROR: db_mysql
[km_dbase.c:128]: db_mysql_submit_query(): driver error on query:
Duplicate entry '9584-3854-435' for key 'hash_index' (1062)
Jul 15 08:57:01 server /usr/sbin/kamailio[16482]: ERROR: <core>
[db_query.c:181]: db_do_raw_query(): error while submitting query
Jul 15 08:57:01 server /usr/sbin/kamailio[16482]: ERROR: sqlops
[sql_api.c:265]: sql_do_query(): cannot do the query [INSERT INTO
`dialog_extra` (`h_i]
Jul 15 08:57:01 server /usr/sbin/kamailio[16482]: ERROR: auth
[api.c:119]: auth_check_hdr_md5(): auth:pre_auth: Credentials are not
filled properly
Jul 15 08:57:01 server /usr/sbin/kamailio[16483]: ERROR: auth
[api.c:119]: auth_check_hdr_md5(): auth:pre_auth: Credentials are not
filled properly
Jul 15 08:57:54 server /usr/sbin/kamailio[16506]: NOTICE: dialog
[dlg_hash.c:245]: dlg_clean_run(): dialog in delete state is too old
(0x7fceb3f64470 ref 4)
Jul 15 08:57:54 server /usr/sbin/kamailio[16473]: WARNING: dialog
[dlg_handlers.c:1348]: dlg_onroute(): inconsitent dlg timer data on dlg
0x7fceb3f64470 [1182:5803] with clid
'09ad128753e2535d24bde58e3d7eda04 at 192.168.10.232:5060' and tags
'as1b497b34' '5788890C-EC6F55F-3E86ED0C'
Jul 15 08:57:54 server /usr/sbin/kamailio[16469]: ERROR: dialog
[dlg_handlers.c:334]: dlg_terminated_confirmed(): failed to get dialog
from params!
Jul 15 08:58:49 server /usr/sbin/kamailio[16467]: WARNING: dialog
[dlg_handlers.c:1219]: dlg_onroute(): unable to find dialog for BYE with
route param '6d2.2581' [726:6226]
Jul 15 08:59:24 server /usr/sbin/kamailio[16506]: NOTICE: dialog
[dlg_hash.c:245]: dlg_clean_run(): dialog in delete state is too old
(0x7fceb400e2f0 ref 4)
Jul 15 08:59:25 server /usr/sbin/kamailio[16464]: WARNING: dialog
[dlg_handlers.c:1219]: dlg_onroute(): unable to find dialog for BYE with
route param '3e4.b5c1' [1251:7259]
Jul 15 08:59:25 server /usr/sbin/kamailio[16465]: WARNING: dialog
[dlg_handlers.c:1348]: dlg_onroute(): inconsitent dlg timer data on dlg
0x7fceb400e2f0 [1251:7259] with clid '87791a#015#012Call-ID:
25750e286a5654361ef9405d72edbc' and tags '' 'as148f41b1'
Jul 15 08:59:25 server kernel: [203670.830521] kamailio[16465] general
protection ip:7fcead34b3a5 sp:7ffeb0b3e220 error:0 in
dialog.so[7fcead330000+88000]
Jul 15 08:59:26 server /usr/sbin/kamailio[16511]: CRITICAL: <core>
[pass_fd.c:275]: receive_fd(): EOF on 33
Jul 15 08:59:26 server /usr/sbin/kamailio[16458]: ALERT: <core>
[main.c:739]: handle_sigs(): child process 16465 exited by a signal 11
Jul 15 08:59:26 server /usr/sbin/kamailio[16458]: ALERT: <core>
[main.c:742]: handle_sigs(): core was generated
Jul 15 08:59:26 server /usr/sbin/kamailio[16458]: INFO: <core>
[main.c:754]: handle_sigs(): terminating due to SIGCHLD

Any insight would be appreciated!

Cheers,
Dirk