Hi,
I am running Kamailio 3.3 as a Homer capture agent, the sip-capture module
receives HEP packets from a sip-trace module in a remote kamailio instance.
Periodically the capture agent dies. The log and core dump suggest the
initial problem is an invalid HEP msg received, but kamailio crashes when
trying to send an error reply. Can anyone shed any light on this?
Thanks,
Owen Lynch
Back trace:
Program terminated with signal 11, Segmentation fault.
#0 0x0813c916 in send2child (tcpconn=0xb55c1c60) at tcp_main.c:3967
3967 tcp_main.c: No such file or directory.
in tcp_main.c
Missing separate debuginfos, use: debuginfo-install
glibc-2.12-1.80.el6.i686 keyutils-libs-1.4-4.el6.i686
krb5-libs-1.9-33.el6.i686 libcom_err-1.41.12-12.el6.i686
libselinux-2.0.94-5.3.el6.i686 mysql-libs-5.1.61-4.el6.i686
nss-softokn-freebl-3.12.9-11.el6.i686 openssl-1.0.0-20.el6_2.5.i686
zlib-1.2.3-27.el6.i686
(gdb) bt
#0 0x0813c916 in send2child (tcpconn=0xb55c1c60) at tcp_main.c:3967
#1 0x08136e78 in handle_tcpconn_ev (fm=<value optimized out>, ev=<value
optimized out>,
idx=<value optimized out>) at tcp_main.c:4310
#2 handle_io (fm=<value optimized out>, ev=<value optimized out>,
idx=<value optimized out>)
at tcp_main.c:4362
#3 0x0813ea3c in io_wait_loop_epoll () at io_wait.h:1092
#4 tcp_main_loop () at tcp_main.c:4656
#5 0x080a502b in main_loop () at main.c:1727
#6 0x080a6c00 in main (argc=11, argv=0xbfeafd14) at main.c:2546
Log:
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: : <core>
[pass_fd.c:288]: ERROR: receive_fd: recvmsg on 10 failed: Connection reset
by peer
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: ERROR: <core>
[tcp_main.c:2347]: BUG: tcp_send: failed to get fd(receive_fd): Connection
reset by peer (104)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: ERROR: sl
[../../forward.h:193]: msg_send: ERROR: tcp_send failed
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: ERROR: ***
cfgtrace: c=[/usr/local/etc/kamailio/kamailio.cfg] l=704 a=3 n=exit
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[xavp.c:365]: destroying xavp list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[receive.c:293]: receive_msg: cleaning up
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: ERROR:
sipcapture [sipcapture.c:682]: ERROR: sipcapture:hep_msg_received: not
supported version or bad length: v:[10] l:[10] vs [40]
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/msg_parser.c:634]: SIP Reply (status):
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/msg_parser.c:636]: version: <SIP/2.0>
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/msg_parser.c:638]: status: <500>
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/msg_parser.c:640]: reason: <Invalid CSeq>
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/parse_via.c:1286]: Found param type 234, <received> =
<yadayadayada>; state=6
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/parse_via.c:1286]: Found param type 232, <branch> =
<z9hG4bK2348.d1620f62.0>; state=16
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/parse_via.c:2561]: end of header reached, state=5
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/msg_parser.c:511]: parse_headers: Via found, flags=2
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core>
[parser/msg_parser.c:513]: parse_headers: this is the first via
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: ALERT: <core>
[main.c:785]: child process 19576 exited by a signal 11
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: ALERT: <core>
[main.c:788]: core was generated
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: INFO: <core>
[main.c:800]: INFO: terminating due to SIGCHLD
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19575]: INFO: <core>
[main.c:851]: INFO: signal 15 received
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19574]: INFO: <core>
[main.c:851]: INFO: signal 15 received
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19573]: INFO: <core>
[main.c:851]: INFO: signal 15 received
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19572]: INFO: <core>
[main.c:851]: INFO: signal 15 received
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm
[t_funcs.c:122]: DEBUG: tm_shutdown : start
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm
[t_funcs.c:125]: DEBUG: tm_shutdown : emptying hash table
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm
[t_funcs.c:127]: DEBUG: tm_shutdown : removing semaphores
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm
[t_funcs.c:129]: DEBUG: tm_shutdown : destroying tmcb lists
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm
[t_funcs.c:132]: DEBUG: tm_shutdown : done
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tls
[tls_init.c:674]: tls module final tls destroy
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: <core>
[mem/shm_mem.c:242]: shm_mem_destroy
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: <core>
[mem/shm_mem.c:245]: destroying the shared memory lock
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: <core>
[main.c:804]: terminating due to SIGCHLD