Hi,

I am running Kamailio 3.3 as a Homer capture agent, the sip-capture module receives HEP packets from a sip-trace module in a remote kamailio instance. Periodically the capture agent dies. The log and core dump suggest the initial problem is an invalid HEP msg received, but kamailio crashes when trying to send an error reply. Can anyone shed any light on this?

Thanks,
Owen Lynch

Back  trace:
Program terminated with signal 11, Segmentation fault.
#0  0x0813c916 in send2child (tcpconn=0xb55c1c60) at tcp_main.c:3967
3967    tcp_main.c: No such file or directory.
        in tcp_main.c
Missing separate debuginfos, use: debuginfo-install glibc-2.12-1.80.el6.i686 keyutils-libs-1.4-4.el6.i686 krb5-libs-1.9-33.el6.i686 libcom_err-1.41.12-12.el6.i686 libselinux-2.0.94-5.3.el6.i686 mysql-libs-5.1.61-4.el6.i686 nss-softokn-freebl-3.12.9-11.el6.i686 openssl-1.0.0-20.el6_2.5.i686 zlib-1.2.3-27.el6.i686
(gdb) bt
#0  0x0813c916 in send2child (tcpconn=0xb55c1c60) at tcp_main.c:3967
#1  0x08136e78 in handle_tcpconn_ev (fm=<value optimized out>, ev=<value optimized out>,
    idx=<value optimized out>) at tcp_main.c:4310
#2  handle_io (fm=<value optimized out>, ev=<value optimized out>, idx=<value optimized out>)
    at tcp_main.c:4362
#3  0x0813ea3c in io_wait_loop_epoll () at io_wait.h:1092
#4  tcp_main_loop () at tcp_main.c:4656
#5  0x080a502b in main_loop () at main.c:1727
#6  0x080a6c00 in main (argc=11, argv=0xbfeafd14) at main.c:2546

Log:
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: : <core> [pass_fd.c:288]: ERROR: receive_fd: recvmsg on 10 failed: Connection reset by peer
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: ERROR: <core> [tcp_main.c:2347]: BUG: tcp_send: failed to get fd(receive_fd): Connection reset by peer (104)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: ERROR: sl [../../forward.h:193]: msg_send: ERROR: tcp_send failed
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: ERROR: *** cfgtrace: c=[/usr/local/etc/kamailio/kamailio.cfg] l=704 a=3 n=exit
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [usr_avp.c:644]: DEBUG:destroy_avp_list: destroying list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [xavp.c:365]: destroying xavp list (nil)
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [receive.c:293]: receive_msg: cleaning up
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: ERROR: sipcapture [sipcapture.c:682]: ERROR: sipcapture:hep_msg_received: not supported version or bad length: v:[10] l:[10] vs [40]
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/msg_parser.c:634]: SIP Reply  (status):
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/msg_parser.c:636]:  version: <SIP/2.0>
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/msg_parser.c:638]:  status:  <500>
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/msg_parser.c:640]:  reason:  <Invalid CSeq>
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/parse_via.c:1286]: Found param type 234, <received> = <yadayadayada>; state=6
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/parse_via.c:1286]: Found param type 232, <branch> = <z9hG4bK2348.d1620f62.0>; state=16
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/parse_via.c:2561]: end of header reached, state=5
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/msg_parser.c:511]: parse_headers: Via found, flags=2
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19568]: DEBUG: <core> [parser/msg_parser.c:513]: parse_headers: this is the first via
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: ALERT: <core> [main.c:785]: child process 19576 exited by a signal 11
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: ALERT: <core> [main.c:788]: core was generated
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: INFO: <core> [main.c:800]: INFO: terminating due to SIGCHLD
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19575]: INFO: <core> [main.c:851]: INFO: signal 15 received
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19574]: INFO: <core> [main.c:851]: INFO: signal 15 received
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19573]: INFO: <core> [main.c:851]: INFO: signal 15 received
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19572]: INFO: <core> [main.c:851]: INFO: signal 15 received
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm [t_funcs.c:122]: DEBUG: tm_shutdown : start
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm [t_funcs.c:125]: DEBUG: tm_shutdown : emptying hash table
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm [t_funcs.c:127]: DEBUG: tm_shutdown : removing semaphores
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm [t_funcs.c:129]: DEBUG: tm_shutdown : destroying tmcb lists
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tm [t_funcs.c:132]: DEBUG: tm_shutdown : done
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: tls [tls_init.c:674]: tls module final tls destroy
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: <core> [mem/shm_mem.c:242]: shm_mem_destroy
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: <core> [mem/shm_mem.c:245]: destroying the shared memory lock
Nov 28 12:24:24 flowadmin /usr/local/sbin/kamailio[19567]: DEBUG: <core> [main.c:804]: terminating due to SIGCHLD