[SR-Users] Kamailio core dumped

[Alexey V. Panfilov]

Hi there,

I've kamailio 4.2.3 (i386/freebsd) which works perfectly with 200-300
cps for years.

Now I need migrate to freebsd amd64. I've installed kamailio 4.4.5
(amd64/freebsd), copied kamailio.cfg, made a test call - it was all right.

But when I start work load (200-300 cps), kamailio core dumped and
exited. In logs (skipped "<script>:" having):
=======================
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core>
[mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000,
976); Free fragment not found!
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core>
[mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 976) called
from core: msg_translator.c: build_req_buf_from_sip_req(2154), module:
core; Free fragment not found!
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core>
[msg_translator.c:2159]: build_req_buf_from_sip_req(): out of memory
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm
[t_fwd.c:462]: prepare_new_uac(): could not build request
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm
[t_fwd.c:1723]: t_forward_nonack(): ERROR: t_forward_nonack: failure to
add branches
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: sl
[sl_funcs.c:363]: sl_reply_error(): ERROR: sl_reply_error used: No error
(2/SL)
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core>
[mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000,
864); Free fragment not found!
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core>
[mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 864) called
from tm: t_reply.c: relay_reply(1885), module: tm; Free fragment not found!
Mar  1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: tm
[t_reply.c:1887]: relay_reply(): ERROR: relay_reply: cannot alloc reply
shmem
Mar  1 12:39:37 sip7 /usr/local/sbin/kamailio[32038]: : <core>
[mem/f_malloc.c:598]: fm_free(): BUG: fm_free: bad pointer
0x61743b3e6d6f632e (out of memory block!), called from tm: h_table.c:
free_cell_helper(226) - aborting
Mar  1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core>
[main.c:740]: handle_sigs(): child process 32034 exited by a signal 10
Mar  1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core>
[main.c:743]: handle_sigs(): core was generated
Mar  1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: INFO: <core>
[main.c:755]: handle_sigs(): terminating due to SIGCHLD
Mar  1 12:39:39 sip7 /usr/local/sbin/kamailio[32044]: INFO: <core>
[main.c:810]: sig_usr(): signal 15 received
=======================

I've tried to start with -m 512 - nothing changes.

Hardware:  Xeon(R) CPU E5-2660, 16Gb RAM, 1Tb HDD.

Software:

OS: FreeBSD 10.3-STABLE (r313760) amd64

version: kamailio 4.4.5 (amd64/freebsd) f98162
flags: STATS: Off, USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, DISABLE_NAGLE,
USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, Q_MALLOC,
F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_PTHREAD_MUTEX, USE_DNS_CACHE,
USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES
MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE
65535, DEFAULT PKG_SIZE 8MB
poll method support: poll, select, kqueue.
id: f98162
compiled on 12:25:48 Mar  1 2017 with clang 3.4

bt is here: http://tmp.lehis.ru/kam_gdb.txt
I can't enable debug symbols for gdb (tried gmake mode=debug, which
added EXTRA_DEBUG to flags). How can I do it?

I need in direction for resolve this issue, please, help.

Thanks.

-- 
Best regards,
Alexey V. Panfilov