Hi there,
I've kamailio 4.2.3 (i386/freebsd) which works perfectly with 200-300 cps for years.
Now I need migrate to freebsd amd64. I've installed kamailio 4.4.5 (amd64/freebsd), copied kamailio.cfg, made a test call - it was all right.
But when I start work load (200-300 cps), kamailio core dumped and exited. In logs (skipped "<script>:" having): ======================= Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000, 976); Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 976) called from core: msg_translator.c: build_req_buf_from_sip_req(2154), module: core; Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [msg_translator.c:2159]: build_req_buf_from_sip_req(): out of memory Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm [t_fwd.c:462]: prepare_new_uac(): could not build request Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm [t_fwd.c:1723]: t_forward_nonack(): ERROR: t_forward_nonack: failure to add branches Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: sl [sl_funcs.c:363]: sl_reply_error(): ERROR: sl_reply_error used: No error (2/SL) Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000, 864); Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 864) called from tm: t_reply.c: relay_reply(1885), module: tm; Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: tm [t_reply.c:1887]: relay_reply(): ERROR: relay_reply: cannot alloc reply shmem Mar 1 12:39:37 sip7 /usr/local/sbin/kamailio[32038]: : <core> [mem/f_malloc.c:598]: fm_free(): BUG: fm_free: bad pointer 0x61743b3e6d6f632e (out of memory block!), called from tm: h_table.c: free_cell_helper(226) - aborting Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core> [main.c:740]: handle_sigs(): child process 32034 exited by a signal 10 Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core> [main.c:743]: handle_sigs(): core was generated Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: INFO: <core> [main.c:755]: handle_sigs(): terminating due to SIGCHLD Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32044]: INFO: <core> [main.c:810]: sig_usr(): signal 15 received =======================
I've tried to start with -m 512 - nothing changes.
Hardware: Xeon(R) CPU E5-2660, 16Gb RAM, 1Tb HDD.
Software:
OS: FreeBSD 10.3-STABLE (r313760) amd64
version: kamailio 4.4.5 (amd64/freebsd) f98162 flags: STATS: Off, USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_PTHREAD_MUTEX, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB poll method support: poll, select, kqueue. id: f98162 compiled on 12:25:48 Mar 1 2017 with clang 3.4
bt is here: http://tmp.lehis.ru/kam_gdb.txt I can't enable debug symbols for gdb (tried gmake mode=debug, which added EXTRA_DEBUG to flags). How can I do it?
I need in direction for resolve this issue, please, help.
Thanks.
Hello,
01.03.2017 13:51, Alexey V. Panfilov wrote:
Hi there,
I've kamailio 4.2.3 (i386/freebsd) which works perfectly with 200-300 cps for years.
Now I need migrate to freebsd amd64. I've installed kamailio 4.4.5 (amd64/freebsd), copied kamailio.cfg, made a test call - it was all right.
But when I start work load (200-300 cps), kamailio core dumped and exited. In logs (skipped "<script>:" having): ======================= Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000, 976); Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 976) called from core: msg_translator.c: build_req_buf_from_sip_req(2154), module: core; Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [msg_translator.c:2159]: build_req_buf_from_sip_req(): out of memory Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm [t_fwd.c:462]: prepare_new_uac(): could not build request Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm [t_fwd.c:1723]: t_forward_nonack(): ERROR: t_forward_nonack: failure to add branches Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: sl [sl_funcs.c:363]: sl_reply_error(): ERROR: sl_reply_error used: No error (2/SL) Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000, 864); Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 864) called from tm: t_reply.c: relay_reply(1885), module: tm; Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: tm [t_reply.c:1887]: relay_reply(): ERROR: relay_reply: cannot alloc reply shmem Mar 1 12:39:37 sip7 /usr/local/sbin/kamailio[32038]: : <core> [mem/f_malloc.c:598]: fm_free(): BUG: fm_free: bad pointer 0x61743b3e6d6f632e (out of memory block!), called from tm: h_table.c: free_cell_helper(226) - aborting Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core> [main.c:740]: handle_sigs(): child process 32034 exited by a signal 10 Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core> [main.c:743]: handle_sigs(): core was generated Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: INFO: <core> [main.c:755]: handle_sigs(): terminating due to SIGCHLD Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32044]: INFO: <core> [main.c:810]: sig_usr(): signal 15 received =======================
I've tried to start with -m 512 - nothing changes.
Hardware: Xeon(R) CPU E5-2660, 16Gb RAM, 1Tb HDD.
Software:
OS: FreeBSD 10.3-STABLE (r313760) amd64
version: kamailio 4.4.5 (amd64/freebsd) f98162 flags: STATS: Off, USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_PTHREAD_MUTEX, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB poll method support: poll, select, kqueue. id: f98162 compiled on 12:25:48 Mar 1 2017 with clang 3.4
bt is here: http://tmp.lehis.ru/kam_gdb.txt I can't enable debug symbols for gdb (tried gmake mode=debug, which added EXTRA_DEBUG to flags). How can I do it?
I need in direction for resolve this issue, please, help.
Thanks.
It's a pity: no answers for a week...
Hello,
can you open an issue on bug tracker? Having it there ensure that it is not forgotten and properly handles -- sometimes people travel and miss various messages on the mailing list. As a matter of fact for this specific case, your messages is put in spam folder for me by the gmail server and only spotted now as I looked into the mailing list archive.
I will try to look at it as soon as I get a chance, right now being out of the office.
Cheers, Daniel
On 07/03/2017 09:08, Alexey V. Panfilov wrote:
Hello,
01.03.2017 13:51, Alexey V. Panfilov wrote:
Hi there,
I've kamailio 4.2.3 (i386/freebsd) which works perfectly with 200-300 cps for years.
Now I need migrate to freebsd amd64. I've installed kamailio 4.4.5 (amd64/freebsd), copied kamailio.cfg, made a test call - it was all right.
But when I start work load (200-300 cps), kamailio core dumped and exited. In logs (skipped "<script>:" having): ======================= Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000, 976); Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 976) called from core: msg_translator.c: build_req_buf_from_sip_req(2154), module: core; Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [msg_translator.c:2159]: build_req_buf_from_sip_req(): out of memory Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm [t_fwd.c:462]: prepare_new_uac(): could not build request Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm [t_fwd.c:1723]: t_forward_nonack(): ERROR: t_forward_nonack: failure to add branches Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: sl [sl_funcs.c:363]: sl_reply_error(): ERROR: sl_reply_error used: No error (2/SL) Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000, 864); Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 864) called from tm: t_reply.c: relay_reply(1885), module: tm; Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: tm [t_reply.c:1887]: relay_reply(): ERROR: relay_reply: cannot alloc reply shmem Mar 1 12:39:37 sip7 /usr/local/sbin/kamailio[32038]: : <core> [mem/f_malloc.c:598]: fm_free(): BUG: fm_free: bad pointer 0x61743b3e6d6f632e (out of memory block!), called from tm: h_table.c: free_cell_helper(226) - aborting Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core> [main.c:740]: handle_sigs(): child process 32034 exited by a signal 10 Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core> [main.c:743]: handle_sigs(): core was generated Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: INFO: <core> [main.c:755]: handle_sigs(): terminating due to SIGCHLD Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32044]: INFO: <core> [main.c:810]: sig_usr(): signal 15 received =======================
I've tried to start with -m 512 - nothing changes.
Hardware: Xeon(R) CPU E5-2660, 16Gb RAM, 1Tb HDD.
Software:
OS: FreeBSD 10.3-STABLE (r313760) amd64
version: kamailio 4.4.5 (amd64/freebsd) f98162 flags: STATS: Off, USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_PTHREAD_MUTEX, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB poll method support: poll, select, kqueue. id: f98162 compiled on 12:25:48 Mar 1 2017 with clang 3.4
bt is here: http://tmp.lehis.ru/kam_gdb.txt I can't enable debug symbols for gdb (tried gmake mode=debug, which added EXTRA_DEBUG to flags). How can I do it?
I need in direction for resolve this issue, please, help.
Thanks.
It's a pity: no answers for a week...
Hello, Daniel!
Sure, issue is here - https://github.com/kamailio/kamailio/issues/1021
Thanks!
07.03.2017 12:58, Daniel-Constantin Mierla wrote:
Hello,
can you open an issue on bug tracker? Having it there ensure that it is not forgotten and properly handles -- sometimes people travel and miss various messages on the mailing list. As a matter of fact for this specific case, your messages is put in spam folder for me by the gmail server and only spotted now as I looked into the mailing list archive.
I will try to look at it as soon as I get a chance, right now being out of the office.
Cheers, Daniel
On 07/03/2017 09:08, Alexey V. Panfilov wrote:
Hello,
01.03.2017 13:51, Alexey V. Panfilov wrote:
Hi there,
I've kamailio 4.2.3 (i386/freebsd) which works perfectly with 200-300 cps for years.
Now I need migrate to freebsd amd64. I've installed kamailio 4.4.5 (amd64/freebsd), copied kamailio.cfg, made a test call - it was all right.
But when I start work load (200-300 cps), kamailio core dumped and exited. In logs (skipped "<script>:" having): ======================= Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000, 976); Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 976) called from core: msg_translator.c: build_req_buf_from_sip_req(2154), module: core; Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: <core> [msg_translator.c:2159]: build_req_buf_from_sip_req(): out of memory Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm [t_fwd.c:462]: prepare_new_uac(): could not build request Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: tm [t_fwd.c:1723]: t_forward_nonack(): ERROR: t_forward_nonack: failure to add branches Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32034]: ERROR: sl [sl_funcs.c:363]: sl_reply_error(): ERROR: sl_reply_error used: No error (2/SL) Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core> [mem/f_malloc.c:415]: fm_search_defrag(): fm_search_defrag(0x809937000, 864); Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: <core> [mem/f_malloc.c:498]: fm_malloc(): fm_malloc(0x809937000, 864) called from tm: t_reply.c: relay_reply(1885), module: tm; Free fragment not found! Mar 1 12:39:32 sip7 /usr/local/sbin/kamailio[32035]: ERROR: tm [t_reply.c:1887]: relay_reply(): ERROR: relay_reply: cannot alloc reply shmem Mar 1 12:39:37 sip7 /usr/local/sbin/kamailio[32038]: : <core> [mem/f_malloc.c:598]: fm_free(): BUG: fm_free: bad pointer 0x61743b3e6d6f632e (out of memory block!), called from tm: h_table.c: free_cell_helper(226) - aborting Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core> [main.c:740]: handle_sigs(): child process 32034 exited by a signal 10 Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: ALERT: <core> [main.c:743]: handle_sigs(): core was generated Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32031]: INFO: <core> [main.c:755]: handle_sigs(): terminating due to SIGCHLD Mar 1 12:39:39 sip7 /usr/local/sbin/kamailio[32044]: INFO: <core> [main.c:810]: sig_usr(): signal 15 received =======================
I've tried to start with -m 512 - nothing changes.
Hardware: Xeon(R) CPU E5-2660, 16Gb RAM, 1Tb HDD.
Software:
OS: FreeBSD 10.3-STABLE (r313760) amd64
version: kamailio 4.4.5 (amd64/freebsd) f98162 flags: STATS: Off, USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_PTHREAD_MUTEX, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES MAX_RECV_BUFFER_SIZE 262144, MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB poll method support: poll, select, kqueue. id: f98162 compiled on 12:25:48 Mar 1 2017 with clang 3.4
bt is here: http://tmp.lehis.ru/kam_gdb.txt I can't enable debug symbols for gdb (tried gmake mode=debug, which added EXTRA_DEBUG to flags). How can I do it?
I need in direction for resolve this issue, please, help.
Thanks.
It's a pity: no answers for a week...
-
Alexey V. Panfilov -
Daniel-Constantin Mierla