From miconda@gmail.com Mon May 11 16:55:52 2015
From: Daniel-Constantin Mierla <miconda@gmail.com>
To: sr-users@lists.kamailio.org
Subject: Re: [SR-Users] Keep-Alive in dialog "freeing a free fragment"
Date: Mon, 11 May 2015 16:55:43 +0200
Message-ID: <5550C2EF.9050408@gmail.com>
In-Reply-To: <554B7F50.9050006@signet.nl>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============1890152120=="

--===============1890152120==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

Hello,

the message "freeing a free fragment ..." is from Dialog KA Timer and
that process doesn't handle any SIP reply or the transmission timeout
callback. I will look at the code and see if I can spot where the double
free happens.

But now I understand that the dialog is actually not ended, right?

Cheers,
Daniel


On 07/05/15 17:05, Dirk Teurlings - SIGNET B.V. wrote:
> Hi Daniel,
>
> Good to see you found an improvement, not sure yet if it'll help us.
>
> Here is the non-debug log first. Just now I noticed that the initial
> dialog doesn't get ended as well now, 5fa4dc3670596fb626269f083b0c9480
> in the log.
>
> The setup is like this
>
> Leg 1 Kamailio -> Asterisk
>     Leg 2 (initialized by Asterisk) -> Kamailio -> Gateway
>
> First the output of ps
>
> Process::  ID=3D0 PID=3D21528 Type=3Dattendant
> Process::  ID=3D1 PID=3D21530 Type=3Dudp receiver child=3D0 sock=3D127.0.0.=
1:5060
> Process::  ID=3D2 PID=3D21531 Type=3Dudp receiver child=3D0
> sock=3D192.168.10.246:5060
> Process::  ID=3D3 PID=3D21532 Type=3Dudp receiver child=3D0
> sock=3D31.223.168.246:5060
> Process::  ID=3D4 PID=3D21533 Type=3Dudp receiver child=3D0 sock=3D[::1]:50=
60
> Process::  ID=3D5 PID=3D21534 Type=3Dudp receiver child=3D0
> sock=3D[2001:4cb8:34a:10::246]:5060
> Process::  ID=3D6 PID=3D21535 Type=3Dslow timer
> Process::  ID=3D7 PID=3D21536 Type=3Dtimer
> Process::  ID=3D8 PID=3D21537 Type=3DMI FIFO
> Process::  ID=3D9 PID=3D21538 Type=3Dctl handler
> Process::  ID=3D10 PID=3D21539 Type=3DTIMER NH
> Process::  ID=3D11 PID=3D21540 Type=3DDialog KA Timer
> Process::  ID=3D12 PID=3D21541 Type=3DDialog Clean Timer
> Process::  ID=3D13 PID=3D21542 Type=3DWLCC TB TIMER
> Process::  ID=3D14 PID=3D21543 Type=3DLLCC TB TIMER
> Process::  ID=3D15 PID=3D21544 Type=3Dtcp receiver (generic) child=3D0
> Process::  ID=3D16 PID=3D21545 Type=3Dtcp main process
>
> And the log
>
> May  7 18:54:43 vps-host /usr/sbin/kamailio[21532]: INFO: <script>:
> 5fa4dc3670596fb626269f083b0c9480(a)192.168.10.245:5060 - CC, dialog:start
> May  7 18:54:44 vps-host /usr/sbin/kamailio[21531]: INFO: <script>:
> 4d263e35-89ea921c(a)172.16.0.205 - CC, dialog:start
> May  7 18:55:57 vps-host /usr/sbin/kamailio[21535]: INFO: <script>:
> 123 - CC, dialog:end
> May  7 18:55:57 vps-host /usr/sbin/kamailio[21535]: INFO: <script>:
> 123 - WLCC: ENDCALL
> May  7 18:55:57 vps-host /usr/sbin/kamailio[21531]: WARNING: dialog
> [dlg_req_within.c:212]: bye_reply_cb(): inconsitent dlg timer data on
> dlg 0x7fa76e546600 [869:4705] with clid
> '5fa4dc3670596fb626269f083b0c9480(a)192.168.10.245:5060' and tags
> 'as155a87b8' '95b0a07565f99244i0'
> May  7 18:55:57 vps-host /usr/sbin/kamailio[21531]: INFO: <script>:
> 4d263e35-89ea921c(a)172.16.0.205 - CC, dialog:end
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>
>
> Is this enough, or do you need the full debug log? It's a bit heavy on
> the log because of continuous database lookups. But I could filter
> them down a bit if needed.
>
> Cheers,
> Dirk Teurlings
>
>
> On 07-05-15 13:31, Daniel-Constantin Mierla wrote:
>> Hello,
>>
>> I couldn't correlate the log message for double free with the code for
>> bye_reply_cb and dlg_ka_cb. The logs from pid 24493 shows only dialog
>> lookups and that double free message.
>>
>> Do you have the instance still running? Can you send the output of:
>>
>> kamctl ps
>>
>> Also, would be helpful to see some other logs messages printed just
>> before by pid 24493.
>>
>> By analyzing the code I found an improvement to be done, already
>> committed in master via:
>>
>> -
>> https://github.com/kamailio/kamailio/commit/04410aef38f5ed40c8f4a6796d9565=
8407e1597c
>>
>>
>> It is about being sure the dialog is still in confirmed state when the
>> keepalive callback is handled.
>>
>> But I can't be sure yet if that was the case resulting in double free.
>>
>> Cheers,
>> Daniel
>>
>> On 07/05/15 09:34, Dirk Teurlings - SIGNET B.V. wrote:
>>> Hi again,
>>>
>>> File dlg_req_within.c
>>>      function bye_reply_cb line: 166-236
>>>      functino dlg_ka_cb line: 240-275
>>>
>>> To help you out a bit more, this is important part of the log.
>>>
>>>
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>> [dlg_hash.c:1066]: next_state_dlg(): dialog 0x7f812f2585e8 changed
>>> from state 4 to state 5, due event 7 (ref 5)
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>> [dlg_req_within.c:195]: bye_reply_cb(): removing dialog with h_entry
>>> 1231 and h_id 1142
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: WARNING: dialog
>>> [dlg_req_within.c:212]: bye_reply_cb(): inconsitent dlg timer data on
>>> dlg 0x7f812f2585e8 [1231:1142] with clid
>>> '6fcb9a946131aad41e1deda730c6b76a(a)192.168.10.245:5060' and tags
>>> 'as57b6a153' 'c42610a13600fe22i0'
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>> [dlg_cb.c:256]: run_dlg_callbacks(): dialog=3D0x7f812f2585e8, type=3D64
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>> [dlg_req_within.c:219]: bye_reply_cb(): first final reply
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>> [dlg_hash.c:872]: dlg_unref(): unref dlg 0x7f812f2585e8 with 2 -> 3
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>> [dlg_handlers.c:324]: dlg_iuid_sfree(): freeing dlg iuid [1231:1142]
>>> (0x7f812f2529f0)
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: tm
>>> [t_reply.c:1653]: cleanup_uac_timers(): DEBUG: cleanup_uac_timers:
>>> RETR/FR timers reset
>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>> [dlg_var.c:81]: cb_dlg_locals_reset(): resetting the local dialog
>>> shortcuts on script callback: 2147483652
>>>
>>> ...
>>>
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24484]: DEBUG: <core>
>>> [xavp.c:448]: xavp_destroy_list(): destroying xavp list (nil)
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24484]: DEBUG: <core>
>>> [receive.c:298]: receive_msg(): receive_msg: cleaning up
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm
>>> [t_reply.c:1294]: t_should_relay_response(): ->>>>>>>>> T_code=3D0,
>>> new_code=3D408
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm
>>> [t_reply.c:2080]: local_reply(): DEBUG: local_reply: branch=3D0, save=3D0,
>>> winner=3D0
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm
>>> [t_reply.c:2117]: local_reply(): DEBUG: local transaction completed
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm
>>> [t_hooks.c:288]: run_trans_callbacks_internal(): DBG:
>>> trans=3D0x7f812f256fd0, callback type 1024, id 0 entered
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog
>>> [dlg_req_within.c:255]: dlg_ka_cb(): receiving a final reply 408
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog
>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D1142 found on entry 1231
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog
>>> [dlg_handlers.c:324]: dlg_iuid_sfree(): freeing dlg iuid [1231:1142]
>>> (0x7f812f252ba0)
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog
>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D1142 found on entry 1231
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog
>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D11917 found on entry 68
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog
>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D1142 found on entry 1231
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: INFO: <core>
>>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>>> (0x7f812f252ad0/0x7f812f252b08) - ignore
>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog
>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D11917 found on entry 68
>>> etc...
>>>
>>>
>>> Cheers,
>>> Dirk Teurlings
>>>
>>>
>>> On 07-05-15 09:03, Daniel-Constantin Mierla wrote:
>>>> Hello,
>>>>
>>>> thanks for reporting and troubleshooting.
>>>>
>>>> Can you refer to the code (file+lines) for step 3 and 4? It will
>>>> save me
>>>> some time to look into the code and fix the issue.
>>>>
>>>> Cheers,
>>>> Daniel
>>>>
>>>> On 07/05/15 08:46, Dirk Teurlings - SIGNET B.V. wrote:
>>>>> Hi,
>>>>>
>>>>> (Kamailio 4.2.3)
>>>>>
>>>>> Working to get dialogs closed and cleaned up nicely I'm looking into
>>>>> the ka_interval and ka_timer parameter of the dialog module. The
>>>>> following is now happening.
>>>>>
>>>>> Scenario:
>>>>> 1. Call gets setup
>>>>> 2. Callee's internet connection drops
>>>>> 3. Call gets terminated (nicely) due to ka_timer/ka_interval
>>>>> 4. Log fills with "freeing a free fragment" after about 10 seconds
>>>>>
>>>>> Digging into this I saw that the dialog is being closed and cleaned
>>>>> properly in step 3. But it fails to remove/clean the timers used for
>>>>> the keep-alive. That's what triggers step 4, which in turn tries to
>>>>> clean the (or some of the) dialog space again. Is this expected
>>>>> behaviour when using the keep-alive options, or am I running into
>>>>> somekind of (known) bug?
>>>>>
>>>>> Thanks in advance for any help.
>>>>>
>>>>
>>

--=20
Daniel-Constantin Mierla
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
Kamailio World Conference, May 27-29, 2015
Berlin, Germany - http://www.kamailioworld.com



--===============1890152120==--