From miconda@gmail.com Mon May 11 17:25:21 2015
From: Daniel-Constantin Mierla <miconda@gmail.com>
To: sr-users@lists.kamailio.org
Subject: Re: [SR-Users] Keep-Alive in dialog "freeing a free fragment"
Date: Mon, 11 May 2015 17:25:12 +0200
Message-ID: <5550C9D8.7010707@gmail.com>
In-Reply-To: <5550C2EF.9050408@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============0507470596=="

--===============0507470596==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

Following quickly up, I pushed another patch that will remove the dialog
from keepalive list as soon as 'deleted' state is discovered and also
sends keepalive options only if dialog is in state 'confirmed'.

Can you test the patch and see how it works?

  -
https://github.com/kamailio/kamailio/commit/0e22abe2b89be8936df4b8230955fbaf4=
3ad40e7

Cheers,
Daniel

On 11/05/15 16:55, Daniel-Constantin Mierla wrote:
> Hello,
>
> the message "freeing a free fragment ..." is from Dialog KA Timer and
> that process doesn't handle any SIP reply or the transmission timeout
> callback. I will look at the code and see if I can spot where the double
> free happens.
>
> But now I understand that the dialog is actually not ended, right?
>
> Cheers,
> Daniel
>
>
> On 07/05/15 17:05, Dirk Teurlings - SIGNET B.V. wrote:
>> Hi Daniel,
>>
>> Good to see you found an improvement, not sure yet if it'll help us.
>>
>> Here is the non-debug log first. Just now I noticed that the initial
>> dialog doesn't get ended as well now, 5fa4dc3670596fb626269f083b0c9480
>> in the log.
>>
>> The setup is like this
>>
>> Leg 1 Kamailio -> Asterisk
>>     Leg 2 (initialized by Asterisk) -> Kamailio -> Gateway
>>
>> First the output of ps
>>
>> Process::  ID=3D0 PID=3D21528 Type=3Dattendant
>> Process::  ID=3D1 PID=3D21530 Type=3Dudp receiver child=3D0 sock=3D127.0.0=
.1:5060
>> Process::  ID=3D2 PID=3D21531 Type=3Dudp receiver child=3D0
>> sock=3D192.168.10.246:5060
>> Process::  ID=3D3 PID=3D21532 Type=3Dudp receiver child=3D0
>> sock=3D31.223.168.246:5060
>> Process::  ID=3D4 PID=3D21533 Type=3Dudp receiver child=3D0 sock=3D[::1]:5=
060
>> Process::  ID=3D5 PID=3D21534 Type=3Dudp receiver child=3D0
>> sock=3D[2001:4cb8:34a:10::246]:5060
>> Process::  ID=3D6 PID=3D21535 Type=3Dslow timer
>> Process::  ID=3D7 PID=3D21536 Type=3Dtimer
>> Process::  ID=3D8 PID=3D21537 Type=3DMI FIFO
>> Process::  ID=3D9 PID=3D21538 Type=3Dctl handler
>> Process::  ID=3D10 PID=3D21539 Type=3DTIMER NH
>> Process::  ID=3D11 PID=3D21540 Type=3DDialog KA Timer
>> Process::  ID=3D12 PID=3D21541 Type=3DDialog Clean Timer
>> Process::  ID=3D13 PID=3D21542 Type=3DWLCC TB TIMER
>> Process::  ID=3D14 PID=3D21543 Type=3DLLCC TB TIMER
>> Process::  ID=3D15 PID=3D21544 Type=3Dtcp receiver (generic) child=3D0
>> Process::  ID=3D16 PID=3D21545 Type=3Dtcp main process
>>
>> And the log
>>
>> May  7 18:54:43 vps-host /usr/sbin/kamailio[21532]: INFO: <script>:
>> 5fa4dc3670596fb626269f083b0c9480(a)192.168.10.245:5060 - CC, dialog:start
>> May  7 18:54:44 vps-host /usr/sbin/kamailio[21531]: INFO: <script>:
>> 4d263e35-89ea921c(a)172.16.0.205 - CC, dialog:start
>> May  7 18:55:57 vps-host /usr/sbin/kamailio[21535]: INFO: <script>:
>> 123 - CC, dialog:end
>> May  7 18:55:57 vps-host /usr/sbin/kamailio[21535]: INFO: <script>:
>> 123 - WLCC: ENDCALL
>> May  7 18:55:57 vps-host /usr/sbin/kamailio[21531]: WARNING: dialog
>> [dlg_req_within.c:212]: bye_reply_cb(): inconsitent dlg timer data on
>> dlg 0x7fa76e546600 [869:4705] with clid
>> '5fa4dc3670596fb626269f083b0c9480(a)192.168.10.245:5060' and tags
>> 'as155a87b8' '95b0a07565f99244i0'
>> May  7 18:55:57 vps-host /usr/sbin/kamailio[21531]: INFO: <script>:
>> 4d263e35-89ea921c(a)172.16.0.205 - CC, dialog:end
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore
>> May  7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core>
>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>> (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
>>
>>
>> Is this enough, or do you need the full debug log? It's a bit heavy on
>> the log because of continuous database lookups. But I could filter
>> them down a bit if needed.
>>
>> Cheers,
>> Dirk Teurlings
>>
>>
>> On 07-05-15 13:31, Daniel-Constantin Mierla wrote:
>>> Hello,
>>>
>>> I couldn't correlate the log message for double free with the code for
>>> bye_reply_cb and dlg_ka_cb. The logs from pid 24493 shows only dialog
>>> lookups and that double free message.
>>>
>>> Do you have the instance still running? Can you send the output of:
>>>
>>> kamctl ps
>>>
>>> Also, would be helpful to see some other logs messages printed just
>>> before by pid 24493.
>>>
>>> By analyzing the code I found an improvement to be done, already
>>> committed in master via:
>>>
>>> -
>>> https://github.com/kamailio/kamailio/commit/04410aef38f5ed40c8f4a6796d956=
58407e1597c
>>>
>>>
>>> It is about being sure the dialog is still in confirmed state when the
>>> keepalive callback is handled.
>>>
>>> But I can't be sure yet if that was the case resulting in double free.
>>>
>>> Cheers,
>>> Daniel
>>>
>>> On 07/05/15 09:34, Dirk Teurlings - SIGNET B.V. wrote:
>>>> Hi again,
>>>>
>>>> File dlg_req_within.c
>>>>      function bye_reply_cb line: 166-236
>>>>      functino dlg_ka_cb line: 240-275
>>>>
>>>> To help you out a bit more, this is important part of the log.
>>>>
>>>>
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>>> [dlg_hash.c:1066]: next_state_dlg(): dialog 0x7f812f2585e8 changed
>>>> from state 4 to state 5, due event 7 (ref 5)
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>>> [dlg_req_within.c:195]: bye_reply_cb(): removing dialog with h_entry
>>>> 1231 and h_id 1142
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: WARNING: dialog
>>>> [dlg_req_within.c:212]: bye_reply_cb(): inconsitent dlg timer data on
>>>> dlg 0x7f812f2585e8 [1231:1142] with clid
>>>> '6fcb9a946131aad41e1deda730c6b76a(a)192.168.10.245:5060' and tags
>>>> 'as57b6a153' 'c42610a13600fe22i0'
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>>> [dlg_cb.c:256]: run_dlg_callbacks(): dialog=3D0x7f812f2585e8, type=3D64
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>>> [dlg_req_within.c:219]: bye_reply_cb(): first final reply
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>>> [dlg_hash.c:872]: dlg_unref(): unref dlg 0x7f812f2585e8 with 2 -> 3
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>>> [dlg_handlers.c:324]: dlg_iuid_sfree(): freeing dlg iuid [1231:1142]
>>>> (0x7f812f2529f0)
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: tm
>>>> [t_reply.c:1653]: cleanup_uac_timers(): DEBUG: cleanup_uac_timers:
>>>> RETR/FR timers reset
>>>> May  4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog
>>>> [dlg_var.c:81]: cb_dlg_locals_reset(): resetting the local dialog
>>>> shortcuts on script callback: 2147483652
>>>>
>>>> ...
>>>>
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24484]: DEBUG: <core>
>>>> [xavp.c:448]: xavp_destroy_list(): destroying xavp list (nil)
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24484]: DEBUG: <core>
>>>> [receive.c:298]: receive_msg(): receive_msg: cleaning up
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm
>>>> [t_reply.c:1294]: t_should_relay_response(): ->>>>>>>>> T_code=3D0,
>>>> new_code=3D408
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm
>>>> [t_reply.c:2080]: local_reply(): DEBUG: local_reply: branch=3D0, save=3D=
0,
>>>> winner=3D0
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm
>>>> [t_reply.c:2117]: local_reply(): DEBUG: local transaction completed
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm
>>>> [t_hooks.c:288]: run_trans_callbacks_internal(): DBG:
>>>> trans=3D0x7f812f256fd0, callback type 1024, id 0 entered
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog
>>>> [dlg_req_within.c:255]: dlg_ka_cb(): receiving a final reply 408
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog
>>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D1142 found on entry 1231
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog
>>>> [dlg_handlers.c:324]: dlg_iuid_sfree(): freeing dlg iuid [1231:1142]
>>>> (0x7f812f252ba0)
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog
>>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D1142 found on entry 1231
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog
>>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D11917 found on entry 68
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog
>>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D1142 found on entry 1231
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: INFO: <core>
>>>> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment
>>>> (0x7f812f252ad0/0x7f812f252b08) - ignore
>>>> May  4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog
>>>> [dlg_hash.c:663]: dlg_lookup(): no dialog id=3D11917 found on entry 68
>>>> etc...
>>>>
>>>>
>>>> Cheers,
>>>> Dirk Teurlings
>>>>
>>>>
>>>> On 07-05-15 09:03, Daniel-Constantin Mierla wrote:
>>>>> Hello,
>>>>>
>>>>> thanks for reporting and troubleshooting.
>>>>>
>>>>> Can you refer to the code (file+lines) for step 3 and 4? It will
>>>>> save me
>>>>> some time to look into the code and fix the issue.
>>>>>
>>>>> Cheers,
>>>>> Daniel
>>>>>
>>>>> On 07/05/15 08:46, Dirk Teurlings - SIGNET B.V. wrote:
>>>>>> Hi,
>>>>>>
>>>>>> (Kamailio 4.2.3)
>>>>>>
>>>>>> Working to get dialogs closed and cleaned up nicely I'm looking into
>>>>>> the ka_interval and ka_timer parameter of the dialog module. The
>>>>>> following is now happening.
>>>>>>
>>>>>> Scenario:
>>>>>> 1. Call gets setup
>>>>>> 2. Callee's internet connection drops
>>>>>> 3. Call gets terminated (nicely) due to ka_timer/ka_interval
>>>>>> 4. Log fills with "freeing a free fragment" after about 10 seconds
>>>>>>
>>>>>> Digging into this I saw that the dialog is being closed and cleaned
>>>>>> properly in step 3. But it fails to remove/clean the timers used for
>>>>>> the keep-alive. That's what triggers step 4, which in turn tries to
>>>>>> clean the (or some of the) dialog space again. Is this expected
>>>>>> behaviour when using the keep-alive options, or am I running into
>>>>>> somekind of (known) bug?
>>>>>>
>>>>>> Thanks in advance for any help.
>>>>>>

--=20
Daniel-Constantin Mierla
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
Kamailio World Conference, May 27-29, 2015
Berlin, Germany - http://www.kamailioworld.com



--===============0507470596==--