Hello,
master is still the code to be 4.3, we will make a dedicated branch sometime soon.
The patch will be backported to 4.2 as well. Thanks for helping to troubleshoot and testing.
Cheers, Daniel
On 12/05/15 10:03, Dirk Teurlings - SIGNET B.V. wrote:
Hi Daniel,
This fixes the problem, thanks very much,
Will this fix be included in the next (4.2 and/or 4.3) stable release?
Cheers, Dirk Teurlings
On 11-05-15 17:25, Daniel-Constantin Mierla wrote:
Following quickly up, I pushed another patch that will remove the dialog from keepalive list as soon as 'deleted' state is discovered and also sends keepalive options only if dialog is in state 'confirmed'.
Can you test the patch and see how it works?
https://github.com/kamailio/kamailio/commit/0e22abe2b89be8936df4b8230955fbaf...
Cheers, Daniel
On 11/05/15 16:55, Daniel-Constantin Mierla wrote:
Hello,
the message "freeing a free fragment ..." is from Dialog KA Timer and that process doesn't handle any SIP reply or the transmission timeout callback. I will look at the code and see if I can spot where the double free happens.
But now I understand that the dialog is actually not ended, right?
Cheers, Daniel
On 07/05/15 17:05, Dirk Teurlings - SIGNET B.V. wrote:
Hi Daniel,
Good to see you found an improvement, not sure yet if it'll help us.
Here is the non-debug log first. Just now I noticed that the initial dialog doesn't get ended as well now, 5fa4dc3670596fb626269f083b0c9480 in the log.
The setup is like this
Leg 1 Kamailio -> Asterisk Leg 2 (initialized by Asterisk) -> Kamailio -> Gateway
First the output of ps
Process:: ID=0 PID=21528 Type=attendant Process:: ID=1 PID=21530 Type=udp receiver child=0 sock=127.0.0.1:5060 Process:: ID=2 PID=21531 Type=udp receiver child=0 sock=192.168.10.246:5060 Process:: ID=3 PID=21532 Type=udp receiver child=0 sock=31.223.168.246:5060 Process:: ID=4 PID=21533 Type=udp receiver child=0 sock=[::1]:5060 Process:: ID=5 PID=21534 Type=udp receiver child=0 sock=[2001:4cb8:34a:10::246]:5060 Process:: ID=6 PID=21535 Type=slow timer Process:: ID=7 PID=21536 Type=timer Process:: ID=8 PID=21537 Type=MI FIFO Process:: ID=9 PID=21538 Type=ctl handler Process:: ID=10 PID=21539 Type=TIMER NH Process:: ID=11 PID=21540 Type=Dialog KA Timer Process:: ID=12 PID=21541 Type=Dialog Clean Timer Process:: ID=13 PID=21542 Type=WLCC TB TIMER Process:: ID=14 PID=21543 Type=LLCC TB TIMER Process:: ID=15 PID=21544 Type=tcp receiver (generic) child=0 Process:: ID=16 PID=21545 Type=tcp main process
And the log
May 7 18:54:43 vps-host /usr/sbin/kamailio[21532]: INFO: <script>: 5fa4dc3670596fb626269f083b0c9480@192.168.10.245:5060 - CC, dialog:start May 7 18:54:44 vps-host /usr/sbin/kamailio[21531]: INFO: <script>: 4d263e35-89ea921c@172.16.0.205 - CC, dialog:start May 7 18:55:57 vps-host /usr/sbin/kamailio[21535]: INFO: <script>: 123 - CC, dialog:end May 7 18:55:57 vps-host /usr/sbin/kamailio[21535]: INFO: <script>: 123 - WLCC: ENDCALL May 7 18:55:57 vps-host /usr/sbin/kamailio[21531]: WARNING: dialog [dlg_req_within.c:212]: bye_reply_cb(): inconsitent dlg timer data on dlg 0x7fa76e546600 [869:4705] with clid '5fa4dc3670596fb626269f083b0c9480@192.168.10.245:5060' and tags 'as155a87b8' '95b0a07565f99244i0' May 7 18:55:57 vps-host /usr/sbin/kamailio[21531]: INFO: <script>: 4d263e35-89ea921c@172.16.0.205 - CC, dialog:end May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54a4a8/0x7fa76e54a4e0) - ignore May 7 18:56:17 vps-host /usr/sbin/kamailio[21540]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7fa76e54aeb8/0x7fa76e54aef0) - ignore
Is this enough, or do you need the full debug log? It's a bit heavy on the log because of continuous database lookups. But I could filter them down a bit if needed.
Cheers, Dirk Teurlings
On 07-05-15 13:31, Daniel-Constantin Mierla wrote:
Hello,
I couldn't correlate the log message for double free with the code for bye_reply_cb and dlg_ka_cb. The logs from pid 24493 shows only dialog lookups and that double free message.
Do you have the instance still running? Can you send the output of:
kamctl ps
Also, would be helpful to see some other logs messages printed just before by pid 24493.
By analyzing the code I found an improvement to be done, already committed in master via:
https://github.com/kamailio/kamailio/commit/04410aef38f5ed40c8f4a6796d956584...
It is about being sure the dialog is still in confirmed state when the keepalive callback is handled.
But I can't be sure yet if that was the case resulting in double free.
Cheers, Daniel
On 07/05/15 09:34, Dirk Teurlings - SIGNET B.V. wrote:
Hi again,
File dlg_req_within.c function bye_reply_cb line: 166-236 functino dlg_ka_cb line: 240-275
To help you out a bit more, this is important part of the log.
May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog [dlg_hash.c:1066]: next_state_dlg(): dialog 0x7f812f2585e8 changed from state 4 to state 5, due event 7 (ref 5) May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog [dlg_req_within.c:195]: bye_reply_cb(): removing dialog with h_entry 1231 and h_id 1142 May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: WARNING: dialog [dlg_req_within.c:212]: bye_reply_cb(): inconsitent dlg timer data on dlg 0x7f812f2585e8 [1231:1142] with clid '6fcb9a946131aad41e1deda730c6b76a@192.168.10.245:5060' and tags 'as57b6a153' 'c42610a13600fe22i0' May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog [dlg_cb.c:256]: run_dlg_callbacks(): dialog=0x7f812f2585e8, type=64 May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog [dlg_req_within.c:219]: bye_reply_cb(): first final reply May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog [dlg_hash.c:872]: dlg_unref(): unref dlg 0x7f812f2585e8 with 2 -> 3 May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog [dlg_handlers.c:324]: dlg_iuid_sfree(): freeing dlg iuid [1231:1142] (0x7f812f2529f0) May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: tm [t_reply.c:1653]: cleanup_uac_timers(): DEBUG: cleanup_uac_timers: RETR/FR timers reset May 4 18:09:42 vps-host /usr/sbin/kamailio[24484]: DEBUG: dialog [dlg_var.c:81]: cb_dlg_locals_reset(): resetting the local dialog shortcuts on script callback: 2147483652
...
May 4 18:10:02 vps-host /usr/sbin/kamailio[24484]: DEBUG: <core> [xavp.c:448]: xavp_destroy_list(): destroying xavp list (nil) May 4 18:10:02 vps-host /usr/sbin/kamailio[24484]: DEBUG: <core> [receive.c:298]: receive_msg(): receive_msg: cleaning up May 4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm [t_reply.c:1294]: t_should_relay_response(): ->>>>>>>>> T_code=0, new_code=408 May 4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm [t_reply.c:2080]: local_reply(): DEBUG: local_reply: branch=0, save=0, winner=0 May 4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm [t_reply.c:2117]: local_reply(): DEBUG: local transaction completed May 4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: tm [t_hooks.c:288]: run_trans_callbacks_internal(): DBG: trans=0x7f812f256fd0, callback type 1024, id 0 entered May 4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog [dlg_req_within.c:255]: dlg_ka_cb(): receiving a final reply 408 May 4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog [dlg_hash.c:663]: dlg_lookup(): no dialog id=1142 found on entry 1231 May 4 18:10:02 vps-host /usr/sbin/kamailio[24488]: DEBUG: dialog [dlg_handlers.c:324]: dlg_iuid_sfree(): freeing dlg iuid [1231:1142] (0x7f812f252ba0) May 4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog [dlg_hash.c:663]: dlg_lookup(): no dialog id=1142 found on entry 1231 May 4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog [dlg_hash.c:663]: dlg_lookup(): no dialog id=11917 found on entry 68 May 4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog [dlg_hash.c:663]: dlg_lookup(): no dialog id=1142 found on entry 1231 May 4 18:10:02 vps-host /usr/sbin/kamailio[24493]: INFO: <core> [mem/f_malloc.c:599]: fm_free(): freeing a free fragment (0x7f812f252ad0/0x7f812f252b08) - ignore May 4 18:10:02 vps-host /usr/sbin/kamailio[24493]: DEBUG: dialog [dlg_hash.c:663]: dlg_lookup(): no dialog id=11917 found on entry 68 etc...
Cheers, Dirk Teurlings
On 07-05-15 09:03, Daniel-Constantin Mierla wrote: > Hello, > > thanks for reporting and troubleshooting. > > Can you refer to the code (file+lines) for step 3 and 4? It will > save me > some time to look into the code and fix the issue. > > Cheers, > Daniel > > On 07/05/15 08:46, Dirk Teurlings - SIGNET B.V. wrote: >> Hi, >> >> (Kamailio 4.2.3) >> >> Working to get dialogs closed and cleaned up nicely I'm looking >> into >> the ka_interval and ka_timer parameter of the dialog module. The >> following is now happening. >> >> Scenario: >> 1. Call gets setup >> 2. Callee's internet connection drops >> 3. Call gets terminated (nicely) due to ka_timer/ka_interval >> 4. Log fills with "freeing a free fragment" after about 10 seconds >> >> Digging into this I saw that the dialog is being closed and >> cleaned >> properly in step 3. But it fails to remove/clean the timers >> used for >> the keep-alive. That's what triggers step 4, which in turn >> tries to >> clean the (or some of the) dialog space again. Is this expected >> behaviour when using the keep-alive options, or am I running into >> somekind of (known) bug? >> >> Thanks in advance for any help. >>