Hi Henning & Charles,
So far the module performed pretty good for us.
But there might be a problem, when I shut down Kamailio I see this in the logs :
ERROR: memcached [memcached.c:255]: mod_destroy(): memory manager callbacks not removed, returned INVALID ARGUMENTS but continue anyway
It also dumps core at shutdown: http://pastebin.com/5uJJ3tp4
Regards, Dragos
________________________________ From: Henning Westerholt hw@kamailio.org To: sr-users@lists.sip-router.org Cc: Charles Chance charles.chance@sipcentric.com; Dragos Oancea droancea@yahoo.com Sent: Friday, June 14, 2013 6:24 PM Subject: Re: [SR-Users] memcache problem - reporting protocol error
Am Freitag, 7. Juni 2013, 12:07:00 schrieb Charles Chance:
Yes, that should work fine.
Cheers,
Hello Dragos,
just one thing to add - if you find any issues with the master version of the module, please report to our developer list that we could take a look.
Best regards,
Henning Westerholt
Hi Dragos,
I don't think it will make a difference, but do you still see the problem if you build/run Kamailio completely from master, instead of just copying across the compiled memcache module?
Cheers,
Charles
On 17 June 2013 15:43, Dragos Oancea droancea@yahoo.com wrote:
Hi Henning & Charles,
So far the module performed pretty good for us.
But there might be a problem, when I shut down Kamailio I see this in the logs :
ERROR: memcached [memcached.c:255]: mod_destroy(): memory manager callbacks not removed, returned INVALID ARGUMENTS but continue anyway
It also dumps core at shutdown: http://pastebin.com/5uJJ3tp4
Regards, Dragos
*From:* Henning Westerholt hw@kamailio.org *To:* sr-users@lists.sip-router.org *Cc:* Charles Chance charles.chance@sipcentric.com; Dragos Oancea < droancea@yahoo.com> *Sent:* Friday, June 14, 2013 6:24 PM *Subject:* Re: [SR-Users] memcache problem - reporting protocol error
Am Freitag, 7. Juni 2013, 12:07:00 schrieb Charles Chance:
Yes, that should work fine.
Cheers,
Hello Dragos,
just one thing to add - if you find any issues with the master version of the module, please report to our developer list that we could take a look.
Best regards,
Henning Westerholt
Hi Charles,
Yes, when I build and run it completely from master, I have the same issue.
So I get this when I shut it down with `killall kamailio`. This time I run it with log_stderror=yes , so it prints alot of debugging messages - it seems it tries to free() un-allocated memory :
........ 37(18544) DEBUG: <core> [main.c:856]: sig_usr(): Memory still-in-use summary (pkg): 0(18507) DEBUG: memcached [memcached.c:251]: mod_destroy(): remove memory manager callbacks 0(18507) DEBUG: memcached [memcached.c:254]: mod_destroy(): memory manager callbacks removed*** glibc detected *** /opt/kamailio/sbin/kamailio: free(): invalid pointer: 0x00007fd4767b57f0 *** ======= Backtrace: ========= /lib64/libc.so.6(+0x760e6)[0x7fd476a770e6] /usr/local/lib/libmemcached.so.11(+0x1711a)[0x7fd46d8f911a] /opt/kamailio/sbin/kamailio(destroy_modules+0x1f)[0x4ed69f] /opt/kamailio/sbin/kamailio(cleanup+0x2d)[0x466a6d] /opt/kamailio/sbin/kamailio[0x4677bf] /opt/kamailio/sbin/kamailio(handle_sigs+0x20f)[0x467abf] /opt/kamailio/sbin/kamailio(main_loop+0x151c)[0x46a12c] /opt/kamailio/sbin/kamailio(main+0x1619)[0x46bda9] /lib64/libc.so.6(__libc_start_main+0xfd)[0x7fd476a1fcdd] /opt/kamailio/sbin/kamailio[0x4145e9] ........
I use libmemcached version 1.0.17 . Let me know if I can help you debug this.
Regards, Dragos
________________________________ From: Charles Chance charles.chance@sipcentric.com To: Dragos Oancea droancea@yahoo.com Cc: "sr-dev@lists.sip-router.org" sr-dev@lists.sip-router.org Sent: Tuesday, June 18, 2013 12:01 PM Subject: Re: the new memcache module
Hi Dragos,
I don't think it will make a difference, but do you still see the problem if you build/run Kamailio completely from master, instead of just copying across the compiled memcache module?
Cheers,
Charles
On 17 June 2013 15:43, Dragos Oancea droancea@yahoo.com wrote:
Hi Henning & Charles,
So far the module performed pretty good for us.
But there might be a problem, when I shut down Kamailio I see this in the logs :
ERROR: memcached [memcached.c:255]: mod_destroy(): memory manager callbacks not removed, returned INVALID ARGUMENTS but continue anyway
It also dumps core at shutdown: http://pastebin.com/5uJJ3tp4
Regards, Dragos
From: Henning Westerholt hw@kamailio.org To: sr-users@lists.sip-router.org Cc: Charles Chance charles.chance@sipcentric.com; Dragos Oancea droancea@yahoo.com Sent: Friday, June 14, 2013 6:24 PM Subject: Re: [SR-Users] memcache problem - reporting protocol error
Am Freitag, 7. Juni 2013, 12:07:00 schrieb Charles Chance:
Yes, that should work fine.
Cheers,
Hello Dragos,
just one thing to add - if you find any issues with the master version of the module, please report to our developer list that we could take a look.
Best
regards,
Henning Westerholt
www.sipcentric.com
Follow us on twitter @sipcentric
Sipcentric Ltd. Company registered in England & Wales no. 7365592. Registered office: Unit 10 iBIC, Birmingham Science Park, Holt Court South, Birmingham B7 4EJ.
Am Dienstag, 18. Juni 2013, 08:24:49 schrieb Dragos Oancea:
Yes, when I build and run it completely from master, I have the same issue.
So I get this when I shut it down with `killall kamailio`. This time I run it with log_stderror=yes , so it prints alot of debugging messages - it seems it tries to free() un-allocated memory :
Hi Dragos,
thank you for the report. Good to know that it works generally fine for you. :-) With regards to the crash on shutdown you observe, I'll have a look in the next days to it. In my tests it worked correctly so far, so I need to try to reproduce it as well.
Best regards,
Henning Westerholt
Am Montag, 17. Juni 2013, 07:43:16 schrieb Dragos Oancea:
So far the module performed pretty good for us.
But there might be a problem, when I shut down Kamailio I see this in the logs :
ERROR: memcached [memcached.c:255]: mod_destroy(): memory manager callbacks not removed, returned INVALID ARGUMENTS but continue anyway
It also dumps core at shutdown: http://pastebin.com/5uJJ3tp4
Hello Dragos,
I was able to reproduce your crash in my installation. I've did a few changes to the module, including making the memory manager setting configurable. It would be great if you could test again. In my tests my changes fixed the crash.
Best regards,
Henning Westerholt
Hi Henning,
Good work. I just compiled, did a few tests and let it run on a box. It's working fine. Just a question , the memory manager was the `system` one before your latest patch, right ? aka dlmalloc. ?
Since we're using the module and we plan to go to production with it very soon, I will be watching the logs for anything abnormal.
Cheers, Dragos
________________________________ From: Henning Westerholt hw@kamailio.org To: Dragos Oancea droancea@yahoo.com Cc: "sr-dev@lists.sip-router.org" sr-dev@lists.sip-router.org; Charles Chance charles.chance@sipcentric.com Sent: Tuesday, July 2, 2013 3:56 PM Subject: Re: the new memcache module
Am Montag, 17. Juni 2013, 07:43:16 schrieb Dragos Oancea:
So far the module performed pretty good for us.
But there might be a problem, when I shut down Kamailio I see this in the logs :
ERROR: memcached [memcached.c:255]: mod_destroy(): memory manager callbacks not removed, returned INVALID ARGUMENTS but continue anyway
It also dumps core at shutdown: http://pastebin.com/5uJJ3tp4
Hello Dragos,
I was able to reproduce your crash in my installation. I've did a few changes to the module, including making the memory manager setting configurable. It would be great if you could test again. In my tests my changes fixed the crash.
Best regards,
Henning Westerholt
Am Dienstag, 2. Juli 2013, 07:51:32 schrieb Dragos Oancea:
Good work. I just compiled, did a few tests and let it run on a box. It's working fine. Just a question , the memory manager was the `system` one before your latest patch, right ? aka dlmalloc. ?
Since we're using the module and we plan to go to production with it very soon, I will be watching the logs for anything abnormal.
Hello Dragos,
no, the memory manager was the one from Kamailio before my latest patch. I changed this also based from your crash report and because of the feedback I got from the "old" module which also used the internal memory manager.
Best regards,
Henning Westerholt
-
Charles Chance -
Dragos Oancea -
Henning Westerholt