First, send the backtrace. gdb /path/to/kamailio /path/to/corefile then bt. Then see if you have any other log messages from pid 19935. The logs before are more important that what is after. Also, by last version you mean 3.1.0 or the latest GIT version of 3.1. If you use 3.1.0 then there were couple of fixes already, so update to latest git branch. 3.1.1 should be released soon with all these fixes. Cheers, Daniel On 11/25/10 12:13 AM, michel freiha wrote: -- Daniel-Constantin Mierla Kamailio (OpenSER) Advanced Training Jan 24-26, 2011, Irvine, CA, USA http://www.asipto.com

this seems to me like something already fixed after 3.1.0. You haven't said what version are you running, is it git stable branch or tarball? Cheers, Daniel On 11/25/10 10:05 AM, michel freiha wrote: -- Daniel-Constantin Mierla Kamailio (OpenSER) Advanced Training Jan 24-26, 2011, Irvine, CA, USA http://www.asipto.com

A number of significant things have been fixed in the git master branch since the 3.1.0 tarball, but all or some of those fixes have also been backported to the 3.1 branch. I do not know if they have been generated into new Kamailio 3.1.0 tarballs in www.kamailio.org/pub per se, but daily builds from git are available from sip-router.org. For this reason, there is a more or less standing policy not to break the build, especially of maintenance branches. :-) -- Alex Balashov - Principal Evariste Systems LLC 1170 Peachtree Street 12th Floor, Suite 1200 Atlanta, GA 30309 Tel: +1-678-954-0670 Fax: +1-404-961-1892 Web: http://www.evaristesys.com/

Daniel, one last question...3.1 branch is the git version of 3.1.0 or we have to wait till 3.1.1? Thanks On Thu, Nov 25, 2010 at 1:27 PM, Daniel-Constantin Mierla &lt;miconda(a)gmail.com > Looks very likely to be this one fixed by Andrei and cherry-picked by me > in 3.1 branch: > > http://git.sip-router.org/cgi-bin/gitweb.cgi/sip-router/?a=commit;h=292bab7… > > Cheers, > Daniel > > > On 11/25/10 12:18 PM, michel freiha wrote: > > Dear Daniel, > > We are using the tarball version 3.1.0...Do you think this is fixed in git > 3.1.0 or have to wait till 3.1.1? > > Regards > > On Thu, Nov 25, 2010 at 1:07 PM, Daniel-Constantin Mierla < > miconda(a)gmail.com> >> this seems to me like something already fixed after 3.1.0. You haven't >> said what version are you running, is it git stable branch or tarball? >> >> Cheers, >> Daniel >> >> >> On 11/25/10 10:05 AM, michel freiha wrote: >> >> hello Daniel...thanks for replying...Please find below the core file >> content >> >> [root@tunnel bin]# gdb /usr/local/sbin/kamailio core.19935 >> GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-23.el5_5.2) >> Copyright (C) 2009 Free Software Foundation, Inc. >> License GPLv3+: GNU GPL version 3 or later < >> http://gnu.org/licenses/gpl.html> >> This is free software: you are free to change and redistribute it. >> There is NO WARRANTY, to the extent permitted by law. Type "show copying" >> and "show warranty" for details. >> This GDB was configured as "i386-redhat-linux-gnu". >> For bug reporting instructions, please see: >> <http://www.gnu.org/software/gdb/bugs/>... >> Reading symbols from /usr/local/sbin/kamailio...done. >> >> warning: .dynamic section for "/usr/lib/libkrb5.so.3" is not at the >> expected address >> >> warning: difference appears to be caused by prelink, adjusting >> expectations >> >> warning: .dynamic section for "/usr/lib/libk5crypto.so.3" is not at the >> expected address >> >> warning: difference appears to be caused by prelink, adjusting >> expectations >> Reading symbols from /lib/libdl.so.2...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libdl.so.2 >> Reading symbols from /lib/libresolv.so.2...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libresolv.so.2 >> Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done. >> Loaded symbols for /lib/libc.so.6 >> Reading symbols from /lib/ld-linux.so.2...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/ld-linux.so.2 >> Reading symbols from /usr/local/lib/kamailio/modules/db_mysql.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules/db_mysql.so >> Reading symbols from /usr/lib/mysql/libmysqlclient.so.15...(no debugging >> symbols found)...done. >> Loaded symbols for /usr/lib/mysql/libmysqlclient.so.15 >> Reading symbols from /usr/lib/libz.so.1...(no debugging symbols >> found)...done. >> Loaded symbols for /usr/lib/libz.so.1 >> Reading symbols from /usr/local/lib/kamailio/libsrdb2.so.1...done. >> Loaded symbols for /usr/local/lib/kamailio/libsrdb2.so.1 >> Reading symbols from /usr/local/lib/kamailio/libsrdb1.so.1...done. >> Loaded symbols for /usr/local/lib/kamailio/libsrdb1.so.1 >> Reading symbols from /lib/libcrypt.so.1...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libcrypt.so.1 >> Reading symbols from /lib/libnsl.so.1...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libnsl.so.1 >> Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done. >> Loaded symbols for /lib/libm.so.6 >> Reading symbols from /lib/libssl.so.6...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libssl.so.6 >> Reading symbols from /lib/libcrypto.so.6...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libcrypto.so.6 >> Reading symbols from /usr/lib/libgssapi_krb5.so.2...(no debugging symbols >> found)...done. >> Loaded symbols for /usr/lib/libgssapi_krb5.so.2 >> Reading symbols from /usr/lib/libkrb5.so.3...(no debugging symbols >> found)...done. >> Loaded symbols for /usr/lib/libkrb5.so.3 >> Reading symbols from /lib/libcom_err.so.2...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libcom_err.so.2 >> Reading symbols from /usr/lib/libk5crypto.so.3...(no debugging symbols >> found)...done. >> Loaded symbols for /usr/lib/libk5crypto.so.3 >> Reading symbols from /usr/lib/libkrb5support.so.0...(no debugging symbols >> found)...done. >> Loaded symbols for /usr/lib/libkrb5support.so.0 >> Reading symbols from /lib/libkeyutils.so.1...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libkeyutils.so.1 >> Reading symbols from /lib/libselinux.so.1...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libselinux.so.1 >> Reading symbols from /lib/libsepol.so.1...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libsepol.so.1 >> Reading symbols from /usr/local/lib/kamailio/modules_k/exec.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/exec.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/group.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/group.so >> Reading symbols from /usr/local/lib/kamailio/libkcore.so.1...done. >> Loaded symbols for /usr/local/lib/kamailio/libkcore.so.1 >> Reading symbols from >> /usr/local/lib/kamailio/modules_k/speeddial.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/speeddial.so >> Reading symbols from >> /usr/local/lib/kamailio/modules/carrierroute.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules/carrierroute.so >> Reading symbols from /usr/lib/libconfuse.so.0...(no debugging symbols >> found)...done. >> Loaded symbols for /usr/lib/libconfuse.so.0 >> Reading symbols from /usr/local/lib/kamailio/libtrie.so.1...done. >> Loaded symbols for /usr/local/lib/kamailio/libtrie.so.1 >> Reading symbols from /usr/local/lib/kamailio/libkmi.so.1...done. >> Loaded symbols for /usr/local/lib/kamailio/libkmi.so.1 >> Reading symbols from /usr/local/lib/kamailio/modules_k/mi_fifo.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/mi_fifo.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/kex.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/kex.so >> Reading symbols from /usr/local/lib/kamailio/modules/tm.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules/tm.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/tmx.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/tmx.so >> Reading symbols from /usr/local/lib/kamailio/modules/sl.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules/sl.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/rr.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/rr.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/pv.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/pv.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/maxfwd.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/maxfwd.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/usrloc.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/usrloc.so >> Reading symbols from >> /usr/local/lib/kamailio/modules_k/registrar.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/registrar.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/textops.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/textops.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/siputils.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/siputils.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/xlog.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/xlog.so >> Reading symbols from /usr/local/lib/kamailio/modules/sanity.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules/sanity.so >> Reading symbols from /usr/local/lib/kamailio/modules/ctl.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules/ctl.so >> Reading symbols from /usr/local/lib/kamailio/modules/mi_rpc.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules/mi_rpc.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/acc.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/acc.so >> Reading symbols from /usr/local/lib/kamailio/modules/auth.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules/auth.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/auth_db.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/auth_db.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/alias_db.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/alias_db.so >> Reading symbols from >> /usr/local/lib/kamailio/modules_k/nathelper.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/nathelper.so >> Reading symbols from /usr/local/lib/kamailio/modules_k/rtpproxy.so...done. >> Loaded symbols for /usr/local/lib/kamailio/modules_k/rtpproxy.so >> Reading symbols from /lib/libnss_files.so.2...(no debugging symbols >> found)...done. >> Loaded symbols for /lib/libnss_files.so.2 >> Core was generated by `/usr/local/sbin/kamailio -P /var/run/kamailio.pid >> -m 128 -u root -g root'. >> Program terminated with signal 11, Segmentation fault. >> #0 0x00641fba in build_local_reparse (Trans=0xb14e6564, branch=0, >> len=0xbfe9a5c8, method=0x660495 "CANCEL", method_len=6, to=0xb14e6594, >> reason=0xbfe9a640) at t_msgbuilder.c:476 >> 476 >> append_str(d, reason->u.text.s, >> (gdb) bt >> #0 0x00641fba in build_local_reparse (Trans=0xb14e6564, branch=0, >> len=0xbfe9a5c8, method=0x660495 "CANCEL", method_len=6, to=0xb14e6594, >> reason=0xbfe9a640) at t_msgbuilder.c:476 >> #1 0x00610425 in cancel_branch (t=0xb14e6564, branch=0, >> reason=0xbfe9a640, flags=<value optimized out>) at t_cancel.c:285 >> #2 0x00628afe in final_response_handler (ticks=1751388270, tl=0xb14e6658, >> p=0x10) at timer.c:320 >> #3 retr_buf_handler (ticks=1751388270, tl=0xb14e6658, p=0x10) at >> timer.c:546 >> #4 0x081641e5 in timer_list_expire () at timer.c:894 >> #5 timer_handler () at timer.c:957 >> #6 timer_main () at timer.c:996 >> #7 0x080aec5b in main_loop () at main.c:1618 >> #8 0x080b1126 in main (argc=9, argv=0xbfe9a9b4) at main.c:2398 >> >> On Thu, Nov 25, 2010 at 8:53 AM, Daniel-Constantin Mierla < >> miconda(a)gmail.com>> >>> First, send the backtrace. >>> >>> gdb /path/to/kamailio /path/to/corefile >>> >>> then bt. >>> >>> Then see if you have any other log messages from pid 19935. The logs >>> before are more important that what is after. >>> >>> Also, by last version you mean 3.1.0 or the latest GIT version of 3.1. If >>> you use 3.1.0 then there were couple of fixes already, so update to latest >>> git branch. 3.1.1 should be released soon with all these fixes. >>> >>> Cheers, >>> Daniel >>> >>> >>> On 11/25/10 12:13 AM, michel freiha wrote: >>> >>> Hi all, >>> >>> I have latest version of kamailio but it keep crashing...I know that the >>> log could not be sufficient but maybe anyone faced the same issue >>> before...Please find log below and let me know if you can find anything >>> >>> Nov 24 15:56:23 tunnel /usr/local/sbin/kamailio[19943]: : <core> >>> [pass_fd.c:293]: ERROR: receive_fd: EOF on 15 >>> Nov 24 15:56:23 tunnel /usr/local/sbin/kamailio[19929]: ALERT: <core> >>> [main.c:741]: child process 19935 exited by a signal 11 >>> Nov 24 15:56:23 tunnel /usr/local/sbin/kamailio[19932]: INFO: >>> carrierroute [cr_func.c:595]: uri 919437452006 was rewritten to >>> sip:919437452006@x.x.x.x, carrier 5, domain 0 >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19930]: INFO: >>> carrierroute [cr_func.c:595]: uri 008801823703200 was rewritten to >>> sip:008801823703200@X.X.X.5, carrier 5, domain 0 >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19933]: ERROR: <script>: >>> CARRIERROUTE_time_dbg:method=INVITE;time=1290614183;callid=14b6536a-d102-1910-9b23-9f3b3c3065ca >>> - before cr >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19929]: ALERT: <core> >>> [main.c:744]: core was generated >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19932]: INFO: <script>: >>> time_dbg:method=SUBSCRIBE;time=1290614183;callid=YjVmODYzYjQxYWY0ZTU3MGRmMmZkYjRhOTg4ZGZmODQ. >>> - before cr >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19930]: INFO: <script>: >>> time_dbg:method=INVITE;time=1290614183;callid=cdc9556a-d102-1910-8b30-926b495dad44 >>> - before cr >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19933]: INFO: >>> carrierroute [cr_func.c:595]: uri 00919974265815 was rewritten to >>> sip:00919974265815@X.X.X.X>, carrier 5, domain 0 >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19931]: ERROR: <script>: >>> time_dbg:method=INVITE;time=1290614182;callid=14b6536a-d102-1910-9b23-9f3b3c3065ca >>> - before t_relay >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19929]: INFO: <core> >>> [main.c:756]: INFO: terminating due to SIGCHLD >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19934]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19943]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19942]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19940]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19939]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19938]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19941]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19937]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19936]: INFO: <core> >>> [main.c:807]: INFO: signal 15 received >>> >>> Regards >>> >>> >>> _______________________________________________ >>> SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing listsr-users@lists.sip-router.orghttp://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users >>> >>> >>> -- >>> Daniel-Constantin Mierla >>> Kamailio (OpenSER) Advanced Training >>> Jan 24-26, 2011, Irvine, CA, USAhttp://www.asipto.com >>> >>> >> >> _______________________________________________ >> SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing listsr-users@lists.sip-router.orghttp://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users >> >> >> -- >> Daniel-Constantin Mierla >> Kamailio (OpenSER) Advanced Training >> Jan 24-26, 2011, Irvine, CA, USAhttp://www.asipto.com >> >> > > -- > Daniel-Constantin Mierla > Kamailio (OpenSER) Advanced Training > Jan 24-26, 2011, Irvine, CA, USAhttp://www.asipto.com > >

Thanks a lot Daniel...Will test and will get back to you Regards On Fri, Nov 26, 2010 at 12:04 AM, Daniel-Constantin Mierla < miconda(a)gmail.com&gt; wrote:

Hello, On 12/10/10 4:15 PM, michel freiha wrote: thanks for reporting back. Do you have high debug level? If yes, is your syslog configured asynchronously? Other than that, you can use benchmark module to spot which of your config actions takes so long to execute. Normally, such cases can happen when you have queries to slow database or dns servers. Cheers, Daniel -- Daniel-Constantin Mierla Kamailio (OpenSER) Advanced Training Jan 24-26, 2011, Irvine, CA, USA http://www.asipto.com

This sounds like some sort of host-specific issue. I have run Kamailio across 4 different versions with a whole lot more concurrent registrants than that with no issue. -- Alex Balashov - Principal Evariste Systems LLC 1170 Peachtree Street NE 12th Floor, Suite 1200 Atlanta, GA 30309 Tel: +1-678-954-0670 Fax: +1-404-961-1892 Web: http://www.evaristesys.com/

Daniel, The crash has been fixed...It was a database issue...Now I have another issue...After some time of run we are getting a message "too many hopes" on dialers like x-Lite while if we use IP address to register to Kamailio, everything works fine Any tips? Regards Dear On Tue, Dec 14, 2010 at 12:48 PM, Daniel-Constantin Mierla < miconda(a)gmail.com&gt; wrote:

Hello, On 12/23/10 8:29 PM, michel freiha wrote: good to know. Anything specific you can tell that may help in the future to identify similar cases? Add: alias=yoursipdomain in configuration file. In this way you tell kamailio to consider the sip domain as local domain. At startup, kamailio does reverse dns query to discover hostnames, but it might not be returned, ending up in a loop, resulting in too many hops. Cheers, Daniel -- Daniel-Constantin Mierla Kamailio (OpenSER) Advanced Training Jan 24-26, 2011, Irvine, CA, USA http://www.asipto.com

Thanks Daniel for help...Everything seems OK now... Regard On Fri, Dec 24, 2010 at 12:07 PM, Daniel-Constantin Mierla < miconda(a)gmail.com&gt; wrote:s

Hello, starting with kamailio 3.0, is very easy to spot the logic used for nat traversal. So look at default config file coming with 3.1, it uses defines to mark the logic required for NAT traversal -- just search for WITH_NAT -- from there should be easy to pull it out, adapt and and plug it in your config. Cheers, Daniel On 12/28/10 10:39 AM, michel freiha wrote: -- Daniel-Constantin Mierla Kamailio (OpenSER) Advanced Training Jan 24-26, 2011, Irvine, CA, USA http://www.asipto.com