hello Daniel...thanks for replying...Please find below the core file content

[root@tunnel bin]# gdb /usr/local/sbin/kamailio core.19935
GNU gdb (GDB) Red Hat Enterprise Linux (7.0.1-23.el5_5.2)
Copyright (C) 2009 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "i386-redhat-linux-gnu".
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>...
Reading symbols from /usr/local/sbin/kamailio...done.

warning: .dynamic section for "/usr/lib/libkrb5.so.3" is not at the expected address

warning: difference appears to be caused by prelink, adjusting expectations

warning: .dynamic section for "/usr/lib/libk5crypto.so.3" is not at the expected address

warning: difference appears to be caused by prelink, adjusting expectations
Reading symbols from /lib/libdl.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libresolv.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /lib/libc.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libc.so.6
Reading symbols from /lib/ld-linux.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /usr/local/lib/kamailio/modules/db_mysql.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules/db_mysql.so
Reading symbols from /usr/lib/mysql/libmysqlclient.so.15...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/mysql/libmysqlclient.so.15
Reading symbols from /usr/lib/libz.so.1...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /usr/local/lib/kamailio/libsrdb2.so.1...done.
Loaded symbols for /usr/local/lib/kamailio/libsrdb2.so.1
Reading symbols from /usr/local/lib/kamailio/libsrdb1.so.1...done.
Loaded symbols for /usr/local/lib/kamailio/libsrdb1.so.1
Reading symbols from /lib/libcrypt.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /lib/libnsl.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/libm.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libm.so.6
Reading symbols from /lib/libssl.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libssl.so.6
Reading symbols from /lib/libcrypto.so.6...(no debugging symbols found)...done.
Loaded symbols for /lib/libcrypto.so.6
Reading symbols from /usr/lib/libgssapi_krb5.so.2...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libgssapi_krb5.so.2
Reading symbols from /usr/lib/libkrb5.so.3...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libkrb5.so.3
Reading symbols from /lib/libcom_err.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libcom_err.so.2
Reading symbols from /usr/lib/libk5crypto.so.3...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libk5crypto.so.3
Reading symbols from /usr/lib/libkrb5support.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libkrb5support.so.0
Reading symbols from /lib/libkeyutils.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libkeyutils.so.1
Reading symbols from /lib/libselinux.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libselinux.so.1
Reading symbols from /lib/libsepol.so.1...(no debugging symbols found)...done.
Loaded symbols for /lib/libsepol.so.1
Reading symbols from /usr/local/lib/kamailio/modules_k/exec.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/exec.so
Reading symbols from /usr/local/lib/kamailio/modules_k/group.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/group.so
Reading symbols from /usr/local/lib/kamailio/libkcore.so.1...done.
Loaded symbols for /usr/local/lib/kamailio/libkcore.so.1
Reading symbols from /usr/local/lib/kamailio/modules_k/speeddial.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/speeddial.so
Reading symbols from /usr/local/lib/kamailio/modules/carrierroute.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules/carrierroute.so
Reading symbols from /usr/lib/libconfuse.so.0...(no debugging symbols found)...done.
Loaded symbols for /usr/lib/libconfuse.so.0
Reading symbols from /usr/local/lib/kamailio/libtrie.so.1...done.
Loaded symbols for /usr/local/lib/kamailio/libtrie.so.1
Reading symbols from /usr/local/lib/kamailio/libkmi.so.1...done.
Loaded symbols for /usr/local/lib/kamailio/libkmi.so.1
Reading symbols from /usr/local/lib/kamailio/modules_k/mi_fifo.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/mi_fifo.so
Reading symbols from /usr/local/lib/kamailio/modules_k/kex.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/kex.so
Reading symbols from /usr/local/lib/kamailio/modules/tm.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules/tm.so
Reading symbols from /usr/local/lib/kamailio/modules_k/tmx.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/tmx.so
Reading symbols from /usr/local/lib/kamailio/modules/sl.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules/sl.so
Reading symbols from /usr/local/lib/kamailio/modules_k/rr.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/rr.so
Reading symbols from /usr/local/lib/kamailio/modules_k/pv.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/pv.so
Reading symbols from /usr/local/lib/kamailio/modules_k/maxfwd.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/maxfwd.so
Reading symbols from /usr/local/lib/kamailio/modules_k/usrloc.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/usrloc.so
Reading symbols from /usr/local/lib/kamailio/modules_k/registrar.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/registrar.so
Reading symbols from /usr/local/lib/kamailio/modules_k/textops.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/textops.so
Reading symbols from /usr/local/lib/kamailio/modules_k/siputils.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/siputils.so
Reading symbols from /usr/local/lib/kamailio/modules_k/xlog.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/xlog.so
Reading symbols from /usr/local/lib/kamailio/modules/sanity.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules/sanity.so
Reading symbols from /usr/local/lib/kamailio/modules/ctl.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules/ctl.so
Reading symbols from /usr/local/lib/kamailio/modules/mi_rpc.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules/mi_rpc.so
Reading symbols from /usr/local/lib/kamailio/modules_k/acc.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/acc.so
Reading symbols from /usr/local/lib/kamailio/modules/auth.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules/auth.so
Reading symbols from /usr/local/lib/kamailio/modules_k/auth_db.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/auth_db.so
Reading symbols from /usr/local/lib/kamailio/modules_k/alias_db.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/alias_db.so
Reading symbols from /usr/local/lib/kamailio/modules_k/nathelper.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/nathelper.so
Reading symbols from /usr/local/lib/kamailio/modules_k/rtpproxy.so...done.
Loaded symbols for /usr/local/lib/kamailio/modules_k/rtpproxy.so
Reading symbols from /lib/libnss_files.so.2...(no debugging symbols found)...done.
Loaded symbols for /lib/libnss_files.so.2
Core was generated by `/usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 128 -u root -g root'.
Program terminated with signal 11, Segmentation fault.
#0 0x00641fba in build_local_reparse (Trans=0xb14e6564, branch=0, len=0xbfe9a5c8, method=0x660495 "CANCEL", method_len=6, to=0xb14e6594,
    reason=0xbfe9a640) at t_msgbuilder.c:476
476                                                             append_str(d, reason->u.text.s,
(gdb) bt
#0 0x00641fba in build_local_reparse (Trans=0xb14e6564, branch=0, len=0xbfe9a5c8, method=0x660495 "CANCEL", method_len=6, to=0xb14e6594,
    reason=0xbfe9a640) at t_msgbuilder.c:476
#1 0x00610425 in cancel_branch (t=0xb14e6564, branch=0, reason=0xbfe9a640, flags=<value optimized out>) at t_cancel.c:285
#2 0x00628afe in final_response_handler (ticks=1751388270, tl=0xb14e6658, p=0x10) at timer.c:320
#3 retr_buf_handler (ticks=1751388270, tl=0xb14e6658, p=0x10) at timer.c:546
#4 0x081641e5 in timer_list_expire () at timer.c:894
#5 timer_handler () at timer.c:957
#6 timer_main () at timer.c:996
#7 0x080aec5b in main_loop () at main.c:1618
#8 0x080b1126 in main (argc=9, argv=0xbfe9a9b4) at main.c:2398

On Thu, Nov 25, 2010 at 8:53 AM, Daniel-Constantin Mierla <miconda@gmail.com> wrote:

First, send the backtrace.

gdb /path/to/kamailio /path/to/corefile

then bt.

Then see if you have any other log messages from pid 19935. The logs before are more important that what is after.

Also, by last version you mean 3.1.0 or the latest GIT version of 3.1. If you use 3.1.0 then there were couple of fixes already, so update to latest git branch. 3.1.1 should be released soon with all these fixes.

Cheers,
Daniel

On 11/25/10 12:13 AM, michel freiha wrote:
Hi all,

I have latest version of kamailio but it keep crashing...I know that the log could not be sufficient but maybe anyone faced the same issue before...Please find log below and let me know if you can find anything

Nov 24 15:56:23 tunnel /usr/local/sbin/kamailio[19943]: : <core> [pass_fd.c:293]: ERROR: receive_fd: EOF on 15
Nov 24 15:56:23 tunnel /usr/local/sbin/kamailio[19929]: ALERT: <core> [main.c:741]: child process 19935 exited by a signal 11
Nov 24 15:56:23 tunnel /usr/local/sbin/kamailio[19932]: INFO: carrierroute [cr_func.c:595]: uri 919437452006 was rewritten to sip:919437452006@x.x.x.x, carrier 5, domain 0
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19930]: INFO: carrierroute [cr_func.c:595]: uri 008801823703200 was rewritten to sip:008801823703200@X.X.X.5, carrier 5, domain 0
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19933]: ERROR: <script>: CARRIERROUTE_time_dbg:method=INVITE;time=1290614183;callid=14b6536a-d102-1910-9b23-9f3b3c3065ca - before cr
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19929]: ALERT: <core> [main.c:744]: core was generated
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19932]: INFO: <script>: time_dbg:method=SUBSCRIBE;time=1290614183;callid=YjVmODYzYjQxYWY0ZTU3MGRmMmZkYjRhOTg4ZGZmODQ. - before cr
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19930]: INFO: <script>: time_dbg:method=INVITE;time=1290614183;callid=cdc9556a-d102-1910-8b30-926b495dad44 - before cr
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19933]: INFO: carrierroute [cr_func.c:595]: uri 00919974265815 was rewritten to sip:00919974265815@X.X.X.X>, carrier 5, domain 0
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19931]: ERROR: <script>: time_dbg:method=INVITE;time=1290614182;callid=14b6536a-d102-1910-9b23-9f3b3c3065ca - before t_relay
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19929]: INFO: <core> [main.c:756]: INFO: terminating due to SIGCHLD
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19934]: INFO: <core> [main.c:807]: INFO: signal 15 received
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19943]: INFO: <core> [main.c:807]: INFO: signal 15 received
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19942]: INFO: <core> [main.c:807]: INFO: signal 15 received
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19940]: INFO: <core> [main.c:807]: INFO: signal 15 received
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19939]: INFO: <core> [main.c:807]: INFO: signal 15 received
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19938]: INFO: <core> [main.c:807]: INFO: signal 15 received
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19941]: INFO: <core> [main.c:807]: INFO: signal 15 received
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19937]: INFO: <core> [main.c:807]: INFO: signal 15 received
Nov 24 15:56:24 tunnel /usr/local/sbin/kamailio[19936]: INFO: <core> [main.c:807]: INFO: signal 15 received

Regards
_______________________________________________
SIP Express Router (SER) and Kamailio (OpenSER) - sr-users mailing list
sr-users@lists.sip-router.org
http://lists.sip-router.org/cgi-bin/mailman/listinfo/sr-users
-- 
Daniel-Constantin Mierla
Kamailio (OpenSER) Advanced Training
Jan 24-26, 2011, Irvine, CA, USA
http://www.asipto.com