[Serusers] SER 0.9.4-rc3 (i386/linux)) keeps crashing

Wed Aug 10 13:07:42 CEST 2005

  We have a SER 0.9.4-rc3 (i386/linux)) system running on RedHat ES4 that
crashes about once every three days. I've done a cvs update, performed a 
re-make
of all modules as well as just mysql.so and reinitialized the mysql 
database using the
script provided. Nothing seems to fix the problem. Using gdb to examine 
a core
dump seems to indicate SER fails when receiving REGISTER messages but I 
cannot
figure out why. In each of the three core dumps the REGISTER message is 
from a
different client.

  Below is the gdb output from the latest core dump. Can anyone shed 
some light
on what might be happening?

Thanks,Steve

----- start gdb output ----

[blairs at voicesrvr tmp]$ sudo gdb /usr/local/sbin/ser /tmp/core.18868
GNU gdb Red Hat Linux (6.3.0.0-0.31rh)
Copyright 2004 Free Software Foundation, Inc.
GDB is free software, covered by the GNU General Public License, and you are
welcome to change it and/or distribute copies of it under certain 
conditions.
Type "show copying" to see the conditions.
There is absolutely no warranty for GDB.  Type "show warranty" for details.
This GDB was configured as "i386-redhat-linux-gnu"...Using host 
libthread_db library "/lib/tls/libthread_db.so.1".

Core was generated by `/usr/local/sbin/ser -P /var/run/ser.pid -dddd -E 
-w /tmp -f /usr/local/etc/ser/'.
Program terminated with signal 6, Aborted.
Reading symbols from /lib/libdl.so.2...done.
Loaded symbols for /lib/libdl.so.2
Reading symbols from /lib/libresolv.so.2...done.
Loaded symbols for /lib/libresolv.so.2
Reading symbols from /lib/tls/libc.so.6...done.
Loaded symbols for /lib/tls/libc.so.6
Reading symbols from /lib/ld-linux.so.2...done.
Loaded symbols for /lib/ld-linux.so.2
Reading symbols from /usr/local/lib/ser/modules/sl.so...done.
Loaded symbols for /usr/local/lib/ser/modules/sl.so
Reading symbols from /usr/local/lib/ser/modules/tm.so...done.
Loaded symbols for /usr/local/lib/ser/modules/tm.so
Reading symbols from /usr/local/lib/ser/modules/acc.so...done.
Loaded symbols for /usr/local/lib/ser/modules/acc.so
Reading symbols from /usr/local/lib/ser/modules/rr.so...done.
Loaded symbols for /usr/local/lib/ser/modules/rr.so
Reading symbols from /usr/local/lib/ser/modules/maxfwd.so...done.
Loaded symbols for /usr/local/lib/ser/modules/maxfwd.so
Reading symbols from /usr/local/lib/ser/modules/mysql.so...done.
Loaded symbols for /usr/local/lib/ser/modules/mysql.so
Reading symbols from /usr/lib/mysql/libmysqlclient.so.14...done.
Loaded symbols for /usr/lib/mysql/libmysqlclient.so.14
Reading symbols from /usr/lib/libz.so.1...done.
Loaded symbols for /usr/lib/libz.so.1
Reading symbols from /lib/libcrypt.so.1...done.
Loaded symbols for /lib/libcrypt.so.1
Reading symbols from /lib/libnsl.so.1...done.
Loaded symbols for /lib/libnsl.so.1
Reading symbols from /lib/tls/libm.so.6...done.
Loaded symbols for /lib/tls/libm.so.6
Reading symbols from /usr/local/lib/ser/modules/usrloc.so...done.
Loaded symbols for /usr/local/lib/ser/modules/usrloc.so
Reading symbols from /usr/local/lib/ser/modules/registrar.so...done.
Loaded symbols for /usr/local/lib/ser/modules/registrar.so
Reading symbols from /usr/local/lib/ser/modules/auth.so...done.
Loaded symbols for /usr/local/lib/ser/modules/auth.so
Reading symbols from /usr/local/lib/ser/modules/auth_db.so...done.
Loaded symbols for /usr/local/lib/ser/modules/auth_db.so
Reading symbols from /usr/local/lib/ser/modules/textops.so...done.
Loaded symbols for /usr/local/lib/ser/modules/textops.so
Reading symbols from /usr/local/lib/ser/modules/uri.so...done.
Loaded symbols for /usr/local/lib/ser/modules/uri.so
Reading symbols from /usr/local/lib/ser/modules/uri_db.so...done.
Loaded symbols for /usr/local/lib/ser/modules/uri_db.so
Reading symbols from /usr/local/lib/ser/modules/print.so...done.
Loaded symbols for /usr/local/lib/ser/modules/print.so
Reading symbols from /usr/local/lib/ser/modules/speeddial.so...done.
Loaded symbols for /usr/local/lib/ser/modules/speeddial.so
Reading symbols from /usr/local/lib/ser/modules/options.so...done.
Loaded symbols for /usr/local/lib/ser/modules/options.so
Reading symbols from /usr/local/lib/ser/modules/avpops.so...done.
Loaded symbols for /usr/local/lib/ser/modules/avpops.so
Reading symbols from /usr/local/lib/ser/modules/permissions.so...done.
Loaded symbols for /usr/local/lib/ser/modules/permissions.so
Reading symbols from /usr/local/lib/ser/modules/flatstore.so...done.
Loaded symbols for /usr/local/lib/ser/modules/flatstore.so
Reading symbols from /usr/local/lib/ser/modules/group.so...done.
Loaded symbols for /usr/local/lib/ser/modules/group.so
Reading symbols from /usr/local/lib/ser/modules/xlog.so...done.
Loaded symbols for /usr/local/lib/ser/modules/xlog.so
Reading symbols from /lib/libnss_files.so.2...done.
Loaded symbols for /lib/libnss_files.so.2
Reading symbols from /lib/libnss_dns.so.2...done.
Loaded symbols for /lib/libnss_dns.so.2
#0  0x006857a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
(gdb) bt
#0  0x006857a2 in _dl_sysinfo_int80 () from /lib/ld-linux.so.2
#1  0x006c57d5 in raise () from /lib/tls/libc.so.6
#2  0x006c7149 in abort () from /lib/tls/libc.so.6
#3  0x006bedb1 in __assert_fail () from /lib/tls/libc.so.6
#4  0x003907c8 in t_retransmit_reply (t=0xb6189db8) at t_reply.c:855
#5  0x00388103 in t_newtran (p_msg=0x813afc8) at t_lookup.c:1096
#6  0x003800ba in t_relay_to (p_msg=0x813afc8, proxy=0x8116858, proto=1, 
replicate=1) at t_funcs.c:224
#7  0x00382ad3 in t_replicate (p_msg=0x0, proxy=0x0, proto=0) at t_fwd.c:513
#8  0x0038b09e in w_t_replicate (p_msg=0x6, proxy=0x0, _foo=0x8116a98 
"5060") at tm.c:839
#9  0x0804fc81 in do_action (a=0x8116b28, msg=0x813afc8) at action.c:610
#10 0x0805099d in run_actions (a=0x8116b28, msg=0x813afc8) at action.c:718
#11 0x0804ecd3 in do_action (a=0x8116b58, msg=0x813afc8) at action.c:603
#12 0x0805099d in run_actions (a=0x8116b58, msg=0x813afc8) at action.c:718
#13 0x0804ecd3 in do_action (a=0x8116b88, msg=0x813afc8) at action.c:603
#14 0x0805099d in run_actions (a=0x8116b88, msg=0x813afc8) at action.c:718
#15 0x0804ecd3 in do_action (a=0x8116be8, msg=0x813afc8) at action.c:603
#16 0x0805099d in run_actions (a=0x8116be8, msg=0x813afc8) at action.c:718
#17 0x0804ecd3 in do_action (a=0x8128af8, msg=0x813afc8) at action.c:603
#18 0x0805099d in run_actions (a=0x8128af8, msg=0x813afc8) at action.c:718
#19 0x0806cfd2 in receive_msg (
    buf=0x80d61e0 "REGISTER sip:net.isc.upenn.edu SIP/2.0\r\nVia: 
SIP/2.0/UDP 128.91.56.10:5060;branch=z9hG4bK52d3bc34\r\nFrom: 
sip:68007 at net.isc.upenn.edu\r\nTo: 
sip:68007 at net.isc.upenn.edu\r\nCall-ID: 00042744-ab3d0002-14a230"..., 
len=579, rcv_info=0xbff43360) at receive.c:165
#20 0x0808421c in udp_rcv_loop () at udp_server.c:472
#21 0x0805cd0f in main_loop () at main.c:1056
#22 0x0805e36b in main (argc=9, argv=0xbff43524) at main.c:1592

--- end gdb output ----

-- 

ISC Network Engineering
The University of Pennsylvania
3401 Walnut Street, Suite 221A
Philadelphia, PA 19104  

voice: 215-573-8396 

       215-746-8001

fax: 215-898-9348    

sip:blairs at upenn.edu