I didn't really capture the signaling for the issue, I'll get a trace when I get the chance and send it to you.<br><br>Rgds,<br>Uriel<br><br><div class="gmail_quote">On Mon, Feb 23, 2009 at 12:02 PM, Daniel-Constantin Mierla <span dir="ltr"><<a href="mailto:miconda@gmail.com">miconda@gmail.com</a>></span> wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><div class="Ih2E3d"><br>
<br>
On 02/23/2009 02:25 PM, Uriel Rozenbaum wrote:<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
Sure, I can turn of report ack to check; anyway i substracter $re from db_extra and now I'm not seeing any crashes. But maybe its useful for you to clear the bug in there.<br>
</blockquote></div>
yes, this is the goal. This issue has to be fixed. You can keep the report ack on, I just wanted to get your confirmation.<br>
<br>
I will try to reproduce first by myself, and then ask you for more. Just in case you have such ACK at your hand, send it to me, I will use it in tests. Does it have a RPID header?<br>
<br>
Thanks,<br>
Daniel<br>
<br>
<br>
<blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;"><div class="Ih2E3d">
<br>
Let me know how you want to proceed and I'll send you everithing.<br>
<br>
-- Uriel<br>
<br></div><div><div></div><div class="Wj3C7c">
On Mon, Feb 23, 2009 at 10:18 AM, Daniel-Constantin Mierla <<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a> <mailto:<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a>>> wrote:<br>
<br>
Hello,<br>
<br>
thanks. Do you have report ack set for acc module?<br>
<br>
The crash happens to an ACK and relates to building outgoing<br>
request and processing lumps. I will investigate and try to<br>
reproduce. Just asking for now, would be any chance to get the ACK<br>
and eventually your config in case it is needed for troubleshooting?<br>
<br>
Thanks,<br>
Daniel<br>
<br>
<br>
<br>
On 02/20/2009 08:17 PM, Uriel Rozenbaum wrote:<br>
<br>
Here it is:<br>
<br>
[root@ops3 ~]# gdb /usr/local/sbin/kamailio /core.4899<br>
GNU gdb Red Hat Linux (6.5-37.el5_2.2rh)<br>
Copyright (C) 2006 Free Software Foundation, Inc.<br>
GDB is free software, covered by the GNU General Public<br>
License, and you are<br>
welcome to change it and/or distribute copies of it under<br>
certain conditions.<br>
Type "show copying" to see the conditions.<br>
There is absolutely no warranty for GDB. Type "show warranty"<br>
for details.<br>
This GDB was configured as "i386-redhat-linux-gnu"...Using<br>
host libthread_db library "/lib/libthread_db.so.1".<br>
<br>
<br>
warning: Can't read pathname for load map: Input/output error.<br>
Reading symbols from /lib/libdl.so.2...done.<br>
Loaded symbols for /lib/libdl.so.2<br>
Reading symbols from /lib/libresolv.so.2...done.<br>
Loaded symbols for /lib/libresolv.so.2<br>
Reading symbols from /lib/libc.so.6...done.<br>
Loaded symbols for /lib/libc.so.6<br>
Reading symbols from /lib/ld-linux.so.2...done.<br>
Loaded symbols for /lib/ld-linux.so.2<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/db_mysql.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/db_mysql.so<br>
Reading symbols from /usr/lib/mysql/libmysqlclient.so.15...done.<br>
Loaded symbols for /usr/lib/mysql/libmysqlclient.so.15<br>
Reading symbols from /usr/lib/libz.so.1...done.<br>
Loaded symbols for /usr/lib/libz.so.1<br>
Reading symbols from /lib/libcrypt.so.1...done.<br>
Loaded symbols for /lib/libcrypt.so.1<br>
Reading symbols from /lib/libnsl.so.1...done.<br>
Loaded symbols for /lib/libnsl.so.1<br>
Reading symbols from /lib/libm.so.6...done.<br>
Loaded symbols for /lib/libm.so.6<br>
Reading symbols from /lib/libssl.so.6...done.<br>
Loaded symbols for /lib/libssl.so.6<br>
Reading symbols from /lib/libcrypto.so.6...done.<br>
Loaded symbols for /lib/libcrypto.so.6<br>
Reading symbols from /usr/lib/libgssapi_krb5.so.2...done.<br>
Loaded symbols for /usr/lib/libgssapi_krb5.so.2<br>
Reading symbols from /usr/lib/libkrb5.so.3...done.<br>
Loaded symbols for /usr/lib/libkrb5.so.3<br>
Reading symbols from /lib/libcom_err.so.2...done.<br>
Loaded symbols for /lib/libcom_err.so.2<br>
Reading symbols from /usr/lib/libk5crypto.so.3...done.<br>
Loaded symbols for /usr/lib/libk5crypto.so.3<br>
Reading symbols from /usr/lib/libkrb5support.so.0...done.<br>
Loaded symbols for /usr/lib/libkrb5support.so.0<br>
Reading symbols from /lib/libkeyutils.so.1...done.<br>
Loaded symbols for /lib/libkeyutils.so.1<br>
Reading symbols from /lib/libselinux.so.1...done.<br>
Loaded symbols for /lib/libselinux.so.1<br>
Reading symbols from /lib/libsepol.so.1...done.<br>
Loaded symbols for /lib/libsepol.so.1<br>
Reading symbols from /usr/local/lib/kamailio/modules/sl.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/sl.so<br>
Reading symbols from /usr/local/lib/kamailio/modules/tm.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/tm.so<br>
Reading symbols from /usr/local/lib/kamailio/modules/rr.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/rr.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/maxfwd.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/maxfwd.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/usrloc.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/usrloc.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/registrar.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/registrar.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/textops.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/textops.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/mi_fifo.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/mi_fifo.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/uri_db.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/uri_db.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/uri.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/uri.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/xlog.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/xlog.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/acc.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/acc.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/auth.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/auth.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/auth_db.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/auth_db.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/alias_db.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/alias_db.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/domain.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/domain.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/lcr.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/lcr.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/avpops.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/avpops.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/permissions.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/permissions.so<br>
Reading symbols from<br>
/usr/local/lib/kamailio/modules/carrierroute.so...done.<br>
Loaded symbols for /usr/local/lib/kamailio/modules/carrierroute.so<br>
Reading symbols from /lib/libnss_files.so.2...done.<br>
Loaded symbols for /lib/libnss_files.so.2<br>
Core was generated by `/usr/local/sbin/kamailio -P<br>
/var/run/kamailio.pid'.<br>
Program terminated with signal 11, Segmentation fault.<br>
#0 lumps_len (msg=0x81b3450, lumps=<value optimized out>,<br>
send_sock=0x81afe28) at msg_translator.c:665<br>
665 switch(r->op){<br>
(gdb) bt<br>
#0 lumps_len (msg=0x81b3450, lumps=<value optimized out>,<br>
send_sock=0x81afe28) at msg_translator.c:665<br>
#1 0x0807ce8e in build_req_buf_from_sip_req (msg=0x81b3450,<br>
returned_len=0xbffd27f8, send_sock=0x81afe28, proto=1,<br>
flags=<value optimized out>) at msg_translator.c:1456<br>
#2 0x08063703 in forward_request (msg=0x81b3450, p=0x81b28b8)<br>
at forward.c:362<br>
#3 0x00157a28 in t_relay_to (p_msg=0x81b3450,<br>
proxy=0x81b2dc0, flags=0) at t_funcs.c:238<br>
#4 0x0016a241 in w_t_relay (p_msg=0x81b3450, proxy=0x0,<br>
flags=0x0) at tm.c:977<br>
#5 0x08052f66 in do_action (a=0x81ac3b8, msg=0x81b3450) at<br>
action.c:850<br>
#6 0x080557d9 in run_action_list (a=0x81ac3b8, msg=0x81b3450)<br>
at action.c:138<br>
#7 0x080a4925 in eval_expr (e=0x81ac420, msg=0x81b3450,<br>
val=0x0) at route.c:1116<br>
#8 0x080a43a0 in eval_expr (e=0x81ac448, msg=0x81b3450,<br>
val=0x0) at route.c:1429<br>
#9 0x080a4336 in eval_expr (e=0x81ac470, msg=0x81b3450,<br>
val=0x0) at route.c:1434<br>
#10 0x08052a47 in do_action (a=0x81ac588, msg=0x81b3450) at<br>
action.c:705<br>
#11 0x080557d9 in run_action_list (a=0x81ac588, msg=0x81b3450)<br>
at action.c:138<br>
#12 0x08054048 in do_action (a=0x81ab960, msg=0x81b3450) at<br>
action.c:118<br>
#13 0x080557d9 in run_action_list (a=0x81ab8f8, msg=0x81b3450)<br>
at action.c:138<br>
#14 0x08054485 in do_action (a=0x81ab9c8, msg=0x81b3450) at<br>
action.c:722<br>
#15 0x080557d9 in run_action_list (a=0x81aa930, msg=0x81b3450)<br>
at action.c:138<br>
#16 0x08055b7c in run_top_route (a=0x81aa930, msg=0x81b3450)<br>
at action.c:118<br>
#17 0x08094e29 in receive_msg (<br>
buf=0x817a0a0 "ACK <a href="mailto:sip%3A8888860911167@192.168.200.63" target="_blank">sip:8888860911167@192.168.200.63</a><br>
<mailto:<a href="mailto:sip%253A8888860911167@192.168.200.63" target="_blank">sip%3A8888860911167@192.168.200.63</a>><br>
<mailto:<a href="mailto:sip%253A8888860911167@192.168.200.63" target="_blank">sip%3A8888860911167@192.168.200.63</a><br></div></div>
<mailto:<a href="mailto:sip%25253A8888860911167@192.168.200.63" target="_blank">sip%253A8888860911167@192.168.200.63</a>>> SIP/2.0\r\nVia:<div class="Ih2E3d"><br>
SIP/2.0/UDP<br>
192.168.200.62:5060;branch=z9hG4bK4859c659;rport\r\nRoute:<br>
<sip:192.168.200.9;lr=on>\r\nFrom: \"7001\"<br>
<<a href="mailto:sip%3A60911100@ops3.cpsnet.com.ar" target="_blank">sip:60911100@ops3.cpsnet.com.ar</a><br>
<mailto:<a href="mailto:sip%253A60911100@ops3.cpsnet.com.ar" target="_blank">sip%3A60911100@ops3.cpsnet.com.ar</a>><br>
<mailto:<a href="mailto:sip%253A60911100@ops3.cpsnet.com.ar" target="_blank">sip%3A60911100@ops3.cpsnet.com.ar</a><br></div>
<mailto:<a href="mailto:sip%25253A60911100@ops3.cpsnet.com.ar" target="_blank">sip%253A60911100@ops3.cpsnet.com.ar</a>>>>;tag=as"...,<div class="Ih2E3d"><br>
len=523, rcv_info=0xbffd3904) at receive.c:165<br>
<br>
#18 0x080d8027 in udp_rcv_loop () at udp_server.c:449<br>
#19 0x0806d49e in main (argc=3, argv=0xbffd3af4) at main.c:780<br>
<br>
On Fri, Feb 20, 2009 at 3:00 PM, Daniel-Constantin Mierla<br>
<<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a> <mailto:<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a>><br></div><div><div></div><div class="Wj3C7c">
<mailto:<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a> <mailto:<a href="mailto:miconda@gmail.com" target="_blank">miconda@gmail.com</a>>>> wrote:<br>
<br>
First send the backtrace, the core without binaries is not much<br>
helpful as the symbols can differ to a local compiled<br>
version. Use:<br>
<br>
gdb /usr/local/sbin/kamailio /path/to/corefile<br>
<br>
The do "bt" there and send the output here.<br>
<br>
Thanks,<br>
Daniel<br>
<br>
<br>
<br>
On 02/20/2009 02:12 PM, Uriel Rozenbaum wrote:<br>
<br>
Hi Henning, here's the core file zipped.<br>
<br>
On Fri, Feb 20, 2009 at 7:24 AM, Henning Westerholt<br>
<<a href="mailto:henning.westerholt@1und1.de" target="_blank">henning.westerholt@1und1.de</a><br>
<mailto:<a href="mailto:henning.westerholt@1und1.de" target="_blank">henning.westerholt@1und1.de</a>><br>
<mailto:<a href="mailto:henning.westerholt@1und1.de" target="_blank">henning.westerholt@1und1.de</a><br>
<mailto:<a href="mailto:henning.westerholt@1und1.de" target="_blank">henning.westerholt@1und1.de</a>>><br>
<mailto:<a href="mailto:henning.westerholt@1und1.de" target="_blank">henning.westerholt@1und1.de</a><br>
<mailto:<a href="mailto:henning.westerholt@1und1.de" target="_blank">henning.westerholt@1und1.de</a>><br>
<mailto:<a href="mailto:henning.westerholt@1und1.de" target="_blank">henning.westerholt@1und1.de</a><br>
<mailto:<a href="mailto:henning.westerholt@1und1.de" target="_blank">henning.westerholt@1und1.de</a>>>>> wrote:<br>
<br>
On Thursday 19 February 2009, Uriel Rozenbaum wrote:<br>
> Sure, but I'll need some guidance on obtaining it;<br>
I'm just<br>
checking with<br>
> the syslog messages with debugging level in 3. Can you<br>
show me<br>
how to do<br>
> it?<br>
<br>
Hi Uriel,<br>
<br>
the core was already generated, as you can see in<br>
the logs:<br>
<br>
>> Feb 19 08:48:58 ops3<br>
/usr/local/sbin/kamailio[4895]:<br>
>> INFO:core:handle_sigs: core was generated<br>
<br>
You should find this file in the working directory<br>
of the<br>
server.<br>
<br>
Cheers,<br>
<br>
Henning<br>
<br>
<br>
<br>
-- Daniel-Constantin Mierla<br>
<a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a><br>
<br>
<br>
------------------------------------------------------------------------<br>
<br>
_______________________________________________<br>
Kamailio (OpenSER) - Users mailing list<br></div></div>
<a href="mailto:Users@lists.kamailio.org" target="_blank">Users@lists.kamailio.org</a> <mailto:<a href="mailto:Users@lists.kamailio.org" target="_blank">Users@lists.kamailio.org</a>><div class="Ih2E3d"><br>
<a href="http://lists.kamailio.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.kamailio.org/cgi-bin/mailman/listinfo/users</a><br>
<a href="http://lists.openser-project.org/cgi-bin/mailman/listinfo/users" target="_blank">http://lists.openser-project.org/cgi-bin/mailman/listinfo/users</a><br>
<br>
<br>
-- Daniel-Constantin Mierla<br>
<a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a><br>
<br>
<br>
</div></blockquote><div><div></div><div class="Wj3C7c">
<br>
-- <br>
Daniel-Constantin Mierla<br>
<a href="http://www.asipto.com" target="_blank">http://www.asipto.com</a><br>
<br>
</div></div></blockquote></div><br>