[SR-Users] Kamailio stability/timing problem w.r.t. registrations?

Ovidiu Sas osas at voipembedded.com
Thu Jan 17 15:20:30 CET 2013


Hello Michiel ,

You should check with top to see the status of all kamailio processes.
If you see processes that are using 100% CPU, you may have a deadlock.
Connect with gdb to the process to investigate what's going on.

Also, you are running on arm.  How did you compiled kamailio: native or cross.
When you run kamailio on an embedded system, you need to check if you
have enough memory.  If you start running out of memory, the OS may
start killing processes randomly (check your OS logs).

You definitely need to look at this issue from a broader prospective
as it's not a regular x86 deployment with plenty of CPU and memory.
Also tuning the config (by removing everything that you don't need
might help with memory utilization).


Regards,
Ovidiu Sas

-- 
VoIP Embedded, Inc.
http://www.voipembedded.com

On Thu, Jan 17, 2013 at 8:41 AM, Sotas Development <sotasdev at gmail.com> wrote:
> Daniel,
>
>
>> can you add an xlog() at the start of the main route block and log a
>> message for any
>> request received? [...] You can put another xlog before the save()
>> function to see if
>> registration requests are getting there. [...] You can switch to kamailio
>> flavour modules
>> and see if reproduces.
>
> Thanks for the help! We switched to kamailio flavour, added some xlog
> messages and managed to reproduce. See below for some logging.
>
> To our surprise, the last message handled was an INVITE. We'll add more
> logging to see whether it is handled successfully or gets stuck somewhere.
>
> Those numbers at the start of the log message, are these child IDs? At first
> they alternate, but apparently child 1 and 2 stop running early on (each
> with an INVITE as last message).
>
> Regards,
>
> Michiel Veldkamp
>
>  0(304) WARNING: <core> [socket_info.c:1392]: WARNING: fix_hostname: could
> not rev. resolve 192.168.10.1
>  0(304) INFO: <core> [tcp_main.c:4832]: init_tcp: using epoll_lt as the io
> watch method (auto detected)
>  0(306) INFO: usrloc [hslot.c:53]: locks array size 512
>  0(306) INFO: <core> [udp_server.c:179]: INFO: udp_init: SO_RCVBUF is
> initially 108544
>  0(306) INFO: <core> [udp_server.c:230]: INFO: udp_init: SO_RCVBUF is
> finally 217088
>  7(315) INFO: ctl [io_listener.c:225]: io_listen_loop:  using epoll_lt io
> watch method (config)
>  1(309) ERROR: <script>: request_route start -- method=REGISTER
>  2(310) ERROR: <script>: request_route start -- method=REGISTER
>  3(311) ERROR: <script>: request_route start -- method=REGISTER
>  3(311) ERROR: <script>: route[REGISTRAR] start
>  2(310) ERROR: <script>: route[REGISTRAR] start
>  3(311) ERROR: <script>: route[REGISTRAR] saving location...
>  2(310) ERROR: <script>: route[REGISTRAR] saving location...
>  1(309) ERROR: <script>: route[REGISTRAR] start
>  1(309) ERROR: <script>: route[REGISTRAR] saving location...
>  1(309) ERROR: <script>: route[REGISTRAR] saving location... done
>  3(311) ERROR: <script>: route[REGISTRAR] saving location... done
>  2(310) ERROR: <script>: route[REGISTRAR] saving location... done
>  3(311) ERROR: <script>: request_route start -- method=REGISTER
>  3(311) ERROR: <script>: route[REGISTRAR] start
>  3(311) ERROR: <script>: route[REGISTRAR] saving location...
>  3(311) ERROR: <script>: route[REGISTRAR] saving location... done
>  2(310) ERROR: <script>: request_route start -- method=REGISTER
>  1(309) ERROR: <script>: request_route start -- method=REGISTER
>  1(309) ERROR: <script>: route[REGISTRAR] start
>  1(309) ERROR: <script>: route[REGISTRAR] saving location...
>  2(310) ERROR: <script>: route[REGISTRAR] start
>  2(310) ERROR: <script>: route[REGISTRAR] saving location...
>  1(309) ERROR: <script>: route[REGISTRAR] saving location... done
>  2(310) ERROR: <script>: route[REGISTRAR] saving location... done
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: route[REGISTRAR] start
>  1(309) ERROR: <script>: request_route start -- method=INVITE
>  1(309) ERROR: <script>: route[REGISTRAR] start
>  2(310) ERROR: <script>: request_route start -- method=INVITE
>  2(310) ERROR: <script>: route[REGISTRAR] start
>  1(309) ERROR: <script>: request_route start -- method=INVITE
>  1(309) ERROR: <script>: route[REGISTRAR] start
>  2(310) ERROR: <script>: request_route start -- method=INVITE
>  2(310) ERROR: <script>: route[REGISTRAR] start
>  2(310) ERROR: <script>: request_route start -- method=ACK
>  1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034404;method=INVITE;from_tag=966002447;to_tag=3a8473f2;call_id=331189810 at 192.168.10.2;code=200;reason=OK;src_user=Radio1_device;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=Radio1;dst_user=3;dst_domain=192.168.10.2
>  3(311) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034404;method=INVITE;from_tag=1718943109;to_tag=22a97aa7;call_id=956233863 at 192.168.10.2;code=200;reason=OK;src_user=User3;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=IC1;dst_user=1;dst_domain=192.168.10.2
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034404;method=INVITE;from_tag=1709043140;to_tag=4aa972a8;call_id=780056350 at 192.168.10.2;code=200;reason=OK;src_user=User3;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=IC2;dst_user=2;dst_domain=192.168.10.2
>  1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034404;method=INVITE;from_tag=1506064927;to_tag=5a73a3fc;call_id=1129604628 at 192.168.10.2;code=200;reason=OK;src_user=User3;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=emergency;dst_user=4;dst_domain=192.168.10.2
>  1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034404;method=INVITE;from_tag=1200029211;to_tag=14c6d7d4;call_id=1214006622 at 192.168.10.2;code=200;reason=OK;src_user=User3;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=Radio1;dst_user=3;dst_domain=192.168.10.2
>  1(309) ERROR: <script>: request_route start -- method=ACK
>  2(310) ERROR: <script>: request_route start -- method=ACK
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  2(310) ERROR: <script>: request_route start -- method=REGISTER
>  2(310) ERROR: <script>: route[REGISTRAR] start
>  2(310) ERROR: <script>: route[REGISTRAR] saving location...
>  1(309) ERROR: <script>: request_route start -- method=REGISTER
>  1(309) ERROR: <script>: route[REGISTRAR] start
>  1(309) ERROR: <script>: route[REGISTRAR] saving location...
>  2(310) ERROR: <script>: route[REGISTRAR] saving location... done
>  1(309) ERROR: <script>: route[REGISTRAR] saving location... done
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: route[REGISTRAR] start
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034419;method=INVITE;from_tag=22866096;to_tag=461b3848;call_id=119348927 at 192.168.10.1;code=200;reason=OK;src_user=User1;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=IC1;dst_user=1;dst_domain=192.168.10.2
>  2(310) ERROR: <script>: request_route start -- method=INVITE
>  2(310) ERROR: <script>: route[REGISTRAR] start
>  2(310) ERROR: <script>: request_route start -- method=ACK
>  3(311) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034419;method=INVITE;from_tag=1086463804;to_tag=1b28a959;call_id=1666188208 at 192.168.10.1;code=200;reason=OK;src_user=User1;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=IC2;dst_user=2;dst_domain=192.168.10.2
>  1(309) ERROR: <script>: request_route start -- method=INVITE
>  1(309) ERROR: <script>: route[REGISTRAR] start
>  1(309) ERROR: <script>: request_route start -- method=ACK
>  2(310) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034419;method=INVITE;from_tag=425688445;to_tag=7c6f5fd8;call_id=138053674 at 192.168.10.1;code=200;reason=OK;src_user=User1;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=emergency;dst_user=4;dst_domain=192.168.10.2
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: route[REGISTRAR] start
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  2(310) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034419;method=INVITE;from_tag=2111220874;to_tag=6a7be79d;call_id=1381530996 at 192.168.10.1;code=200;reason=OK;src_user=User1;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=Radio1;dst_user=3;dst_domain=192.168.10.2
>  1(309) ERROR: <script>: request_route start -- method=INVITE
>  1(309) ERROR: <script>: route[REGISTRAR] start
>  1(309) ERROR: <script>: request_route start -- method=ACK
>  2(310) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034419;method=INVITE;from_tag=269879616;to_tag=210d7864;call_id=907816659 at 192.168.10.1;code=200;reason=OK;src_user=User2;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=IC1;dst_user=1;dst_domain=192.168.10.2
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: route[REGISTRAR] start
>  1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
> timestamp=1350034419;method=INVITE;from_tag=1891265955;to_tag=29747a68;call_id=1205241696 at 192.168.10.1;code=200;reason=OK;src_user=User2;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=emergency;dst_user=4;dst_domain=192.168.10.2
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  2(310) ERROR: <script>: request_route start -- method=INVITE
>  1(309) ERROR: <script>: request_route start -- method=INVITE
>  2(310) ERROR: <script>: request_route start -- method=ACK
>  2(310) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  2(310) ERROR: <script>: request_route start -- method=INVITE <-- Last
> message from 2(310)
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  1(309) ERROR: <script>: request_route start -- method=INVITE  <-- Last
> message from 1(309)
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  3(311) ERROR: <script>: request_route start -- method=INVITE
>  3(311) ERROR: <script>: request_route start -- method=ACK
>  ...
>  3(311) ERROR: <script>: request_route start -- method=REGISTER
>  3(311) ERROR: <script>: route[REGISTRAR] start
>  3(311) ERROR: <script>: route[REGISTRAR] saving location...
>  3(311) ERROR: <script>: route[REGISTRAR] saving location... done
>  3(311) ERROR: <script>: request_route start -- method=INVITE  <-- Last
> message



More information about the sr-users mailing list