17 Jan
2013
17 Jan
'13
4:20 p.m.
Hello Michiel ,
You should check with top to see the status of all kamailio processes.
If you see processes that are using 100% CPU, you may have a deadlock.
Connect with gdb to the process to investigate what's going on.
Also, you are running on arm. How did you compiled kamailio: native or cross.
When you run kamailio on an embedded system, you need to check if you
have enough memory. If you start running out of memory, the OS may
start killing processes randomly (check your OS logs).
You definitely need to look at this issue from a broader prospective
as it's not a regular x86 deployment with plenty of CPU and memory.
Also tuning the config (by removing everything that you don't need
might help with memory utilization).
Regards,
Ovidiu Sas
--
VoIP Embedded, Inc.
http://www.voipembedded.com
On Thu, Jan 17, 2013 at 8:41 AM, Sotas Development <sotasdev(a)gmail.com> wrote:
Daniel,
can you add an xlog() at the start of the main
route block and log a
message for any
request received? [...] You can put another xlog before the save()
function to see if
registration requests are getting there. [...] You can switch to kamailio
flavour modules
and see if reproduces.
Thanks for the help! We switched to kamailio flavour, added some xlog
messages and managed to reproduce. See below for some logging.
To our surprise, the last message handled was an INVITE. We'll add more
logging to see whether it is handled successfully or gets stuck somewhere.
Those numbers at the start of the log message, are these child IDs? At first
they alternate, but apparently child 1 and 2 stop running early on (each
with an INVITE as last message).
Regards,
Michiel Veldkamp
0(304) WARNING: <core> [socket_info.c:1392]: WARNING: fix_hostname: could
not rev. resolve 192.168.10.1
0(304) INFO: <core> [tcp_main.c:4832]: init_tcp: using epoll_lt as the io
watch method (auto detected)
0(306) INFO: usrloc [hslot.c:53]: locks array size 512
0(306) INFO: <core> [udp_server.c:179]: INFO: udp_init: SO_RCVBUF is
initially 108544
0(306) INFO: <core> [udp_server.c:230]: INFO: udp_init: SO_RCVBUF is
finally 217088
7(315) INFO: ctl [io_listener.c:225]: io_listen_loop: using epoll_lt io
watch method (config)
1(309) ERROR: <script>: request_route start -- method=REGISTER
2(310) ERROR: <script>: request_route start -- method=REGISTER
3(311) ERROR: <script>: request_route start -- method=REGISTER
3(311) ERROR: <script>: route[REGISTRAR] start
2(310) ERROR: <script>: route[REGISTRAR] start
3(311) ERROR: <script>: route[REGISTRAR] saving location...
2(310) ERROR: <script>: route[REGISTRAR] saving location...
1(309) ERROR: <script>: route[REGISTRAR] start
1(309) ERROR: <script>: route[REGISTRAR] saving location...
1(309) ERROR: <script>: route[REGISTRAR] saving location... done
3(311) ERROR: <script>: route[REGISTRAR] saving location... done
2(310) ERROR: <script>: route[REGISTRAR] saving location... done
3(311) ERROR: <script>: request_route start -- method=REGISTER
3(311) ERROR: <script>: route[REGISTRAR] start
3(311) ERROR: <script>: route[REGISTRAR] saving location...
3(311) ERROR: <script>: route[REGISTRAR] saving location... done
2(310) ERROR: <script>: request_route start -- method=REGISTER
1(309) ERROR: <script>: request_route start -- method=REGISTER
1(309) ERROR: <script>: route[REGISTRAR] start
1(309) ERROR: <script>: route[REGISTRAR] saving location...
2(310) ERROR: <script>: route[REGISTRAR] start
2(310) ERROR: <script>: route[REGISTRAR] saving location...
1(309) ERROR: <script>: route[REGISTRAR] saving location... done
2(310) ERROR: <script>: route[REGISTRAR] saving location... done
3(311) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: route[REGISTRAR] start
1(309) ERROR: <script>: request_route start -- method=INVITE
1(309) ERROR: <script>: route[REGISTRAR] start
2(310) ERROR: <script>: request_route start -- method=INVITE
2(310) ERROR: <script>: route[REGISTRAR] start
1(309) ERROR: <script>: request_route start -- method=INVITE
1(309) ERROR: <script>: route[REGISTRAR] start
2(310) ERROR: <script>: request_route start -- method=INVITE
2(310) ERROR: <script>: route[REGISTRAR] start
2(310) ERROR: <script>: request_route start -- method=ACK
1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034404;method=INVITE;from_tag=966002447;to_tag=3a8473f2;call_id=331189810@192.168.10.2;code=200;reason=OK;src_user=Radio1_device;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=Radio1;dst_user=3;dst_domain=192.168.10.2
3(311) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034404;method=INVITE;from_tag=1718943109;to_tag=22a97aa7;call_id=956233863@192.168.10.2;code=200;reason=OK;src_user=User3;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=IC1;dst_user=1;dst_domain=192.168.10.2
3(311) ERROR: <script>: request_route start -- method=ACK
1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034404;method=INVITE;from_tag=1709043140;to_tag=4aa972a8;call_id=780056350@192.168.10.2;code=200;reason=OK;src_user=User3;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=IC2;dst_user=2;dst_domain=192.168.10.2
1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034404;method=INVITE;from_tag=1506064927;to_tag=5a73a3fc;call_id=1129604628@192.168.10.2;code=200;reason=OK;src_user=User3;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=emergency;dst_user=4;dst_domain=192.168.10.2
1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034404;method=INVITE;from_tag=1200029211;to_tag=14c6d7d4;call_id=1214006622@192.168.10.2;code=200;reason=OK;src_user=User3;src_domain=testnet;src_ip=192.168.10.2;dst_ouser=Radio1;dst_user=3;dst_domain=192.168.10.2
1(309) ERROR: <script>: request_route start -- method=ACK
2(310) ERROR: <script>: request_route start -- method=ACK
3(311) ERROR: <script>: request_route start -- method=ACK
2(310) ERROR: <script>: request_route start -- method=REGISTER
2(310) ERROR: <script>: route[REGISTRAR] start
2(310) ERROR: <script>: route[REGISTRAR] saving location...
1(309) ERROR: <script>: request_route start -- method=REGISTER
1(309) ERROR: <script>: route[REGISTRAR] start
1(309) ERROR: <script>: route[REGISTRAR] saving location...
2(310) ERROR: <script>: route[REGISTRAR] saving location... done
1(309) ERROR: <script>: route[REGISTRAR] saving location... done
3(311) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: route[REGISTRAR] start
3(311) ERROR: <script>: request_route start -- method=ACK
1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034419;method=INVITE;from_tag=22866096;to_tag=461b3848;call_id=119348927@192.168.10.1;code=200;reason=OK;src_user=User1;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=IC1;dst_user=1;dst_domain=192.168.10.2
2(310) ERROR: <script>: request_route start -- method=INVITE
2(310) ERROR: <script>: route[REGISTRAR] start
2(310) ERROR: <script>: request_route start -- method=ACK
3(311) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034419;method=INVITE;from_tag=1086463804;to_tag=1b28a959;call_id=1666188208@192.168.10.1;code=200;reason=OK;src_user=User1;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=IC2;dst_user=2;dst_domain=192.168.10.2
1(309) ERROR: <script>: request_route start -- method=INVITE
1(309) ERROR: <script>: route[REGISTRAR] start
1(309) ERROR: <script>: request_route start -- method=ACK
2(310) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034419;method=INVITE;from_tag=425688445;to_tag=7c6f5fd8;call_id=138053674@192.168.10.1;code=200;reason=OK;src_user=User1;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=emergency;dst_user=4;dst_domain=192.168.10.2
3(311) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: route[REGISTRAR] start
3(311) ERROR: <script>: request_route start -- method=ACK
2(310) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034419;method=INVITE;from_tag=2111220874;to_tag=6a7be79d;call_id=1381530996@192.168.10.1;code=200;reason=OK;src_user=User1;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=Radio1;dst_user=3;dst_domain=192.168.10.2
1(309) ERROR: <script>: request_route start -- method=INVITE
1(309) ERROR: <script>: route[REGISTRAR] start
1(309) ERROR: <script>: request_route start -- method=ACK
2(310) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034419;method=INVITE;from_tag=269879616;to_tag=210d7864;call_id=907816659@192.168.10.1;code=200;reason=OK;src_user=User2;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=IC1;dst_user=1;dst_domain=192.168.10.2
3(311) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: route[REGISTRAR] start
1(309) NOTICE: acc [acc.c:275]: ACC: transaction answered:
timestamp=1350034419;method=INVITE;from_tag=1891265955;to_tag=29747a68;call_id=1205241696@192.168.10.1;code=200;reason=OK;src_user=User2;src_domain=testnet;src_ip=192.168.10.1;dst_ouser=emergency;dst_user=4;dst_domain=192.168.10.2
3(311) ERROR: <script>: request_route start -- method=ACK
2(310) ERROR: <script>: request_route start -- method=INVITE
1(309) ERROR: <script>: request_route start -- method=INVITE
2(310) ERROR: <script>: request_route start -- method=ACK
2(310) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: request_route start -- method=ACK
3(311) ERROR: <script>: request_route start -- method=INVITE
2(310) ERROR: <script>: request_route start -- method=INVITE <-- Last
message from 2(310)
3(311) ERROR: <script>: request_route start -- method=ACK
3(311) ERROR: <script>: request_route start -- method=ACK
3(311) ERROR: <script>: request_route start -- method=ACK
1(309) ERROR: <script>: request_route start -- method=INVITE <-- Last
message from 1(309)
3(311) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: request_route start -- method=ACK
3(311) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: request_route start -- method=ACK
3(311) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: request_route start -- method=ACK
3(311) ERROR: <script>: request_route start -- method=INVITE
3(311) ERROR: <script>: request_route start -- method=ACK
...
3(311) ERROR: <script>: request_route start -- method=REGISTER
3(311) ERROR: <script>: route[REGISTRAR] start
3(311) ERROR: <script>: route[REGISTRAR] saving location...
3(311) ERROR: <script>: route[REGISTRAR] saving location... done
3(311) ERROR: <script>: request_route start -- method=INVITE <-- Last
message