Hi,
It happend again.
I got the result from gdb. Here is the output from a bt indside gdb for each worker and one bt full for one of the workers.
They are all stuck in futexlock.h
My C debuging skills are a bit rusty so I hope one of you have some ideas.
/Morten
(gdb) bt #0 0x000000329b6d0a19 in syscall () from /lib64/libc.so.6 #1 0x00002acaf17b2e0d in futex_get (t=<value optimized out>, type=<value optimized out>, ps=0x7fffafb7d7a0) at ../../mem/../futexlock.h:113 #2 publ_cback_func (t=<value optimized out>, type=<value optimized out>, ps=0x7fffafb7d7a0) at send_publish.c:272 #3 0x00002acaeeb97815 in run_trans_callbacks_internal (cb_lst=0x2acaf3cfd260, type=256, trans=0x2acaf3cfd1f0, params=0x7fffafb7d7a0) at t_hooks.c:290 #4 0x00002acaeeb97a6e in run_trans_callbacks (type=0, trans=0x2, req=0x0, rpl=0x246, code=0) at t_hooks.c:317 #5 0x00002acaeebbfcb3 in local_reply (t=0x2acaf3cfd1f0, p_msg=<value optimized out>, branch=0, msg_status=<value optimized out>, cancel_bitmap=<value optimized out>) at t_reply.c:1847 #6 0x00002acaeebc29e8 in reply_received (p_msg=0x8d36c8) at t_reply.c:2133 #7 0x000000000044780e in forward_reply (msg=0x8d36c8) at forward.c:689 #8 0x000000000047ff02 in receive_msg ( buf=0x874a40 "SIP/2.0 200 OK\r\nVia: SIP/2.0/UDP 178.21.248.8;branch=z9hG4bKcd3a.d99d6403.0\r\nTo: sip:+380432571592@sip.uni-tel.dk;user=phone;tag=4e546d1f8c10c6f99af9c51d895c9c87-c9ca\r\nFrom: sip:+380432571592@sip.uni-"..., len=<value optimized out>, rcv_info=0x7fffafb7dd20) at receive.c:257 #9 0x00000000005067ab in udp_rcv_loop () at udp_server.c:520 #10 0x0000000000455cdf in main_loop () at main.c:1447 #11 0x0000000000456de2 in main (argc=<value optimized out>, argv=0x7fffafb7dfe8) at main.c:2251
(gdb) bt #0 0x000000329b6d0a19 in syscall () from /lib64/libc.so.6 #1 0x00002acaeeb7ea32 in futex_get (i=<value optimized out>) at ../../mem/../futexlock.h:100 #2 _lock (i=<value optimized out>) at lock.h:98 #3 lock_hash (i=<value optimized out>) at h_table.c:98 #4 0x00002acaeeba1b99 in t_lookup_request (p_msg=0x8d36c8, leave_new_locked=0, cancel=0x7fffafb7d5e0) at t_lookup.c:548 #5 0x00002acaeeba3532 in t_check_msg (p_msg=0x8d36c8, param_branch=<value optimized out>) at t_lookup.c:1104 #6 0x00002acaeebab7b1 in t_check_trans (msg=0x2acaf1f4b2e8, foo=<value optimized out>, bar=0x2 <Address 0x2 out of bounds>) at tm.c:1881 #7 0x000000000041345c in do_action (h=0x7fffafb7dab0, a=0x8a6f98, msg=0x8d36c8) at action.c:860 #8 0x0000000000415d2b in run_actions (h=0x7fffafb7dab0, a=0x89f8d8, msg=0x8d36c8) at action.c:1293 #9 0x0000000000416084 in run_top_route (a=0x89f8d8, msg=0x8d36c8, c=<value optimized out>) at action.c:1341 #10 0x000000000047ff4c in receive_msg ( buf=0x874a40 "INVITE sip:20322595@178.21.248.8:5060;transport=udp SIP/2.0\r\nRecord-Route: sip:178.21.248.20;lr;ftag=as3d313976\r\nVia: SIP/2.0/UDP 178.21.248.20;branch=z9hG4bKdd3a.3d0516e1.0\r\nVia: SIP/2.0/UDP 81.27."..., len=<value optimized out>, rcv_info=0x7fffafb7dd20) at receive.c:196 #11 0x00000000005067ab in udp_rcv_loop () at udp_server.c:520 #12 0x0000000000455cdf in main_loop () at main.c:1447 #13 0x0000000000456de2 in main (argc=<value optimized out>, argv=0x7fffafb7dfe8) at main.c:2251
#0 0x000000329b6d0a19 in syscall () from /lib64/libc.so.6 #1 0x00002acaeeb7ea32 in futex_get (i=<value optimized out>) at ../../mem/../futexlock.h:100 #2 _lock (i=<value optimized out>) at lock.h:98 #3 lock_hash (i=<value optimized out>) at h_table.c:98 #4 0x00002acaeeba1b99 in t_lookup_request (p_msg=0x8d36c8, leave_new_locked=0, cancel=0x7fffafb7d5e0) at t_lookup.c:548 #5 0x00002acaeeba3532 in t_check_msg (p_msg=0x8d36c8, param_branch=<value optimized out>) at t_lookup.c:1104 #6 0x00002acaeebab7b1 in t_check_trans (msg=0x2acaf1f4b2e8, foo=<value optimized out>, bar=0x2 <Address 0x2 out of bounds>) at tm.c:1881 #7 0x000000000041345c in do_action (h=0x7fffafb7dab0, a=0x8a6f98, msg=0x8d36c8) at action.c:860 #8 0x0000000000415d2b in run_actions (h=0x7fffafb7dab0, a=0x89f8d8, msg=0x8d36c8) at action.c:1293 #9 0x0000000000416084 in run_top_route (a=0x89f8d8, msg=0x8d36c8, c=<value optimized out>) at action.c:1341 #10 0x000000000047ff4c in receive_msg ( buf=0x874a40 "INVITE sip:20322595@178.21.248.8:5060;transport=udp SIP/2.0\r\nRecord-Route: sip:178.21.248.20;lr;ftag=as3d313976\r\nVia: SIP/2.0/UDP 178.21.248.20;branch=z9hG4bKdd3a.3d0516e1.0\r\nVia: SIP/2.0/UDP 81.27."..., len=<value optimized out>, rcv_info=0x7fffafb7dd20) at receive.c:196 #11 0x00000000005067ab in udp_rcv_loop () at udp_server.c:520 #12 0x0000000000455cdf in main_loop () at main.c:1447 #13 0x0000000000456de2 in main (argc=<value optimized out>, argv=0x7fffafb7dfe8) at main.c:2251
(gdb) bt #0 0x000000329b6d0a19 in syscall () from /lib64/libc.so.6 #1 0x00002acaeeb7e9fa in futex_get (i=<value optimized out>) at ../../mem/../futexlock.h:113 #2 _lock (i=<value optimized out>) at lock.h:98 #3 lock_hash (i=<value optimized out>) at h_table.c:98 #4 0x00002acaeebca0e3 in t_uac_prepare (uac_r=0x7fffafb7c270, dst_req=0x7fffafb7c060, dst_cell=0x7fffafb7c058) at uac.c:319 #5 0x00002acaeebcb4ae in t_uac_with_ids (uac_r=0x2acaf1f4b2e8, ret_index=0x0, ret_label=0x0) at uac.c:531 #6 0x00002acaeebcc9c7 in request (uac_r=0x7fffafb7c270, ruri=0x11, to=0x1b, from=0x8e0fe0, next_hop=0x2acaf19c01c0) at uac.c:778 #7 0x00002acaf17af3ff in send_publish (publ=<value optimized out>) at send_publish.c:556 #8 0x00002acaf19c4f67 in dialog_publish (state=<value optimized out>, entity=<value optimized out>, peer=<value optimized out>, callid=<value optimized out>, initiator=<value optimized out>, lifetime=43200, localtag=0x0, remotetag=0x0, localtarget=0x0, remotetarget=0x0) at dialog_publish.c:349 #9 0x00002acaf19c6880 in __dialog_created (dlg=0x2acaf575eb38, type=<value optimized out>, _params=<value optimized out>) at pua_dialoginfo.c:351 #10 0x00002acaf134ef0f in run_create_callbacks (dlg=0x2acaf575eb38, msg=<value optimized out>) at dlg_cb.c:230 #11 0x00002acaf13563c7 in dlg_new_dialog (msg=0x8d36c8, t=0x2acaf157d940) at dlg_handlers.c:643 #12 0x00002acaeeb9751a in run_reqin_callbacks_internal (hl=0x2acaf1e55018, trans=0x2acaf6fa1630, params=0x2acaeede2920) at t_hooks.c:376 #13 0x00002acaeeb7ec5a in build_cell (p_msg=0x8d36c8) at h_table.c:346 #14 0x00002acaeeba240e in new_t (p_msg=0x8d36c8) at t_lookup.c:1332 #15 t_newtran (p_msg=0x8d36c8) at t_lookup.c:1472 #16 0x00002acaeeb8d92b in t_relay_to (p_msg=0x2acaf1f4b2e8, proxy=0x0, proto=0, replicate=0) at t_funcs.c:272 #17 0x000000000041345c in do_action (h=0x7fffafb7dab0, a=0x8c8918, msg=0x8d36c8) at action.c:860 #18 0x0000000000415d2b in run_actions (h=0x7fffafb7dab0, a=0x8c8918, msg=0x8d36c8) at action.c:1293 #19 0x0000000000496815 in rval_get_int (h=0x2acaf1f4b2e8, msg=0x0, i=0x7fffafb7d1ac, rv=0xffffffffffffffff, cache=0x0) at rvalue.c:897 #20 0x000000000049b68c in rval_expr_eval_int (h=0x7fffafb7dab0, msg=0x8d36c8, res=0x7fffafb7d1ac, rve=0x8c8a08) at rvalue.c:1837 #21 0x000000000049b73d in rval_expr_eval_int (h=0x7fffafb7dab0, msg=0x8d36c8, res=0x7fffafb7d5b8, rve=0x8c90d8) at rvalue.c:1844 #22 0x0000000000411d16 in do_action (h=0x7fffafb7dab0, a=0x8c9928, msg=0x8d36c8) at action.c:834 #23 0x0000000000415d2b in run_actions (h=0x7fffafb7dab0, a=0x8bda00, msg=0x8d36c8) at action.c:1293 #24 0x0000000000413054 in do_action (h=0x7fffafb7dab0, a=0x8bd7f0, msg=0x8d36c8) at action.c:479 #25 0x0000000000415d2b in run_actions (h=0x7fffafb7dab0, a=0x89f8d8, msg=0x8d36c8) at action.c:1293 #26 0x0000000000416084 in run_top_route (a=0x89f8d8, msg=0x8d36c8, c=<value optimized out>) at action.c:1341 #27 0x000000000047ff4c in receive_msg ( buf=0x874a40 "INVITE sip:20322595@178.21.248.8:5060;transport=udp SIP/2.0\r\nRecord-Route: sip:178.21.248.20;lr;ftag=as3d313976\r\nVia : SIP/2.0/UDP 178.21.248.20;branch=z9hG4bKdd3a.3d0516e1.0\r\nVia: SIP/2.0/UDP 81.27."..., len=<value optimized out>, rcv_info=0x7fffafb7dd20) at receive.c:196 #28 0x00000000005067ab in udp_rcv_loop () at udp_server.c:520 #29 0x0000000000455cdf in main_loop () at main.c:1447 #30 0x0000000000456de2 in main (argc=<value optimized out>, argv=0x7fffafb7dfe8) at main.c:2251
(gdb) bt full #0 0x000000329b6d0a19 in syscall () from /lib64/libc.so.6 No symbol table info available. #1 0x00002acaeeb7ea32 in futex_get (i=<value optimized out>) at ../../mem/../futexlock.h:100 v = <value optimized out> #2 _lock (i=<value optimized out>) at lock.h:98 No locals. #3 lock_hash (i=<value optimized out>) at h_table.c:98 No locals. #4 0x00002acaeeba1b99 in t_lookup_request (p_msg=0x8d36c8, leave_new_locked=0, cancel=0x7fffafb7d5e0) at t_lookup.c:548 p_cell = <value optimized out> isACK = 0 t_msg = <value optimized out> branch = 0xfffffffffffffffc match_status = <value optimized out> hash_bucket = <value optimized out> #5 0x00002acaeeba3532 in t_check_msg (p_msg=0x8d36c8, param_branch=<value optimized out>) at t_lookup.c:1104 local_branch = 0 canceled = 9042808 ret = <value optimized out> #6 0x00002acaeebab7b1 in t_check_trans (msg=0x2acaf1f4b2e8, foo=<value optimized out>, bar=0x2 <Address 0x2 out of bounds>) at tm.c:1881 t = <value optimized out> #7 0x000000000041345c in do_action (h=0x7fffafb7dab0, a=0x8a6f98, msg=0x8d36c8) at action.c:860 ret = -5 v = <value optimized out> dst = {send_sock = 0x2acaedccc000, to = {s = {sa_family = 37544, sa_data = "\220\000\000\000\000\000`\253\220\000\000\000\000"}, sin = { sin_family = 37544, sin_port = 144, sin_addr = {s_addr = 0}, sin_zero = "`\253\220\000\000\000\000"}, sin6 = {sin6_family = 37544, sin6_port = 144, sin6_flowinfo = 0, sin6_addr = {in6_u = {u6_addr8 = "`\253\220\000\000\000\000\000LK\207\000\000\000\000", u6_addr16 = { 43872, 144, 0, 0, 19276, 135, 0, 0}, u6_addr32 = {9481056, 0, 8866636, 0}}}, sin6_scope_id = 9480096}}, id = 0, proto = -46 '\322', send_flags = 74 'J'} tmp = <value optimized out> new_uri = <value optimized out> end = <value optimized out> crt = <value optimized out> f = 0xfffffffffffffffc len = <value optimized out> user = <value optimized out> uri = {user = {s = 0x7fffafb7da60 "\310\066\215", len = 0}, passwd = {s = 0x7fffafb7da40 "\001", len = 5767096}, host = { s = 0x1be1460 "8*\225\233\062", len = -1684723232}, port = {s = 0x100000000 <Address 0x100000000 out of bounds>, len = 134}, params = { s = 0x0, len = 29234864}, sip_params = {s = 0x100000000 <Address 0x100000000 out of bounds>, len = -1687727470}, headers = { s = 0x36b7 <Address 0x36b7 out of bounds>, len = 8208}, port_no = 24939, proto = 24941, type = 1869180009, flags = 21, transport = { ---Type <return> to continue, or q <return> to quit--- s = 0x1be1460 "8*\225\233\062", len = 0}, ttl = {s = 0x0, len = 21}, user_param = {s = 0x1be1460 "8*\225\233\062", len = 21}, maddr = { s = 0x0, len = -1346905536}, method = {s = 0x57ffb8 "%s: %sERROR: forward_reply: no 2nd via found in reply\n", len = -1687738517}, lr = { s = 0x18 <Address 0x18 out of bounds>, len = 21}, r2 = {s = 0x15 <Address 0x15 out of bounds>, len = 29234272}, transport_val = { s = 0x15 <Address 0x15 out of bounds>, len = 21}, ttl_val = {s = 0x1be1460 "8*\225\233\062", len = -1687354197}, user_param_val = { s = 0x2a00000033 <Address 0x2a00000033 out of bounds>, len = 5458017}, maddr_val = {s = 0x6f00000003 <Address 0x6f00000003 out of bounds>, len = 2}, method_val = {s = 0x1 <Address 0x1 out of bounds>, len = 7200}, lr_val = {s = 0x1bacb40 "CEST", len = 5267113}, r2_val = { s = 0x90a606 "", len = -1346905500}} next_hop = {user = {s = 0x10 <Address 0x10 out of bounds>, len = -1687029130}, passwd = {s = 0x1ff4 <Address 0x1ff4 out of bounds>, len = -1687023672}, host = {s = 0x8 <Address 0x8 out of bounds>, len = 29234892}, port = { s = 0x1be16cc "16:42:57 /usr/local/sbin/kamailio[14007]: WARNING: <script>: ua=CEC-PBX", len = -1684723232}, params = {s = 0x329b952a00 "", len = -1684723200}, sip_params = {s = 0x2acaf3e05470 "", len = -1684723144}, headers = {s = 0x329b94fae0 "@íen = -1346905792}, port_no = 16, proto = 0, type = 48, flags = 2948061504, transport = {s = 0x7fffafb7d880 "", len = 29235008}, ttl = { s = 0x1e8c0 <Address 0x1e8c0 out of bounds>, len = 29243072}, user_param = {s = 0x329b722698 "double free or corruption (out)", len = 117056}, maddr = {s = 0x329b9529e0 "", len = -1687739828}, method = {s = 0x329b9535a0 "", len = 5767096}, lr = { s = 0x1 <Address 0x1 out of bounds>, len = -1687631697}, r2 = {s = 0x7fffafb7dad8 "\330", <incomplete sequence \370\211>, len = 8231792}, transport_val = {s = 0x7fffafb7dd8c "\020", len = -289787385}, ttl_val = {s = 0x8d36c8 "\033x\r", len = 412}, user_param_val = { s = 0x313500000000 <Address 0x313500000000 out of bounds>, len = 29243072}, maddr_val = {s = 0x2010 <Address 0x2010 out of bounds>, len = 134}, method_val = {s = 0x2010 <Address 0x2010 out of bounds>, len = 29234864}, lr_val = {s = 0x90 <Address 0x90 out of bounds>, len = -1687731159}, r2_val = {s = 0x3000000010 <Address 0x3000000010 out of bounds>, len = -1684723232}} u = <value optimized out> port = <value optimized out> i = <value optimized out> flags = <value optimized out> sct = <value optimized out> sjt = <value optimized out> rve = <value optimized out> mct = <value optimized out> rv = <value optimized out> rv1 = <value optimized out> c1 = {cache_type = 8866741, val_type = RV_NONE, c = {avp_val = {n = 133, s = {s = 0x85 <Address 0x85 out of bounds>, len = 29234880}, re = 0x85}, pval = {rs = {s = 0x85 <Address 0x85 out of bounds>, len = 29234880}, ri = 1303224171, flags = 0}}} #8 0x0000000000415d2b in run_actions (h=0x7fffafb7dab0, a=0x89f8d8, msg=0x8d36c8) at action.c:1293 t = 0x8a6f98 ret = 1 mod = <value optimized out> #9 0x0000000000416084 in run_top_route (a=0x89f8d8, msg=0x8d36c8, c=<value optimized out>) at action.c:1341 ctx = {rec_lev = 1, run_flags = 0, last_retcode = -1, jmp_env = {{__jmpbuf = {9254600, -7918255915006962580, 0, 9042136, 9482320, 140736141450636, -7918229962976915956, -7918255915011241414}, __mask_was_saved = 0, __saved_mask = {__val = {9254600, 2, 5317260, 928, 8866420, 0, 8866368, 9254608, 1, 140736141450528, 9254600, 8866429, 5321012, 9479616, 47051076858778, 9295328}}}}} p = 0x7fffafb7dab0 ---Type <return> to continue, or q <return> to quit--- ret = <value optimized out> sfbk = 0 #10 0x000000000047ff4c in receive_msg ( buf=0x874a40 "INVITE sip:20322595@178.21.248.8:5060;transport=udp SIP/2.0\r\nRecord-Route: sip:178.21.248.20;lr;ftag=as3d313976\r\nVia: SIP/2.0/UDP 178.21.248.20;branch=z9hG4bKdd3a.3d0516e1.0\r\nVia: SIP/2.0/UDP 81.27."..., len=<value optimized out>, rcv_info=0x7fffafb7dd20) at receive.c:196 msg = 0x0 ctx = {rec_lev = 9034719, run_flags = 0, last_retcode = 9295720, jmp_env = {{__jmpbuf = {47051129731136, 8, 47051127553476, 2, 217355168616, 47051061455248, 47051127553501, 4294967295}, __mask_was_saved = -236996544, __saved_mask = {__val = {8230504, 9007856, 16, 9482320, 140736141450636, 0, 217350982997, 1, 0, 8963168, 47051127486569, 217355168616, 2, 150476210, 217351006434, 0}}}}} ret = <value optimized out> inb = { s = 0x874a40 "INVITE sip:20322595@178.21.248.8:5060;transport=udp SIP/2.0\r\nRecord-Route: sip:178.21.248.20;lr;ftag=as3d313976\r\nVia: SIP/2.0/UDP 178.21.248.20;branch=z9hG4bKdd3a.3d0516e1.0\r\nVia: SIP/2.0/UDP 81.27."..., len = 928} #11 0x00000000005067ab in udp_rcv_loop () at udp_server.c:520 len = 928 tmp = <value optimized out> from = <value optimized out> fromlen = 16 ri = {src_ip = {af = 2, len = 4, u = {addrl = {351802802, 420}, addr32 = {351802802, 0, 420, 0}, addr16 = {5554, 5368, 0, 0, 420, 0, 0, 0}, addr = "\262\025\370\024\000\000\000\000\244\001\000\000\000\000\000"}}, dst_ip = {af = 2, len = 4, u = {addrl = {150476210, 0}, addr32 = {150476210, 0, 0, 0}, addr16 = {5554, 2296, 0, 0, 0, 0, 0, 0}, addr = "\262\025\370\b", '\000' <repeats 11 times>}}, src_port = 5060, dst_port = 5060, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {sa_family = 2, sa_data = "\023IJ\025\370\024\000\000\000\000\000\000\000"}, sin = {sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 351802802}, sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2, sin6_port = 50195, sin6_flowinfo = 351802802, sin6_addr = {in6_u = { u6_addr8 = '\000' <repeats 15 times>, u6_addr16 = {0, 0, 0, 0, 0, 0, 0, 0}, u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, bind_address = 0x8972f0, proto = 1 '\001'} buf = "INVITE sip:20322595@178.21.248.8:5060;transport=udp SIP/2.0\r\nRecord-Route: sip:178.21.248.20;lr;ftag=as3d313976\r\nVia: SIP/2.0/UDP 178.21.248.20;branch=z9hG4bKdd3a.3d0516e1.0\r\nVia: SIP/2.0/UDP 81.27."... #12 0x0000000000455cdf in main_loop () at main.c:1447 i = 2 pid = <value optimized out> si = 0x8972f0 si_desc = "udp receiver child=2 sock=178.21.248.8:5060\000\000\000\000\000\004", '\000' <repeats 11 times>, "\001", '\000' <repeats 11 times>, "\b\000\000\000\000\000\000\000\001\000\000\000\000\000\000\000\004", '\000' <repeats 23 times>"\350, \337\267\257\377\177\000\000\252\267H\000\000\000\000" #13 0x0000000000456de2 in main (argc=<value optimized out>, argv=0x7fffafb7dfe8) at main.c:2251 cfg_stream = 0x1b95010 c = <value optimized out> r = <value optimized out> tmp = 0x7fffafb7ef76 "" ---Type <return> to continue, or q <return> to quit--- tmp_len = 16777216 port = 0 proto = 0 ret = <value optimized out> seed = 524492455 rfd = <value optimized out> debug_save = 0 debug_flag = 0 dont_fork_cnt = 0 n_lst = 0x0
On Thu, Apr 7, 2011 at 10:52 PM, Daniel-Constantin Mierla miconda@gmail.com wrote:
Hello,
do you get high CPU usage by kamailio?
What you can do is to attach with gdb to kamailio processes and see what they are doing:
gdb /path/to/kamailio pid_of_a_kamailio_process bt
You should attach to the sip worker processes - you can find the type of processes with 'kamctl ps'.
Cheers, Daniel
On 4/7/11 9:02 PM, Morten Isaksen wrote:
Hi!
Kamailio 3.0.3.
I have a strange problem with one of our Kamailio servers. This one is used for routing (with carrierroute) and to send presence information (with pua module)
Once every 10 day or so I get this error and then Kamailio stops responding to any SIP packets.
Apr 6 08:05:48 sip-core-1 /usr/local/sbin/kamailio[9186]: WARNING:
<script>: Failure route - M=INVITE RURI=sip:8615XXXX@178.XX.XX.XX F=sip:861XXXXX@188.120.93.114:1025 T=sip:86155XXXX@sip1.uni-tel.dk IP=178.XX.XX.XX ID=6de881ec07f9c6494ee589cf208da358@10.11.87.206 Apr 6 08:05:48 sip-core-1 /usr/local/sbin/kamailio[9186]: ERROR: carrierroute [cr_func.c:95]: cannot find AVP 'carrier' Apr 6 08:05:48 sip-core-1 /usr/local/sbin/kamailio[9186]: ERROR: carrierroute [cr_func.c:805]: invalid carrier id -1 Apr 6 08:05:48 sip-core-1 /usr/local/sbin/kamailio[9186]: ERROR: <script>: cr_next_domain failed Shared memory size is 128M and over halv is free just before the error. The server is in production and does handle debug>1 well, so I do not have much information in the log files. Private memory is the default size. Any ideas what it could be, or how to investegate further? I think my next steps would be to increase the private memory og to increase children=4 to children=8
-- Daniel-Constantin Mierla http://www.asipto.com