Hi Daniel,

Thanks for the reply. Perhaps what we're seeing is normal, and the memory use is meant to increase as time progresses. Would you expect to see an ongoing memory use increase, or when should it stop increasing?



On 11 October 2013 00:49, Daniel-Constantin Mierla <miconda@gmail.com> wrote:
Hello,


On 10/10/13 1:14 PM, David Cunningham wrote:
Hi Daniel,

I was looking to give you the information you requested in your previous reply for PID 6824. Hopefully this is it:

# sercmd pkg.stats pid 6824
{
    entry: 1
    pid: 6824
    rank: 1
    used: 209836
    free: 3704080
    real_used: 490224
}

used memory is like 200k out of 4MB, so it is not big and the log you sent with memory chunks didn't reveal a potential leaking. Maybe it is a corner case not hit so far.

You need to monitor for a while and when you see that used memory value has increased with few more 100k (or getting at 1MB) and doesn't go back low, then dump again the log with memory chunks and sent it over.

Cheers,
Daniel






On 10 October 2013 21:41, Daniel-Constantin Mierla <miconda@gmail.com> wrote:
Hello,

getting pkg stats for a process:

sercmd pkg.stats pid 1234

replace 1234 with the real PID value. There are options to use rank or index, see:

- http://kamailio.org/docs/modules/stable/modules/kex.html#idp213872

Is it what you were looking for or did I misunderstood?

Cheers,
Daniel


On 10/10/13 6:48 AM, David Cunningham wrote:
Hi Daniel,

How do I get that information please? The information above includes what I got from the pkgstats module. Is it by restarting Kamailio?



On 4 October 2013 16:42, Daniel-Constantin Mierla <miconda@gmail.com> wrote:
Hello,

none of the chunks there are indication of a leak. Can you give the output of pkg.stats for pid 6824? Which of the processes has the highest value of used pkg memory?

Cheers,
Daniel


On 10/4/13 4:25 AM, David Cunningham wrote:
Hi Daniel,

Here are the 'kamctl ps' and pkg status logs. During the 24 hours it ran for lots of REGISTER packets came through and memory use definitely increased. Thank you.


Process::  ID=0 PID=6822 Type=attendant
Process::  ID=1 PID=6824 Type=udp receiver child=0 sock=67.58.182.98:5060
Process::  ID=2 PID=6825 Type=udp receiver child=1 sock=67.58.182.98:5060
Process::  ID=3 PID=6826 Type=udp receiver child=2 sock=67.58.182.98:5060
Process::  ID=4 PID=6827 Type=udp receiver child=3 sock=67.58.182.98:5060
Process::  ID=5 PID=6828 Type=udp receiver child=4 sock=67.58.182.98:5060
Process::  ID=6 PID=6829 Type=udp receiver child=5 sock=67.58.182.98:5060
Process::  ID=7 PID=6830 Type=udp receiver child=6 sock=67.58.182.98:5060
Process::  ID=8 PID=6831 Type=udp receiver child=7 sock=67.58.182.98:5060
Process::  ID=9 PID=6832 Type=udp receiver child=0 sock=67.58.182.98:5061
Process::  ID=10 PID=6833 Type=udp receiver child=1 sock=67.58.182.98:5061
Process::  ID=11 PID=6834 Type=udp receiver child=2 sock=67.58.182.98:5061
Process::  ID=12 PID=6835 Type=udp receiver child=3 sock=67.58.182.98:5061
Process::  ID=13 PID=6836 Type=udp receiver child=4 sock=67.58.182.98:5061
Process::  ID=14 PID=6837 Type=udp receiver child=5 sock=67.58.182.98:5061
Process::  ID=15 PID=6838 Type=udp receiver child=6 sock=67.58.182.98:5061
Process::  ID=16 PID=6839 Type=udp receiver child=7 sock=67.58.182.98:5061
Process::  ID=17 PID=6840 Type=udp receiver child=0 sock=127.0.0.1:5060
Process::  ID=18 PID=6841 Type=udp receiver child=1 sock=127.0.0.1:5060
Process::  ID=19 PID=6842 Type=udp receiver child=2 sock=127.0.0.1:5060
Process::  ID=20 PID=6843 Type=udp receiver child=3 sock=127.0.0.1:5060
Process::  ID=21 PID=6844 Type=udp receiver child=4 sock=127.0.0.1:5060
Process::  ID=22 PID=6845 Type=udp receiver child=5 sock=127.0.0.1:5060
Process::  ID=23 PID=6846 Type=udp receiver child=6 sock=127.0.0.1:5060
Process::  ID=24 PID=6847 Type=udp receiver child=7 sock=127.0.0.1:5060
Process::  ID=25 PID=6848 Type=slow timer
Process::  ID=26 PID=6849 Type=timer
Process::  ID=27 PID=6850 Type=ctl handler
Process::  ID=28 PID=6851 Type=MI FIFO
Process::  ID=29 PID=6852 Type=tcp main process


Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums: summarizing all alloc'ed. fragments:
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=      8192 bytes from mi_fifo: mi_writer.c: mi_writer_init(57)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=       964 bytes from db_mysql: km_my_con.c: db_mysql_new_connection(62)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=      4100 bytes from xlog: xlog.c: mod_init(159)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=       512 bytes from <core>: counters.c: cnt_hash_add(382)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        24 bytes from kex: mi_core.c: init_mi_uptime(74)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        32 bytes from auth: auth_mod.c: generate_random_secret(221)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        76 bytes from auth: auth_mod.c: generate_random_secret(220)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     5 size=        60 bytes from <core>: script_cb.c: add_callback(69)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=         8 bytes from <core>: select.c: register_select_table(461)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     5 size=       288 bytes from <core>: cfg/cfg_struct.c: cfg_new_group(86)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     5 size=      2904 bytes from <core>: cfg/cfg.c: cfg_declare(52)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     3 size=       228 bytes from <core>: socket_info.c: fix_sock_str(436)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        28 bytes from <core>: udp_server.c: udp_rcv_loop(434)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        28 bytes from db_mysql: km_my_con.c: db_mysql_new_connection(53)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     5 size=        84 bytes from <core>: name_alias.h: add_alias(101)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     5 size=       112 bytes from <core>: name_alias.h: add_alias(99)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     3 size=        44 bytes from <core>: socket_info.c: fix_hostname(1377)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     9 size=       392 bytes from <core>: counters.c: grp_hash_add(233)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     3 size=        24 bytes from <core>: socket_info.c: fix_socket_list(1581)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=       900 bytes from <core>: receive.c: receive_msg(120)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=       336 bytes from <core>: parser/msg_parser.c: get_hdr_field(171)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     3 size=        96 bytes from <core>: parser/parse_via.c: parse_via(2429)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=       116 bytes from <core>: parser/msg_parser.c: get_hdr_field(131)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     2 size=        12 bytes from rtpproxy: rtpproxy.c: child_init(907)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        32 bytes from <core>: parser/parse_to.c: parse_to_param(287)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        24 bytes from <core>: parser/msg_parser.c: get_hdr_field(150)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    10 size=       328 bytes from <core>: parser/msg_parser.c: parse_headers(341)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=       240 bytes from sanity: sanity.c: check_parse_uris(767)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        16 bytes from <core>: route.c: route_new_list(234)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     2 size=        64 bytes from <core>: db_id.c: new_db_id(242)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        32 bytes from <core>: sr_module.c: fix_param(1142)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     3 size=       124 bytes from <core>: cfg.y: mk_case_stm(3877)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     2 size=        32 bytes from <core>: db.c: db_do_init2(300)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        56 bytes from <core>: switch.c: mk_switch_cond_table(54)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     4 size=       248 bytes from <core>: sr_module.c: fix_param(1203)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     2 size=        72 bytes from <core>: mod_fix.c: fixup_regexp_null(219)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    15 size=       228 bytes from textops: textops.c: fixup_method(1705)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     4 size=       140 bytes from textops: textops.c: hname_fixup(1634)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     8 size=       448 bytes from <core>: pvapi.c: pv_parse_format(954)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        44 bytes from <core>: rvalue.c: mk_rval_expr_v(2545)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    10 size=      9000 bytes from <core>: rvalue.c: mk_rval_expr2(2669)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     2 size=        64 bytes from <core>: route_struct.c: mk_elem(127)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     2 size=        96 bytes from <core>: ip_addr.c: mk_new_net(66)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    18 size=     16200 bytes from <core>: rvalue.c: mk_rval_expr1(2611)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    58 size=     52200 bytes from <core>: rvalue.c: mk_rval_expr_v(2534)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=   180 size=     22032 bytes from <core>: route_struct.c: mk_action(155)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        28 bytes from <core>: re.c: subst_str(533)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        24 bytes from xlog: xlog.c: xdbg_fixup_helper(346)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    86 size=      1752 bytes from <core>: rvalue.c: rval_get_str(1260)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    46 size=      1592 bytes from <core>: sr_module.c: fix_param(1108)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        24 bytes from <core>: sr_module.c: init_modules(971)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     7 size=       140 bytes from <core>: pvapi.c: tr_table_add(1660)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    21 size=      9828 bytes from <core>: sr_module.c: sr_cmd_exports_convert(234)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    23 size=      1656 bytes from <core>: sr_module.c: register_module(278)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    23 size=       856 bytes from <core>: sr_module.c: load_module(485)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    10 size=       312 bytes from <core>: modparam.c: set_mod_param_regex(124)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        32 bytes from <core>: cfg.lex: sr_push_yy_state(1692)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        24 bytes from <core>: re.c: subst_parser(315)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        80 bytes from <core>: re.c: subst_parser(306)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        32 bytes from <core>: re.c: subst_parser(289)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=   293 size=     38296 bytes from <core>: cfg.lex: addstr(1439)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    14 size=       276 bytes from <core>: cfg.lex: pp_define(1799)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        20 bytes from <core>: ppcfg.c: pp_subst_add(54)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        20 bytes from <core>: cfg.lex: sr_push_yy_state(1682)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     3 size=        44 bytes from <core>: socket_info.c: new_sock_info(251)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     3 size=       528 bytes from <core>: socket_info.c: new_sock_info(246)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     3 size=        48 bytes from <core>: cfg.y: yyparse(722)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     5 size=       120 bytes from <core>: cfg.y: yyparse(1820)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=       256 bytes from <core>: rpc_lookup.c: rpc_hash_add(156)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    63 size=      7048 bytes from <core>: rpc_lookup.c: rpc_hash_add(110)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=       256 bytes from <core>: str_hash.h: str_hash_alloc(69)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=   133 size=      5856 bytes from <core>: pvapi.c: pv_table_add(231)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    10 size=     10240 bytes from <core>: pvapi.c: pv_init_buffer(1831)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        40 bytes from <core>: pvapi.c: pv_init_buffer(1821)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        12 bytes from <core>: nonsip_hooks.c: init_nonsip_hooks(57)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    10 size=       248 bytes from <core>: db_id.c: dupl_string(50)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    10 size=       240 bytes from <core>: route.c: route_add(159)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     6 size=       384 bytes from <core>: str_hash.h: str_hash_alloc(69)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     5 size=        36 bytes from <core>: route.c: init_rlist(180)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     1 size=        64 bytes from <core>: counters.c: init_counters(121)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=    73 size=      9044 bytes from <core>: counters.c: cnt_hash_add(331)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums:  count=     2 size=       640 bytes from <core>: str_hash.h: str_hash_alloc(69)
Oct  3 22:23:21 sip0-test /sbin/kamailio[6844]: NOTICE: qm_sums: -----------------------------



-- 
Daniel-Constantin Mierla - http://www.asipto.com
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
Kamailio Advanced Trainings - Berlin, Nov 25-28; Miami, Nov 18-20, 2013
  - more details about Kamailio trainings at http://www.asipto.com -



--
David Cunningham, Voisonics
http://voisonics.com/
USA: +1 213 221 1092
UK: +44 (0) 20 3298 1642
Australia: +61 (0) 2 8063 9019

-- 
Daniel-Constantin Mierla - http://www.asipto.com
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
Kamailio Advanced Trainings - Berlin, Nov 25-28; Miami, Nov 18-20, 2013
  - more details about Kamailio trainings at http://www.asipto.com -



--
David Cunningham, Voisonics
http://voisonics.com/
USA: +1 213 221 1092
UK: +44 (0) 20 3298 1642
Australia: +61 (0) 2 8063 9019

-- 
Daniel-Constantin Mierla - http://www.asipto.com
http://twitter.com/#!/miconda - http://www.linkedin.com/in/miconda
Kamailio Advanced Trainings - Berlin, Nov 25-28; Miami, Nov 18-20, 2013
  - more details about Kamailio trainings at http://www.asipto.com -



--
David Cunningham, Voisonics
http://voisonics.com/
USA: +1 213 221 1092
UK: +44 (0) 20 3298 1642
Australia: +61 (0) 2 8063 9019