<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hello,</p>
<p>can you enable pkg summary and generate it once the out of memory
happens?</p>
<p>Set memlog to lower value than debug, when the memory happens,
do:</p>
<p><a
href="https://www.kamailio.org/docs/modules/devel/modules/corex.html#corex.rpc.pkg_summary">https://www.kamailio.org/docs/modules/devel/modules/corex.html#corex.rpc.pkg_summary</a></p>
<p>Then send some traffic to that process and watch the syslog.</p>
<p>Alternative, enable memory summary via core parameter and stop
kamailio when the errors happen, but you will get summary for all
processes, so it might be harder to extract those log messages
related the evapi process.</p>
<p>Cheers,<br>
Daniel<br>
</p>
<div class="moz-cite-prefix">On 14.08.19 10:37, José Seabra wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAEVZRWu9s9a5i+0zyGo7uhUiQXtPz2ok-Fki319KYw=4Aw5fpQ@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">Hello there,
<div>I'm using kamailio 5.2.1 with evapi module to send and
receive events from an external application.</div>
<div> </div>
<div>During my stress tests to kamailio i have been noticing
that at some point kamailio is getting out of memory:</div>
<div><br>
</div>
<div>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">edge-sip-proxy[20565]ERROR:
ESP_LOG: <null>: <core>
[core/mem/q_malloc.c:291]: qm_find_free():
qm_find_free(0x7fb8730b6010, 64); Free fragment not found!</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">edge-sip-proxy[20565]:
ERROR: ESP_LOG: <null>: <core>
[core/mem/q_malloc.c:425]: qm_malloc():
qm_malloc(0x7fb8730b6010, 64) called from core:
core/parser/msg_parser.c: parse_headers(325), module: core;
Free fragment not found!</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">edge-sip-proxy[20565]:
ERROR: ESP_LOG: <null>: <core>
[core/parser/msg_parser.c:328]: parse_headers(): memory
allocation error</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">edge-sip-proxy[20565]:
ERROR: ESP_LOG: <null>: pv [pv_core.c:704]:
pv_get_callid(): cannot parse Call-Id header</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">edge-sip-proxy[20565]: INFO:
ESP_LOG: <null>: [evapi:connection-received] EVAPI msg
received ->
{"aor":<a class="moz-txt-link-rfc2396E" href="sip:FUZECI1-x1516@uc.fuze.domain">"sip:FUZECI1-x1516@uc.fuze.domain"</a>,"contact":"<a class="moz-txt-link-rfc2396E" href="sip:FUZECI1-x1516@10.225.121.206:5060;transport=UDP"><sip:FUZECI1-x1516@10.225.121.206:5060;transport=UDP></a>"}</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">edge-sip-proxy[20565]:
ERROR: ESP_LOG: <null>: <core>
[core/mem/q_malloc.c:291]: qm_find_free():
qm_find_free(0x7fb8730b6010, 64); Free fragment not found!</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">edge-sip-proxy[20565]:
ERROR: ESP_LOG: <null>: <core>
[core/mem/q_malloc.c:425]: qm_malloc():
qm_malloc(0x7fb8730b6010, 64) called from core:
core/parser/msg_parser.c: parse_headers(325), module: core;
Free fragment not found!</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)"><br>
</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">The process id 20565 is
running out of memory as you can see bellow:</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)"><br>
</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">output of kamcmd pkg.stats </p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)"><br>
</p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)"><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>entry:
14</p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)"><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>pid:<span
class="gmail-Apple-converted-space"> </span></p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)"><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>rank:
-2</p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)"><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>used:
6058696</p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)"><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>free:
824</p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)"><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>real_used:
8387784</p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)"><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>total_size:
8388608</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">
</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)"><span class="gmail-Apple-tab-span" style="white-space:pre"> </span>total_frags:
30</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)"><br>
</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">This process ID is related
with Evapi Dispatcher</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)"><br>
</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)"><br>
</p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)">kamcmd ps |
grep 20565</p>
<p class="gmail-p1" style="margin:0px;font:12px
"Helvetica Neue";color:rgb(69,69,69)"><br>
</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">
</p>
<p class="gmail-p1"
style="margin:0px;font-variant-numeric:normal;font-variant-east-asian:normal;font-stretch:normal;font-size:12px;line-height:normal;font-family:"Helvetica
Neue";color:rgb(69,69,69)">20565<span class="gmail-Apple-tab-span" style="white-space:pre"> </span>EvAPI
Dispatcher</p>
<div><br>
</div>
<div>After stop the sipp that was generating traffic to
kamailio the evapi process still have all the memory
consumed</div>
<div><br>
</div>
<div>Can it be some memory leak in Evapi module?</div>
<div><br>
</div>
<div>Best Regards</div>
<div>José Seabra</div>
-- <br>
<div dir="ltr" class="gmail_signature"
data-smartmail="gmail_signature">Cumprimentos
<div>José Seabra</div>
</div>
</div>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Kamailio (SER) - Users Mailing List
<a class="moz-txt-link-abbreviated" href="mailto:sr-users@lists.kamailio.org">sr-users@lists.kamailio.org</a>
<a class="moz-txt-link-freetext" href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
</blockquote>
<pre class="moz-signature" cols="72">--
Daniel-Constantin Mierla -- <a class="moz-txt-link-abbreviated" href="http://www.asipto.com">www.asipto.com</a>
<a class="moz-txt-link-abbreviated" href="http://www.twitter.com/miconda">www.twitter.com/miconda</a> -- <a class="moz-txt-link-abbreviated" href="http://www.linkedin.com/in/miconda">www.linkedin.com/in/miconda</a></pre>
</body>
</html>