<div dir="auto">Hi, I have glad you guys found a solution.<div dir="auto"><br></div><div dir="auto">Thanks for sharing it.</div><div dir="auto"><br></div><div dir="auto">Regards,</div><div dir="auto">Julien</div></div><br><div class="gmail_quote"><div dir="ltr">On Wed, Aug 22, 2018, 21:43 Rogelio Perez <<a href="mailto:rogelio@telnyx.com">rogelio@telnyx.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Hi Julien,</div><div><br></div><div>Thanks for checking on this.<br></div><div>I've been working in the background with Charles on this issue and we think we've found a solution, although the cause isn't clear to me yet.</div><div>Following Charles advice we changed the usrloc module parameter db_mode from 1 (Write-Through) to 2 (Write-Back) and there's been no more memory leaks incidents since then.</div><div>I'll report back if we have any further updates.</div><div><br></div><div>Best,</div><div>Rogelio<br></div><div><br> </div></div><br><div class="gmail_quote"><div dir="ltr">On Wed, Aug 22, 2018 at 11:39 AM Julien Chavanton <<a href="mailto:jchavanton@gmail.com" target="_blank" rel="noreferrer">jchavanton@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Rogerio, did you have any luck digging this leak further ?</div><br><div class="gmail_quote"><div dir="ltr">On Wed, Aug 8, 2018 at 3:37 AM Charles Chance <<a href="mailto:charles.chance@sipcentric.com" target="_blank" rel="noreferrer">charles.chance@sipcentric.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">Hi Rogelio,<div><br></div><div>I have been running master on a three-node lab (one primary, two secondary) for the past 24 hours or so, maintaining 2000 registrations on the primary, replicating to both secondaries, and memory usage has remained constant throughout.</div><div><br></div><div>I will leave it running for another 24 hours to be sure but in the meantime, you mentioned you are loading records from DB - which mode are you using for writing (write-through or write-back)? Do you experience the same symptoms if you disable the database completely on the secondary nodes (or just one for testing) and instead, enable sync in dmq_usrloc?</div><div><br></div><div>Cheers,</div><div><br></div><div>Charles</div><div><br></div><div class="gmail_extra"><br><div class="gmail_quote">On 7 August 2018 at 16:42, Julien Chavanton <span dir="ltr"><<a href="mailto:jchavanton@gmail.com" target="_blank" rel="noreferrer">jchavanton@gmail.com</a>></span> wrote:<br><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr">I wonder if this could be introduced by a regression or if you are facing a specific edge case<div><br></div><div>I briefly looked at the commits of DMQ and DMQ_USRLOC </div><div>It seems there was significant work done.</div><div>I would give a try with 5.0.0 and then we will at least learn that this is not a recent regression.</div></div><div class="gmail_extra"><br><div class="gmail_quote"><div><div class="m_4846788512629054945m_-4845294015022319819m_3972436241549873714h5">On Mon, Aug 6, 2018 at 1:43 PM, Rogelio Perez <span dir="ltr"><<a href="mailto:rogelio@telnyx.com" target="_blank" rel="noreferrer">rogelio@telnyx.com</a>></span> wrote:<br></div></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div><div class="m_4846788512629054945m_-4845294015022319819m_3972436241549873714h5"><div dir="ltr"><div>Charles, Julien, Daniel,</div><div><br></div><div>The results are pretty much the same, the mem leak is still there and we need to restart Kamailio when it reaches certain threshold.</div><div><a href="https://www.dropbox.com/s/enxx6b7t0c8vl49/Selection_539.png?dl=0" target="_blank" rel="noreferrer">https://www.dropbox.com/s/enxx6b7t0c8vl49/Selection_539.png?dl=0</a></div><div><br></div><div>Is there anything else we can try? <br></div><div>Will a core dump file tell us what's causing it?</div><div><br></div><div>Thanks,</div><div>Rogelio<br></div></div><div class="m_4846788512629054945m_-4845294015022319819m_3972436241549873714m_7667195813473266982HOEnZb"><div class="m_4846788512629054945m_-4845294015022319819m_3972436241549873714m_7667195813473266982h5"><br><div class="gmail_quote"><div dir="ltr">On Thu, Aug 2, 2018 at 2:57 PM Rogelio Perez <<a href="mailto:rogelio@telnyx.com" target="_blank" rel="noreferrer">rogelio@telnyx.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex"><div dir="ltr"><div>Thanks Charles, it's working now.</div><div>I'm deploying to production and confirming results soon.</div><div><br></div><div>Rogelio<br></div></div>
</blockquote></div><br clear="all"><br></div></div><span class="m_4846788512629054945m_-4845294015022319819m_3972436241549873714m_7667195813473266982HOEnZb"><font color="#888888">-- <br><div dir="ltr" class="m_4846788512629054945m_-4845294015022319819m_3972436241549873714m_7667195813473266982m_-7454434222745768971gmail_signature" data-smartmail="gmail_signature"><div><a href="https://telnyx.com" target="_blank" rel="noreferrer"><font color="#666666"><img border="0" hspace="0" src="https://telnyx.com/assets/telnyxemailsignaturelogo.png"></font></a><br><font color="#666666">Rogelio Perez | engineering
| </font><a style="TEXT-DECORATION:none" href="https://telnyx.com" target="_blank" rel="noreferrer"><font color="#666666">telnyx</font></a><font color="#666666"> <br>chicago: +1 312 270 8119
| dublin: +353 1 912 6119</font> </div><br></div>
</font></span><br></div></div><span>_______________________________________________<br>
Kamailio (SER) - Users Mailing List<br>
<a href="mailto:sr-users@lists.kamailio.org" target="_blank" rel="noreferrer">sr-users@lists.kamailio.org</a><br>
<a href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users" rel="noreferrer noreferrer" target="_blank">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a><br>
<br></span></blockquote></div><br></div>
</blockquote></div><br><br clear="all"><div><br></div>
</div></div>
<br>
<div><font color="gray" style="font-size:10pt;font-family:Helvetica,Arial,sans-serif">Sipcentric Ltd.
Company registered in England & Wales no. 7365592.</font><span style="font-size:10pt;font-family:Helvetica,Arial,sans-serif"> </span><font color="gray" style="font-size:10pt;font-family:Helvetica,Arial,sans-serif">Registered
office: Faraday Wharf, Innovation Birmingham Campus, Holt Street, Birmingham Science Park, Birmingham B7 4BB.</font></div>_______________________________________________<br>
Kamailio (SER) - Users Mailing List<br>
<a href="mailto:sr-users@lists.kamailio.org" target="_blank" rel="noreferrer">sr-users@lists.kamailio.org</a><br>
<a href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users" rel="noreferrer noreferrer" target="_blank">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a><br>
</blockquote></div>
</blockquote></div><br clear="all"><br>-- <br><div dir="ltr" class="m_4846788512629054945gmail_signature" data-smartmail="gmail_signature"><div><a href="https://telnyx.com" target="_blank" rel="noreferrer"><font color="#666666"><img border="0" hspace="0" src="https://telnyx.com/assets/telnyxemailsignaturelogo.png"></font></a><br><font color="#666666">Rogelio Perez | engineering
| </font><a style="TEXT-DECORATION:none" href="https://telnyx.com" target="_blank" rel="noreferrer"><font color="#666666">telnyx</font></a><font color="#666666"> <br>chicago: +1 312 270 8119
| dublin: +353 1 912 6119</font> </div><br></div>
</blockquote></div>