<div dir="ltr">Thanks Daniel. We did perform a restart of the AWS instance to apply a kernel patch and when the process started up during bootup, that's when we saw the messages. However, manually starting it seems to work.<div><br></div><div>We will work on upgrading to 5.3.x as you suggested.</div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">On Tue, Sep 1, 2020 at 10:43 AM Daniel-Constantin Mierla <<a href="mailto:miconda@gmail.com">miconda@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<p>Hello,</p>
<p>first it is really recommended you run at least latest 5.1.x
version, the 5.1.2 is old in 5.1.x release series and many bugs
may have been fixed. Even more, 5.1.x is no longer maintained, so
I would strongly recommend to upgrade to latest in series 5.3.x or
5.4.x.</p>
<p>Then, searching on google on Bad RIP value returns mainly
discussions about Kernel panic. According to this article:</p>
<p> *
<a href="https://www.opensourceforu.com/2011/01/understanding-a-kernel-oops/" target="_blank">https://www.opensourceforu.com/2011/01/understanding-a-kernel-oops/</a><br>
</p>
<p>RIP is the CPU register containing the address of the instruction
that is getting executed. Without a clear corefile with backtrace
pointing to kamailio, it is not easy to say if Kamailio has
anything to do with or there is some linux kernel issue on your
system. Try searching on google, there should be some hints to try
to troubleshoot by ip and sp values, maybe you can get further
details.<br>
</p>
<p>Cheers,<br>
Daniel<br>
</p>
<div>On 01.09.20 15:12, Andrew Chen wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">Hey guys,
<div><br>
</div>
<div>Our monitoring system caught kamailio coring. I did a
dmesg and gave me this:</div>
<div><br>
</div>
<div>
<div>[Tue Sep 1 09:12:34 2020] kamailio[1375]: segfault
at 1 ip 0000000000000001 sp 00007fff4203f098 error 14 in
kamailio[563969b5a000+4a4000]</div>
<div>[Tue Sep 1 09:12:34 2020] Code: Bad RIP value.</div>
<div>[Tue Sep 1 09:12:34 2020] kamailio[1363]: segfault
at 0 ip 0000000000000000 sp 00007fff4203f368 error 14 in
kamailio[563969b5a000+4a4000]</div>
<div>[Tue Sep 1 09:12:34 2020] Code: Bad RIP value.</div>
<div>[Tue Sep 1 09:12:34 2020] kamailio[1377]: segfault
at 1 ip 0000000000000001 sp 00007fff4203e308 error 14 in
kamailio[563969b5a000+4a4000]</div>
<div>[Tue Sep 1 09:12:34 2020] Code: Bad RIP value.</div>
</div>
<div><br>
</div>
<div>After doing gdb bt, didn't tell me much except it can't
access some parts of the memory:</div>
<div><br>
</div>
<div>
<div>warning: Unexpected size of section
`.reg-xstate/1624' in core file.</div>
<div>Cannot access memory at address 0x7fb23433e148</div>
<div>Cannot access memory at address 0x7fb23433e140</div>
<div>Failed to read a valid object file image from memory.</div>
<div>Core was generated by `/usr/sbin/kamailio -P
/var/run/kamailio/kamailio.pid -f
/etc/kamailio/kamailio.'.</div>
<div>Program terminated with signal SIGSEGV, Segmentation
fault.</div>
<div><br>
</div>
<div>warning: Unexpected size of section
`.reg-xstate/1624' in core file.</div>
<div>#0 0x0000000000000001 in ?? ()</div>
<div>(gdb) bt full</div>
<div>#0 0x0000000000000001 in ?? ()</div>
<div>No symbol table info available.</div>
<div>Backtrace stopped: Cannot access memory at address
0x7fff4203e1f8</div>
<div>(gdb) quit</div>
</div>
<div><br>
</div>
<div>Any idea on how to troubleshoot this further?</div>
<div><br>
</div>
<div>Thanks.</div>
<div><br>
</div>
<div>-- <br>
<div dir="ltr">
<div dir="ltr">
<div dir="ltr">
<div dir="ltr" style="font-size:12.8px">Andy Chen</div>
<div dir="ltr" style="font-size:12.8px">
<div>Sr. Telephony Lead Engineer</div>
<div><a href="mailto:achen@thinkingphones.com" style="font-size:12.8px" target="_blank">achen@</a><a href="http://fuze.com" style="font-size:12.8px" target="_blank">fuze.com</a><br>
</div>
<div><br>
<br>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
</div>
<br>
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">*Confidentiality
Notice: The information contained in this e-mail and any</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">attachments
may be confidential. If you are not an intended recipient, you</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">are
hereby notified that any dissemination, distribution or copying
of this</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">e-mail
is strictly prohibited. If you have received this e-mail in
error,</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">please
notify the sender and permanently delete the e-mail and any</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">attachments
immediately. You should not retain, copy or use this e-mail or</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">any
attachment for any purpose, nor disclose all or any part of the</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">contents
to any other person. Thank you.*</span>
<br>
<fieldset></fieldset>
<pre>_______________________________________________
Kamailio (SER) - Users Mailing List
<a href="mailto:sr-users@lists.kamailio.org" target="_blank">sr-users@lists.kamailio.org</a>
<a href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users" target="_blank">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
</blockquote>
<pre cols="72">--
Daniel-Constantin Mierla -- <a href="http://www.asipto.com" target="_blank">www.asipto.com</a>
<a href="http://www.twitter.com/miconda" target="_blank">www.twitter.com/miconda</a> -- <a href="http://www.linkedin.com/in/miconda" target="_blank">www.linkedin.com/in/miconda</a>
Funding: <a href="https://www.paypal.me/dcmierla" target="_blank">https://www.paypal.me/dcmierla</a></pre>
</div>
</blockquote></div><br clear="all"><div><br></div>-- <br><div dir="ltr" class="gmail_signature"><div dir="ltr"><div><div dir="ltr"><div dir="ltr" style="font-size:12.8px">Andy Chen</div><div dir="ltr" style="font-size:12.8px"><div>Sr. Telephony Lead Engineer</div><div>415 516 5535 (M)</div><div><a href="mailto:achen@thinkingphones.com" target="_blank">achen@</a><a href="http://fuze.com" target="_blank">fuze.com</a></div><div><br></div></div></div></div></div></div>
<br>
<span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">*Confidentiality Notice: The information contained in this e-mail and any</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">attachments may be confidential. If you are not an intended recipient, you</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">are hereby notified that any dissemination, distribution or copying of this</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">e-mail is strictly prohibited. If you have received this e-mail in error,</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">please notify the sender and permanently delete the e-mail and any</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">attachments immediately. You should not retain, copy or use this e-mail or</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">any attachment for any purpose, nor disclose all or any part of the</span><br style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)"><span style="color:rgb(51,51,51);font-family:Arial,sans-serif;font-size:14px;background-color:rgb(255,255,255)">contents to any other person. Thank you.*</span>