<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
  </head>
  <body text="#000000" bgcolor="#FFFFFF">
    <p>The line is now a comment in 5.1 branch, send the output the
      command 'list' in gdb.</p>
    <p><br>
    </p>
    <p>Are all the backtraces from those core files looking the same?</p>
    <p><br>
    </p>
    <p>Can you reproduce the issue?</p>
    <p><br>
    </p>
    <p>Can you list here the loaded modules (the lines with loadmodule
      from kamailio.cfg)?</p>
    <p><br>
    </p>
    <p>Cheers,<br>
      Daniel<br>
    </p>
    <br>
    <div class="moz-cite-prefix">On 04.10.18 08:48, Hamid Hashmi wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:SIXPR0301MB1225BC62987988107671A5CEE0EA0@SIXPR0301MB1225.apcprd03.prod.outlook.com">
      <meta http-equiv="Content-Type" content="text/html; charset=utf-8">
      <style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
      <div style="font-family: EmojiFont, Calibri, Helvetica,
        sans-serif, "Apple Color Emoji", "Segoe UI
        Emoji", NotoColorEmoji, "Segoe UI Symbol",
        "Android Emoji", EmojiSymbols; font-size: 12pt; color:
        rgb(38, 114, 236);">
        No, I am not that expert <span>😊</span></div>
      <div style="font-family: EmojiFont, Calibri, Helvetica,
        sans-serif, "Apple Color Emoji", "Segoe UI
        Emoji", NotoColorEmoji, "Segoe UI Symbol",
        "Android Emoji", EmojiSymbols; font-size: 12pt; color:
        rgb(38, 114, 236);">
        <br>
      </div>
      <div style="font-family: EmojiFont, Calibri, Helvetica,
        sans-serif, "Apple Color Emoji", "Segoe UI
        Emoji", NotoColorEmoji, "Segoe UI Symbol",
        "Android Emoji", EmojiSymbols; font-size: 12pt; color:
        rgb(38, 114, 236);">
        I just find out that there are so many dump files in the working
        directory.  Please find the backtrace below</div>
      <div style="font-family: EmojiFont, Calibri, Helvetica,
        sans-serif, "Apple Color Emoji", "Segoe UI
        Emoji", NotoColorEmoji, "Segoe UI Symbol",
        "Android Emoji", EmojiSymbols; font-size: 12pt; color:
        rgb(38, 114, 236);">
        <br>
      </div>
      <div style="font-family: EmojiFont, Calibri, Helvetica,
        sans-serif, "Apple Color Emoji", "Segoe UI
        Emoji", NotoColorEmoji, "Segoe UI Symbol",
        "Android Emoji", EmojiSymbols; font-size: 12pt; color:
        rgb(38, 114, 236);">
        <span>#0  0x00007f3e27818c9f in t_should_relay_response
          (Trans=0x7f3de60bdc60, new_code=200, branch=0,
          should_store=0x7fff44501d78, should_relay=0x7fff44501d7c,
          cancel_data=0x7fff44501fc0,<br>
        </span>
        <div>    reply=0x7f3e2a042708) at t_reply.c:1281<br>
        </div>
        <div>#1  0x00007f3e2781d1d6 in relay_reply (t=0x7f3de60bdc60,
          p_msg=0x7f3e2a042708, branch=0, msg_status=200,
          cancel_data=0x7fff44501fc0, do_put_on_wait=1) at
          t_reply.c:1785<br>
        </div>
        <div>#2  0x00007f3e278223a2 in reply_received
          (p_msg=0x7f3e2a042708) at t_reply.c:2530<br>
        </div>
        <div>#3  0x00000000004f0271 in do_forward_reply
          (msg=0x7f3e2a042708, mode=0) at core/forward.c:744<br>
        </div>
        <div>#4  0x00000000004f1a31 in forward_reply
          (msg=0x7f3e2a042708) at core/forward.c:845<br>
        </div>
        <div>#5  0x0000000000572d17 in receive_msg (<br>
        </div>
        <div>    buf=0xa533c0 <buf.6822> "SIP/2.0 200 OK\r\nVia:
          SIP/2.0/UDP <b>X.X.X.X:xxx</b>;branch=z9hG4bK408d.a486c78251b57e015f4f0942872a10bf.0;i=2;received=<b>X.X.X.X</b>\r\nVia:
          SIP/2.0/TCP
          192.168.2.7:60336;received=58.65.176.42;rport=26439;b"...,
          len=969, rcv_info=0x7fff44502730) at core/receive.c:355<br>
        </div>
        <div>#6  0x0000000000454f9c in udp_rcv_loop () at
          core/udp_server.c:554<br>
        </div>
        <div>#7  0x0000000000424409 in main_loop () at main.c:1619<br>
        </div>
        <span>#8  0x000000000042b98e in main (argc=9,
          argv=0x7fff44502c78) at main.c:2638</span>  </div>
      <div style="font-family: Calibri, Helvetica, sans-serif;
        font-size: 12pt; color: rgb(38, 114, 236);">
        <br>
      </div>
      <div id="signature">
        <p class="ecxMsoNormal">Regards</p>
        <p class="ecxMsoNormal"><br>
        </p>
        <p class="ecxMsoNormal"><a name="_MailAutoSig" target="_blank"
            moz-do-not-send="true"><b><span style="font-size:8.0pt;
                font-family:"Verdana","sans-serif";
                font-variant:small-caps; color:navy">Hamid R. Hashmi</span></b></a></p>
      </div>
      <hr style="display:inline-block;width:98%" tabindex="-1">
      <div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt"
          face="Calibri, sans-serif" color="#000000"><b>From:</b>
          Daniel-Constantin Mierla <a class="moz-txt-link-rfc2396E" href="mailto:miconda@gmail.com"><miconda@gmail.com></a><br>
          <b>Sent:</b> Thursday, October 4, 2018 11:30 AM<br>
          <b>To:</b> Kamailio (SER) - Users Mailing List; Hamid Hashmi<br>
          <b>Subject:</b> Re: [SR-Users] Freeing already Freed pointer</font>
        <div> </div>
      </div>
      <meta content="text/html; charset=Windows-1252">
      <div style="background-color:#FFFFFF">
        <p>Hello,</p>
        <p><br>
        </p>
        <p>do you have your own developed module or other private
          extensions made to kamailio?</p>
        <p><br>
        </p>
        <p>The logs show there was a core dump file, locate it and get
          the back trace with gdb and send it here.</p>
        <p><br>
        </p>
        <p>Cheers,<br>
          Daniel<br>
        </p>
        <br>
        <div class="x_moz-cite-prefix">On 03.10.18 10:39, Hamid Hashmi
          wrote:<br>
        </div>
        <blockquote type="cite">
          <style type="text/css" style="display:none">
<!--
p
        {margin-top:0;
        margin-bottom:0}
-->
</style>
          <div style="color:rgb(38,114,236);
            font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
            Dear Kamailio User</div>
          <div style="color:rgb(38,114,236);
            font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
            <br>
          </div>
          <div style="color:rgb(38,114,236);
            font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
            Can you please guide me in identifying the issue. </div>
          <div style="color:rgb(38,114,236);
            font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
            <br>
          </div>
          <div style="color:rgb(38,114,236);
            font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
            <span style="">Sep 27 14:40:19 kamailio_eu SIPSer[11289]:
              923226363266 923000000001 27872 INVITE
              haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL: <core>
              [core/mem/q_malloc.c:504]: qm_free(): BUG: freeing already
              freed pointer (0x7f30c8a4df30), called from tm: t_reply.c:
              relay_reply(1920), first free tm: h_table.c:
              free_cell_helper(155) - aborting Sep 27 14:40:19
              kamailio_eu SIPSer[11289]: 923226363266 923000000001 27872
              INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL:
              <core> [core/mem/q_malloc.c:504]: qm_free(): BUG:
              freeing already freed pointer (0x7f30c8a4cc40), called
              from tm: h_table.c: free_cell_helper(153), first free tm:
              h_table.c: free_cell_helper(153) - aborting Sep 27
              14:40:19 kamailio_eu SIPSer[11289]: 923226363266
              923000000001 27872 INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A
              CRITICAL: <core> [core/mem/q_malloc.c:504]:
              qm_free(): BUG: freeing already freed pointer
              (0x7f30c8a4afc8), called from tm: h_table.c:
              free_cell_helper(153), first free tm: h_table.c:
              free_cell_helper(153) - aborting Sep 27 14:40:19
              kamailio_eu SIPSer[11289]: 923226363266 923000000001 27872
              INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL:
              <core> [core/mem/q_malloc.c:504]: qm_free(): BUG:
              freeing already freed pointer (0x7f30c8a4af38), called
              from tm: h_table.c: free_cell_helper(174), first free tm:
              h_table.c: free_cell_helper(174) - aborting Sep 27
              14:40:19 kamailio_eu SIPSer[11289]: 923226363266
              923000000001 27872 INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A
              CRITICAL: <core> [core/mem/q_malloc.c:504]:
              qm_free(): BUG: freeing already freed pointer
              (0x7f30c8a4ae38), called from dialog: dlg_handlers.c:
              dlg_iuid_sfree(305), first free dialog: dlg_handlers.c:
              dlg_iuid_sfree(305) - aborting Sep 27 14:40:19 kamailio_eu
              SIPSer[11289]: 923226363266 923000000001 27872 INVITE
              haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL: <core>
              [core/mem/q_malloc.c:504]: qm_free(): BUG: freeing already
              freed pointer (0x7f30c8a4aea8), called from tm: h_table.c:
              free_cell_helper(174), first free tm: h_table.c:
              free_cell_helper(174) - aborting Sep 27 14:40:19
              kamailio_eu SIPSer[11289]: 923226363266 923000000001 27872
              INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL:
              <core> [core/mem/q_malloc.c:504]: qm_free(): BUG:
              freeing already freed pointer (0x7f30c8a4ada8), called
              from tm: h_table.c: free_cell_helper(174), first free tm:
              h_table.c: free_cell_helper(174) - aborting Sep 27
              14:40:19 kamailio_eu SIPSer[11289]: 923226363266
              923000000001 27872 INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A
              CRITICAL: <core> [core/mem/q_malloc.c:504]:
              qm_free(): BUG: freeing already freed pointer
              (0x7f30c8a4ad18), called from tm: h_table.c:
              free_cell_helper(174), first free tm: h_table.c:
              free_cell_helper(174) - aborting Sep 27 14:40:19
              kamailio_eu SIPSer[11289]: 923226363266 923000000001 27872
              INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL:
              <core> [core/mem/q_malloc.c:504]: qm_free(): BUG:
              freeing already freed pointer (0x7f30c8a4ac88), called
              from tm: h_table.c: free_cell_helper(174), first free tm:
              h_table.c: free_cell_helper(174) - aborting Sep 27
              14:40:19 kamailio_eu SIPSer[11289]: 923226363266
              923000000001 27872 INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A
              CRITICAL: <core> [core/mem/q_malloc.c:504]:
              qm_free(): BUG: freeing already freed pointer
              (0x7f30c8a4d290), called from tm: h_table.c:
              free_cell_helper(181), first free tm: h_table.c:
              free_cell_helper(181) - aborting Sep 27 14:40:19
              kamailio_eu SIPSer[11289]: 923226363266 923000000001 27872
              INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL:
              <core> [core/mem/q_malloc.c:504]: qm_free(): BUG:
              freeing already freed pointer (0x7f30c8a4ca20), called
              from tm: h_table.c: free_cell_helper(231), first free tm:
              h_table.c: free_cell_helper(231) - aborting Sep 27
              14:40:19 kamailio_eu SIPSer[11289]: 923226363266
              923000000001 27872 INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A
              CRITICAL: <core> [core/mem/q_malloc.c:504]:
              qm_free(): BUG: freeing already freed pointer
              (0x7f30c8a4c998), called from tm: h_table.c:
              free_cell_helper(232), first free tm: h_table.c:
              free_cell_helper(232) - aborting Sep 27 14:40:19
              kamailio_eu SIPSer[11289]: 923226363266 923000000001 27872
              INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL:
              <core> [core/mem/q_malloc.c:504]: qm_free(): BUG:
              freeing already freed pointer (0x7f30c8a495d8), called
              from tm: h_table.c: free_cell_helper(251), first free tm:
              h_table.c: free_cell_helper(251) - aborting
            </span><br>
          </div>
          <div style="color:rgb(38,114,236);
            font-family:Calibri,Helvetica,sans-serif; font-size:12pt">
            <br>
          </div>
          <div id="x_signature">
            <p class="x_ecxMsoNormal">Regards</p>
            <p class="x_ecxMsoNormal"><br>
            </p>
            <p class="x_ecxMsoNormal"><a name="x__MailAutoSig"
                target="_blank" moz-do-not-send="true"><b><span
                    style="font-size:8.0pt;
                    font-family:"Verdana","sans-serif";
                    font-variant:small-caps; color:navy">Hamid R. Hashmi</span></b></a></p>
          </div>
          <hr tabindex="-1" style="display:inline-block; width:98%">
          <div id="x_divRplyFwdMsg" dir="ltr"><font
              style="font-size:11pt" face="Calibri, sans-serif"
              color="#000000"><b>From:</b> sr-users
              <a class="x_moz-txt-link-rfc2396E"
                href="mailto:sr-users-bounces@lists.kamailio.org"
                moz-do-not-send="true">
                <sr-users-bounces@lists.kamailio.org></a> on
              behalf of Hamid Hashmi <a class="x_moz-txt-link-rfc2396E"
                href="mailto:hamid2kviii@hotmail.com"
                moz-do-not-send="true">
                <hamid2kviii@hotmail.com></a><br>
              <b>Sent:</b> Thursday, September 27, 2018 5:14 PM<br>
              <b>To:</b> Kamailio (SER) - Users Mailing List<br>
              <b>Subject:</b> [SR-Users] Freeing already Freed pointer</font>
            <div> </div>
          </div>
          <meta content="text/html; charset=iso-8859-1">
          <style type="text/css" style="display:none">
<!--
p
        {margin-top:0;
        margin-bottom:0}
-->
</style>
          <div dir="ltr">
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              I have been receiving CRITICAL core logs since I have
              updated my service to the following version. </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <br>
            </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <span>Print out of kamailio internals<br>
              </span>
              <div>  Version: kamailio 5.1.5 (x86_64/linux) d06080<br>
              </div>
              <div>  Default config:
                /usr/local/SIPSer/etc/kamailio/kamailio.cfg<br>
              </div>
              <div>  Default paths to modules:
                /usr/local/SIPSer/lib64/kamailio/modules<br>
              </div>
              <div>  Compile flags: STATS: Off, USE_TCP, USE_TLS,
                USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE,
                USE_MCAST, DNS_IP_HACK, SHM_MEM, SHM_MMAP, PKG_MALLOC,
                Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY,
                USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE,
                USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST,
                HAVE_RESOLV_RES<br>
              </div>
              <div>  MAX_RECV_BUFFER_SIZE=262144<br>
              </div>
              <div>  MAX_URI_SIZE=1024<br>
              </div>
              <div>  BUF_SIZE=65535<br>
              </div>
              <div>  DEFAULT PKG_SIZE=8MB<br>
              </div>
              <div>  DEFAULT SHM_SIZE=64MB<br>
              </div>
              <div>  ADAPTIVE_WAIT_LOOPS=1024<br>
              </div>
              <div>  TCP poll methods: poll, epoll_lt, epoll_et,
                sigio_rt, select<br>
              </div>
              <div>  Source code revision ID: d06080<br>
              </div>
              <div>  Compiled with: gcc 4.8.5<br>
              </div>
              <div>  Compiled on: 14:17:56 Sep 13 2018<br>
              </div>
              <span>Thank you for flying kamailio!</span><br>
            </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <br>
            </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              I have been starting kamailio with the following command</div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <br>
            </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              $ /usr/local/sbin/kamailio -P /run/kamailio/kamailio.pid
              -f /usr/local/etc/kamailio/kamailio.cfg -m 1024 -M 512</div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <br>
            </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              Sample Critical Logs are below</div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <br>
            </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <span style="font-size:8pt">Sep 27 14:40:19 kamailio_eu
                SIPSer[11289]: 923226363266 923000000001 27872 INVITE
                haYKxpYM1QR8XTU37WdVbxf4VkEITe7A CRITICAL: <core>
                [core/mem/q_malloc.c:504]: qm_free(): BUG: freeing
                already freed pointer (0x7f30c8a4df30), called from tm:
                t_reply.c: relay_reply(1920), first free tm: h_table.c:
                free_cell_helper(155) - aborting</span><span><br>
              </span>
              <div><span style="font-size:8pt">Sep 27 14:40:19
                  kamailio_eu SIPSer[11289]: 923226363266 923000000001
                  27872 INVITE haYKxpYM1QR8XTU37WdVbxf4VkEITe7A
                  CRITICAL: <core> [core/mem/q_malloc.c:504]:
                  qm_free(): BUG: freeing already freed pointer
                  (0x7f30c8a4cc40), called from tm: h_table.c:
                  free_cell_helper(153), first free tm: h_table.c:
                  free_cell_helper(153) - aborting</span></div>
            </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <br>
            </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              Its also causing service crash.  Complete logs are <a
                href="https://paste.ee/p/q65DE"
                title="https://paste.ee/p/q65DE" moz-do-not-send="true">
                here</a>. </div>
            <div style="font-family:Calibri,Helvetica,sans-serif;
              font-size:12pt; color:rgb(38,114,236)">
              <br>
            </div>
            <div id="x_x_signature">
              <p class="x_x_ecxMsoNormal">Regards</p>
              <p class="x_x_ecxMsoNormal"><a name="x_x__MailAutoSig"
                  target="_blank" moz-do-not-send="true"><b><span
                      style="font-size:8.0pt;
                      font-family:"Verdana","sans-serif";
                      font-variant:small-caps; color:navy">Hamid R.
                      Hashmi</span></b></a></p>
            </div>
          </div>
          <br>
          <fieldset class="x_mimeAttachmentHeader"></fieldset>
          <br>
          <pre>_______________________________________________
Kamailio (SER) - Users Mailing List
<a class="x_moz-txt-link-abbreviated" href="mailto:sr-users@lists.kamailio.org" moz-do-not-send="true">sr-users@lists.kamailio.org</a>
<a class="x_moz-txt-link-freetext" href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users" moz-do-not-send="true">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
        </blockquote>
        <br>
        <pre class="x_moz-signature" cols="72">-- 
Daniel-Constantin Mierla -- <a class="x_moz-txt-link-abbreviated" href="http://www.asipto.com" moz-do-not-send="true">www.asipto.com</a>
<a class="x_moz-txt-link-abbreviated" href="http://www.twitter.com/miconda" moz-do-not-send="true">www.twitter.com/miconda</a> -- <a class="x_moz-txt-link-abbreviated" href="http://www.linkedin.com/in/miconda" moz-do-not-send="true">www.linkedin.com/in/miconda</a>
Kamailio World Conference -- <a class="x_moz-txt-link-abbreviated" href="http://www.kamailioworld.com" moz-do-not-send="true">www.kamailioworld.com</a>
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- <a class="x_moz-txt-link-abbreviated" href="http://www.asipto.com" moz-do-not-send="true">www.asipto.com</a></pre>
      </div>
      <br>
      <fieldset class="mimeAttachmentHeader"></fieldset>
      <br>
      <pre wrap="">_______________________________________________
Kamailio (SER) - Users Mailing List
<a class="moz-txt-link-abbreviated" href="mailto:sr-users@lists.kamailio.org">sr-users@lists.kamailio.org</a>
<a class="moz-txt-link-freetext" href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
    </blockquote>
    <br>
    <pre class="moz-signature" cols="72">-- 
Daniel-Constantin Mierla -- <a class="moz-txt-link-abbreviated" href="http://www.asipto.com">www.asipto.com</a>
<a class="moz-txt-link-abbreviated" href="http://www.twitter.com/miconda">www.twitter.com/miconda</a> -- <a class="moz-txt-link-abbreviated" href="http://www.linkedin.com/in/miconda">www.linkedin.com/in/miconda</a>
Kamailio World Conference -- <a class="moz-txt-link-abbreviated" href="http://www.kamailioworld.com">www.kamailioworld.com</a>
Kamailio Advanced Training, Nov 12-14, 2018, in Berlin -- <a class="moz-txt-link-abbreviated" href="http://www.asipto.com">www.asipto.com</a></pre>
  </body>
</html>