<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    <p>Thanks for testing and the feedback!</p>
    <p>Check also if this one can affect you:</p>
    <p>  * <a
href="https://github.com/kamailio/kamailio/issues/2224#issuecomment-602730307">https://github.com/kamailio/kamailio/issues/2224#issuecomment-602730307</a></p>
    <p>I just backported all of them to 5.3, so if you want to test, you
      can use directly the latest branch 5.3.</p>
    <p>Cheers,<br>
      Daniel<br>
    </p>
    <div class="moz-cite-prefix">On 26.03.20 13:20, Virgílio Cunha
      wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CALhXjXw9+OdY59PfvSmtms3V4J-RCCgTn+vRKUobfB7OeCCKUg@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr">Hello Daniel,
        <div><br>
        </div>
        <div>I followed your recommendation and upgraded to
          kamailio-5.3.3 but the problem remains with this version.</div>
        <div>So I applied this patch: <a
href="https://github.com/kamailio/kamailio/commit/21bdbff049571ca22f1205a041c8b1162005d319"
            moz-do-not-send="true">https://github.com/kamailio/kamailio/commit/21bdbff049571ca22f1205a041c8b1162005d319</a> and
          I run the tests again. <br>
          After applying the patch, I was no longer able to replicate
          the problem :)</div>
        <div><br>
        </div>
        <div>Thank you for your great support.</div>
        <div><br>
        </div>
        <div>Best Regards,<br>
          Virgílio Cunha</div>
      </div>
      <br>
      <div class="gmail_quote">
        <div dir="ltr" class="gmail_attr">Em qua., 18 de mar. de 2020 às
          18:22, Virgílio Cunha <<a
            href="mailto:virgilio18vsc@gmail.com" moz-do-not-send="true">virgilio18vsc@gmail.com</a>>
          escreveu:<br>
        </div>
        <blockquote class="gmail_quote" style="margin:0px 0px 0px
          0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
          <div dir="ltr">Hi,
            <div><br>
            </div>
            <div>Sorry for using this topic for this question, but where
              can I find Kamailio's release policy? </div>
            <div>I needed to know how long the kamailio 5.3.x branch
              will maintain its support.<br>
            </div>
            <div><br>
            </div>
            <div>Best Regards,<br>
              Virgílio Cunha</div>
          </div>
          <br>
          <div class="gmail_quote">
            <div dir="ltr" class="gmail_attr">Em ter., 17 de mar. de
              2020 às 11:03, Daniel-Constantin Mierla <<a
                href="mailto:miconda@gmail.com" target="_blank"
                moz-do-not-send="true">miconda@gmail.com</a>>
              escreveu:<br>
            </div>
            <blockquote class="gmail_quote" style="margin:0px 0px 0px
              0.8ex;border-left:1px solid
              rgb(204,204,204);padding-left:1ex">
              <div>
                <p>Hello,</p>
                <p>if it is a runtime issue, then it is better to
                  upgrade to a supported release series and try to
                  reproduce it.</p>
                <p>Looking at startup/shutdown code is easier than the
                  rest used during runtime by a module, but it is not
                  the case here. So we may waste a lot of time to dig
                  into it and discover it was fixed or the code in an
                  older release was refactored not matching any longer
                  what is now in stable releases.</p>
                <p>Cheers,<br>
                  Daniel<br>
                </p>
                <div>On 17.03.20 11:35, Virgílio Cunha wrote:<br>
                </div>
                <blockquote type="cite">
                  <div dir="ltr">Hi,
                    <div><br>
                    </div>
                    <div>The problem does not just occur when kamailio
                      is restarted. The restart was the way I found to
                      reproduce the problem, because when a proxy is
                      restarted, there is more traffic from DMQ
                      messages, so the problem is more likely to occur.<br>
                    </div>
                    <div><br>
                    </div>
                    <div>The full backtrace is following:</div>
                    <div><br>
                    </div>
                    <div>GNU gdb (GDB) Red Hat Enterprise Linux
                      (7.2-92.el6)<br>
                      Copyright (C) 2010 Free Software Foundation, Inc.<br>
                      License GPLv3+: GNU GPL version 3 or later <<a
                        href="http://gnu.org/licenses/gpl.html"
                        target="_blank" moz-do-not-send="true">http://gnu.org/licenses/gpl.html</a>><br>
                      This is free software: you are free to change and
                      redistribute it.<br>
                      There is NO WARRANTY, to the extent permitted by
                      law.  Type "show copying"<br>
                      and "show warranty" for details.<br>
                      This GDB was configured as
                      "x86_64-redhat-linux-gnu".<br>
                      For bug reporting instructions, please see:<br>
                      <<a
                        href="http://www.gnu.org/software/gdb/bugs/"
                        target="_blank" moz-do-not-send="true">http://www.gnu.org/software/gdb/bugs/</a>>...<br>
                      Reading symbols from
                      /opt/ptin/kamailio-ksipadp/bin/ksipadp-proxy...Reading
                      symbols from
                      /usr/lib/debug/usr/sbin/kamailio.debug...done.<br>
                      done.<br>
                      [New Thread 506]<br>
                      Reading symbols from /lib64/libdl.so.2...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libdl.so.2<br>
                      Reading symbols from /lib64/libresolv.so.2...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libresolv.so.2<br>
                      Reading symbols from /lib64/libc.so.6...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libc.so.6<br>
                      Reading symbols from
                      /lib64/ld-linux-x86-64.so.2...(no debugging
                      symbols found)...done.<br>
                      Loaded symbols for /lib64/ld-linux-x86-64.so.2<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/db_postgres.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/db_postgres.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/db_postgres.so<br>
                      Reading symbols from /usr/lib64/libpq.so.5...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /usr/lib64/libpq.so.5<br>
                      Reading symbols from
                      /usr/lib64/kamailio/libsrdb2.so.1...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/libsrdb2.so.1.0.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/libsrdb2.so.1<br>
                      Reading symbols from
                      /usr/lib64/kamailio/libsrdb1.so.1...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/libsrdb1.so.1.0.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/libsrdb1.so.1<br>
                      Reading symbols from /usr/lib64/libssl.so.10...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /usr/lib64/libssl.so.10<br>
                      Reading symbols from
                      /usr/lib64/libcrypto.so.10...(no debugging symbols
                      found)...done.<br>
                      Loaded symbols for /usr/lib64/libcrypto.so.10<br>
                      Reading symbols from
                      /lib64/libgssapi_krb5.so.2...(no debugging symbols
                      found)...done.<br>
                      Loaded symbols for /lib64/libgssapi_krb5.so.2<br>
                      Reading symbols from
                      /lib64/libldap_r-2.4.so.2...(no debugging symbols
                      found)...done.<br>
                      Loaded symbols for /lib64/libldap_r-2.4.so.2<br>
                      Reading symbols from /lib64/libpthread.so.0...(no
                      debugging symbols found)...done.<br>
                      [Thread debugging using libthread_db enabled]<br>
                      Loaded symbols for /lib64/libpthread.so.0<br>
                      Reading symbols from /lib64/libkrb5.so.3...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libkrb5.so.3<br>
                      Reading symbols from /lib64/libcom_err.so.2...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libcom_err.so.2<br>
                      Reading symbols from /lib64/libk5crypto.so.3...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libk5crypto.so.3<br>
                      Reading symbols from /lib64/libz.so.1...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libz.so.1<br>
                      Reading symbols from
                      /lib64/libkrb5support.so.0...(no debugging symbols
                      found)...done.<br>
                      Loaded symbols for /lib64/libkrb5support.so.0<br>
                      Reading symbols from /lib64/libkeyutils.so.1...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libkeyutils.so.1<br>
                      Reading symbols from /lib64/liblber-2.4.so.2...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/liblber-2.4.so.2<br>
                      Reading symbols from
                      /usr/lib64/libsasl2.so.2...(no debugging symbols
                      found)...done.<br>
                      Loaded symbols for /usr/lib64/libsasl2.so.2<br>
                      Reading symbols from /usr/lib64/libssl3.so...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /usr/lib64/libssl3.so<br>
                      Reading symbols from /usr/lib64/libsmime3.so...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /usr/lib64/libsmime3.so<br>
                      Reading symbols from /usr/lib64/libnss3.so...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /usr/lib64/libnss3.so<br>
                      Reading symbols from
                      /usr/lib64/libnssutil3.so...(no debugging symbols
                      found)...done.<br>
                      Loaded symbols for /usr/lib64/libnssutil3.so<br>
                      Reading symbols from /lib64/libplds4.so...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libplds4.so<br>
                      Reading symbols from /lib64/libplc4.so...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libplc4.so<br>
                      Reading symbols from /lib64/libnspr4.so...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libnspr4.so<br>
                      Reading symbols from /lib64/libselinux.so.1...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libselinux.so.1<br>
                      Reading symbols from /lib64/libcrypt.so.1...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libcrypt.so.1<br>
                      Reading symbols from /lib64/librt.so.1...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/librt.so.1<br>
                      Reading symbols from /lib64/libfreebl3.so...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libfreebl3.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/ctl.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/ctl.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/ctl.so<br>
                      Reading symbols from
                      /lib64/libnss_files.so.2...(no debugging symbols
                      found)...done.<br>
                      Loaded symbols for /lib64/libnss_files.so.2<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/kex.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/kex.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/kex.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/libsrutils.so.1...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/libsrutils.so.1.0.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/libsrutils.so.1<br>
                      Reading symbols from /lib64/libm.so.6...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libm.so.6<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/tm.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/tm.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/tm.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/tmx.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/tmx.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/tmx.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/corex.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/corex.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/corex.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/cfg_rpc.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/cfg_rpc.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/cfg_rpc.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/sl.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/sl.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/sl.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/rr.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/rr.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/rr.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/maxfwd.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/maxfwd.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/maxfwd.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/siputils.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/siputils.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/siputils.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/sanity.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/sanity.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/sanity.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/textops.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/textops.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/textops.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/textopsx.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/textopsx.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/textopsx.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/dmq.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/dmq.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/dmq.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/htable.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/htable.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/htable.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/pv.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/pv.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/pv.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/xlog.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/xlog.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/xlog.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/jsonrpcs.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/jsonrpcs.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/jsonrpcs.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/uac.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/uac.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/uac.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/uac_redirect.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/uac_redirect.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/uac_redirect.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/db_text.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/db_text.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/db_text.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/dispatcher.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/dispatcher.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/dispatcher.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/sqlops.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/sqlops.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/sqlops.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/regex.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/regex.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/regex.so<br>
                      Reading symbols from /lib64/libpcre.so.0...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libpcre.so.0<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/permissions.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/permissions.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/permissions.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/dialplan.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/dialplan.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/dialplan.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/mtree.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/mtree.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/mtree.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/cfgutils.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/cfgutils.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/cfgutils.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/statsd.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/statsd.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/statsd.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/app_lua.so...Reading
                      symbols from
/usr/lib/debug/usr/lib64/kamailio/modules/app_lua.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/app_lua.so<br>
                      Reading symbols from
                      /usr/lib64/liblua-5.1.so...(no debugging symbols
                      found)...done.<br>
                      Loaded symbols for /usr/lib64/<a
                        href="http://liblua-5.1.so" target="_blank"
                        moz-do-not-send="true">liblua-5.1.so</a><br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/rtimer.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/rtimer.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/rtimer.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/mqueue.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/mqueue.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/mqueue.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/auth.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/auth.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/auth.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/usrloc.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/usrloc.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/usrloc.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/registrar.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/registrar.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/registrar.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/dmq_usrloc.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/dmq_usrloc.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/dmq_usrloc.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/xhttp.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/xhttp.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/xhttp.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/exec.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/exec.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/exec.so<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/http_client.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/http_client.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/http_client.so<br>
                      Reading symbols from /usr/lib64/libxml2.so.2...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /usr/lib64/libxml2.so.2<br>
                      Reading symbols from /usr/lib64/libcurl.so.4...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /usr/lib64/libcurl.so.4<br>
                      Reading symbols from /lib64/libidn.so.11...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libidn.so.11<br>
                      Reading symbols from /lib64/libldap-2.4.so.2...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libldap-2.4.so.2<br>
                      Reading symbols from /usr/lib64/libssh2.so.1...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /usr/lib64/libssh2.so.1<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/json.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/json.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/json.so<br>
                      Reading symbols from /lib64/libjson-c.so.2...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libjson-c.so.2<br>
                      Reading symbols from
                      /usr/lib64/kamailio/modules/ipops.so...Reading
                      symbols from
                      /usr/lib/debug/usr/lib64/kamailio/modules/ipops.so.debug...done.<br>
                      done.<br>
                      Loaded symbols for
                      /usr/lib64/kamailio/modules/ipops.so<br>
                      Reading symbols from /lib64/libnss_dns.so.2...(no
                      debugging symbols found)...done.<br>
                      Loaded symbols for /lib64/libnss_dns.so.2<br>
                      Core was generated by
                      `/opt/ptin/kamailio-ksipadp/bin/ksipadp-proxy -f
                      /opt/ptin/kamailio-ksipadp/prox'.<br>
                      Program terminated with signal 11, Segmentation
                      fault.<br>
                      #0  0x00007fefe58ea7c4 in atomic_get (v=0x0) at
                      ../../core/atomic/atomic_common.h:66<br>
                      66              return
                      atomic_get_int(&(v->val));<br>
                      Missing separate debuginfos, use:
                      debuginfo-install
                      kamailio-ksipadp-2.8.0-1.ptin.el6.x86_64<br>
                      (gdb) bt full<br>
                      #0  0x00007fefe58ea7c4 in atomic_get (v=0x0) at
                      ../../core/atomic/atomic_common.h:66<br>
                      No locals.<br>
                      #1  0x00007fefe58ee246 in job_queue_size
                      (queue=0x0) at worker.c:254<br>
                      No locals.<br>
                      #2  0x00007fefe58ed920 in add_dmq_job
                      (msg=0x7ff028b453f8, peer=0x7fefebcc4df8) at
                      worker.c:184<br>
                              i = 1<br>
                              found_available = 0<br>
                              new_job = {f = 0x7fefe2613797
                      <usrloc_dmq_handle_msg>, msg =
                      0x7fefebce67c8, orig_peer = 0x7fefebcc4df8, next =
                      0x0, prev = 0x0}<br>
                              worker = 0x7fefe7a1d890<br>
                              cloned_msg = 0x7fefebce67c8<br>
                              cloned_msg_len = 3888<br>
                              __FUNCTION__ = "add_dmq_job"<br>
                      #3  0x00007fefe58dfec1 in dmq_handle_message
                      (msg=0x7ff028b453f8, str1=0x0, str2=0x0) at
                      message.c:66<br>
                              peer = 0x7fefebcc4df8<br>
                              __FUNCTION__ = "dmq_handle_message"<br>
                      #4  0x0000000000433729 in do_action
                      (h=0x7ffc89e35670, a=0x7ff0285a9340,
                      msg=0x7ff028b453f8) at core/action.c:1054<br>
                              ret = -5<br>
                              v = 1<br>
                              dst = {send_sock = 0x7ff0285a8810, to = {s
                      = {sa_family = 21376, sa_data =
                      "\343\211\374\177\000\000\370S\264(\360\177\000"},
                      sin = {<br>
                                    sin_family = 21376, sin_port =
                      35299, sin_addr = {s_addr = 32764}, sin_zero =
                      "\370S\264(\360\177\000"}, sin6 = {sin6_family =
                      21376,<br>
                                    sin6_port = 35299, sin6_flowinfo =
                      32764, sin6_addr = {__in6_u = {__u6_addr8 =
                      "\370S\264(\360\177\000\000pV\343\211\374\177\000",<br>
                                        __u6_addr16 = {21496, 10420,
                      32752, 0, 22128, 35299, 32764, 0}, __u6_addr32 =
                      {682906616, 32752, 2313377392, 32764}}},<br>
                                    sin6_scope_id = 1}}, id = 32764,
                      proto = 0 '\000', send_flags = {f = 0, blst_imask
                      = 0}}<br>
                              tmp = 0x389c422190 ""<br>
                              new_uri = 0x7c00000000 <Address
                      0x7c00000000 out of bounds><br>
                              end = 0x6e00000077 <Address
                      0x6e00000077 out of bounds><br>
                              crt = 0x389c98e120 ""<br>
                              cmd = 0x7ff0283219b0<br>
                              len = 0<br>
                              user = 0<br>
                              uri = {user = {s = 0x7ffc89e34a10
                      "@K\343\211\374\177", len = 4459394}, passwd = {s
                      = 0x7ffc89e34e80 "\356Q\343\211\374\177",<br>
                                  len = 682906616}, host = {s =
                      0x7ff0285a9020 "\177\001", len = -1981589904},
                      port = {s = 0x0, len = 1}, params = {<br>
                                  s = 0x7ff028b453f8 "\017", len =
                      295169284}, sip_params = {s = 0x32 <Address
                      0x32 out of bounds>, len = 1073741824}, headers
                      = {<br>
                                  s = 0x2000000 <Address 0x2000000
                      out of bounds>, len = 4289104}, port_no =
                      60676, proto = 5047, type = 2312043322, flags =
                      2168712452,<br>
                                transport = {s = 0x0, len =
                      -1675583518}, ttl = {s = 0x89e34e90 <Address
                      0x89e34e90 out of bounds>, len = 35715777},
                      user_param = {<br>
                                  s = 0xffffffff0000003c <Address
                      0xffffffff0000003c out of bounds>, len =
                      -1671419584}, maddr = {s = 0x0, len =
                      -1981592704}, method = {<br>
                                  s = 0x389c603c48 "", len =
                      -1671391960}, lr = {s = 0x0, len = -1981592544},
                      r2 = {s = 0x1dde9a0 " 9\336\001", len = 0}, gr = {<br>
                                  s = 0x4 <Address 0x4 out of
                      bounds>, len = 2479}, transport_val = {s =
                      0x389c422190 "", len = 1}, ttl_val = {<br>
                                  s = 0x7ffc89e34b40
                      "pM\343\211\374\177", len = 5683491},
                      user_param_val = {s = 0x40e7e8
                      "\370\377\377\377\377\377\377\377@ݘ\234\070",<br>
                                  len = -1671362728}, maddr_val = {s =
                      0x404130 "", len = 0}, method_val = {s =
                      0x1000003b4 <Address 0x1000003b4 out of
                      bounds>, len = 0},<br>
                                lr_val = {s = 0x7fefe7374b9a "%x%c%x%c",
                      len = -1673386776}, r2_val = {s = 0x7ffc89e34bd0
                      "", len = -1981592584}, gr_val = {<br>
                      ---Type <return> to continue, or q
                      <return> to quit---<br>
                                  s = 0x389c422190 "", len = 0}}<br>
                              next_hop = {user = {s = 0x1 <Address
                      0x1 out of bounds>, len = 40}, passwd = {s =
                      0x0, len = -1407107317}, host = {<br>
                                  s = 0x2000000 <Address 0x2000000
                      out of bounds>, len = 31398688}, port = {s =
                      0x1dde9a0 " 9\336\001", len = 31320480}, params =
                      {<br>
                                  s = 0x7ffc89e34c20 "", len =
                      -1981593152}, sip_params = {s = 0x7ffc89e34910
                      "\200N\343\211\374\177", len = 682906616}, headers
                      = {<br>
                                  s = 0x32 <Address 0x32 out of
                      bounds>, len = 1073741824}, port_no = 0, proto
                      = 512, type = ERROR_URI_T, flags = 4289104,
                      transport = {<br>
                                  s = 0x7ffc89e34900
                      "\020J\343\211\374\177", len = 4457737}, ttl = {s
                      = 0x7ffc89e348f0 "", len = -1981593520},
                      user_param = {<br>
                                  s = 0x7ffc89e34858 "\r", len =
                      -1981593264}, maddr = {s = 0x7ffc89e34870 "", len
                      = -1981593456}, method = {s = 0x7ffc89e348b0 "\r",<br>
                                  len = -1981593392}, lr = {s = 0x8cd2d0
                      <Address 0x8cd2d0 out of bounds>, len = 13},
                      r2 = {<br>
                                  s = 0x10100000002 <Address
                      0x10100000002 out of bounds>, len = -1}, gr =
                      {s = 0x0, len = 0}, transport_val = {s = 0x0, len
                      = 682906616},<br>
                                ttl_val = {s = 0x7ff0285a9020
                      "\177\001", len = -1981593296}, user_param_val =
                      {s = 0x7ffc89e34fa0 "\001\200\255\373\374\177",
                      len = 0},<br>
                                maddr_val = {s = 0x10000000d <Address
                      0x10000000d out of bounds>, len = -1981591296},
                      method_val = {<br>
                                  s = 0x7fef00000000 <Address
                      0x7fef00000000 out of bounds>, len =
                      -1671151657}, lr_val = {s = 0x7fefe7374ba2 "", len
                      = 682906616},<br>
                                r2_val = {s = 0x32 <Address 0x32 out
                      of bounds>, len = 1073741824}, gr_val = {s =
                      0x2000000 <Address 0x2000000 out of bounds>,<br>
                                  len = 4289104}}<br>
                              u = 0x389c4224e8<br>
                              port = 0<br>
                              dst_host = 0x89e34bd0<br>
                              i = 32764<br>
                              flags = 52<br>
                              avp = 0x189e35040<br>
                              st = {flags = 2313374752, id = 32764, name
                      = {n = -1981593512, s = {s = 0x7ffc89e34858 "\r",
                      len = -1981593152}, re = 0x7ffc89e34858},<br>
                                avp = 0x7ffc89e347a0}<br>
                              sct = 0x0<br>
                              sjt = 0x7ff028b453f8<br>
                              rve = 0x32<br>
                              mct = 0x40000000<br>
                              rv = 0x7ffc89e34c20<br>
                              rv1 = 0x2000000<br>
                              c1 = {cache_type = 2313374144, val_type =
                      32764, c = {avp_val = {n = 1, s = {s = 0x1
                      <Address 0x1 out of bounds>, len = 1}, re =
                      0x1}, pval = {<br>
                                    rs = {s = 0x1 <Address 0x1 out of
                      bounds>, len = 1}, ri = -1407115050, flags =
                      52}},<br>
                                i2s =
                      "\000\000\000\000\000\000\000\000\274\224
                      \254\064\000\000\000\240G\343\211\374\177"}<br>
                              s = {s = 0x1 <Address 0x1 out of
                      bounds>, len = -1981593512}<br>
                              srevp = {0x7ffc89e34960, 0x34ac208a97}<br>
                              mod_f_params = {{type = NOSUBTYPE, u =
                      {number = 0, string = 0x0, str = {s = 0x0, len =
                      0}, data = 0x0, attr = 0x0, select = 0x0}}, {<br>
                                  type = NOSUBTYPE, u = {number = 0,
                      string = 0x0, str = {s = 0x0, len = 0}, data =
                      0x0, attr = 0x0, select = 0x0}}, {type =
                      NOSUBTYPE, u = {<br>
                                    number = 0, string = 0x0, str = {s =
                      0x0, len = 0}, data = 0x0, attr = 0x0, select =
                      0x0}}, {type = NOSUBTYPE, u = {number = 0,<br>
                                    string = 0x0, str = {s = 0x0, len =
                      0}, data = 0x0, attr = 0x0, select = 0x0}}, {type
                      = NOSUBTYPE, u = {number = 0, string = 0x0, str =
                      {<br>
                                      s = 0x0, len = 0}, data = 0x0,
                      attr = 0x0, select = 0x0}}, {type = NOSUBTYPE, u =
                      {number = 0, string = 0x0, str = {s = 0x0, len =
                      0},<br>
                                    data = 0x0, attr = 0x0, select =
                      0x0}}, {type = NOSUBTYPE, u = {number = 0, string
                      = 0x0, str = {s = 0x0, len = 0}, data = 0x0,<br>
                                    attr = 0x0, select = 0x0}}, {type =
                      NOSUBTYPE, u = {number = 0, string = 0x0, str = {s
                      = 0x0, len = 0}, data = 0x0, attr = 0x0,<br>
                                    select = 0x0}}}<br>
                      ---Type <return> to continue, or q
                      <return> to quit---<br>
                              __FUNCTION__ = "do_action"<br>
                      #5  0x00000000004404b8 in run_actions
                      (h=0x7ffc89e35670, a=0x7ff0285a9340,
                      msg=0x7ff028b453f8) at core/action.c:1552<br>
                              t = 0x7ff0285a9340<br>
                              ret = -1<br>
                              mod = 0x1dde9a0<br>
                              ms = 176570657<br>
                              __FUNCTION__ = "run_actions"<br>
                      #6  0x0000000000433692 in do_action
                      (h=0x7ffc89e35670, a=0x7ff0285a9668,
                      msg=0x7ff028b453f8) at core/action.c:1045<br>
                              ret = 1<br>
                              v = 1<br>
                              dst = {send_sock = 0x7ffc89e35380, to = {s
                      = {sa_family = 61042, sa_data = "I", '\000'
                      <repeats 12 times>}, sin = {sin_family =
                      61042,<br>
                                    sin_port = 73, sin_addr = {s_addr =
                      0}, sin_zero = "\000\000\000\000\000\000\000"},
                      sin6 = {sin6_family = 61042, sin6_port = 73,<br>
                                    sin6_flowinfo = 0, sin6_addr =
                      {__in6_u = {__u6_addr8 =
                      "\000\000\000\000\000\000\000\000\020\000\000\000\005\000\000",
                      __u6_addr16 = {<br>
                                          0, 0, 0, 0, 16, 0, 5, 0},
                      __u6_addr32 = {0, 0, 16, 5}}}, sin6_scope_id =
                      673678288}}, id = 32752, proto = 0 '\000',
                      send_flags = {<br>
                                  f = 0, blst_imask = 32752}}<br>
                              tmp = 0x66307b
                      "H\213E\270H\203\300\070\351O\003"<br>
                              new_uri = 0x7ff028a93048 ""<br>
                              end = 0x7ff028a93038 "\303l\256"<br>
                              crt = 0x2000000 <Address 0x2000000 out
                      of bounds><br>
                              cmd = 0x1773508<br>
                              len = 6791248<br>
                              user = 0<br>
                              uri = {user = {s = 0xae6ecd "", len =
                      11430897}, passwd = {s = 0x7c95f8 "core:
                      core/parser/msg_parser.c", len = 682507016}, host
                      = {<br>
                                  s = 0xae6c43 "To: <<a
                        href="http://sip:usrloc@10.112.103.64:5080"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.103.64:5080</a>>\r\nFrom:
                      <<a
                        href="http://sip:usrloc@10.112.101.128:5060"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.101.128:5060</a>>;tag=8a3534eb92149bbe647f599d354f2511-090e\r\nCSeq:
                      10 KDMQ\r\nCall-ID: <a
                        href="mailto:409f4ac5788a8cc4-24333@10.112.101.128"
                        target="_blank" moz-do-not-send="true">409f4ac5788a8cc4-24333@10.112.101.128</a>\r\nContent-Length:
                      39"..., len = 11430924}, port = {s = 0x0, len =
                      682507072}, params = {<br>
                                  s = 0x7ff028ae3c90  <incomplete
                      sequence \350>, len = 0}, sip_params = {s =
                      0x7ffc89e35330 "\246", len = 6697083}, headers = {<br>
                                  s = 0x7c9170 "core", len =
                      -1981590832}, port_no = 8, proto = 0, type =
                      ERROR_URI_T, flags = 30415600, transport = {<br>
                                  s = 0xa8428197 <Address 0xa8428197
                      out of bounds>, len = -1675583518}, ttl = {s =
                      0x3000000030 <Address 0x3000000030 out of
                      bounds>,<br>
                                  len = 44108294}, user_param = {s =
                      0x400000017 <Address 0x400000017 out of
                      bounds>, len = 8176032}, maddr = {s = 0x0, len
                      = -1981590448},<br>
                                method = {s = 0x389c603c48 "", len =
                      11431629}, lr = {s = 0x7ffc89e35450
                      "\220T\343\211\374\177", len = 6869803}, r2 = {<br>
                                  s = 0x7cc190 "get_hdr_field", len =
                      6730416}, gr = {s = 0x7ffc89e35300 "", len =
                      673677328}, transport_val = {s = 0x389c422190 "",<br>
                                  len = 673677328}, ttl_val = {s =
                      0x7ffc89e35350 "\200S\343\211\374\177", len =
                      -413652166}, user_param_val = {s = 0x40e7f9 "",
                      len = 0},<br>
                                maddr_val = {s = 0x2000000 <Address
                      0x2000000 out of bounds>, len = 24588552},
                      method_val = {<br>
                                  s = 0x67a450
                      "\030A\211\321A)\301D\211ȉ\302H\213\205(\377\377\377\211P
                      \276\004", len = 8965880}, lr_val = {<br>
                                  s = 0x8cd2d0 <Address 0x8cd2d0 out
                      of bounds>, len = 8}, r2_val = {s = 0xa6
                      <Address 0xa6 out of bounds>, len =
                      8136007}, gr_val = {<br>
                                  s = 0x7c95f8 "core:
                      core/parser/msg_parser.c", len = 682176488}}<br>
                              next_hop = {user = {s = 0x1e7374b9a
                      <Address 0x1e7374b9a out of bounds>, len =
                      674472240}, passwd = {<br>
                                  s = 0xffffffff <Address 0xffffffff
                      out of bounds>, len = 4289104}, host = {s =
                      0x4e2cb1825 <Address 0x4e2cb1825 out of
                      bounds>,<br>
                                  len = -1667705792}, port = {s = 0x0,
                      len = 1073741824}, params = {s = 0x2000000
                      <Address 0x2000000 out of bounds>, len =
                      4289104},<br>
                                sip_params = {s = 0x7ffc89e35180
                      "\360Q\343\211\374\177", len = 6031673}, headers =
                      {s = 0x7fefe2cb183f "", len = -1981591296},<br>
                                port_no = 23013, proto = 58022, type =
                      32751, flags = 2313376240, transport = {s =
                      0x7fefe7374b9a "%x%c%x%c", len = -1981590944}, ttl
                      = {<br>
                      ---Type <return> to continue, or q
                      <return> to quit---<br>
                                  s = 0x1a <Address 0x1a out of
                      bounds>, len = 4289104}, user_param = {s =
                      0x7fefe2a659e5 "5e6a5a14-1fa-", len =
                      -1670974014}, maddr = {<br>
                                  s = 0x30fbad8001 <Address
                      0x30fbad8001 out of bounds>, len = -492414491},
                      method = {s = 0x7fefe2a659e5 "5e6a5a14-1fa-", len
                      = -492414491},<br>
                                lr = {s = 0x7fefe2a659e5
                      "5e6a5a14-1fa-", len = -492414478}, r2 = {s =
                      0x7fefe2a659ff "", len = -492414491}, gr = {s =
                      0x7fefe2a659ff "",<br>
                                  len = 0}, transport_val = {s = 0x0,
                      len = 6730416}, ttl_val = {s = 0x7ffc89e351a0 "",
                      len = 673677328}, user_param_val = {<br>
                                  s = 0x2000000 <Address 0x2000000
                      out of bounds>, len = 673677328}, maddr_val =
                      {s = 0x7ffc89e351f0 "Cl\256", len = -413652166},<br>
                                method_val = {s = 0x7ff028278010 "\001",
                      len = 0}, lr_val = {s = 0x2000000 <Address
                      0x2000000 out of bounds>, len = 24589344},
                      r2_val = {<br>
                                  s = 0x67a138 "", len = 8965088},
                      gr_val = {s = 0x8cd2d0 <Address 0x8cd2d0 out of
                      bounds>, len = 682507072}}<br>
                              u = 0x66273d<br>
                              port = 0<br>
                              dst_host = 0x40000000<br>
                              i = 28<br>
                              flags = 0<br>
                              avp = 0xae6cc7<br>
                              st = {flags = 31129600, id = 0, name = {n
                      = 0, s = {s = 0x0, len = 93}, re = 0x0}, avp =
                      0x7ffc89e35080}<br>
                              sct = 0x7ffc89e35490<br>
                              sjt = 0x6943d3<br>
                              rve = 0x7ff0285a8808<br>
                              mct = 0x6a283b<br>
                              rv = 0x0<br>
                              rv1 = 0x7c9170<br>
                              c1 = {cache_type = 24, val_type = 48, c =
                      {avp_val = {n = -1981590720, s = {s =
                      0x7ffc89e35340 "\370\225|", len = -1981590912},<br>
                                    re = 0x7ffc89e35340}, pval = {rs =
                      {s = 0x7ffc89e35340 "\370\225|", len =
                      -1981590912}, ri = 0, flags = 0}},<br>
                                i2s = '\000' <repeats 21 times>}<br>
                              s = {s = 0x7fefe2cb183f "", len =
                      -490006491}<br>
                              srevp = {0x7fefe2cb1825, 0x7fefe2cb1832}<br>
                              mod_f_params = {{type = NOSUBTYPE, u =
                      {number = 0, string = 0x0, str = {s = 0x0, len =
                      0}, data = 0x0, attr = 0x0, select = 0x0}}, {<br>
                                  type = NOSUBTYPE, u = {number = 0,
                      string = 0x0, str = {s = 0x0, len = 0}, data =
                      0x0, attr = 0x0, select = 0x0}}, {type =
                      NOSUBTYPE, u = {<br>
                                    number = 0, string = 0x0, str = {s =
                      0x0, len = 0}, data = 0x0, attr = 0x0, select =
                      0x0}}, {type = NOSUBTYPE, u = {number = 0,<br>
                                    string = 0x0, str = {s = 0x0, len =
                      0}, data = 0x0, attr = 0x0, select = 0x0}}, {type
                      = NOSUBTYPE, u = {number = 0, string = 0x0, str =
                      {<br>
                                      s = 0x0, len = 0}, data = 0x0,
                      attr = 0x0, select = 0x0}}, {type = NOSUBTYPE, u =
                      {number = 0, string = 0x0, str = {s = 0x0, len =
                      0},<br>
                                    data = 0x0, attr = 0x0, select =
                      0x0}}, {type = NOSUBTYPE, u = {number = 0, string
                      = 0x0, str = {s = 0x0, len = 0}, data = 0x0,<br>
                                    attr = 0x0, select = 0x0}}, {type =
                      NOSUBTYPE, u = {number = 0, string = 0x0, str = {s
                      = 0x0, len = 0}, data = 0x0, attr = 0x0,<br>
                                    select = 0x0}}}<br>
                              __FUNCTION__ = "do_action"<br>
                      #7  0x00000000004404b8 in run_actions
                      (h=0x7ffc89e35670, a=0x7ff0285a85d0,
                      msg=0x7ff028b453f8) at core/action.c:1552<br>
                              t = 0x7ff0285a9668<br>
                              ret = 1<br>
                              mod = 0x417250<br>
                              ms = 176570657<br>
                              __FUNCTION__ = "run_actions"<br>
                      #8  0x0000000000440c4a in run_top_route
                      (a=0x7ff0285a85d0, msg=0x7ff028b453f8, c=0x0) at
                      core/action.c:1641<br>
                      ---Type <return> to continue, or q
                      <return> to quit---<br>
                              ctx = {rec_lev = 2, run_flags = 0,
                      last_retcode = 1, jmp_env = {{__jmpbuf =
                      {140669451785720, -8516593617994257148, 50,
                      1073741824, 33554432,<br>
                                      4289104, -8516593618092823292,
                      8518532807277145348}, __mask_was_saved = 0,
                      __saved_mask = {__val = {140668355198191,
                      4302791168, 48,<br>
                                        48, 18446744073709551615,
                      140722621863712, 140668355198919, 50, 0,
                      4611686022755909632, 140669451785208,
                      140722621863776, 5814046,<br>
                                        6608344928, 140669451785208,
                      0}}}}}<br>
                              p = 0x7ffc89e35670<br>
                              ret = 682907128<br>
                              sfbk = 0<br>
                      #9  0x000000000052e6b9 in receive_msg (<br>
                          buf=0xae6bc0 "KDMQ <a
                        href="http://sip:usrloc@10.112.103.64:5080"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.103.64:5080</a>
                      SIP/2.0\r\nVia: SIP/2.0/UDP
                      10.112.101.128;branch=z9hG4bK8791.0c350dd3", '0'
                      <repeats 24 times>, ".0\r\nTo: <<a
                        href="http://sip:usrloc@10.112.103.64:5080"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.103.64:5080</a>>\r\nFrom:
                      <<a href="mailto:sip%3Ausrloc@10.112.101.128"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.101.128</a>"...,
                      len=781, rcv_info=0x7ffc89e35a70) at
                      core/receive.c:264<br>
                              msg = 0x7ff028b453f8<br>
                              ctx = {rec_lev = -1981589208, run_flags =
                      32764, last_retcode = 8, jmp_env = {{__jmpbuf =
                      {163, 4253893, 8100093, 140669451683568,<br>
                                      140722621864176, 4845170, 0,
                      21474836480}, __mask_was_saved = 673677840,
                      __saved_mask = {__val = {140668768878592,
                      140722621864448,<br>
                                        6697083, 8094080, 5501958,
                      243141751568, 140669476122624, 140722621864896,
                      4294967295, 88212724672, 1, 140668357584160, 0,
                      33554432,<br>
                                        1024, 6608345520}}}}}<br>
                              bctx = 0x7ffc89e359b0<br>
                              ret = 0<br>
                              stats_on = 0<br>
                              tvb = {tv_sec = 140722621864208, tv_usec =
                      8961768}<br>
                              tve = {tv_sec = 0, tv_usec = 243139749096}<br>
                              tz = {tz_minuteswest = 50, tz_dsttime = 0}<br>
                              diff = 0<br>
                              inb = {<br>
                                s = 0xae6bc0 "KDMQ <a
                        href="http://sip:usrloc@10.112.103.64:5080"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.103.64:5080</a>
                      SIP/2.0\r\nVia: SIP/2.0/UDP
                      10.112.101.128;branch=z9hG4bK8791.0c350dd3", '0'
                      <repeats 24 times>, ".0\r\nTo: <<a
                        href="http://sip:usrloc@10.112.103.64:5080"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.103.64:5080</a>>\r\nFrom:
                      <<a href="mailto:sip%3Ausrloc@10.112.101.128"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.101.128</a>"...,
                      len = 781}<br>
                              netinfo = {data = {s = 0x7ffc00000001
                      <Address 0x7ffc00000001 out of bounds>, len
                      = 0}, dst = 0x1, rcv = 0x389c422190}<br>
                              keng = 0x0<br>
                              __FUNCTION__ = "receive_msg"<br>
                      #10 0x00000000006456a3 in udp_rcv_loop () at
                      core/udp_server.c:515<br>
                              len = 781<br>
                              buf = "KDMQ <a
                        href="http://sip:usrloc@10.112.103.64:5080"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.103.64:5080</a>
                      SIP/2.0\r\nVia: SIP/2.0/UDP
                      10.112.101.128;branch=z9hG4bK8791.0c350dd3", '0'
                      <repeats 24 times>, ".0\r\nTo: <<a
                        href="http://sip:usrloc@10.112.103.64:5080"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.103.64:5080</a>>\r\nFrom:
                      <<a
                        href="http://sip:usrloc@10.112.101.128:5060"
                        target="_blank" moz-do-not-send="true">sip:usrloc@10.112.101.128:5060</a>>;tag=8a3"...<br>
                              tmp = 0x100000000 <Address 0x100000000
                      out of bounds><br>
                              from = 0x7ff028b2c728<br>
                              fromlen = 16<br>
                              ri = {src_ip = {af = 2, len = 4, u =
                      {addrl = {140722462617610, 140722621864592},
                      addr32 = {2154131466, 32764, 2313378448, 32764},
                      addr16 = {<br>
                                      28682, 32869, 32764, 0, 23184,
                      35299, 32764, 0}, addr =
                      "\npe\200\374\177\000\000\220Z\343\211\374\177\000"}},
                      dst_ip = {af = 2,<br>
                                  len = 4, u = {addrl = {1080520714, 0},
                      addr32 = {1080520714, 0, 0, 0}, addr16 = {28682,
                      16487, 0, 0, 0, 0, 0, 0},<br>
                                    addr = "\npg@", '\000' <repeats
                      11 times>}}, src_port = 5060, dst_port = 5080,
                      proto_reserved1 = 0, proto_reserved2 = 0, src_su =
                      {s = {<br>
                                    sa_family = 2, sa_data =
                      "\023\304\npe\200\000\000\000\000\000\000\000"},
                      sin = {sin_family = 2, sin_port = 50195, sin_addr
                      = {<br>
                                      s_addr = 2154131466}, sin_zero =
                      "\000\000\000\000\000\000\000"}, sin6 =
                      {sin6_family = 2, sin6_port = 50195,<br>
                      ---Type <return> to continue, or q
                      <return> to quit---<br>
                                    sin6_flowinfo = 2154131466,
                      sin6_addr = {__in6_u = {__u6_addr8 = '\000'
                      <repeats 15 times>, __u6_addr16 = {0, 0, 0,
                      0, 0, 0, 0, 0},<br>
                                        __u6_addr32 = {0, 0, 0, 0}}},
                      sin6_scope_id = 0}}, bind_address =
                      0x7ff02830fff0, proto = 1 '\001'}<br>
                              __FUNCTION__ = "udp_rcv_loop"<br>
                      #11 0x0000000000423c7d in main_loop () at
                      main.c:1623<br>
                              i = 0<br>
                              pid = 0<br>
                              si = 0x7ff02830fff0<br>
                              si_desc = "udp receiver child=0 sock=<a
                        href="http://10.112.103.64:5080" target="_blank"
                        moz-do-not-send="true">10.112.103.64:5080</a>\000\000\000\000
_\343\211\374\177\000\000\062\000\000\000\000\000\000\000\000\000\000@\000\000\000\000\000\000\000\002\000\000\000\000PrA\000\000\000\000\000PSn\234\070\000\000\000\060\000\000\000\060\000\000\000\020]\343\211\374\177\000\000@\\\343\211\374\177\000\000\000px\347\357\177\000"<br>
                              nrprocs = 4<br>
                              woneinit = 0<br>
                              __FUNCTION__ = "main_loop"<br>
                      #12 0x000000000042b0ce in main (argc=13,
                      argv=0x7ffc89e36008) at main.c:2646<br>
                              cfg_stream = 0x1bb5010<br>
                              c = -1<br>
                              r = 0<br>
                              tmp = 0x7ffc89e36ef7 ""<br>
                              tmp_len = 32764<br>
                              port = -1981587768<br>
                              proto = 56<br>
                              options = 0x7434f8
                      ":f:cm:M:dVIhEeb:l:L:n:vKrRDTN:W:w:t:u:g:P:G:SQ:O:a:A:x:X:Y:"<br>
                              ret = -1<br>
                              seed = 4012862799<br>
                              rfd = 4<br>
                              debug_save = 0<br>
                              debug_flag = 0<br>
                              dont_fork_cnt = 0<br>
                              n_lst = 0x7ffc89e35f08<br>
                              p = 0x100000000 <Address 0x100000000
                      out of bounds><br>
                              st = {st_dev = 64769, st_ino = 148592,
                      st_nlink = 2, st_mode = 16877, st_uid = 498,
                      st_gid = 498, __pad0 = 0, st_rdev = 0, st_size =
                      4096,<br>
                                st_blksize = 4096, st_blocks = 8,
                      st_atim = {tv_sec = 1576522467, tv_nsec =
                      972000117}, st_mtim = {tv_sec = 1519927576,<br>
                                  tv_nsec = 668342155}, st_ctim =
                      {tv_sec = 1584026268, tv_nsec = 165523404},
                      __unused = {0, 0, 0}}<br>
                              __FUNCTION__ = "main"<br>
                      (gdb)<br>
                    </div>
                  </div>
                  <br>
                  <div class="gmail_quote">
                    <div dir="ltr" class="gmail_attr">Em ter., 17 de
                      mar. de 2020 às 09:52, Daniel-Constantin Mierla
                      <<a href="mailto:miconda@gmail.com"
                        target="_blank" moz-do-not-send="true">miconda@gmail.com</a>>
                      escreveu:<br>
                    </div>
                    <blockquote class="gmail_quote" style="margin:0px
                      0px 0px 0.8ex;border-left:1px solid
                      rgb(204,204,204);padding-left:1ex">
                      <div>
                        <p>Hello,</p>
                        <p>does it happen only when doing restart of
                          kamailio? Can you send the full backtrace from
                          gdb?</p>
                        <p>Also, 5.0.x is no longer a supported release
                          for quite some time, try to upgrade to 5.2.x
                          or even better to the latest one 5.3.x and see
                          if you can reproduce it with one of the
                          supported releases, maybe it is something that
                          was already fixed.</p>
                        <p>Cheers,<br>
                          Daniel<br>
                        </p>
                        <div>On 17.03.20 10:32, Virgílio Cunha wrote:<br>
                        </div>
                        <blockquote type="cite">
                          <div dir="ltr">Hello,
                            <div><br>
                            </div>
                            <div>I have in production environment with 4
                              proxies using DMQ to sync terminal
                              registers and the DMQ configuration
                              parameters is following:</div>
                            <div>loadmodule "dmq.so"<br>
                              #modparam("dmq", "server_address", <a
                                moz-do-not-send="true">"sip:MY_IP_ADDRESS:MY_PORT_ADDRESS"</a>)<br>
                              modparam("dmq", "notification_address",
                              "DMQ_HOSTS")<br>
                              modparam("dmq", "multi_notify", 1)<br>
                              modparam("dmq", "num_workers", 4)<br>
                            </div>
                            <div><br>
                            </div>
                            <div><br>
                            </div>
                            <div>In the lab environment with the same
                              configuration that in prod, I can simulate
                              this problem with 12000 terminal REGISTERS
                              and, when doing several restarts on a
                              proxy, one of them is generated a
                              coredump. </div>
                            <div>Analyzing the core, I can see that the
                              problem is concurrency in the dmq
                              synchronization. </div>
                            <div><br>
                            </div>
                            <div>Job_queue_size (...) is called with a
                              valid <i>queue </i>and, but inside this
                              function, the <i>queue </i>is null.</div>
                            <div><br>
                            </div>
                            <div><br>
                            </div>
                            <div>(gdb) up<br>
                              #1  0x00007fefe58ee246 in job_queue_size
                              (queue=0x0) at worker.c:254<br>
                              254             return
                              atomic_get(&queue->count);<br>
                              (gdb) print queue<br>
                              $1 = (job_queue_t *) 0x0<br>
                              (gdb) up<br>
                              #2  0x00007fefe58ed920 in add_dmq_job
                              (msg=0x7ff028b453f8, peer=0x7fefebcc4df8)
                              at worker.c:184<br>
                              184                    
                              if(job_queue_size(workers[i].queue) == 0)
                              {<br>
                              (gdb) print i<br>
                              $2 = 1<br>
                              (gdb) print workers[i].queue<br>
                              $3 = (job_queue_t *) 0x7fefebce49b0<br>
                            </div>
                            <div><br>
                            </div>
                            <div>If I configure DMQ with  num_workers=1
                              I can't reproduce this problem.</div>
                            <div>I'm using the kamailio 5.0.8 release.</div>
                            <div><br>
                            </div>
                            <div>Is this problem known to you? What is
                              the right way to solve it?<br>
                            </div>
                            <div><br>
                            </div>
                            <div>Best Regards,<br>
                              Virgílio Cunha</div>
                          </div>
                          <br>
                          <fieldset></fieldset>
                          <pre>_______________________________________________
Kamailio (SER) - Users Mailing List
<a href="mailto:sr-users@lists.kamailio.org" target="_blank" moz-do-not-send="true">sr-users@lists.kamailio.org</a>
<a href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users" target="_blank" moz-do-not-send="true">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
                        </blockquote>
                        <pre cols="72">-- 
Daniel-Constantin Mierla -- <a href="http://www.asipto.com" target="_blank" moz-do-not-send="true">www.asipto.com</a>
<a href="http://www.twitter.com/miconda" target="_blank" moz-do-not-send="true">www.twitter.com/miconda</a> -- <a href="http://www.linkedin.com/in/miconda" target="_blank" moz-do-not-send="true">www.linkedin.com/in/miconda</a></pre>
                      </div>
                    </blockquote>
                  </div>
                </blockquote>
                <pre cols="72">-- 
Daniel-Constantin Mierla -- <a href="http://www.asipto.com" target="_blank" moz-do-not-send="true">www.asipto.com</a>
<a href="http://www.twitter.com/miconda" target="_blank" moz-do-not-send="true">www.twitter.com/miconda</a> -- <a href="http://www.linkedin.com/in/miconda" target="_blank" moz-do-not-send="true">www.linkedin.com/in/miconda</a></pre>
              </div>
            </blockquote>
          </div>
        </blockquote>
      </div>
    </blockquote>
    <pre class="moz-signature" cols="72">-- 
Daniel-Constantin Mierla -- <a class="moz-txt-link-abbreviated" href="http://www.asipto.com">www.asipto.com</a>
<a class="moz-txt-link-abbreviated" href="http://www.twitter.com/miconda">www.twitter.com/miconda</a> -- <a class="moz-txt-link-abbreviated" href="http://www.linkedin.com/in/miconda">www.linkedin.com/in/miconda</a></pre>
  </body>
</html>