<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body>
<p>Hello,</p>
<p>can you open a bug on the github issue tracker, almost forgot
about it and with some things that popped up and the lockdown
specific tasks, I can't say if I can look at them today or
tomorrow and then I may forget again. Having it on tracker is
easier to spot it. You can add a link to mailing list archive
there to jump to this discussion for details.<br>
</p>
<p>Cheers,<br>
Daniel<br>
</p>
<div class="moz-cite-prefix">On 08.05.20 21:13, Ilie Soltanici
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:CAJQ6-U3OFa5Ls7p1Chxh=TEj5wfAButi-gF_SaoHiPGr_E=_2A@mail.gmail.com">
<meta http-equiv="content-type" content="text/html; charset=UTF-8">
<div dir="ltr">
<div>Daniel,</div>
<div><br>
</div>
<div>There are 2 core dump files. Please see attached full back
trace from both files.</div>
<div>Thanks<br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">În vin., 8 mai 2020 la 19:53,
Daniel-Constantin Mierla <<a
href="mailto:miconda@gmail.com" moz-do-not-send="true">miconda@gmail.com</a>>
a scris:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex">
<div>
<p>Hello,</p>
<p>you have to provide the full output of gdb command from
the core file:</p>
<p>bt full</p>
<p>To see the entire execution stack that cause the crash.</p>
<p>Cheers,<br>
Daniel<br>
</p>
<div>On 08.05.20 19:09, Ilie Soltanici wrote:<br>
</div>
<blockquote type="cite">
<div dir="ltr">
<div>Hello,</div>
I'm trying to replicate a hash table to another 2 nodes
by using DMQ Module. That's the related configuration:<br>
<div><br>
</div>
<div>loadmodule "tm.so"</div>
loadmodule "tmx.so"<br>
loadmodule "dialog.so"<br>
loadmodule "dmq.so"<br>
<div>loadmodule "htable.so"</div>
<div><br>
</div>
<div>modparam("dmq", "server_address", <a
moz-do-not-send="true">"sip:MY_INTERNAL_IP_ADDR:5062"</a>)</div>
modparam("dmq", "notification_address", <a
moz-do-not-send="true">"sip:dmq.domain.local:5062"</a>)<br>
modparam("dmq", "multi_notify", 1)<br>
modparam("dmq", "num_workers", 4)<br>
<div>modparam("dmq", "ping_interval", 90)</div>
<div><br>
</div>
<div>modparam("htable", "enable_dmq", 1)<br>
modparam("htable", "dmq_init_sync", 1)<br>
modparam("htable", "htable",
"test=>size=10;initval=0;dmqreplicate=1;")</div>
<div><br>
</div>
<div> if(is_method("KDMQ")) {<br>
dmq_handle_message();<br>
exit;<br>
}</div>
<div><br>
</div>
<div>After starting Kamailio - everything seems to be
working fine, Kamailio is able to discover other nodes
and replications is working fine, until after a few
minutes I'm getting such errors in the Kamailio Log
file:</div>
<div><br>
</div>
<div>May 8 17:14:26 kamailio kamailio[28064]: CRITICAL:
<core> [core/mem/q_malloc.c:521]: qm_free():
BUG: freeing already freed pointer (0x7f0ac62493e0),
called from dialog: dlg_var.c:
free_local_varlist(145), first free dialog: dlg_var.c:
set_dlg_variable_unsafe(205) - ignoring</div>
<div><br>
</div>
<div>Then, if I'm getting any SIP messages from any
Device - Kamailio is crashing with the following info
in the log file:</div>
<div><br>
</div>
<div>May 8 16:03:19 kamailio kam[10963]: CRITICAL:
{REGISTER (1) | Seq=45534 | Source IP=192.168.1.5
(tcp) | Call ID=Kyb-KJjf.U9ttdOwQNYu6mUWCKb2bvk7}
<core> [core/mem/q_malloc.c:150]:
qm_debug_check_frag(): BUG: qm: prev. fragm. tail
overwritten(0, 0)[0x7f62cc746a10:0x7f62cc746a48]!<br>
Memory allocator was called from dialog:
dlg_var.c:147. Fragment marked by dialog:
dlg_var.c:108. Exec from core/mem/q_malloc.c:511.</div>
<div>May 8 16:03:21 kamailio kam[10966]: CRITICAL:
<core> [core/pass_fd.c:277]: receive_fd(): EOF
on 59<br>
May 8 16:03:21 kamailio kam[10966]: DEBUG:
<core> [core/tcp_main.c:3825]:
handle_ser_child(): dead child 37, pid 10963 (shutting
down?)<br>
May 8 16:03:21 kamailio kam[10966]: DEBUG:
<core> [core/io_wait.h:599]: io_watch_del():
DBG: io_watch_del (0xa9e1c0, 59, -1, 0x0) fd_no=48
called<br>
May 8 16:03:21 kamailio kam[10966]: DEBUG:
<core> [core/tcp_main.c:3593]:
handle_tcp_child(): dead tcp child 1 (pid 10963, no
37) (shutting down?)<br>
May 8 16:03:21 kamailio kam[10966]: DEBUG:
<core> [core/io_wait.h:599]: io_watch_del():
DBG: io_watch_del (0xa9e1c0, 62, -1, 0x0) fd_no=47
called<br>
May 8 16:03:21 kamailio kam[10919]: ALERT:
<core> [main.c:767]: handle_sigs(): child
process 10963 exited by a signal 6<br>
May 8 16:03:21 kamailio kam[10919]: ALERT:
<core> [main.c:770]: handle_sigs(): core was
generated<br>
May 8 16:03:21 kamailio kam[10919]: INFO:
<core> [main.c:792]: handle_sigs(): terminating
due to SIGCHLD<br>
May 8 16:03:21 kamailio kam[10919]: DEBUG:
<core> [main.c:794]: handle_sigs(): terminating
due to SIGCHLD<br>
May 8 16:03:21 kamailio kam[10966]: INFO:
<core> [main.c:847]: sig_usr(): signal 15
received</div>
<div><br>
</div>
<div><br>
</div>
<div>This is what i got from the dump core file:</div>
<div><br>
</div>
<div>uri = {user = {s = 0x3 <Address 0x3 out of
bounds>, len = -264573566}, passwd = {s = 0x788
<Address 0x788 out of bounds>, len = 8208}, host
= {s = 0x393100000000 <Address 0x393100000000 out
of bounds>, len = 1588950199}, port = {s = 0x2
<Address 0x2 out of bounds>,<br>
len = 24086112}, params = {s =
0x7ffcbb1600c0 "\200", len = -261173312}, sip_params =
{s = 0x7ffcbb1601a8 "\300\317n\360b\177", len =
24086112}, headers = {s = 0x0, len = -261173312},
port_no = 424, proto = 47894, type = 32764,<br>
flags = (URI_SIP_USER_PHONE | unknown:
4031456108), transport = {<br>
s = 0x16f88cc "16:03:19 kamailio[10963]:
CRITICAL: {REGISTER (1) | Seq=45534 | Source
IP=192.168.1.5 (tcp) | Call
ID=Kyb-KJjf.U9ttdOwQNYu6mUWCKb2bvk7} <core>
[core/mem/q_malloc.c:150]: qm_debug_check_frag(): BUG:
qm: pr"..., len = -261163168}, ttl = {<br>
s = 0x8 <Address 0x8 out of bounds>,
len = -263517049}, user_param = {<br>
s = 0x16f88cc "16:03:19 kamailio[10963]:
CRITICAL: {REGISTER (1) | Seq=45534 | Source
IP=192.168.1.5 (tcp) | Call
ID=Kyb-KJjf.U9ttdOwQNYu6mUWCKb2bvk7} <core>
[core/mem/q_malloc.c:150]: qm_debug_check_frag(): BUG:
qm: pr"..., len = -264350686}, maddr = {<br>
s = 0x3336393031000080 <Address
0x3336393031000080 out of bounds>, len = 8187},
method = {s = 0x0, len = 24086112}, lr = {s = 0x820ce8
"%s: %s%s(): cseq <%.*s>: <%.*s>
<%.*s>\n", len = -1156185384}, r2 = {s = 0xb
<Address 0xb out of bounds>, len = 21}, gr = {<br>
s = 0xffffffff <Address 0xffffffff out
of bounds>, len = -264780793}, transport_val = {s =
0x1ff4 <Address 0x1ff4 out of bounds>, len =
24086720}, ttl_val = {s = 0x7f62f06f0760
<main_arena> "", len = 128}, user_param_val = {s
= 0x16f88b0 "`\002", len = 144},<br>
maddr_val = {s = 0x15 <Address 0x15 out
of bounds>, len = -264573566}, method_val = {s =
0x788 <Address 0x788 out of bounds>, len =
8208}, lr_val = {s = 0x0, len = 1588950199}, r2_val =
{s = 0x2 <Address 0x2 out of bounds>, len =
24086112}, gr_val = {<br>
s = 0x7ffcbb1601f0 "\006", len =
-261173312}}<br>
next_hop = {user = {s = 0x0, len = 0}, passwd
= {s = 0x0, len = 0}, host = {s = 0x7f62f06eef20
<_nl_C_LC_NUMERIC+32> "", len = 0}, port = {s =
0x0, len = 0}, params = {s = 0x7f620000000b
<Address 0x7f620000000b out of bounds>, len =
0}, sip_params = {<br>
s = 0x7f62f03762cd <vfprintf+19661>
"\200\275\360\372\377\377", len = 0}, headers = {s =
0x0, len = -1}, port_no = 25293, proto = 61495, type =
32610, flags = (URI_USER_NORMALIZE |
URI_SIP_USER_PHONE), transport = {s = 0x7ffcbb160038
"\267t\265^", len = 24086112},<br>
ttl = {s = 0xffffffff <Address 0xffffffff
out of bounds>, len = 0}, user_param = {s =
0x7d62e8 "%s: %.*s%s%s(): preparing to run routing
scripts...\n", len = 11}, maddr = {s = 0xbd
<Address 0xbd out of bounds>, len = 3440},
method = {s = 0x7d631c "", len = -263511186},<br>
lr = {s = 0x16f88cc "16:03:19
kamailio[10963]: CRITICAL: {REGISTER (1) | Seq=45534 |
Source IP=192.168.1.5 (tcp) | Call
ID=Kyb-KJjf.U9ttdOwQNYu6mUWCKb2bvk7} <core>
[core/mem/q_malloc.c:150]: qm_debug_check_frag(): BUG:
qm: pr"..., len = -261163168}, r2 = {<br>
s = 0x8 <Address 0x8 out of bounds>,
len = -263517049}, gr = {<br>
s = 0x16f88cc "16:03:19 kamailio[10963]:
CRITICAL: {REGISTER (1) | Seq=45534 | Source
IP=192.168.1.5 (tcp) | Call
ID=Kyb-KJjf.U9ttdOwQNYu6mUWCKb2bvk7} <core>
[core/mem/q_malloc.c:150]: qm_debug_check_frag(): BUG:
qm: pr"..., len = -264350686}, transport_val = {<br>
s = 0x7d62ef "s%s%s(): preparing to run
routing scripts...\n", len = 8187}, ttl_val = {s =
0x0, len = -264345823}, user_param_val = {s =
0x3000000010 <Address 0x3000000010 out of
bounds>, len = -1156184608}, maddr_val = {<br>
s = 0x7ffcbb160520
"\341+:\213'H\027\203\341+\342ޙ>\356|", len = 21},
method_val = {s = 0x7ffcbb160250 "\023", len =
-1156186080}, lr_val = {s = 0x7f62f06eef80
<_nl_C_LC_TIME> "r\036K\360b\177", len =
-1156185648}, r2_val = {s = 0x17ff710 "IST", len =
-1156186048},<br>
gr_val = {s = 0x0, len = -1156186058}}<br>
u = 0x400001ff4</div>
<div><br>
</div>
<div>By disabling DMQ Module i haven't noticed any
crashes or issues like that, so i suppose that
Kamailio is crashing because of this module, but i can
be wrong. I've tried with 2 versions of Kamailio
(5.2.6 and 5.3.4), both of them having the same issue.</div>
<div><br>
</div>
<div>Thanks<br>
</div>
<div><br>
</div>
</div>
<br>
<fieldset></fieldset>
<pre>_______________________________________________
Kamailio (SER) - Users Mailing List
<a href="mailto:sr-users@lists.kamailio.org" target="_blank" moz-do-not-send="true">sr-users@lists.kamailio.org</a>
<a href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users" target="_blank" moz-do-not-send="true">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
</blockquote>
<pre cols="72">--
Daniel-Constantin Mierla -- <a href="http://www.asipto.com" target="_blank" moz-do-not-send="true">www.asipto.com</a>
<a href="http://www.twitter.com/miconda" target="_blank" moz-do-not-send="true">www.twitter.com/miconda</a> -- <a href="http://www.linkedin.com/in/miconda" target="_blank" moz-do-not-send="true">www.linkedin.com/in/miconda</a>
Funding: <a href="https://www.paypal.me/dcmierla" target="_blank" moz-do-not-send="true">https://www.paypal.me/dcmierla</a></pre>
</div>
</blockquote>
</div>
</blockquote>
<pre class="moz-signature" cols="72">--
Daniel-Constantin Mierla -- <a class="moz-txt-link-abbreviated" href="http://www.asipto.com">www.asipto.com</a>
<a class="moz-txt-link-abbreviated" href="http://www.twitter.com/miconda">www.twitter.com/miconda</a> -- <a class="moz-txt-link-abbreviated" href="http://www.linkedin.com/in/miconda">www.linkedin.com/in/miconda</a>
Funding: <a class="moz-txt-link-freetext" href="https://www.paypal.me/dcmierla">https://www.paypal.me/dcmierla</a></pre>
</body>
</html>