<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
</head>
<body text="#000000" bgcolor="#FFFFFF">
<p>Hello,</p>
<p>the crash exposed by the backtrace sent here is from shut down
procedure. If there was a crash, then it happened earlier and you
have to enable core dumps per process/pid in order to get more
core files, one of them should have the crash at runtime. The one
at shutdown might be a side effect of the one at runtime, or can
be independent of it. But first needs to be sorted out the one at
runtime.</p>
<p>See more details about core files per process/pid at:</p>
<p> - <a
href="https://www.kamailio.org/wiki/tutorials/troubleshooting/coredumpfile">https://www.kamailio.org/wiki/tutorials/troubleshooting/coredumpfile</a></p>
<div class="moz-cite-prefix">Reproduce and sent the backtraces from
all dumped corefiles.</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">Cheers,<br>
Daniel</div>
<div class="moz-cite-prefix"><br>
</div>
<div class="moz-cite-prefix">On 14.09.19 16:36, Henning Westerholt
wrote:<br>
</div>
<blockquote type="cite"
cite="mid:2d185756-b313-126f-c46f-2174eec8efb9@skalatan.de">
<meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
<p>Hello David,</p>
<p>strange. Do you have a timer in the msilo module configured
that is executed every 20s?</p>
<p>About the core dump - this looks like the kamailio is already
shutting down from some earlier error. The crash is not in the
msilo code but in the tsilo code.
<br>
</p>
<p>Can you print the value of urecord in frame 0?<br>
</p>
<p>Cheers,</p>
<p>Henning<br>
</p>
<div class="moz-cite-prefix">Am 14.09.19 um 15:45 schrieb David
Villasmil:<br>
</div>
<blockquote type="cite"
cite="mid:CAFGRPVq2jCWKeTZGKOZkufGkHV8ravLW+DU3zdOS-wdB-69tpg@mail.gmail.com">
<div dir="ltr">bt full:
<div><font face="monospace"><br>
</font></div>
<div><font face="monospace"><br>
root@<a class="moz-txt-link-freetext" href="sip:/home/carlos#">sip:/home/carlos#</a> gdb
/usr/local/kamailio5/sbin/kamailio
/usr/local/kamailio5/sbin/core<br>
GNU gdb (Debian 7.7.1+dfsg-5) 7.7.1<br>
Copyright (C) 2014 Free Software Foundation, Inc.<br>
License GPLv3+: GNU GPL version 3 or later <<a
href="http://gnu.org/licenses/gpl.html"
moz-do-not-send="true">http://gnu.org/licenses/gpl.html</a>><br>
This is free software: you are free to change and
redistribute it.<br>
There is NO WARRANTY, to the extent permitted by law.
Type "show copying"<br>
and "show warranty" for details.<br>
This GDB was configured as "x86_64-linux-gnu".<br>
Type "show configuration" for configuration details.<br>
For bug reporting instructions, please see:<br>
<<a href="http://www.gnu.org/software/gdb/bugs/"
moz-do-not-send="true">http://www.gnu.org/software/gdb/bugs/</a>>.<br>
Find the GDB manual and other documentation resources
online at:<br>
<<a
href="http://www.gnu.org/software/gdb/documentation/"
moz-do-not-send="true">http://www.gnu.org/software/gdb/documentation/</a>>.<br>
For help, type "help".<br>
Type "apropos word" to search for commands related to
"word"...<br>
Reading symbols from
/usr/local/kamailio5/sbin/kamailio...done.<br>
[New LWP 22299]<br>
[Thread debugging using libthread_db enabled]<br>
Using host libthread_db library
"/lib/x86_64-linux-gnu/libthread_db.so.1".<br>
Core was generated by `/usr/local/kamailio5/sbin/kamailio
-f /usr/local/kamailio5/etc/kamailio/kamaili'.<br>
Program terminated with signal SIGSEGV, Segmentation
fault.<br>
#0 0x00007f32cd989140 in free_ts_urecord
(urecord=0x7f328e347270) at ts_hash.c:54<br>
54 urecord->transactions =
urecord->transactions->next;<br>
(gdb) bt<br>
#0 0x00007f32cd989140 in free_ts_urecord
(urecord=0x7f328e347270) at ts_hash.c:54<br>
#1 0x00007f32cd989e9d in destroy_ts_table () at
ts_hash.c:145<br>
#2 0x00007f32cd9920d4 in destroy () at tsilo.c:193<br>
#3 0x000000000051af99 in destroy_modules () at
core/sr_module.c:811<br>
#4 0x0000000000418199 in cleanup (show_status=1) at
main.c:529<br>
#5 0x0000000000419817 in shutdown_children (sig=15,
show_status=1) at main.c:671<br>
#6 0x000000000041c1de in handle_sigs () at main.c:763<br>
#7 0x0000000000423ddd in main_loop () at main.c:1751<br>
#8 0x0000000000429a61 in main (argc=13,
argv=0x7fff1d3773f8) at main.c:2639</font></div>
<div><font face="monospace"><br>
</font></div>
<div><font face="monospace"><br>
</font></div>
<div><font face="monospace"><br>
(gdb) bt full<br>
#0 0x00007f32cd989140 in free_ts_urecord
(urecord=0x7f328e347270) at ts_hash.c:54<br>
__FUNCTION__ = "free_ts_urecord"<br>
ptr = 0x72743b3536323831<br>
#1 0x00007f32cd989e9d in destroy_ts_table () at
ts_hash.c:145<br>
ts_u = 0x7f3200000023<br>
l_ts_u = 0x7f328e347270<br>
i = 7<br>
__FUNCTION__ = "destroy_ts_table"<br>
#2 0x00007f32cd9920d4 in destroy () at tsilo.c:193<br>
No locals.<br>
#3 0x000000000051af99 in destroy_modules () at
core/sr_module.c:811<br>
t = 0x7f32d68eb248<br>
foo = 0x7f32d68eaa18<br>
__FUNCTION__ = "destroy_modules"<br>
#4 0x0000000000418199 in cleanup (show_status=1) at
main.c:529<br>
memlog = 16711680<br>
__FUNCTION__ = "cleanup"<br>
#5 0x0000000000419817 in shutdown_children (sig=15,
show_status=1) at main.c:671<br>
__FUNCTION__ = "shutdown_children"<br>
#6 0x000000000041c1de in handle_sigs () at main.c:763<br>
chld = 0<br>
chld_status = 139<br>
memlog = 4291896<br>
__FUNCTION__ = "handle_sigs"<br>
#7 0x0000000000423ddd in main_loop () at main.c:1751<br>
i = 8<br>
pid = 22340<br>
si = 0x0<br>
si_desc = "udp receiver child=7 sock=<a
href="http://169.239.137.3:5060" moz-do-not-send="true">169.239.137.3:5060</a>\000\b\000\000P\335ό\001\000\000\000\300\244\244\214\062\177\000\000\220p7\035\377\177\000\000\372\071d\000\000\000\000\000PxA\000\000\000\000\000\350R\237\326\062\177",
'\000' <repeats 14 times>,
"\001\000\000\000\340p7\035\377\177\000\000I\273d\000\000\000\000"<br>
nrprocs = 8<br>
woneinit = 1<br>
__FUNCTION__ = "main_loop"<br>
#8 0x0000000000429a61 in main (argc=13,
argv=0x7fff1d3773f8) at main.c:2639<br>
cfg_stream = 0x202a010<br>
c = -1<br>
r = 0<br>
tmp = 0x7fff1d3788bf ""<br>
tmp_len = 0<br>
port = 1<br>
proto = 32562<br>
options = 0x72b100
":f:cm:M:dVIhEeb:l:L:n:vKrRDTN:W:w:t:u:g:P:G:SQ:O:a:A:x:X:Y:"<br>
ret = -1<br>
seed = 1981610615<br>
rfd = 4<br>
debug_save = 0<br>
debug_flag = 0<br>
dont_fork_cnt = 0<br>
n_lst = 0x7fff1d3772b0<br>
p = 0x7fff1d377468 "\361\210\067\035\377\177"<br>
st = {st_dev = 15, st_ino = 10098, st_nlink = 2,
st_mode = 16832, st_uid = 0, st_gid = 0, __pad0 = 0,
st_rdev = 0, st_size = 80, st_blksize = 4096, st_blocks =
0, st_atim = {tv_sec = 1568455518, tv_nsec = 802350062},
st_mtim = {<br>
tv_sec = 1568457084, tv_nsec = 898346157},
st_ctim = {tv_sec = 1568457084, tv_nsec = 898346157},
__glibc_reserved = {0, 0, 0}}<br>
__FUNCTION__ = "main"<br>
(gdb) </font></div>
<div><br>
</div>
<div><br clear="all">
<div>
<div dir="ltr" class="gmail_signature"
data-smartmail="gmail_signature">
<div dir="ltr">
<div>Regards,</div>
<div><br>
</div>
David Villasmil
<div>email: <a
href="mailto:david.villasmil.work@gmail.com"
target="_blank" moz-do-not-send="true">
david.villasmil.work@gmail.com</a></div>
<div>phone: +34669448337</div>
</div>
</div>
</div>
<br>
</div>
</div>
<br>
<div class="gmail_quote">
<div dir="ltr" class="gmail_attr">On Sat, Sep 14, 2019 at 2:35
PM David Villasmil <<a
href="mailto:david.villasmil.work@gmail.com"
moz-do-not-send="true">david.villasmil.work@gmail.com</a>>
wrote:<br>
</div>
<blockquote class="gmail_quote" style="margin:0px 0px 0px
0.8ex;border-left:1px solid
rgb(204,204,204);padding-left:1ex">
<div dir="ltr">Hello guys,
<div><br>
</div>
<div>i've got a kamailo:</div>
<div><br>
</div>
<div>version: kamailio 5.0.0 (x86_64/linux)<br>
flags: STATS: Off, USE_TCP, USE_TLS, USE_SCTP,
TLS_HOOKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK,
SHM_MEM, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC,
TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX,
FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE,
USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST,
HAVE_RESOLV_RES<br>
ADAPTIVE_WAIT_LOOPS=1024, MAX_RECV_BUFFER_SIZE 262144,
MAX_LISTEN 16, MAX_URI_SIZE 1024, BUF_SIZE 65535,
DEFAULT PKG_SIZE 8MB<br>
poll method support: poll, epoll_lt, epoll_et, sigio_rt,
select.<br>
id: unknown<br>
compiled on 19:50:58 Mar 28 2017 with gcc 4.9.2<br>
</div>
<div><br>
</div>
<div>which was core dumping every 20 seconds and we had no
idea why.</div>
<div>We emptied out the silo table, which had:</div>
<div><br>
</div>
<div>mysql> select count(*) from silobackup;<br>
+----------+<br>
| count(*) |<br>
+----------+<br>
| 5240 |<br>
+----------+<br>
</div>
<div><br>
</div>
<div>records.</div>
<div>Once we truncated it, kamailio started working again.</div>
<div><br>
</div>
<div>Is there a limit to how many records msilo can
handle?</div>
<div><br>
</div>
<div>I will look into the data in the table, but in case
there's a limit, i'd like to know.</div>
<div><br>
</div>
<div>core available on request.</div>
<div><br>
</div>
<div>Thanks</div>
<div><br clear="all">
<div>
<div dir="ltr"
class="gmail-m_1785931820911374184gmail_signature">
<div dir="ltr">
<div>Regards,</div>
<div><br>
</div>
David Villasmil
<div>email: <a
href="mailto:david.villasmil.work@gmail.com"
target="_blank" moz-do-not-send="true">
david.villasmil.work@gmail.com</a></div>
<div>phone: +34669448337</div>
</div>
</div>
</div>
</div>
</div>
</blockquote>
</div>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Kamailio (SER) - Users Mailing List
<a class="moz-txt-link-abbreviated" href="mailto:sr-users@lists.kamailio.org" moz-do-not-send="true">sr-users@lists.kamailio.org</a>
<a class="moz-txt-link-freetext" href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users" moz-do-not-send="true">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
</blockquote>
<pre class="moz-signature" cols="72">--
Henning Westerholt - <a class="moz-txt-link-freetext" href="https://skalatan.de/blog/" moz-do-not-send="true">https://skalatan.de/blog/</a>
Kamailio services - <a class="moz-txt-link-freetext" href="https://skalatan.de/services" moz-do-not-send="true">https://skalatan.de/services</a></pre>
<br>
<fieldset class="mimeAttachmentHeader"></fieldset>
<pre class="moz-quote-pre" wrap="">_______________________________________________
Kamailio (SER) - Users Mailing List
<a class="moz-txt-link-abbreviated" href="mailto:sr-users@lists.kamailio.org">sr-users@lists.kamailio.org</a>
<a class="moz-txt-link-freetext" href="https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users">https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users</a>
</pre>
</blockquote>
<pre class="moz-signature" cols="72">--
Daniel-Constantin Mierla -- <a class="moz-txt-link-abbreviated" href="http://www.asipto.com">www.asipto.com</a>
<a class="moz-txt-link-abbreviated" href="http://www.twitter.com/miconda">www.twitter.com/miconda</a> -- <a class="moz-txt-link-abbreviated" href="http://www.linkedin.com/in/miconda">www.linkedin.com/in/miconda</a>
Kamailio Advanced Training, Oct 21-23, 2019, Berlin, Germany -- <a class="moz-txt-link-freetext" href="https://asipto.com/u/kat">https://asipto.com/u/kat</a></pre>
</body>
</html>