[SR-Users] core dump error when running under docker
Carlos Vicente
cvicente.lists at gmail.com
Mon Nov 30 16:38:42 CET 2020
I couldn't find any "-debug" packages, so I compiled the latest version:
```
root at 348cbcfcb96c:~# /usr/local/sbin/kamailio -v
version: kamailio 5.5.0-dev3 (arm/linux) d43163
flags: USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE,
USE_MCAST, DNS_IP_HACK, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC,
TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT-NOSMP,
USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLOCKLIST,
HAVE_RESOLV_RES, TLS_PTHREAD_MUTEX_SHARED
ADAPTIVE_WAIT_LOOPS 1024, MAX_RECV_BUFFER_SIZE 262144, MAX_URI_SIZE 1024,
BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB
poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.
id: d43163
compiled on 15:17:51 Nov 30 2020 with gcc 9.3.0
```
But still not symbols:
```
root at 348cbcfcb96c:~# gdb /usr/local/sbin/kamailio /cores/core.kamailio.19
GNU gdb (Ubuntu 9.2-0ubuntu1~20.04) 9.2
Copyright (C) 2020 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html
>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.
Type "show copying" and "show warranty" for details.
This GDB was configured as "arm-linux-gnueabihf".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /usr/local/sbin/kamailio...
(No debugging symbols found in /usr/local/sbin/kamailio)
[New LWP 19]
[Thread debugging using libthread_db enabled]
Using host libthread_db library
"/lib/arm-linux-gnueabihf/libthread_db.so.1".
Core was generated by `/usr/local/sbin/kamailio -f
/etc/kamailio/kamailio.cfg -DD -E -d'.
Program terminated with signal SIGILL, Illegal instruction.
#0 0x00b06320 in tsl ()
(gdb) bt full
#0 0x00b06320 in tsl ()
No symbol table info available.
#1 0x00b06380 in get_lock ()
No symbol table info available.
#2 0x00b1979c in qm_shm_malloc ()
No symbol table info available.
#3 0x009504dc in ksr_shutdown_phase_init ()
No symbol table info available.
#4 0x0078e3f4 in main ()
No symbol table info available.
(gdb) quit
```
TIA
cv
On Mon, Nov 30, 2020 at 9:33 AM Sergey Safarov <s.safarov at gmail.com> wrote:
> Are you compiled Kamailio from sources?
>
> If compiled from sources or installed "debug" files then pelase show
> output of "bt full" command.
>
> On Mon, Nov 30, 2020 at 5:23 PM Carlos Vicente <cvicente.lists at gmail.com>
> wrote:
>
>> Daniel,
>>
>> Thank you. That finally helped getting the core file written. Here is the
>> gdb output:
>>
>> ```
>> root at 6e5c06e979cf:/# gdb /usr/sbin/kamailio /cores/core.kamailio.207
>> GNU gdb (Ubuntu 9.2-0ubuntu1~20.04) 9.2
>> Copyright (C) 2020 Free Software Foundation, Inc.
>> License GPLv3+: GNU GPL version 3 or later <
>> http://gnu.org/licenses/gpl.html>
>> This is free software: you are free to change and redistribute it.
>> There is NO WARRANTY, to the extent permitted by law.
>> Type "show copying" and "show warranty" for details.
>> This GDB was configured as "arm-linux-gnueabihf".
>> Type "show configuration" for configuration details.
>> For bug reporting instructions, please see:
>> <http://www.gnu.org/software/gdb/bugs/>.
>> Find the GDB manual and other documentation resources online at:
>> <http://www.gnu.org/software/gdb/documentation/>.
>>
>> For help, type "help".
>> Type "apropos word" to search for commands related to "word"...
>> Reading symbols from /usr/sbin/kamailio...
>> (No debugging symbols found in /usr/sbin/kamailio)
>> [New LWP 207]
>> [Thread debugging using libthread_db enabled]
>> Using host libthread_db library
>> "/lib/arm-linux-gnueabihf/libthread_db.so.1".
>> Core was generated by `/usr/sbin/kamailio -f /etc/kamailio/kamailio.cfg
>> -DD -E -ddd'.
>> Program terminated with signal SIGILL, Illegal instruction.
>> #0 0x007d9cb8 in qm_shm_malloc ()
>> (gdb) bt
>> #0 0x007d9cb8 in qm_shm_malloc ()
>> #1 0x0061a58c in init_atomic_ops ()
>> #2 0x00562508 in main ()
>> ```
>>
>> What can be done about that?
>>
>> cv
>>
>> On Mon, Nov 30, 2020 at 4:29 AM Daniel-Constantin Mierla <
>> miconda at gmail.com> wrote:
>>
>>> Maybe the hints on stackoverflow are also useful:
>>>
>>> *
>>> https://stackoverflow.com/questions/28335614/how-to-generate-core-file-in-docker-container
>>>
>>> Cheers,
>>> Daniel
>>> On 29.11.20 14:23, Sergey Safarov wrote:
>>>
>>> you can change
>>> set args -f /etc/kamailio/kamailio.cfg -D -d -E
>>>
>>> To
>>> set args -f /etc/kamailio/kamailio.cfg -DD -d -E
>>>
>>> On Sun, Nov 29, 2020 at 4:14 PM Carlos Vicente <cvicente.lists at gmail.com>
>>> wrote:
>>>
>>>> Thank you for your response.
>>>>
>>>> I'm trying to run it under gdb but it's not doing anything:
>>>>
>>>> ```
>>>> (gdb) exec-file /usr/sbin/kamailio
>>>> (gdb) set args -f /etc/kamailio/kamailio.cfg -D -d -E
>>>> (gdb) run
>>>> Starting program: /usr/sbin/kamailio -f /etc/kamailio/kamailio.cfg -D
>>>> -d -E
>>>> warning: Error disabling address space randomization: Success
>>>> ```
>>>>
>>>> It just stops there. Am I missing something?
>>>>
>>>> cv
>>>>
>>>> On Sat, Nov 28, 2020 at 11:37 AM Sergey Safarov <s.safarov at gmail.com>
>>>> wrote:
>>>>
>>>>> You can start kamailio under GDB debugger.
>>>>> When issue reproduced, then you can get stack trace and variables
>>>>> values
>>>>>
>>>>>
>>>>> сб, 28 нояб. 2020 г., 18:35 Carlos Vicente <cvicente.lists at gmail.com>:
>>>>>
>>>>>> Greetings,
>>>>>>
>>>>>> I'm having a "fun" time trying to run Kamailio inside a Docker
>>>>>> container. It keeps failing with:
>>>>>>
>>>>>> 0(238) DEBUG: <core> [core/mem/pkg.c:108]: pkg_print_manager(): pkg
>>>>>> - using memory manager: q_malloc
>>>>>> 0(238) DEBUG: <core> [core/mem/shm.c:300]: shm_print_manager(): shm
>>>>>> - using memory manager: q_malloc
>>>>>> Illegal instruction (core dumped)
>>>>>>
>>>>>> Unfortunately the core dump is nowhere to be found. I have tried to
>>>>>> follow the instructions at:
>>>>>>
>>>>>>
>>>>>> https://www.kamailio.org/wiki/tutorials/troubleshooting/coredumpfile
>>>>>>
>>>>>> but that hasn't helped.
>>>>>>
>>>>>> The environment is as follows:
>>>>>>
>>>>>> * Host hardware: Raspberry Pi 4 (4G memory)
>>>>>> * Host OS: Ubuntu 20.04.1 LTS
>>>>>> * Docker version 19.03.13
>>>>>> * Docker base image: arm32v7/ubuntu
>>>>>>
>>>>>> root at 2ef8a21534fa:/# kamailio -v
>>>>>> version: kamailio 5.3.2 (arm/linux)
>>>>>> flags: USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS,
>>>>>> DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MMAP, PKG_MALLOC, Q_MALLOC,
>>>>>> F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX,
>>>>>> FAST_LOCK-ADAPTIVE_WAIT-NOSMP, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR,
>>>>>> USE_DST_BLACKLIST, HAVE_RESOLV_RES, TLS_PTHREAD_MUTEX_SHARED
>>>>>> ADAPTIVE_WAIT_LOOPS 1024, MAX_RECV_BUFFER_SIZE 262144, MAX_URI_SIZE
>>>>>> 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB
>>>>>> poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.
>>>>>> id: unknown
>>>>>> compiled with gcc 9.2.1
>>>>>>
>>>>>> The config file passes the syntax check:
>>>>>>
>>>>>> kamailio -c -f /etc/kamailio/kamailio.cfg
>>>>>>
>>>>>> and, the most interesting part, if I run Kamailio on the host
>>>>>> machine, _with the exact same config file_, it runs fine.
>>>>>>
>>>>>> I'd appreciate any clues you may have. Thanks.
>>>>>>
>>>>>> cv
>>>>>>
>>>>>>
>>>>>> _______________________________________________
>>>>>> Kamailio (SER) - Users Mailing List
>>>>>> sr-users at lists.kamailio.org
>>>>>> https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>>>>>
>>>>> _______________________________________________
>>>>> Kamailio (SER) - Users Mailing List
>>>>> sr-users at lists.kamailio.org
>>>>> https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>>>>
>>>> _______________________________________________
>>>> Kamailio (SER) - Users Mailing List
>>>> sr-users at lists.kamailio.org
>>>> https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>>>
>>>
>>> _______________________________________________
>>> Kamailio (SER) - Users Mailing Listsr-users at lists.kamailio.orghttps://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>>
>>> --
>>> Daniel-Constantin Mierla -- www.asipto.comwww.twitter.com/miconda -- www.linkedin.com/in/miconda
>>> Funding: https://www.paypal.me/dcmierla
>>>
>>> _______________________________________________
>>> Kamailio (SER) - Users Mailing List
>>> sr-users at lists.kamailio.org
>>> https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>>
>> _______________________________________________
>> Kamailio (SER) - Users Mailing List
>> sr-users at lists.kamailio.org
>> https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>
> _______________________________________________
> Kamailio (SER) - Users Mailing List
> sr-users at lists.kamailio.org
> https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.kamailio.org/pipermail/sr-users/attachments/20201130/407b3809/attachment.htm>
More information about the sr-users
mailing list