[SR-Users] core dump error when running under docker

Daniel-Constantin Mierla miconda at gmail.com
Mon Nov 30 21:16:39 CET 2020


How did you compile kamailio? The binaries do not contain the debugging
symbols...

Cheers,
Daniel

On 30.11.20 16:38, Carlos Vicente wrote:
> I couldn't find any "-debug" packages, so I compiled the latest version:
>
> ```
> root at 348cbcfcb96c:~# /usr/local/sbin/kamailio -v
> version: kamailio 5.5.0-dev3 (arm/linux) d43163
> flags: USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS,
> DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MMAP, PKG_MALLOC, Q_MALLOC,
> F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX,
> FAST_LOCK-ADAPTIVE_WAIT-NOSMP, USE_DNS_CACHE, USE_DNS_FAILOVER,
> USE_NAPTR, USE_DST_BLOCKLIST, HAVE_RESOLV_RES, TLS_PTHREAD_MUTEX_SHARED
> ADAPTIVE_WAIT_LOOPS 1024, MAX_RECV_BUFFER_SIZE 262144, MAX_URI_SIZE
> 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB
> poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.
> id: d43163
> compiled on 15:17:51 Nov 30 2020 with gcc 9.3.0
> ```
>
> But still not symbols:
>
> ```
> root at 348cbcfcb96c:~# gdb /usr/local/sbin/kamailio /cores/core.kamailio.19
> GNU gdb (Ubuntu 9.2-0ubuntu1~20.04) 9.2
> Copyright (C) 2020 Free Software Foundation, Inc.
> License GPLv3+: GNU GPL version 3 or later
> <http://gnu.org/licenses/gpl.html <http://gnu.org/licenses/gpl.html>>
> This is free software: you are free to change and redistribute it.
> There is NO WARRANTY, to the extent permitted by law.
> Type "show copying" and "show warranty" for details.
> This GDB was configured as "arm-linux-gnueabihf".
> Type "show configuration" for configuration details.
> For bug reporting instructions, please see:
> <http://www.gnu.org/software/gdb/bugs/
> <http://www.gnu.org/software/gdb/bugs/>>.
> Find the GDB manual and other documentation resources online at:
>     <http://www.gnu.org/software/gdb/documentation/
> <http://www.gnu.org/software/gdb/documentation/>>.
>
> For help, type "help".
> Type "apropos word" to search for commands related to "word"...
> Reading symbols from /usr/local/sbin/kamailio...
> (No debugging symbols found in /usr/local/sbin/kamailio)
> [New LWP 19]
> [Thread debugging using libthread_db enabled]
> Using host libthread_db library
> "/lib/arm-linux-gnueabihf/libthread_db.so.1".
> Core was generated by `/usr/local/sbin/kamailio -f
> /etc/kamailio/kamailio.cfg -DD -E -d'.
> Program terminated with signal SIGILL, Illegal instruction.
> #0  0x00b06320 in tsl ()
> (gdb) bt full
> #0  0x00b06320 in tsl ()
> No symbol table info available.
> #1  0x00b06380 in get_lock ()
> No symbol table info available.
> #2  0x00b1979c in qm_shm_malloc ()
> No symbol table info available.
> #3  0x009504dc in ksr_shutdown_phase_init ()
> No symbol table info available.
> #4  0x0078e3f4 in main ()
> No symbol table info available.
> (gdb) quit
> ```
>
> TIA
>
> cv
>
>
> On Mon, Nov 30, 2020 at 9:33 AM Sergey Safarov <s.safarov at gmail.com
> <mailto:s.safarov at gmail.com>> wrote:
>
>     Are you compiled Kamailio from sources?
>
>     If compiled from sources or installed "debug" files then pelase
>     show output of "bt full" command.
>
>     On Mon, Nov 30, 2020 at 5:23 PM Carlos Vicente
>     <cvicente.lists at gmail.com <mailto:cvicente.lists at gmail.com>> wrote:
>
>         Daniel,
>
>         Thank you. That finally helped getting the core file written.
>         Here is the gdb output:
>
>         ```
>         root at 6e5c06e979cf:/# gdb /usr/sbin/kamailio
>         /cores/core.kamailio.207
>         GNU gdb (Ubuntu 9.2-0ubuntu1~20.04) 9.2
>         Copyright (C) 2020 Free Software Foundation, Inc.
>         License GPLv3+: GNU GPL version 3 or later
>         <http://gnu.org/licenses/gpl.html
>         <http://gnu.org/licenses/gpl.html>>
>         This is free software: you are free to change and redistribute it.
>         There is NO WARRANTY, to the extent permitted by law.
>         Type "show copying" and "show warranty" for details.
>         This GDB was configured as "arm-linux-gnueabihf".
>         Type "show configuration" for configuration details.
>         For bug reporting instructions, please see:
>         <http://www.gnu.org/software/gdb/bugs/
>         <http://www.gnu.org/software/gdb/bugs/>>.
>         Find the GDB manual and other documentation resources online at:
>             <http://www.gnu.org/software/gdb/documentation/
>         <http://www.gnu.org/software/gdb/documentation/>>.
>
>         For help, type "help".
>         Type "apropos word" to search for commands related to "word"...
>         Reading symbols from /usr/sbin/kamailio...
>         (No debugging symbols found in /usr/sbin/kamailio)
>         [New LWP 207]
>         [Thread debugging using libthread_db enabled]
>         Using host libthread_db library
>         "/lib/arm-linux-gnueabihf/libthread_db.so.1".
>         Core was generated by `/usr/sbin/kamailio -f
>         /etc/kamailio/kamailio.cfg -DD -E -ddd'.
>         Program terminated with signal SIGILL, Illegal instruction.
>         #0  0x007d9cb8 in qm_shm_malloc ()
>         (gdb) bt
>         #0  0x007d9cb8 in qm_shm_malloc ()
>         #1  0x0061a58c in init_atomic_ops ()
>         #2  0x00562508 in main ()
>         ```
>
>         What can be done about that?
>
>         cv
>
>         On Mon, Nov 30, 2020 at 4:29 AM Daniel-Constantin Mierla
>         <miconda at gmail.com <mailto:miconda at gmail.com>> wrote:
>
>             Maybe the hints on stackoverflow are also useful:
>
>               *
>             https://stackoverflow.com/questions/28335614/how-to-generate-core-file-in-docker-container
>             <https://stackoverflow.com/questions/28335614/how-to-generate-core-file-in-docker-container>
>
>             Cheers,
>             Daniel
>
>             On 29.11.20 14:23, Sergey Safarov wrote:
>>             you can change
>>             set args -f /etc/kamailio/kamailio.cfg -D -d -E
>>
>>             To
>>             set args -f /etc/kamailio/kamailio.cfg -DD -d -E
>>
>>             On Sun, Nov 29, 2020 at 4:14 PM Carlos Vicente
>>             <cvicente.lists at gmail.com
>>             <mailto:cvicente.lists at gmail.com>> wrote:
>>
>>                 Thank you for your response.
>>
>>                 I'm trying to run it under gdb but it's not doing
>>                 anything:
>>
>>                 ```
>>                 (gdb) exec-file /usr/sbin/kamailio
>>                 (gdb) set args -f /etc/kamailio/kamailio.cfg -D -d -E
>>                 (gdb) run
>>                 Starting program: /usr/sbin/kamailio -f
>>                 /etc/kamailio/kamailio.cfg -D -d -E
>>                 warning: Error disabling address space randomization:
>>                 Success
>>                 ```
>>
>>                 It just stops there. Am I missing something?
>>
>>                 cv
>>
>>                 On Sat, Nov 28, 2020 at 11:37 AM Sergey Safarov
>>                 <s.safarov at gmail.com <mailto:s.safarov at gmail.com>> wrote:
>>
>>                     You can start kamailio under GDB debugger.
>>                     When issue reproduced, then you can get stack
>>                     trace and variables values
>>
>>
>>                     сб, 28 нояб. 2020 г., 18:35 Carlos Vicente
>>                     <cvicente.lists at gmail.com
>>                     <mailto:cvicente.lists at gmail.com>>:
>>
>>                         Greetings,
>>
>>                         I'm having a "fun" time trying to run
>>                         Kamailio inside a Docker container. It keeps
>>                         failing with:
>>
>>                          0(238) DEBUG: <core> [core/mem/pkg.c:108]:
>>                         pkg_print_manager(): pkg - using memory
>>                         manager: q_malloc
>>                          0(238) DEBUG: <core> [core/mem/shm.c:300]:
>>                         shm_print_manager(): shm - using memory
>>                         manager: q_malloc
>>                         Illegal instruction (core dumped)
>>
>>                         Unfortunately the core dump is nowhere to be
>>                         found. I have tried to follow the
>>                         instructions at:
>>
>>                            
>>                         https://www.kamailio.org/wiki/tutorials/troubleshooting/coredumpfile
>>                         <https://www.kamailio.org/wiki/tutorials/troubleshooting/coredumpfile>
>>
>>                         but that hasn't helped.
>>
>>                         The environment is as follows:
>>
>>                         * Host hardware: Raspberry Pi 4 (4G memory)
>>                         * Host OS: Ubuntu 20.04.1 LTS
>>                         * Docker version 19.03.13
>>                         * Docker base image: arm32v7/ubuntu
>>
>>                         root at 2ef8a21534fa:/# kamailio -v
>>                         version: kamailio 5.3.2 (arm/linux)
>>                         flags: USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS,
>>                         USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST,
>>                         DNS_IP_HACK, SHM_MMAP, PKG_MALLOC, Q_MALLOC,
>>                         F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY,
>>                         USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT-NOSMP,
>>                         USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR,
>>                         USE_DST_BLACKLIST, HAVE_RESOLV_RES,
>>                         TLS_PTHREAD_MUTEX_SHARED
>>                         ADAPTIVE_WAIT_LOOPS 1024,
>>                         MAX_RECV_BUFFER_SIZE 262144, MAX_URI_SIZE
>>                         1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB
>>                         poll method support: poll, epoll_lt,
>>                         epoll_et, sigio_rt, select.
>>                         id: unknown
>>                         compiled with gcc 9.2.1
>>
>>                         The config file passes the syntax check:
>>
>>                             kamailio -c -f /etc/kamailio/kamailio.cfg
>>
>>                         and, the most interesting part, if I run
>>                         Kamailio on the host machine, _with the exact
>>                         same config file_, it runs fine.
>>
>>                         I'd appreciate any clues you may have. Thanks.
>>
>>                         cv
>>
>>
>>                         _______________________________________________
>>                         Kamailio (SER) - Users Mailing List
>>                         sr-users at lists.kamailio.org
>>                         <mailto:sr-users at lists.kamailio.org>
>>                         https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>                         <https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users>
>>
>>                     _______________________________________________
>>                     Kamailio (SER) - Users Mailing List
>>                     sr-users at lists.kamailio.org
>>                     <mailto:sr-users at lists.kamailio.org>
>>                     https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>                     <https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users>
>>
>>                 _______________________________________________
>>                 Kamailio (SER) - Users Mailing List
>>                 sr-users at lists.kamailio.org
>>                 <mailto:sr-users at lists.kamailio.org>
>>                 https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>>                 <https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users>
>>
>>
>>             _______________________________________________
>>             Kamailio (SER) - Users Mailing List
>>             sr-users at lists.kamailio.org <mailto:sr-users at lists.kamailio.org>
>>             https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users <https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users>
>
>             -- 
>             Daniel-Constantin Mierla -- www.asipto.com <http://www.asipto.com>
>             www.twitter.com/miconda <http://www.twitter.com/miconda> -- www.linkedin.com/in/miconda <http://www.linkedin.com/in/miconda>
>             Funding: https://www.paypal.me/dcmierla <https://www.paypal.me/dcmierla>
>
>             _______________________________________________
>             Kamailio (SER) - Users Mailing List
>             sr-users at lists.kamailio.org
>             <mailto:sr-users at lists.kamailio.org>
>             https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>             <https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users>
>
>         _______________________________________________
>         Kamailio (SER) - Users Mailing List
>         sr-users at lists.kamailio.org <mailto:sr-users at lists.kamailio.org>
>         https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>         <https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users>
>
>     _______________________________________________
>     Kamailio (SER) - Users Mailing List
>     sr-users at lists.kamailio.org <mailto:sr-users at lists.kamailio.org>
>     https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users
>     <https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users>
>
>
> _______________________________________________
> Kamailio (SER) - Users Mailing List
> sr-users at lists.kamailio.org
> https://lists.kamailio.org/cgi-bin/mailman/listinfo/sr-users

-- 
Daniel-Constantin Mierla -- www.asipto.com
www.twitter.com/miconda -- www.linkedin.com/in/miconda
Funding: https://www.paypal.me/dcmierla

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.kamailio.org/pipermail/sr-users/attachments/20201130/00ef8dee/attachment.htm>


More information about the sr-users mailing list