The pid 6979 is the main process here (being the one handling the signals according to the log), not doing anything at runtime, so it doesn't crash at runtime. The last error is because of the cleanup it tried to do, which can happen if another process was doing a cleanup of the structure but didn't finish because it was killed by main process.
The reason for crash should before the message with "Thank you for flying ..." -- can you check if you get other relevant log messages before it?
Cheers, Daniel
On 30/03/15 21:40, Alex Balashov wrote:
I just encountered another crash with a truncated core dump which was useless, but I did receive this log output:
Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6979]: NOTICE: <core> [main.c:739]: handle_sigs(): Thank you for flying kamailio!!! Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7009]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7007]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7004]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7006]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7000]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6980]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7008]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6998]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7005]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6984]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6989]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7003]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6988]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7002]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[7001]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6999]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6992]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6994]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6981]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6993]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6991]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6990]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6987]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6982]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6995]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6997]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6996]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6985]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6986]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6983]: INFO: <core> [main.c:850]: sig_usr(): signal 15 received Mar 30 18:32:04 Proxy1 /usr/local/sbin/kamailio[6979]: : <core> [mem/f_malloc.c:586]: fm_free(): BUG: fm_free: bad pointer 0x4c36294300000000 (out of memory block!), called from tm: h_table.c: free_cell(162) - aborting
Any interpretation here? Is this an OOM error? I have given Kamailio 8 GB of SHM; that ought to be enough for anyone, right?