BT2 ``` #0 __strlen_avx2 () at ../sysdeps/x86_64/multiarch/strlen-avx2.S:74 #1 0x00007fa59a91e228 in __vfprintf_internal (s=s@entry=0xf78980, format=format@entry=0x881ca0 "%s: %.*s%s%s%sBUG: qm: fragm. %p (address %p) beginning overwritten (%lx)! Memory allocator was called from %s:%u. Fragment marked by %s:%lu. Exec from %s:%u.\n", ap=ap@entry=0x7ffe4cbb4210, mode_flags=mode_flags@entry=0) at vfprintf-internal.c:1647 #2 0x00007fa59a9e1c4a in __vsyslog_internal (pri=<optimized out>, fmt=0x881ca0 "%s: %.*s%s%s%sBUG: qm: fragm. %p (address %p) beginning overwritten (%lx)! Memory allocator was called from %s:%u. Fragment marked by %s:%lu. Exec from %s:%u.\n", ap=0x7ffe4cbb4210, mode_flags=0) at syslog.c:229 #3 0x00007fa59a9e212a in __syslog (pri=<optimized out>, fmt=<optimized out>) at syslog.c:109 #4 0x00000000006fac27 in qm_debug_check_frag (qm=0x7fa588343000, f=0x7fa58cf9ff30, file=0x7fa59871b6e5 "tlsa: ../tls/tls_init.c", line=326, efile=0x881b19 "core/mem/q_malloc.c", eline=511) at core/mem/q_malloc.c:123 #5 0x00000000006fee76 in qm_free (qmp=0x7fa588343000, p=0x7fa58cf9ff68, file=0x7fa59871b6e5 "tlsa: ../tls/tls_init.c", func=0x7fa59871d090 <__func__.0> "ser_free", line=326, mname=0x7fa59871b6e0 "tlsa") at core/mem/q_malloc.c:511 #6 0x000000000070997c in qm_shm_free (qmp=0x7fa588343000, p=0x7fa58cf9ff68, file=0x7fa59871b6e5 "tlsa: ../tls/tls_init.c", func=0x7fa59871d090 <__func__.0> "ser_free", line=326, mname=0x7fa59871b6e0 "tlsa") at core/mem/q_malloc.c:1350 #7 0x00007fa59844d337 in ser_free (ptr=0x7fa58cf9ff68, fname=0x7fa598758da8 "providers/implementations/kdfs/hkdf.c", fline=123) at ../tls/tls_init.c:326 #8 0x00007fa5985d5537 in kdf_hkdf_reset () from /usr/local/lib64/kamailio/modules/tlsa.so #9 0x00007fa5985d5b4e in kdf_hkdf_free () from /usr/local/lib64/kamailio/modules/tlsa.so #10 0x00007fa598534bc4 in EVP_KDF_CTX_free () from /usr/local/lib64/kamailio/modules/tlsa.so #11 0x00007fa5984a0758 in tls13_hkdf_expand () from /usr/local/lib64/kamailio/modules/tlsa.so #12 0x00007fa5984a097d in derive_secret_key_and_iv () from /usr/local/lib64/kamailio/modules/tlsa.so #13 0x00007fa5984a15c5 in tls13_change_cipher_state () from /usr/local/lib64/kamailio/modules/tlsa.so #14 0x00007fa5984c988a in ossl_statem_server_post_work () from /usr/local/lib64/kamailio/modules/tlsa.so #15 0x00007fa5984b82db in state_machine.part () from /usr/local/lib64/kamailio/modules/tlsa.so #16 0x00007fa59846cab2 in tls_accept (c=0x7fa58cf03ef0, error=0x7ffe4cbd4ca4) at ../tls/tls_server.c:468 #17 0x00007fa598477e81 in tls_h_read_f (c=0x7fa58cf03ef0, flags=0x7ffe4cbd50e0) at ../tls/tls_server.c:1173 #18 0x00000000006ac4ae in tcp_read_headers (c=0x7fa58cf03ef0, read_flags=0x7ffe4cbd50e0) at core/tcp_read.c:441 #19 0x00000000006b4686 in tcp_read_req (con=0x7fa58cf03ef0, bytes_read=0x7ffe4cbd50e4, read_flags=0x7ffe4cbd50e0) at core/tcp_read.c:1469 #20 0x00000000006b97b5 in handle_io (fm=0x7fa59897d728, events=1, idx=-1) at core/tcp_read.c:1780 #21 0x00000000006a720f in io_wait_loop_epoll (h=0x979f00 <io_w>, t=2, repeat=0) at core/io_wait.h:1070 #22 0x00000000006bc539 in tcp_receive_loop (unix_sock=23) at core/tcp_read.c:1976 #23 0x000000000069c18b in tcp_init_children (woneinit=0x7ffe4cbd549c) at core/tcp_main.c:5227 #24 0x000000000042fab9 in main_loop () at main.c:1849 #25 0x000000000043995c in main (argc=13, argv=0x7ffe4cbd5b98) at main.c:3078 ``` -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3222#issuecomment-1221756675 You are receiving this because you are subscribed to this thread. Message ID: &lt;kamailio/kamailio/issues/3222/1221756675(a)github.com&gt;

BT4 ``` #0 __strlen_avx2 () at ../sysdeps/x86_64/multiarch/strlen-avx2.S:74 #1 0x00007fb4296c2228 in __vfprintf_internal (s=s@entry=0x1d2f980, format=format@entry=0x881ca0 "%s: %.*s%s%s%sBUG: qm: fragm. %p (address %p) beginning overwritten (%lx)! Memory allocator was called from %s:%u. Fragment marked by %s:%lu. Exec from %s:%u.\n", ap=ap@entry=0x7ffffe23d280, mode_flags=mode_flags@entry=0) at vfprintf-internal.c:1647 #2 0x00007fb429785c4a in __vsyslog_internal (pri=<optimized out>, fmt=0x881ca0 "%s: %.*s%s%s%sBUG: qm: fragm. %p (address %p) beginning overwritten (%lx)! Memory allocator was called from %s:%u. Fragment marked by %s:%lu. Exec from %s:%u.\n", ap=0x7ffffe23d280, mode_flags=0) at syslog.c:229 #3 0x00007fb42978612a in __syslog (pri=<optimized out>, fmt=<optimized out>) at syslog.c:109 #4 0x00000000006fac27 in qm_debug_check_frag (qm=0x7fb4170e7000, f=0x7fb41b2b2cd8, file=0x7fb4274bf6e5 "tlsa: ../tls/tls_init.c", line=326, efile=0x881b19 "core/mem/q_malloc.c", eline=511) at core/mem/q_malloc.c:123 #5 0x00000000006fee76 in qm_free (qmp=0x7fb4170e7000, p=0x7fb41b2b2d10, file=0x7fb4274bf6e5 "tlsa: ../tls/tls_init.c", func=0x7fb4274c1090 <__func__.0> "ser_free", line=326, mname=0x7fb4274bf6e0 "tlsa") at core/mem/q_malloc.c:511 #6 0x000000000070997c in qm_shm_free (qmp=0x7fb4170e7000, p=0x7fb41b2b2d10, file=0x7fb4274bf6e5 "tlsa: ../tls/tls_init.c", func=0x7fb4274c1090 <__func__.0> "ser_free", line=326, mname=0x7fb4274bf6e0 "tlsa") at core/mem/q_malloc.c:1350 #7 0x00007fb4271f1337 in ser_free (ptr=0x7fb41b2b2d10, fname=0x7fb4274e1030 "crypto/err/err_local.h", fline=88) at ../tls/tls_init.c:326 #8 0x00007fb4272cb666 in ERR_pop_to_mark () from /usr/local/lib64/kamailio/modules/tlsa.so #9 0x00007fb42734b129 in ossl_prov_digest_load_from_params () from /usr/local/lib64/kamailio/modules/tlsa.so #10 0x00007fb42738aca2 in hmac_set_ctx_params () from /usr/local/lib64/kamailio/modules/tlsa.so #11 0x00007fb4272dde13 in EVP_Q_mac () from /usr/local/lib64/kamailio/modules/tlsa.so #12 0x00007fb427379e75 in kdf_tls1_3_derive () from /usr/local/lib64/kamailio/modules/tlsa.so #13 0x00007fb427244e31 in tls13_generate_secret () from /usr/local/lib64/kamailio/modules/tlsa.so #14 0x00007fb42726d733 in ossl_statem_server_post_work () from /usr/local/lib64/kamailio/modules/tlsa.so #15 0x00007fb42725c2db in state_machine.part () from /usr/local/lib64/kamailio/modules/tlsa.so #16 0x00007fb427210ab2 in tls_accept (c=0x7fb41b2527a8, error=0x7ffffe25dd74) at ../tls/tls_server.c:468 #17 0x00007fb42721be81 in tls_h_read_f (c=0x7fb41b2527a8, flags=0x7ffffe25e1b0) at ../tls/tls_server.c:1173 #18 0x00000000006ac4ae in tcp_read_headers (c=0x7fb41b2527a8, read_flags=0x7ffffe25e1b0) at core/tcp_read.c:441 #19 0x00000000006b4686 in tcp_read_req (con=0x7fb41b2527a8, bytes_read=0x7ffffe25e1b4, read_flags=0x7ffffe25e1b0) at core/tcp_read.c:1469 #20 0x00000000006b97b5 in handle_io (fm=0x7fb4277216f8, events=1, idx=-1) at core/tcp_read.c:1780 #21 0x00000000006a720f in io_wait_loop_epoll (h=0x979f00 <io_w>, t=2, repeat=0) at core/io_wait.h:1070 #22 0x00000000006bc539 in tcp_receive_loop (unix_sock=21) at core/tcp_read.c:1976 #23 0x000000000069c18b in tcp_init_children (woneinit=0x7ffffe25e56c) at core/tcp_main.c:5227 #24 0x000000000042fab9 in main_loop () at main.c:1849 #25 0x000000000043995c in main (argc=13, argv=0x7ffffe25ec68) at main.c:3078 ``` -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3222#issuecomment-1221758752 You are receiving this because you are subscribed to this thread. Message ID: &lt;kamailio/kamailio/issues/3222/1221758752(a)github.com&gt;

Can you try with git master branch and setting tls moduparam lock_mode to 1? -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3222#issuecomment-1400427697 You are receiving this because you are subscribed to this thread. Message ID: &lt;kamailio/kamailio/issues/3222/1400427697(a)github.com&gt;

Update — I have had good results with 5.7.1! Tested EL9 + kamailio-tls (packaged module, i.e., not locally compiled): * kamailio-5.7.1-0.el9.centos.x86_64 * openssl-3.0.7-16.el9_2.x86_64 * concurrent 500 UAs, 500 connections/s Same load test as with OpenSSL 1.1.1, and tls_wolfssl. I will continue to test Debian bookworm/Ubuntu 22.04 LTS then I think this ticket can be closed. -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3222#issuecomment-1622950128 You are receiving this because you are subscribed to this thread. Message ID: &lt;kamailio/kamailio/issues/3222/1622950128(a)github.com&gt;

Do you use this thing: https://github.com/kamailio/kamailio/tree/master/src/modules/tls/utils/open… ? The documentation says on some places, it is needed, on other — it is not needed anymore. -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3222#issuecomment-1623565241 You are receiving this because you are subscribed to this thread. Message ID: &lt;kamailio/kamailio/issues/3222/1623565241(a)github.com&gt;

@dilyanpalauzov : in recent versions of kamailio this is already included -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3222#issuecomment-1624770629 You are receiving this because you are subscribed to this thread. Message ID: &lt;kamailio/kamailio/issues/3222/1624770629(a)github.com&gt;

Closed #3222 as completed. -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3222#event-9751314237 You are receiving this because you are subscribed to this thread. Message ID: &lt;kamailio/kamailio/issue/3222/issue_event/9751314237(a)github.com&gt;

@dilyanpalauzov — the function of `openssl_mutex_shared.so` is inside kamailio `src/main.c` conditionally based on the macro `KSR_PTHREAD_MUTEX_SHARED` since 2019. This macro is set when libssl ≥ 1.1 is detected. See `src/Makefile.defs`: ``` # libssl version greater or equal than 1.1 ifeq ($(shell [ $(LIBSSL_VERNUM) -ge 1001000 ] && echo libssl11plus), libssl11plus) LIBSSL_SET_MUTEX_SHARED := 1 endif endif endif # dlopen requires -ldl on some systems, but not others. Until there # is clarity on which require -ldl, add just enough ifeq to fix # systems known not to use it. ifeq ($(OS), netbsd) LIBDL="" else LIBDL="-ldl" endif ifeq ($(LIBSSL_SET_MUTEX_SHARED), 1) CC_PMUTEX_OPTS = -pthread -DKSR_PTHREAD_MUTEX_SHARED LD_PMUTEX_OPTS = -pthread -rdynamic $(LIBDL) -Wl,-Bsymbolic-functions else CC_PMUTEX_OPTS = LD_PMUTEX_OPTS = endif ``` -- Reply to this email directly or view it on GitHub: https://github.com/kamailio/kamailio/issues/3222#issuecomment-1627540143 You are receiving this because you are subscribed to this thread. Message ID: &lt;kamailio/kamailio/issues/3222/1627540143(a)github.com&gt;