[sr-dev] [kamailio/kamailio] Kamailio 5.4.4 extremely slow carrierroute preloading (#2653)

[Pawel Kuzak]

Hallo. We have difficulties in reproducing this. We have ~500.000 entries in the carrierroute table and it does not take so long for us to load them. The difference is, we are using MariaDB (not Postgres).
Maybe @kristina258 can tell what DB engine was used in the previous bug report? We are not sure whether it is a DBengine issue or some kind of special table content.
Do you maybe have many entries where where the prob is set 0?

> test-proxy2-bs ~ # **mysql ser**
Reading table information for completion of table and column names
You can turn off this feature to get a quicker startup with -A
Welcome to the MariaDB monitor.  Commands end with ; or \g.
Your MariaDB connection id is 1411
Server version: 10.3.27-MariaDB-0+deb10u1-log Debian 10
Copyright (c) 2000, 2018, Oracle, MariaDB Corporation Ab and others.
Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.
MariaDB [ser]> **select count(*) from carrierroute;**
+----------+
| count(*) |
+----------+
|   **501684** |
+----------+
1 row in set (0.000 sec)
MariaDB [ser]> Bye
test-proxy2-bs ~ # **time kamcmd cr.reload_routes**
real	**0m35.289s**
user	0m0.005s
sys	0m0.000s
test-proxy2-bs ~ # **kamailio -v**
version: **kamailio 5.3.8** (x86_64/linux) 
flags: USE_TCP, USE_TLS, USE_SCTP, TLS_HOOKS, USE_RAW_SOCKS, DISABLE_NAGLE, USE_MCAST, DNS_IP_HACK, SHM_MMAP, PKG_MALLOC, Q_MALLOC, F_MALLOC, TLSF_MALLOC, DBG_SR_MEMORY, USE_FUTEX, FAST_LOCK-ADAPTIVE_WAIT, USE_DNS_CACHE, USE_DNS_FAILOVER, USE_NAPTR, USE_DST_BLACKLIST, HAVE_RESOLV_RES, TLS_PTHREAD_MUTEX_SHARED
ADAPTIVE_WAIT_LOOPS 1024, MAX_RECV_BUFFER_SIZE 262144, MAX_URI_SIZE 1024, BUF_SIZE 65535, DEFAULT PKG_SIZE 8MB
poll method support: poll, epoll_lt, epoll_et, sigio_rt, select.
id:  
compiled with gcc 8.3.0
test-proxy2-bs ~ # **grep -r " and prob>0" /var/log/mysql/mysql.log**
210310 11:18:49	    27 Query	SELECT * FROM carrierroute WHERE carrier=9101 and domain=5 and prob>0
		    27 Query	SELECT * FROM carrierroute WHERE carrier=9101 and domain=6 and prob>0
		    27 Query	SELECT * FROM carrierroute WHERE carrier=9101 and domain=7 and prob>0
		    27 Query	SELECT * FROM carrierroute WHERE carrier=9101 and domain=0 and prob>0
		    27 Query	SELECT * FROM carrierroute WHERE carrier=9101 and domain=1 and prob>0
		    27 Query	SELECT * FROM carrierroute WHERE carrier=9101 and domain=2 and prob>0


-- 
You are receiving this because you are subscribed to this thread.
Reply to this email directly or view it on GitHub:
https://github.com/kamailio/kamailio/issues/2653#issuecomment-795223278
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.kamailio.org/pipermail/sr-dev/attachments/20210310/b6e4ae38/attachment.htm>