[Kamailio-Users] avpops OR sqlops

Daniel-Constantin Mierla miconda at gmail.com
Thu Dec 31 17:24:42 CET 2009 

Hello,

On 12/31/09 12:02 PM, alex pappas wrote:
> Hi,
>
> From the syslog when kamailio start ups I get the following:
>
>
> Dec 31 12:35:45 YGOR /usr/local/sbin/kamailio[10281]: 
> DBG:core:destroy_modules: shutting down module htable
> Dec 31 12:35:46 YGOR kamailio: DBG:core:yyparse: loading module 
> /usr/local/lib64/kamailio/modules/htable.so
> Dec 31 12:35:46 YGOR kamailio: DBG:core:register_module: register_pv: 
> htable
> Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: htable 
> matches module htable
> Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: found 
> <htable> in module htable [/usr/local/lib64/kamailio/modules/]
> Dec 31 12:35:46 YGOR kamailio: DBG:htable:ht_table_spec: htable [a] - 
> size [14]
> Dec 31 12:35:46 YGOR kamailio: DBG:htable:ht_table_spec: htable [a] - 
> dbtable [htable]
> Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: htable 
> matches module htable
> Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: found 
> <db_url> in module htable [/usr/local/lib64/kamailio/modules/]
> Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: htable 
> matches module htable
> Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: found 
> <fetch_rows> in module htable [/usr/local/lib64/kamailio/modules/]
> Dec 31 12:35:46 YGOR kamailio: DBG:core:find_cmd_export_t: found 
> <sht_print>(0) in module htable [/usr/local/lib64/kamailio/modules/]
> Dec 31 12:35:52 YGOR /usr/local/sbin/kamailio[10371]: 
> INFO:core:init_mod: initializing module htable
> Dec 31 12:35:52 YGOR /usr/local/sbin/kamailio[10371]: 
> DBG:htable:ht_db_open_con: database connection opened successfully
> Dec 31 12:35:52 YGOR /usr/local/sbin/kamailio[10371]: 
> DBG:htable:ht_db_load_tables: loading db table [htable] in ht [a]
> Dec 31 12:35:52 YGOR /usr/local/sbin/kamailio[10371]: 
> DBG:htable:ht_db_load_table: =============== loading hash table [a] 
> from database [htable]
> Dec 31 12:35:58 YGOR /usr/local/sbin/kamailio[10371]: 
> DBG:htable*:ht_db_load_table: Nothing to be loaded in hash table*

this is caused by a check of number of rows which seems to be 0. I will 
try to reproduce in the next days ...

> Dec 31 12:35:58 YGOR /usr/local/sbin/kamailio[10371]: 
> DBG:core:init_mod: register MI for htable
> Dec 31 12:35:58 YGOR /usr/local/sbin/kamailio[10371]: 
> DBG:htable:pv_parse_ht_name: htable [a] - key [$rU]
> Dec 31 12:35:58 YGOR /usr/local/sbin/kamailio[10371]: 
> DBG:htable:ht_get_table: htable found [a]
>
> In the mysql htable I see :
>
>
> mysql> select count(*) from openser10.htable;
> +----------+
> | count(*) |
> +----------+
> |  1893255 |
> +----------+
> 1 row in set (0.00 sec)
>
> And ofcourse when I run the sht_print(); I get many errors since 
> htable in memory is empty:
>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1376] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1377] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1378] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1379] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1380] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1381] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1382] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1383] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1384] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1385] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1386] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1387] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1388] -- <0>
> Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]: 
> ERROR:htable:ht_dbg: htable[1389] -- <0>

Yes, these show empty htable slots.

>
> Do you have any idea on why htable module does not load the data in 
> the memory ?

Needs some troubleshooting as looks not to work from a certain amount of 
data.

Cheers,
Daniel


>
> Cheers
> Alex
>
>
>
>
>
>
> On Wed, Dec 30, 2009 at 6:01 PM, Daniel-Constantin Mierla 
> <miconda at gmail.com <mailto:miconda at gmail.com>> wrote:
>
>     Hello,
>
>
>     On 12/30/09 4:53 PM, alex pappas wrote:
>>     Hi,
>>
>>     I don't see where the mysql is stacking but if I read correctly
>>     in http://kamailio.org/docs/modules/1.5.x/htable.html
>>
>>     _/The number of entries in the table is 2^size/_ :  2^14=16384
>>     rows data and i have 2.000.000 rows so maybe it is not possible
>>     to load them..But you know better of course.
>     no, that is the number of slots (buckets) in the hash table, not
>     the number of items that can be loaded -- some more technical
>     aspects of hash tables:
>
>     http://en.wikipedia.org/wiki/Hash_table
>
>     The number of items in htable is only a matter of shared memory.
>     The number of slots controls access speed -- higher number gives
>     less collisions.
>
>     You said at a moment that you could start, but htable was
>     returning only null: put a sht_print() in config to see the
>     content of the htable (you probably need high debug level:
>     debug=5) with the first sip request.
>
>     Cheers,
>     Daniel
>
>
>
>>
>>
>>
>>     On Wed, Dec 30, 2009 at 5:32 PM, Daniel-Constantin Mierla
>>     <miconda at gmail.com <mailto:miconda at gmail.com>> wrote:
>>
>>         Hello,
>>
>>         On 12/30/09 4:05 PM, alex pappas wrote:
>>
>>             Hi,
>>
>>             The error I get is the following:
>>
>>             ERROR:db_mysql:db_mysql_submit_query: driver error on
>>             query: Lost connection to MySQL server during query
>>             ERROR:core:db_do_query: error while submitting query
>>             ERROR:htable:ht_db_load_table: Error while querying db
>>             ERROR:core:init_mod: failed to initialize module htable
>>             ERROR:core:main: error while initializing modules
>>
>>             I'm running kamailio with 8M private memory per process
>>             and 2048M  shared memory.
>>
>>             When kamailio is getting the data from mysql is passing
>>             it all the data chunk in private memory and then in the
>>             shared memory?
>>
>>         It is loaded in chunks of rows -- you can tune it with a
>>         module parameter:
>>         http://kamailio.org/docs/modules/3.0.x/modules_k/htable.html#id2529075
>>
>>         Try to play with it to see if you get better results. You do
>>         not need more private memory, 8MB is ok.
>>
>>         Maybe the mysql server is closing due to lot of loaded data.
>>         Have you got any figure what is the number of rows when it
>>         starts losing the connection?
>>
>>         Cheers,
>>         Daniel
>>
>>
>>
>>             because if this is the case then I need more than 1000M
>>             in private memory.
>>
>>             Cheers
>>             Alex
>>
>>             P.S. i don't get any errors from mysql.
>>
>>
>>
>>
>>         -- 
>>         Daniel-Constantin Mierla
>>         * http://www.asipto.com/
>>
>>
>
>     -- 
>     Daniel-Constantin Mierla
>     *http://www.asipto.com/
>          
>
>

-- 
Daniel-Constantin Mierla
* http://www.asipto.com/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sip-router.org/pipermail/sr-users/attachments/20091231/688c0013/attachment.htm>

More information about the sr-users mailing list