[Kamailio-Users] avpops OR sqlops

Daniel-Constantin Mierla miconda at gmail.com
Thu Dec 31 17:33:58 CET 2009


Hello,

On 12/31/09 12:14 PM, alex pappas wrote:
> Hi,
>
> When I have less rows in the table then :
>
> Dec 31 13:11:26 YGOR kamailio: DBG:core:find_cmd_export_t: found 
> <sht_print>(0) in module htable [/usr/local/lib64/kamailio/modules/]
> Dec 31 13:11:33 YGOR /usr/local/sbin/kamailio[10843]: 
> INFO:core:init_mod: initializing module htable
> Dec 31 13:11:33 YGOR /usr/local/sbin/kamailio[10843]: 
> DBG:htable:ht_db_open_con: database connection opened successfully
> Dec 31 13:11:33 YGOR /usr/local/sbin/kamailio[10843]: 
> DBG:htable:ht_db_load_tables: loading db table [htable] in ht [a]
> Dec 31 13:11:33 YGOR /usr/local/sbin/kamailio[10843]: 
> DBG:htable:ht_db_load_table: =============== loading hash table [a] 
> from database [htable]
> Dec 31 13:11:33 YGOR /usr/local/sbin/kamailio[10843]: 
> DBG:htable:*ht_db_load_table: loaded 67 values in hash table*

this time is ok, indeed. As said in previous email, I will try too look 
deeper at it in the next days.

Thanks for troubleshooting and happy new year!

Daniel

> Dec 31 13:11:33 YGOR /usr/local/sbin/kamailio[10843]: 
> DBG:core:init_mod: register MI for htable
> Dec 31 13:11:33 YGOR /usr/local/sbin/kamailio[10843]: 
> DBG:htable:pv_parse_ht_name: htable [a] - key [$rU]
> Dec 31 13:11:33 YGOR /usr/local/sbin/kamailio[10843]: 
> DBG:htable:ht_get_table: htable found [a]
>
>
>
> Cheers
> Alex
>
>
> On Thu, Dec 31, 2009 at 1:02 PM, alex pappas <rebel.pappas at gmail.com 
> <mailto:rebel.pappas at gmail.com>> wrote:
>
>     Hi,
>
>     From the syslog when kamailio start ups I get the following:
>
>
>     Dec 31 12:35:45 YGOR /usr/local/sbin/kamailio[10281]:
>     DBG:core:destroy_modules: shutting down module htable
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:yyparse: loading module
>     /usr/local/lib64/kamailio/modules/htable.so
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:register_module:
>     register_pv: htable
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex:
>     htable matches module htable
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: found
>     <htable> in module htable [/usr/local/lib64/kamailio/modules/]
>     Dec 31 12:35:46 YGOR kamailio: DBG:htable:ht_table_spec: htable
>     [a] - size [14]
>     Dec 31 12:35:46 YGOR kamailio: DBG:htable:ht_table_spec: htable
>     [a] - dbtable [htable]
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex:
>     htable matches module htable
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: found
>     <db_url> in module htable [/usr/local/lib64/kamailio/modules/]
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex:
>     htable matches module htable
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:set_mod_param_regex: found
>     <fetch_rows> in module htable [/usr/local/lib64/kamailio/modules/]
>     Dec 31 12:35:46 YGOR kamailio: DBG:core:find_cmd_export_t: found
>     <sht_print>(0) in module htable [/usr/local/lib64/kamailio/modules/]
>     Dec 31 12:35:52 YGOR /usr/local/sbin/kamailio[10371]:
>     INFO:core:init_mod: initializing module htable
>     Dec 31 12:35:52 YGOR /usr/local/sbin/kamailio[10371]:
>     DBG:htable:ht_db_open_con: database connection opened successfully
>     Dec 31 12:35:52 YGOR /usr/local/sbin/kamailio[10371]:
>     DBG:htable:ht_db_load_tables: loading db table [htable] in ht [a]
>     Dec 31 12:35:52 YGOR /usr/local/sbin/kamailio[10371]:
>     DBG:htable:ht_db_load_table: =============== loading hash table
>     [a] from database [htable]
>     Dec 31 12:35:58 YGOR /usr/local/sbin/kamailio[10371]:
>     DBG:htable*:ht_db_load_table: Nothing to be loaded in hash table*
>     Dec 31 12:35:58 YGOR /usr/local/sbin/kamailio[10371]:
>     DBG:core:init_mod: register MI for htable
>     Dec 31 12:35:58 YGOR /usr/local/sbin/kamailio[10371]:
>     DBG:htable:pv_parse_ht_name: htable [a] - key [$rU]
>     Dec 31 12:35:58 YGOR /usr/local/sbin/kamailio[10371]:
>     DBG:htable:ht_get_table: htable found [a]
>
>     In the mysql htable I see :
>
>
>     mysql> select count(*) from openser10.htable;
>     +----------+
>     | count(*) |
>     +----------+
>     |  1893255 |
>     +----------+
>     1 row in set (0.00 sec)
>
>     And ofcourse when I run the sht_print(); I get many errors since
>     htable in memory is empty:
>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1376] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1377] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1378] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1379] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1380] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1381] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1382] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1383] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1384] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1385] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1386] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1387] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1388] -- <0>
>     Dec 31 12:52:48 YGOR /usr/local/sbin/kamailio[10375]:
>     ERROR:htable:ht_dbg: htable[1389] -- <0>
>
>     Do you have any idea on why htable module does not load the data
>     in the memory ?
>
>     Cheers
>     Alex
>
>
>
>
>
>
>
>     On Wed, Dec 30, 2009 at 6:01 PM, Daniel-Constantin Mierla
>     <miconda at gmail.com <mailto:miconda at gmail.com>> wrote:
>
>         Hello,
>
>
>         On 12/30/09 4:53 PM, alex pappas wrote:
>>         Hi,
>>
>>         I don't see where the mysql is stacking but if I read
>>         correctly in http://kamailio.org/docs/modules/1.5.x/htable.html
>>
>>         _/The number of entries in the table is 2^size/_ : 
>>         2^14=16384 rows data and i have 2.000.000 rows so maybe it is
>>         not possible to load them..But you know better of course.
>         no, that is the number of slots (buckets) in the hash table,
>         not the number of items that can be loaded -- some more
>         technical aspects of hash tables:
>
>         http://en.wikipedia.org/wiki/Hash_table
>
>         The number of items in htable is only a matter of shared
>         memory. The number of slots controls access speed -- higher
>         number gives less collisions.
>
>         You said at a moment that you could start, but htable was
>         returning only null: put a sht_print() in config to see the
>         content of the htable (you probably need high debug level:
>         debug=5) with the first sip request.
>
>         Cheers,
>         Daniel
>
>
>
>>
>>
>>
>>         On Wed, Dec 30, 2009 at 5:32 PM, Daniel-Constantin Mierla
>>         <miconda at gmail.com <mailto:miconda at gmail.com>> wrote:
>>
>>             Hello,
>>
>>             On 12/30/09 4:05 PM, alex pappas wrote:
>>
>>                 Hi,
>>
>>                 The error I get is the following:
>>
>>                 ERROR:db_mysql:db_mysql_submit_query: driver error on
>>                 query: Lost connection to MySQL server during query
>>                 ERROR:core:db_do_query: error while submitting query
>>                 ERROR:htable:ht_db_load_table: Error while querying db
>>                 ERROR:core:init_mod: failed to initialize module htable
>>                 ERROR:core:main: error while initializing modules
>>
>>                 I'm running kamailio with 8M private memory per
>>                 process and 2048M  shared memory.
>>
>>                 When kamailio is getting the data from mysql is
>>                 passing it all the data chunk in private memory and
>>                 then in the shared memory?
>>
>>             It is loaded in chunks of rows -- you can tune it with a
>>             module parameter:
>>             http://kamailio.org/docs/modules/3.0.x/modules_k/htable.html#id2529075
>>
>>             Try to play with it to see if you get better results. You
>>             do not need more private memory, 8MB is ok.
>>
>>             Maybe the mysql server is closing due to lot of loaded
>>             data. Have you got any figure what is the number of rows
>>             when it starts losing the connection?
>>
>>             Cheers,
>>             Daniel
>>
>>
>>
>>                 because if this is the case then I need more than
>>                 1000M in private memory.
>>
>>                 Cheers
>>                 Alex
>>
>>                 P.S. i don't get any errors from mysql.
>>
>>
>>
>>
>>             -- 
>>             Daniel-Constantin Mierla
>>             * http://www.asipto.com/
>>
>>
>
>         -- 
>         Daniel-Constantin Mierla
>         *http://www.asipto.com/
>                
>
>
>

-- 
Daniel-Constantin Mierla
* http://www.asipto.com/

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.kamailio.org/pipermail/users/attachments/20091231/43d644be/attachment-0001.htm>


More information about the Users mailing list