[SR-Users] kamailio crash after sqlops failures

Uri Shacked ushacked at gmail.com
Thu Jan 9 13:28:43 CET 2014


Hi,

Our system had crashed again.

Here are the exact details and there are logs and corefile attached.



We use 6 kamailio servers over 3 sites.

All the servers are connecting to 1 DB server running MYSQL 5.6.12.



The sql server supplies 2 things for kamailio servers.

1.   Some SQLOPS that the servers need.

2.   The data for the MTREE, HTABLE, CARRIERROUTE etc..



We use "kamctl" command in shell script to reload the data for the modules
every 1 minute. In normal times, the reload takes about 2-3 sec each minute.



When the sql server is down, the queries and reloads fail and it is OK.



Yesterday, we had a different failure on the sql server – The server is set
ona centos 6.2 that is under a VM cluster. The VM cluster had some disk
writing errors, and the sql server could not write or read fast enough.



On 3 of the 6 servers (one at each site) kamailio crashed.



I have no idea why. When the sql server is down, it does not happen.



I attached all 6 servers log, 1 server core file, 1 server var/log/messages
and the mysql slow-query log.



Any ideas how to handle this?


kamailio version 3.3.2




BR,

Uri
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.sip-router.org/pipermail/sr-users/attachments/20140109/0b2b5434/attachment-0001.html>
-------------- next part --------------
Wed Jan  8 02:21:21 IST 2014 FM reload started
Wed Jan  8 02:21:54 IST 2014 FM reload ended with ret_val=0 and res=
Jan  8 08:59:00 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 08:59:00 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 09:33:59 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 09:33:59 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 09:50:12 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f19883170e0 [1827:6151] with clid '59d8b46f-0888190a-003652d2 at 10.25.142.2' and tags '0888190a-66ef311-t-1' '9304749091451097172'
Jan  8 09:56:08 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f19a21be960 [1035:8273] with clid '455c875f-028c190a-005a90ee at 10.25.142.14' and tags '028c190a-ac6df4b-t-1' '9300247690846981810'
Jan  8 11:14:26 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:14:26 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 11:29:20 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:29:20 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 11:34:32 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:34:32 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:49:37 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:49:37 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:22:48 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f19a7110880 [855:9212] with clid '3db54730-03e0a8c0-004238d2 at 192.168.210.8' and tags '03e0a8c0-7cd2a49-t-1' '9304749091451103601'
Jan  8 13:36:13 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:36:13 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:41:04 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:41:04 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:58:38 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:58:38 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:03:24 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:03:24 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:20:09 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:20:09 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:25:36 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:25:36 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:26:05 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:26:05 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:32:43 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:32:43 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:46:19 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:46:19 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:49:35 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:49:35 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:50:12 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:50:12 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:55:41 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:55:41 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:39:37 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:39:37 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:59:42 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:59:42 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:10:57 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: db_mysql [km_dbase.c:179]: driver error: Duplicate entry '6998741155552384520-1389190254 at 10.25.132.6' for key 'PRIMARY'
Jan  8 16:10:57 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <core> [db_query.c:163]: error while storing result
Jan  8 16:10:57 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:57 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13434]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:13 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:13 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:13 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:13 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:14 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:14 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:14 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:14 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13430]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:28 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: db_mysql [km_dbase.c:179]: driver error: Duplicate entry '0ba6e35b-018a190a-0029ff4d at 10.25.142.8' for key 'PRIMARY'
Jan  8 16:11:28 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [db_query.c:163]: error while storing result
Jan  8 16:11:28 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:28 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 104#033[0;39;49m
Jan  8 16:27:19 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f199cb69c10 [375:5918] with clid '6bfeacc1-088a190a-00f9739b at 10.25.142.8' and tags '088a190a-1d2ea4e5-t-1' '9304749091451110269'
Jan  8 16:35:00 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:35:00 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:35:12 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13432]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f1948b41e50 [3719:9175] with clid '3b30c1dc-04daa8c0-002597b7 at 192.168.210.2' and tags '04daa8c0-46cad19-t-1' '9304806266057340284'
Jan  8 17:03:48 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 17:03:48 net-ivr-KamIN-C1 /usr/local/sbin/kamailio[13431]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
-------------- next part --------------
Jan  8 08:40:33 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 08:40:33 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 09:50:42 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 09:50:42 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 10:02:39 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[771]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 10:02:39 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[771]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 10:10:48 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[769]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f04cf106830 [918:10696] with clid '0066043f-01dba8c0-000eb68b at 192.168.210.5' and tags '01dba8c0-1bac334-t-1' '9300247690846982234'
Jan  8 11:07:25 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f04ceb89ee0 [782:11888] with clid '72c7a595-01dda8c0-000e8e57 at 192.168.214.5' and tags '01dda8c0-1b75bd7-t-1' '9300247690846983858'
Jan  8 11:50:17 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[769]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:50:17 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[769]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:06:33 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[769]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:06:33 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[769]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:26:01 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: WARNING: <core> [rvalue.c:1012]: automatic string to int conversion for "anonymous;ss7-cpc=10;cpc=ordinary" failed
Jan  8 12:26:01 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: WARNING: <core> [rvalue.c:1916]: rval expression conversion to int failed (903,19-903,19)
Jan  8 12:30:52 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:30:52 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:47:21 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:47:21 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:51:04 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[771]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f04a5b28470 [1458:3462] with clid '09089ae1-06dca8c0-00e5fbc6 at 192.168.214.2' and tags '06dca8c0-1adefaf6-t-1' '9300247690846989176'
Jan  8 14:03:39 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[769]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:03:39 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[769]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:48:03 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[771]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f04d2a455a0 [3132:4370] with clid '236bf1ff-01e6a8c0-0178d938 at 192.168.210.121' and tags '01e6a8c0-2c2e6a25-t-1' '9304749091451108901'
Jan  8 16:10:11 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:11 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:11 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:11 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[772]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:10:12 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[770]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:12 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[770]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:12 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[770]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:12 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[770]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:10:19 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[771]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:19 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[771]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:19 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[771]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:10:20 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[770]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:20 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[770]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:20 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[770]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:10:38 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[762]: ALERT: <core> [main.c:785]: child process 770 exited by a signal 11
Jan  8 16:10:38 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[790]: : <core> [pass_fd.c:293]: ERROR: receive_fd: EOF on 12
Jan  8 16:10:38 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[762]: ALERT: <core> [main.c:788]: core was generated
Jan  8 16:11:35 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27946]: WARNING: <script>: Please fasten your seat belts we are taking off !!
Wed Jan  8 16:11:35 IST 2014 kamailio was restarted by watchdog
Jan  8 16:11:36 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27951]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:11:36 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27951]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:36 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27951]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:11:37 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:11:37 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:37 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:11:38 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:11:38 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:38 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:11:50 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27956]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:11:50 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27956]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:50 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27956]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:29 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:29 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:29 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:59 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27954]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:59 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27954]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:59 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27954]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:14:21 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:14:21 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:14:21 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:15:10 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27953]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:15:10 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27953]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:15:10 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27953]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:18:58 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:18:58 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:18:58 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:22:01 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:22:01 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:22:01 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:34:18 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:34:18 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:34:18 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27950]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:47:02 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:47:02 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:47:02 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 17:32:11 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 17:32:11 net-ivr-KamIN-J1 /usr/local/sbin/kamailio[27952]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
-------------- next part --------------
Wed Jan  8 02:42:01 IST 2014 FM reload started
Wed Jan  8 02:42:34 IST 2014 FM reload ended with ret_val=0 and res=
Jan  8 09:00:55 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 09:00:55 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 09:52:01 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12565]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f7279956040 [2525:5118] with clid '60abec66-04e5a8c0-00b99d99 at 192.168.214.121' and tags '04e5a8c0-15b756b1-t-1' '9300247690846981729'
Jan  8 11:53:57 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:53:57 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:31:12 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12565]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:31:12 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12565]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:49:51 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:49:51 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:18:25 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f7292bfaf80 [1665:3754] with clid '3ca9127e-05daa8c0-002509a5 at 192.168.210.2' and tags '05daa8c0-45c57a5-t-1' '9304749091451103459'
Jan  8 13:35:34 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12565]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:35:34 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12565]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:49:25 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12565]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:49:25 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12565]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:52:44 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:52:44 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:27:12 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:27:12 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:27:13 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:27:13 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:38:18 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12579]: WARNING: dialog [dlg_handlers.c:1357]: timeout for dlg with CallID '6994160590369364465-1389011840 at 10.250.23.13' and tags '6994160590369364465' '9300003599583058423'
Jan  8 14:43:05 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:43:05 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:52:09 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:52:09 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:54:00 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:54:00 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:09:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:09:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:09:46 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:09:46 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:33:05 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:33:05 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:33:14 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:33:14 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:42:34 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:42:34 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12566]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:09:07 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:09:07 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:10:15 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:15 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:15 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:15 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12568]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:10:16 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:16 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:16 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:16 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12567]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:10:39 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12594]: : <core> [pass_fd.c:293]: ERROR: receive_fd: EOF on 13
Jan  8 16:10:39 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12559]: ALERT: <core> [main.c:785]: child process 12567 exited by a signal 11
Jan  8 16:10:39 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[12559]: ALERT: <core> [main.c:788]: core was generated
Jan  8 16:11:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10323]: WARNING: <script>: Please fasten your seat belts we are taking off !!
Wed Jan  8 16:11:35 IST 2014 kamailio was restarted by watchdog
Jan  8 16:11:37 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:11:37 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:37 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:11:37 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:11:37 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:37 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:11:38 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:11:38 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:38 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:11:42 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:11:42 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:42 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:11 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:11 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:11 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:17 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:17 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:17 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:44 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:44 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:44 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:13:50 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:13:50 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:13:50 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10333]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:14:21 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10331]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:14:21 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10331]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:14:21 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10331]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:16:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:16:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:16:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:17:07 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:17:07 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:17:07 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:17:33 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:17:33 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:17:33 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:18:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:18:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:18:35 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10328]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:19:51 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: <script>: #033[0;31;42mNo TDR is found for 46321888 with Index 0003741956 with group 1#033[0;39;49m
Jan  8 16:20:02 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: <script>: #033[0;31;42mNo TDR is found for 46321888 with Index 0003741956 with group 1#033[0;39;49m
Jan  8 16:20:21 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10326]: ERROR: <script>: #033[0;31;42mNo TDR is found for 46321888 with Index 0003741956 with group 1#033[0;39;49m
Jan  8 16:21:17 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:21:17 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:21:17 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:30:43 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:30:43 net-ivr-KamIN-BK1 /usr/local/sbin/kamailio[10329]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
-------------- next part --------------
Jan  8 01:11:55 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: tm [t_reply.c:1241]: ERROR: t_should_relay_response: status rewrite by UAS: stored: 301, received: 100
Wed Jan  8 02:51:21 IST 2014 FM reload started
Wed Jan  8 02:51:53 IST 2014 FM reload ended with ret_val=0 and res=
Jan  8 09:08:26 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 09:08:26 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 10:41:56 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 10:41:56 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 10:57:10 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f920ffa73a0 [2058:1434] with clid '5c5039d1-0389190a-0033d251 at 10.25.142.5' and tags '0389190a-626e813-t-1' '9304749091451099041'
Jan  8 11:05:48 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:05:48 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 11:24:56 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:24:56 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:32:47 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:32:47 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:33:44 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:33:44 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:39:51 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31856]: ERROR: tm [t_reply.c:1241]: ERROR: t_should_relay_response: status rewrite by UAS: stored: 301, received: 100
Jan  8 12:40:31 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f91e58d5970 [675:8414] with clid '5a6121f1-048d190a-0139325c at 10.25.142.17' and tags '048d190a-2554a688-t-1' '9304749091451102300'
Jan  8 13:06:07 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:06:07 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:03:02 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7f920ffe9500 [3797:8258] with clid '3cc0f189-01dca8c0-002ce42e at 192.168.214.2' and tags '01dca8c0-548bdcc-t-1' '9300247690846989630'
Jan  8 14:11:35 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:11:35 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:17:10 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:17:10 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:26:42 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:26:42 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:10:26 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:10:26 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:20:43 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:20:43 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:56:21 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:56:21 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:00:41 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:00:41 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:10:18 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:18 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:18 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:18 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:10:19 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:19 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:19 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:19 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:11:17 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:17 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:17 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:17 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:18 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:18 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:18 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:18 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:24 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:24 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:24 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:24 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:25 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:25 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:25 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:25 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:28 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: db_mysql [km_dbase.c:179]: driver error: Duplicate entry '6994160590371914277-1389190282 at 10.250.23.13' for key 'PRIMARY'
Jan  8 16:11:28 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <core> [db_query.c:163]: error while storing result
Jan  8 16:11:28 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:28 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31846]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29913550#033[0;39;49m
Jan  8 16:11:28 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: db_mysql [km_dbase.c:179]: driver error: Duplicate entry '6994162789390623901-1389190283 at 10.250.24.16' for key 'PRIMARY'
Jan  8 16:11:28 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <core> [db_query.c:163]: error while storing result
Jan  8 16:11:28 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:28 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31848]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29913550#033[0;39;49m
Jan  8 16:29:21 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:29:21 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:31:35 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:31:35 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31847]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:35:50 net-ivr-KamIN-BK2 /usr/local/sbin/kamailio[31845]: ERROR: mtree [mtree.c:313]: invalid char at 0 in [%23]
-------------- next part --------------
Wed Jan  8 02:11:38 IST 2014 FM reload started
Wed Jan  8 02:12:11 IST 2014 FM reload ended with ret_val=0 and res=
Jan  8 10:05:20 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7ffd33f61350 [1254:11549] with clid '7c3dc397-0388190a-009844ce at 10.25.142.2' and tags '0388190a-11edd36b-t-1' '9304806266057327240'
Jan  8 10:22:30 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 10:22:30 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 10:29:26 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7ffd92a094a0 [1308:3045] with clid '3d3f2fa4-03dca8c0-00f189ba at 192.168.214.2' and tags '03dca8c0-1c3acf6a-t-1' '9304806266057327947'
Jan  8 10:42:29 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 10:42:29 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 11:08:56 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:08:56 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 11:16:09 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7ffd983e62d0 [2714:8233] with clid '5c79b325-07dca8c0-00ba0009 at 192.168.214.2' and tags '07dca8c0-15c5ab1a-t-1' '9300247690846984126'
Jan  8 11:40:20 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7ffd8238ae70 [1634:1077] with clid '12ddeaf6-068a190a-00e821c1 at 10.25.142.8' and tags '068a190a-1b2d48cf-t-1' '9304749091451100382'
Jan  8 11:50:12 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23388]: WARNING: dialog [dlg_handlers.c:1357]: timeout for dlg with CallID '6994239754942871509-1389001762 at 10.25.130.6' and tags '6994239754942871509' '9300082764156565463'
Jan  8 12:33:24 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:33:24 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:04:49 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:04:49 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:35:49 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:35:49 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 13:42:41 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:42:41 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:42:38 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7ffd8e454610 [1843:10504] with clid '00ffea97-07dda8c0-00e87e7a at 192.168.214.5' and tags '07dda8c0-1b04c1a6-t-1' '9304806266057336343'
Jan  8 15:01:36 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7ffd55ef4a40 [647:1851] with clid '08eba15f-078b190a-0099a982 at 10.25.142.11' and tags '078b190a-121937fe-t-1' '9300247690846991864'
Jan  8 15:11:40 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:11:40 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:34:32 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:34:32 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:09:49 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:09:49 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:10:08 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23395]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:08 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23395]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:08 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23395]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:10:13 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:13 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:13 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:13 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:10:14 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:14 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:14 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:14 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:10:17 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23384]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:17 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23384]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:17 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23384]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:10:21 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:21 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:21 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:10:22 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:10:22 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:10:22 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:10:45 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: db_mysql [km_dbase.c:179]: driver error: Duplicate entry '6994162789390622898-1389190243 at 10.250.24.16' for key 'PRIMARY'
Jan  8 16:10:45 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: <core> [db_query.c:163]: error while storing result
Jan  8 16:10:45 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:45 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23375]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:11:19 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:19 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:19 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:19 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23373]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:20 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:20 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:20 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:20 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23374]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 17:28:10 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 17:28:10 net-ivr-KamIN-J2 /usr/local/sbin/kamailio[23376]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
-------------- next part --------------
Wed Jan  8 02:31:25 IST 2014 FM reload started
Wed Jan  8 02:31:57 IST 2014 FM reload ended with ret_val=0 and res=
Jan  8 10:18:08 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32037]: ERROR: tm [tm.c:1375]: ERROR: w_t_relay_to: t_relay_to failed
Jan  8 10:18:08 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32037]: ERROR: sl [sl_funcs.c:371]: ERROR: sl_reply_error used: transaction canceled (487/SL)
Jan  8 10:20:13 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 10:20:13 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 10:47:41 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 10:47:41 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 10:53:20 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7fd8f2608620 [705:479] with clid '743c5d93-078b190a-0098d199 at 10.25.142.11' and tags '078b190a-12014072-t-1' '9300247690846983435'
Jan  8 10:56:04 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 10:56:04 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 11:45:49 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:45:49 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 11:52:49 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 11:52:49 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:00:33 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7fd8f4e4b630 [3092:11303] with clid '5c801666-07e6a8c0-00f06909 at 192.168.210.121' and tags '07e6a8c0-1c2638e6-t-1' '9304806266057330714'
Jan  8 12:00:36 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7fd8f6777240 [2037:11351] with clid '01e639b4-018d190a-00c9f1b4 at 10.25.142.17' and tags '018d190a-1808f473-t-1' '9304749091451101010'
Jan  8 12:01:29 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7fd8f373c210 [1923:11488] with clid '6b84ffb1-068b190a-00930b49 at 10.25.142.11' and tags '068b190a-1158d2f9-t-1' '9304749091451101047'
Jan  8 12:02:01 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 12:02:01 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 12:37:33 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32033]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7fd8f06c7b00 [1934:5822] with clid '3ae59c3a-05e4a8c0-001b2a9d at 192.168.214.8' and tags '05e4a8c0-32d29d1-t-1' '9304806266057331913'
Jan  8 13:55:47 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 13:55:47 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:13:43 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 14:13:43 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 14:42:26 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32033]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7fd8f86ddeb0 [121:4729] with clid '03ff90e2-04dda8c0-009048a1 at 192.168.214.5' and tags '04dda8c0-10cf67c7-t-1' '9304749091451106610'
Jan  8 15:18:02 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:18:02 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:24:33 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:24:33 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:28:41 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:28:41 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:50:12 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32033]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 15:50:12 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32033]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 15:52:47 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: CRITICAL: dialog [dlg_hash.c:782]: bogus event 5 in state 4 for dlg 0x7fd8f0012a00 [3586:2170] with clid '48b0bf32-048a190a-00f919e9 at 10.25.142.8' and tags '048a190a-1d26a80e-t-1' '9304808465080593095'
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32033]: ERROR: db_mysql [km_dbase.c:179]: driver error: Duplicate entry '67738867-01e4a8c0-01256200 at 192.168.214.8' for key 'PRIMARY'
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: db_mysql [km_dbase.c:179]: driver error: Duplicate entry '6994160590371913470-1389190248 at 10.250.23.13' for key 'PRIMARY'
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <core> [db_query.c:163]: error while storing result
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32033]: ERROR: <core> [db_query.c:163]: error while storing result
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32033]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32033]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 104#033[0;39;49m
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: db_mysql [km_dbase.c:179]: driver error: Duplicate entry '6994162789390622974-1389190247 at 10.250.24.16' for key 'PRIMARY'
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <core> [db_query.c:163]: error while storing result
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:10:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 12222080#033[0;39;49m
Jan  8 16:11:11 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:11 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:11 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:11 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32032]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:12 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:12 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:12 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: sqlops [sql_api.c:580]: cannot do the query
Jan  8 16:11:12 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32031]: ERROR: <script>: #033[0;31;42mcall limiter failed to query DB for 29994321#033[0;39;49m
Jan  8 16:11:18 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Lost connection to MySQL server during query
Jan  8 16:11:18 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:11:18 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32030]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:11:36 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32026]: ALERT: <core> [main.c:785]: child process 32030 exited by a signal 11
Jan  8 16:11:36 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32050]: : <core> [pass_fd.c:293]: ERROR: receive_fd: EOF on 11
Jan  8 16:11:36 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[32026]: ALERT: <core> [main.c:788]: core was generated
Jan  8 16:12:34 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18475]: WARNING: <script>: Please fasten your seat belts we are taking off !!
Wed Jan  8 16:12:34 IST 2014 kamailio was restarted by watchdog
Jan  8 16:12:35 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18485]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:35 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18485]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:35 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18485]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:36 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:36 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:36 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:37 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:37 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:37 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:37 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:37 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:37 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18479]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18479]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18479]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:12:38 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:13:55 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:13:55 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:13:55 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:13:59 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18478]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:13:59 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18478]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:13:59 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18478]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:14:06 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18478]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:14:06 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18478]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:14:06 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18478]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:14:49 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18485]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:14:49 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18485]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:14:49 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18485]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:14:58 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:14:58 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:14:58 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18482]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:15:03 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:15:03 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:15:03 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:15:09 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18483]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:15:09 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18483]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:15:09 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18483]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:19:29 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18483]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:19:29 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18483]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:19:29 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18483]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:20:34 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18479]: ERROR: <script>: #033[0;31;42mNo TDR is found for 46321888 with Index 0003741956 with group 1#033[0;39;49m
Jan  8 16:21:09 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18479]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:21:09 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18479]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:21:09 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18479]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:23:03 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:23:03 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
Jan  8 16:23:17 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:23:17 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:23:17 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18481]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:24:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: db_mysql [km_dbase.c:122]: driver error on query: Unknown column 'anonymous' in 'field list'
Jan  8 16:24:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: <core> [db_query.c:156]: error while submitting query
Jan  8 16:24:51 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18480]: ERROR: sqlops [sql_api.c:257]: cannot do the query
Jan  8 16:54:47 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18478]: ERROR: <core> [lvalue.c:347]: non existing right pvar
Jan  8 16:54:47 net-ivr-KamIN-C2 /usr/local/sbin/kamailio[18478]: ERROR: <core> [lvalue.c:407]: assignment failed at pos: (230,16-230,55)
-------------- next part --------------
kernel: kamailio[32030]: segfault at 8 ip 00007fd9d1976175 sp 00007fffd5534fc0 error 4 in tm.so[7fd9d1948000+79000]
-------------- next part --------------
Core was generated by `/usr/local/sbin/kamailio -P /var/run/kamailio.pid -m 4096 -M 16 -u ka           mailio -g'.
Program terminated with signal 11, Segmentation fault.
#0  run_trans_callbacks_internal (cb_lst=<value optimized out>, type=1048576,
    trans=0x7f72dc2e0f30, params=0x7fff4109c1e0) at t_hooks.c:286
286                     if ( (cbp->types)&type ) {
Missing separate debuginfos, use: debuginfo-install cyrus-sasl-lib-2.1.23-13.el6.x86_64 glib           c-2.12-1.47.el6.x86_64 keyutils-libs-1.4-3.el6.x86_64 krb5-libs-1.9-22.el6_2.1.x86_64 libcom           _err-1.41.12-11.el6.x86_64 libconfuse-2.6-3.el6.x86_64 libcurl-7.19.7-26.el6_1.2.x86_64 libg           cc-4.4.6-3.el6.x86_64 libidn-1.18-2.el6.x86_64 libselinux-2.0.94-5.2.el6.x86_64 libssh2-1.2.           2-7.el6_1.1.x86_64 libstdc++-4.4.6-3.el6.x86_64 libxml2-2.7.6-4.el6_2.1.x86_64 mysql-libs-5.           5.20-1.el6.remi.x86_64 nspr-4.8.8-3.el6.x86_64 nss-3.12.10-17.el6_2.x86_64 nss-softokn-freeb           l-3.12.9-11.el6.x86_64 nss-util-3.12.10-2.el6.x86_64 openldap-2.4.23-20.el6.x86_64 openssl-1           .0.0-20.el6.x86_64 pcre-7.8-3.1.el6.x86_64 zlib-1.2.3-27.el6.x86_64
(gdb) bt full
#0  run_trans_callbacks_internal (cb_lst=<value optimized out>, type=1048576,
    trans=0x7f72dc2e0f30, params=0x7fff4109c1e0) at t_hooks.c:286
        cbp = 0x1f
        backup_from = 0x8c5b30
        backup_to = 0x8c5b38
        backup_dom_from = 0x8c5b40
        backup_dom_to = 0x8c5b48
        backup_uri_from = 0x8c5b20
        backup_uri_to = 0x8c5b28
        backup_xavps = 0x8c5c30
#1  0x00007f737d4d83b4 in run_trans_callbacks_with_buf (type=<value optimized out>,
    rbuf=0x7f72dc2e0ff0, req=<value optimized out>, repl=<value optimized out>,
    flags=<value optimized out>) at t_hooks.c:336
        params = {req = 0x7f727961ce80, rpl = 0x7f737ece4130, param = 0x7f72ae77d800,
          code = 500, flags = 500, branch = 0, t_rbuf = 0x7f72dc2e0ff0,
          dst = 0x7f72dc2e1040, send_buf = {
            s = 0x7f72be566610 "G4bK-6110880003693468-a198206-1\r\nContact:  <sip:D377159956           6500 at 10.25.131.129:5060;user=phone>\r\nSupported: timer,100rel\r\nRecord-Route: <sip:10.25.1           52.97:5084;lr=on;ftag=6994239754944984168;vst=AAAAAHUG"..., len = 443}}
        trans = <value optimized out>
#2  0x00007f737d50403c in relay_reply (t=<value optimized out>,
    p_msg=<value optimized out>, branch=0, msg_status=500, cancel_data=0x7fff4109c5b0,
    do_put_on_wait=1) at t_reply.c:1859
        relay = 0
        save_clone = 0
        buf = 0x7f737ece5460 "SIP/2.0 500 Kamin 503 from leg2\r\nCall-ID: 699874115555238373           8-1389190209 at 10.25.132.6\r\nFrom: anonymous <sip:anonymous at localhost>;tag=699874115555238373           8\r\nTo: <sip:12222080 at 10.25.152.97;user=phone>;tag="...
        res_len = 443
        relayed_code = 500
        relayed_msg = 0x7f737ece4130
---Type <return> to continue, or q <return> to quit---
        reply_bak = <value optimized out>
        bm = {to_tag_val = {s = 0x0, len = 0}}
        totag_retr = 0
        reply_status = RPS_COMPLETED
        uas_rb = <value optimized out>
        to_tag = <value optimized out>
        reason = {s = 0x3 <Address 0x3 out of bounds>, len = 1091159564}
        onsend_params = {req = 0x7f72dc2e10f0, rpl = 0x7f72dc2e10a0,
          param = 0x7f72dc2e10f0, code = 503, flags = 0, branch = 0,
          t_rbuf = 0x7f72a8a08080, dst = 0x7f737d4cf831, send_buf = {
            s = 0x5b <Address 0x5b out of bounds>, len = 1091158876}}
#3  0x00007f737d5049ee in reply_received (p_msg=0x7f737ece4130) at t_reply.c:2366
        msg_status = 500
        last_uac_status = 183
        ack = 0x1 <Address 0x1 out of bounds>
        ack_len = 382
        branch = 0
        reply_status = <value optimized out>
        onreply_route = <value optimized out>
        cancel_data = {cancel_bitmap = 0, reason = {cause = 0, u = {text = {s = 0x0,
                len = 9133033}, e2e_cancel = 0x0, packed_hdrs = {s = 0x0, len = 9133033}}}}
        uac = 0x7f72dc2e1098
        t = 0x7f72dc2e0f30
        lack_dst = {send_sock = 0x7f737ece4130, to = {s = {sa_family = 50656,
              sa_data = "\tA\377\177\000\000\220u\313~s\177\000"}, sin = {
              sin_family = 50656, sin_port = 16649, sin_addr = {s_addr = 32767},
              sin_zero = "\220u\313~s\177\000"}, sin6 = {sin6_family = 50656,
              sin6_port = 16649, sin6_flowinfo = 32767, sin6_addr = {__in6_u = {
                  __u6_addr8 = "\220u\313~s\177\000\000\320\305\tA\000\000\000",
                  __u6_addr16 = {30096, 32459, 32627, 0, 50640, 16649, 0, 0},
                  __u6_addr32 = {2127263120, 32627, 1091159504, 0}}},
---Type <return> to continue, or q <return> to quit---
              sin6_scope_id = 922}}, id = 0, proto = 83 'S', send_flags = {f = 92 '\\',
            blst_imask = 139 '\213'}}
        backup_user_from = <value optimized out>
        backup_user_to = <value optimized out>
        backup_domain_from = <value optimized out>
        backup_domain_to = <value optimized out>
        backup_uri_from = <value optimized out>
        backup_uri_to = <value optimized out>
        backup_xavps = <value optimized out>
        replies_locked = <value optimized out>
        branch_ret = <value optimized out>
        prev_branch = <value optimized out>
        blst_503_timeout = <value optimized out>
        hf = <value optimized out>
        onsend_params = {req = 0x7f737ecea0a0, rpl = 0x8b5c53, param = 0x7f737ece7300,
          code = 5581456, flags = 0, branch = 0, t_rbuf = 0x7f737ece4d10, dst = 0x54849d,
          send_buf = {s = 0x7f737ece7630 "", len = 9133849}}
        ctx = {rec_lev = 0, run_flags = 0, last_retcode = 1, jmp_env = {{__jmpbuf = {
                140734284547120, 2039942722550153757, 140134025504416, 140134025412912,
                503, 140131297010104, -2039612715720326627, 2039943277834846749},
              __mask_was_saved = 0, __saved_mask = {__val = {5423285, 140134025437712,
                  9133622, 140134025425312, 5538973, 140134025420496, 140134025420496,
                  140134022851728, 267733853983, 0, 4294967297, 5926243, 140134025258928,
                  1, 140134007009997, 140134025426192}}}}}
#4  0x0000000000451175 in forward_reply (msg=0x7f737ece4130) at forward.c:790
        new_buf = 0x0
        dst = {send_sock = 0x0, to = {s = {sa_family = 0,
              sa_data = '\000' <repeats 13 times>}, sin = {sin_family = 0, sin_port = 0,
              sin_addr = {s_addr = 0}, sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {
              sin6_family = 0, sin6_port = 0, sin6_flowinfo = 0, sin6_addr = {__in6_u = {
                  __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0,
---Type <return> to continue, or q <return> to quit---
                    0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}}, id = 0,
          proto = 0 '\000', send_flags = {f = 0 '\000', blst_imask = 0 '\000'}}
        new_len = <value optimized out>
        r = <value optimized out>
        s = <value optimized out>
        len = <value optimized out>
#5  0x0000000000495302 in receive_msg (buf=<value optimized out>, len=543,
    rcv_info=0x7fff4109c8a0) at receive.c:270
        msg = 0x7f737ece4130
        ctx = {rec_lev = -1509979036, run_flags = 32626, last_retcode = 1445160769,
          jmp_env = {{__jmpbuf = {3, 140133934883291, 267732955896, 140134041812992,
                140734284548480, 4294967295, 3, 5}, __mask_was_saved = 8436752,
              __saved_mask = {__val = {0, 140734284548392, 28, 0, 267724578624,
                  140131897966597, 0, 140130387987556, 267732955896, 0, 140134025421664,
                  140134041810600, 140134025421672, 4294967245, 267724604965,
                  140734284548278}}}}}
        ret = <value optimized out>
        inb = {
          s = 0x8b5ae0 "SIP/2.0 500 Service Unavailable\r\nCall-ID: 6998741155552383738-1389           190209 at 10.25.132.6\r\nFrom: anonymous <sip:anonymous at localhost>;tag=6998741155552383738\r\nT           o: \"D37712222080\" <sip:D37712222080 at 10.25.133."..., len = 543}
#6  0x000000000051f1d7 in udp_rcv_loop () at udp_server.c:544
        len = 543
        buf = "SIP/2.0 500 Service Unavailable\r\nCall-ID: 6998741155552383738-1389190209 at 10           .25.132.6\r\nFrom: anonymous <sip:anonymous at localhost>;tag=6998741155552383738\r\nTo: \"D377           12222080\" <sip:D37712222080 at 10.25.133."...
        from = 0x7f737ece6360
        fromlen = 16
        ri = {src_ip = {af = 2, len = 4, u = {addrl = {25499914, 0}, addr32 = {25499914,
                0, 0, 0}, addr16 = {6410, 389, 0, 0, 0, 0, 0, 0},
              addr = "\n\031\205\001", '\000' <repeats 11 times>}}, dst_ip = {af = 2,
---Type <return> to continue, or q <return> to quit---
            len = 4, u = {addrl = {1637357834, 0}, addr32 = {1637357834, 0, 0, 0},
              addr16 = {6410, 24984, 0, 0, 0, 0, 0, 0},
              addr = "\n\031\230a", '\000' <repeats 11 times>}}, src_port = 5060,
          dst_port = 5060, proto_reserved1 = 0, proto_reserved2 = 0, src_su = {s = {
              sa_family = 2,
              sa_data = "\023\304\n\031\205\001\000\000\000\000\000\000\000"}, sin = {
              sin_family = 2, sin_port = 50195, sin_addr = {s_addr = 25499914},
              sin_zero = "\000\000\000\000\000\000\000"}, sin6 = {sin6_family = 2,
              sin6_port = 50195, sin6_flowinfo = 25499914, sin6_addr = {__in6_u = {
                  __u6_addr8 = '\000' <repeats 15 times>, __u6_addr16 = {0, 0, 0, 0, 0, 0,
                    0, 0}, __u6_addr32 = {0, 0, 0, 0}}}, sin6_scope_id = 0}},
          bind_address = 0x7f737ec96410, proto = 1 '\001'}
#7  0x000000000046163b in main_loop () at main.c:1633
        i = <value optimized out>
        pid = <value optimized out>
        si = <value optimized out>
        si_desc = "udp receiver child=2 sock=10.25.152.97:5060\000\000\000\000\000\260\276\3           45~s\177\000\000\000\000\000\000\000\000\000\000\003\000\000\000\000\000\000\000\001\000\000           \000\004\000\000\000\000\272\214\000\000\000\000\000\n\000\000\000\000\000\000\000@\272\214\           000\000\000\000\000\000\000\000\001\001", '\000' <repeats 11 times>, "\003\000\000\000\000\0           00\000"
        nrprocs = <value optimized out>
#8  0x00000000004641dc in main (argc=<value optimized out>, argv=<value optimized out>)
    at main.c:2546
        cfg_stream = <value optimized out>
        c = <value optimized out>
        r = <value optimized out>
        tmp = 0x7fff4109cf2b ""
        tmp_len = 0
        options = 0x5a40a8 ":f:cm:M:dVIhEb:l:L:n:vrRDTN:W:w:t:u:g:P:G:SQ:O:a:A:"
        ret = -1
---Type <return> to continue, or q <return> to quit---
        seed = 3964642532
        rfd = <value optimized out>
        debug_save = <value optimized out>
        debug_flag = <value optimized out>
        dont_fork_cnt = <value optimized out>
        n_lst = <value optimized out>
        p = <value optimized out>



More information about the sr-users mailing list