From ibc@aliax.net Fri Dec 10 13:39:25 2010
From: =?utf-8?q?I=C3=B1aki?= Baz Castillo <ibc@aliax.net>
To: sr-dev@lists.kamailio.org
Subject: [sr-dev] SR master: [tcp_main.c:700]: _wbufq_add(): ERROR:
 wbufq_add(371 bytes): write queue full or timeout
Date: Fri, 10 Dec 2010 13:39:18 +0100
Message-ID: <AANLkTi=yOPFacFCg6ZuBM=7EFt3COYJybgWxSnL2ULAQ@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============1851158436=="

--===============1851158436==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 8bit

Hi, I'm testing TCP support in Kamailio master branch.

The test is a bit special because I open a TCP connection (client and
proxy in localhost) and send a TCP data containing 5000 SIP requests
together (which is valid). Then wait for responses and parses them.
Kamailio just replies stateless for all those requests (no routing, no
forwarding, no more processing). There are two TCP workers.

Sometimes it works ok and all the replies are received, but sometimes
Kamailio gives an error after receiving N requests (i.e. 1072
requests):


kamailio[18349]: INFO: <script>: Branch = z9hG4bK1---num-request-1071#015#012
kamailio[18349]: ERROR: <core> [tcp_main.c:700]: _wbufq_add(): ERROR:
wbufq_add(372 bytes): write queue full or timeout  (32455, total
32455, last write 0 s ago)
kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
msg_send: ERROR: tcp_send failed
kamailio[18349]: INFO: <script>: Branch = z9hG4bK1---num-request-1072#015#012
kamailio[18350]: ERROR: <core> [tcp_main.c:3594]: handle_ser_child():
handle_ser_child: ERROR: received CON_ERROR for 0x7fc0dd172880 (id
65), refcnt 3, flags 0x601c
kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
connect 127.0.0.1:51901 failed (RST) Connection refused
kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
127.0.0.1:51901: connect & send  for 0x7fc0dd17c648 failed: Connection
refused (111)
kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
msg_send: ERROR: tcp_send failed
kamailio[18349]: INFO: <script>: Branch = z9hG4bK1---num-request-1073#015#012
kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
connect 127.0.0.1:51901 failed (RST) Connection refused
kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
127.0.0.1:51901: connect & send  for 0x7fc0dd17c648 failed: Connection
refused (111)
kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
msg_send: ERROR: tcp_send failed
kamailio[18349]: INFO: <script>: Branch = z9hG4bK1---num-request-1074#015#012
kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
connect 127.0.0.1:51901 failed (RST) Connection refused
kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
127.0.0.1:51901: connect & send  for 0x7fc0dd17c648 failed: Connection
refused (111)
kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
msg_send: ERROR: tcp_send failed
kamailio[18349]: INFO: <script>: Branch = z9hG4bK1---num-request-1075#015#012
kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
connect 127.0.0.1:51901 failed (RST) Connection refused
kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
127.0.0.1:51901: connect & send  for 0x7fc0dd17c648 failed: Connection
refused (111)
kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
msg_send: ERROR: tcp_send failed
kamailio[18349]: INFO: <script>: Branch = z9hG4bK1---num-request-1076#015#012
kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
connect 127.0.0.1:51901 failed (RST) Connection refused
kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
127.0.0.1:51901: connect & send  for 0x7fc0dd17c648 failed: Connection
refused (111)
kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
msg_send: ERROR: tcp_send failed
kamailio[18349]: INFO: <script>: Branch = z9hG4bK1---num-request-1077#015#012
kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
connect 127.0.0.1:51901 failed (RST) Connection refused
kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
127.0.0.1:51901: connect & send  for 0x7fc0dd17c648 failed: Connection
refused (111)
kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
msg_send: ERROR: tcp_send failed


And finally Kamailio closes the TCP connection:

kamailio[18349]: WARNING: <core> [tcp_read.c:1195]: handle_io():
WARNING: tcp_receive: handle_io: F_TCPCONN connection marked as bad:
0x7fc0dd172880 id 65 refcnt 1



I've no special parameters for TCP in the kamailio.cfg, just the
default config file.
Is it a bug? can it be improved by setting some parameter? However
it's strange the fact that the error just occurs sometimes (but very
often).


Thanks.


-- 
Iñaki Baz Castillo
<ibc(a)aliax.net>


--===============1851158436==--


From ibc@aliax.net Sun Dec 12 02:01:14 2010
From: =?utf-8?q?I=C3=B1aki?= Baz Castillo <ibc@aliax.net>
To: sr-dev@lists.kamailio.org
Subject: Re: [sr-dev] SR master: [tcp_main.c:700]: _wbufq_add(): ERROR:
 wbufq_add(371 bytes): write queue full or timeout
Date: Sun, 12 Dec 2010 02:01:08 +0100
Message-ID: <AANLkTikK3qb9UVNVWhFdXgsCiusxCi3-9xjFB-K1xVCy@mail.gmail.com>
In-Reply-To: <AANLkTi=yOPFacFCg6ZuBM=7EFt3COYJybgWxSnL2ULAQ@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============0917001333=="

--===============0917001333==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: 8bit

2010/12/10 Iñaki Baz Castillo <ibc(a)aliax.net>:
> kamailio[18349]: WARNING: <core> [tcp_read.c:1195]: handle_io():
> WARNING: tcp_receive: handle_io: F_TCPCONN connection marked as bad:
> 0x7fc0dd172880 id 65 refcnt 1
>
>
>
> I've no special parameters for TCP in the kamailio.cfg, just the
> default config file.
> Is it a bug? can it be improved by setting some parameter? However
> it's strange the fact that the error just occurs sometimes (but very
> often).


In Kamailio 1.5.4 this issue doesn't occur. Same test has *never*
failed in 1.5.4.

-- 
Iñaki Baz Castillo
<ibc(a)aliax.net>


--===============0917001333==--


From ibc@aliax.net Thu Dec 16 12:36:49 2010
From: =?utf-8?q?I=C3=B1aki?= Baz Castillo <ibc@aliax.net>
To: sr-dev@lists.kamailio.org
Subject: Re: [sr-dev] SR master: [tcp_main.c:700]: _wbufq_add(): ERROR:
 wbufq_add(371 bytes): write queue full or timeout
Date: Thu, 16 Dec 2010 12:36:43 +0100
Message-ID: <AANLkTim6Hmu3KPaQMvuOo782GPnfscHt0+ReLsWvrm82@mail.gmail.com>
In-Reply-To: <AANLkTi=yOPFacFCg6ZuBM=7EFt3COYJybgWxSnL2ULAQ@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============1933900248=="

--===============1933900248==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

Hi, some comment about it please? :)


2010/12/10 I=C3=B1aki Baz Castillo <ibc(a)aliax.net>:
> Hi, I'm testing TCP support in Kamailio master branch.
>
> The test is a bit special because I open a TCP connection (client and
> proxy in localhost) and send a TCP data containing 5000 SIP requests
> together (which is valid). Then wait for responses and parses them.
> Kamailio just replies stateless for all those requests (no routing, no
> forwarding, no more processing). There are two TCP workers.
>
> Sometimes it works ok and all the replies are received, but sometimes
> Kamailio gives an error after receiving N requests (i.e. 1072
> requests):
>
>
> kamailio[18349]: INFO: <script>: Branch =3D z9hG4bK1---num-request-1071#015=
#012
> kamailio[18349]: ERROR: <core> [tcp_main.c:700]: _wbufq_add(): ERROR:
> wbufq_add(372 bytes): write queue full or timeout =C2=A0(32455, total
> 32455, last write 0 s ago)
> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
> msg_send: ERROR: tcp_send failed
> kamailio[18349]: INFO: <script>: Branch =3D z9hG4bK1---num-request-1072#015=
#012
> kamailio[18350]: ERROR: <core> [tcp_main.c:3594]: handle_ser_child():
> handle_ser_child: ERROR: received CON_ERROR for 0x7fc0dd172880 (id
> 65), refcnt 3, flags 0x601c
> kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
> connect 127.0.0.1:51901 failed (RST) Connection refused
> kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
> 127.0.0.1:51901: connect & send =C2=A0for 0x7fc0dd17c648 failed: Connection
> refused (111)
> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
> msg_send: ERROR: tcp_send failed
> kamailio[18349]: INFO: <script>: Branch =3D z9hG4bK1---num-request-1073#015=
#012
> kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
> connect 127.0.0.1:51901 failed (RST) Connection refused
> kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
> 127.0.0.1:51901: connect & send =C2=A0for 0x7fc0dd17c648 failed: Connection
> refused (111)
> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
> msg_send: ERROR: tcp_send failed
> kamailio[18349]: INFO: <script>: Branch =3D z9hG4bK1---num-request-1074#015=
#012
> kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
> connect 127.0.0.1:51901 failed (RST) Connection refused
> kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
> 127.0.0.1:51901: connect & send =C2=A0for 0x7fc0dd17c648 failed: Connection
> refused (111)
> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
> msg_send: ERROR: tcp_send failed
> kamailio[18349]: INFO: <script>: Branch =3D z9hG4bK1---num-request-1075#015=
#012
> kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
> connect 127.0.0.1:51901 failed (RST) Connection refused
> kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
> 127.0.0.1:51901: connect & send =C2=A0for 0x7fc0dd17c648 failed: Connection
> refused (111)
> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
> msg_send: ERROR: tcp_send failed
> kamailio[18349]: INFO: <script>: Branch =3D z9hG4bK1---num-request-1076#015=
#012
> kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
> connect 127.0.0.1:51901 failed (RST) Connection refused
> kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
> 127.0.0.1:51901: connect & send =C2=A0for 0x7fc0dd17c648 failed: Connection
> refused (111)
> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
> msg_send: ERROR: tcp_send failed
> kamailio[18349]: INFO: <script>: Branch =3D z9hG4bK1---num-request-1077#015=
#012
> kamailio[18349]: ERROR: <core> [tcp_main.c:2743]: tcpconn_1st_send():
> connect 127.0.0.1:51901 failed (RST) Connection refused
> kamailio[18349]: ERROR: <core> [tcp_main.c:2753]: tcpconn_1st_send():
> 127.0.0.1:51901: connect & send =C2=A0for 0x7fc0dd17c648 failed: Connection
> refused (111)
> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
> msg_send: ERROR: tcp_send failed
>
>
> And finally Kamailio closes the TCP connection:
>
> kamailio[18349]: WARNING: <core> [tcp_read.c:1195]: handle_io():
> WARNING: tcp_receive: handle_io: F_TCPCONN connection marked as bad:
> 0x7fc0dd172880 id 65 refcnt 1
>
>
>
> I've no special parameters for TCP in the kamailio.cfg, just the
> default config file.
> Is it a bug? can it be improved by setting some parameter? However
> it's strange the fact that the error just occurs sometimes (but very
> often).
>
>
> Thanks.
>
>
> --
> I=C3=B1aki Baz Castillo
> <ibc(a)aliax.net>
>



--=20
I=C3=B1aki Baz Castillo
<ibc(a)aliax.net>


--===============1933900248==--


From miconda@gmail.com Fri Dec 17 00:33:45 2010
From: Daniel-Constantin Mierla <miconda@gmail.com>
To: sr-dev@lists.kamailio.org
Subject: Re: [sr-dev] SR master: [tcp_main.c:700]: _wbufq_add(): ERROR:
 wbufq_add(371 bytes): write queue full or timeout
Date: Fri, 17 Dec 2010 00:33:25 +0100
Message-ID: <4D0AA1C5.6010707@gmail.com>
In-Reply-To: <AANLkTim6Hmu3KPaQMvuOo782GPnfscHt0+ReLsWvrm82@mail.gmail.com>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============0707365977=="

--===============0707365977==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

Hello,

On 12/16/10 12:36 PM, I=C3=B1aki Baz Castillo wrote:
> Hi, some comment about it please? :)

try to increase the value of parameter:
http://www.kamailio.org/dokuwiki/doku.php/core-cookbook:3.1.x#tcp_conn_wq_max

Since there is a connection under heavy traffic, you have to adjust the=20
setting for tcp a bit.

Cheers,
Daniel

>
> 2010/12/10 I=C3=B1aki Baz Castillo<ibc(a)aliax.net>:
>> Hi, I'm testing TCP support in Kamailio master branch.
>>
>> The test is a bit special because I open a TCP connection (client and
>> proxy in localhost) and send a TCP data containing 5000 SIP requests
>> together (which is valid). Then wait for responses and parses them.
>> Kamailio just replies stateless for all those requests (no routing, no
>> forwarding, no more processing). There are two TCP workers.
>>
>> Sometimes it works ok and all the replies are received, but sometimes
>> Kamailio gives an error after receiving N requests (i.e. 1072
>> requests):
>>
>>
>> kamailio[18349]: INFO:<script>: Branch =3D z9hG4bK1---num-request-1071#015=
#012
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:700]: _wbufq_add(): ERROR:
>> wbufq_add(372 bytes): write queue full or timeout  (32455, total
>> 32455, last write 0 s ago)
>> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
>> msg_send: ERROR: tcp_send failed
>> kamailio[18349]: INFO:<script>: Branch =3D z9hG4bK1---num-request-1072#015=
#012
>> kamailio[18350]: ERROR:<core>  [tcp_main.c:3594]: handle_ser_child():
>> handle_ser_child: ERROR: received CON_ERROR for 0x7fc0dd172880 (id
>> 65), refcnt 3, flags 0x601c
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2743]: tcpconn_1st_send():
>> connect 127.0.0.1:51901 failed (RST) Connection refused
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2753]: tcpconn_1st_send():
>> 127.0.0.1:51901: connect&  send  for 0x7fc0dd17c648 failed: Connection
>> refused (111)
>> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
>> msg_send: ERROR: tcp_send failed
>> kamailio[18349]: INFO:<script>: Branch =3D z9hG4bK1---num-request-1073#015=
#012
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2743]: tcpconn_1st_send():
>> connect 127.0.0.1:51901 failed (RST) Connection refused
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2753]: tcpconn_1st_send():
>> 127.0.0.1:51901: connect&  send  for 0x7fc0dd17c648 failed: Connection
>> refused (111)
>> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
>> msg_send: ERROR: tcp_send failed
>> kamailio[18349]: INFO:<script>: Branch =3D z9hG4bK1---num-request-1074#015=
#012
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2743]: tcpconn_1st_send():
>> connect 127.0.0.1:51901 failed (RST) Connection refused
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2753]: tcpconn_1st_send():
>> 127.0.0.1:51901: connect&  send  for 0x7fc0dd17c648 failed: Connection
>> refused (111)
>> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
>> msg_send: ERROR: tcp_send failed
>> kamailio[18349]: INFO:<script>: Branch =3D z9hG4bK1---num-request-1075#015=
#012
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2743]: tcpconn_1st_send():
>> connect 127.0.0.1:51901 failed (RST) Connection refused
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2753]: tcpconn_1st_send():
>> 127.0.0.1:51901: connect&  send  for 0x7fc0dd17c648 failed: Connection
>> refused (111)
>> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
>> msg_send: ERROR: tcp_send failed
>> kamailio[18349]: INFO:<script>: Branch =3D z9hG4bK1---num-request-1076#015=
#012
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2743]: tcpconn_1st_send():
>> connect 127.0.0.1:51901 failed (RST) Connection refused
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2753]: tcpconn_1st_send():
>> 127.0.0.1:51901: connect&  send  for 0x7fc0dd17c648 failed: Connection
>> refused (111)
>> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
>> msg_send: ERROR: tcp_send failed
>> kamailio[18349]: INFO:<script>: Branch =3D z9hG4bK1---num-request-1077#015=
#012
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2743]: tcpconn_1st_send():
>> connect 127.0.0.1:51901 failed (RST) Connection refused
>> kamailio[18349]: ERROR:<core>  [tcp_main.c:2753]: tcpconn_1st_send():
>> 127.0.0.1:51901: connect&  send  for 0x7fc0dd17c648 failed: Connection
>> refused (111)
>> kamailio[18349]: ERROR: sl [../../forward.h:169]: msg_send():
>> msg_send: ERROR: tcp_send failed
>>
>>
>> And finally Kamailio closes the TCP connection:
>>
>> kamailio[18349]: WARNING:<core>  [tcp_read.c:1195]: handle_io():
>> WARNING: tcp_receive: handle_io: F_TCPCONN connection marked as bad:
>> 0x7fc0dd172880 id 65 refcnt 1
>>
>>
>>
>> I've no special parameters for TCP in the kamailio.cfg, just the
>> default config file.
>> Is it a bug? can it be improved by setting some parameter? However
>> it's strange the fact that the error just occurs sometimes (but very
>> often).
>>
>>
>> Thanks.
>>
>>
>> --
>> I=C3=B1aki Baz Castillo
>> <ibc(a)aliax.net>
>>
>
>

--=20
Daniel-Constantin Mierla
Kamailio (OpenSER) Advanced Training
Jan 24-26, 2011, Irvine, CA, USA
http://www.asipto.com



--===============0707365977==--


From ibc@aliax.net Fri Dec 17 11:11:36 2010
From: =?utf-8?q?I=C3=B1aki?= Baz Castillo <ibc@aliax.net>
To: sr-dev@lists.kamailio.org
Subject: Re: [sr-dev] SR master: [tcp_main.c:700]: _wbufq_add(): ERROR:
 wbufq_add(371 bytes): write queue full or timeout
Date: Fri, 17 Dec 2010 11:11:29 +0100
Message-ID: <AANLkTinE2Bm=6YjoCYSN-mDji9gqzCVe+ih1ATxx7ZbV@mail.gmail.com>
In-Reply-To: <4D0AA1C5.6010707@gmail.com>
MIME-Version: 1.0
Content-Type: multipart/mixed; boundary="===============1765809215=="

--===============1765809215==
Content-Type: text/plain; charset="utf-8"
Content-Transfer-Encoding: quoted-printable

2010/12/17 Daniel-Constantin Mierla <miconda(a)gmail.com>:
> try to increase the value of parameter:
> http://www.kamailio.org/dokuwiki/doku.php/core-cookbook:3.1.x#tcp_conn_wq_m=
ax
>
> Since there is a connection under heavy traffic, you have to adjust the
> setting for tcp a bit.

100% right :)
Due to the nature of my test, setting that parameter makes the work :)

Thanks a lot.

--=20
I=C3=B1aki Baz Castillo
<ibc(a)aliax.net>


--===============1765809215==--