Hi,
I am performing SIP to SIP performance testing using Kamailio proxy (UAC-Kamailio-UAC). After increasing the load to 300 calls/sec Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine. I think the bottleneck is the Linux UDP buffer size of the proxy server. Here is the proxy server information:
$ uname -a Linux lab-linux01 2.6.24-19-server #1 SMP Wed Jun 18 14:44:47 UTC 2008 x86_64 GNU/Linux
$ sudo sysctl -a | grep net.core.rmem_max net.core.rmem_max = 131071
The question is if I increase the linux UDP buffer size do I need to change any configuartion parameter (like MAX_RECV_BUFFER_SIZE) in Kamailio?
Thanks, Alex R
_________________________________________________________________ Windows Live™: Keep your life in sync. http://windowslive.com/howitworks?ocid=TXT_TAGLM_WL_t1_allup_howitworks_0220...
Hello,
On 02/11/2009 04:51 PM, Alex R.S.M wrote:
Hi,
I am performing SIP to SIP performance testing using Kamailio proxy (UAC-Kamailio-UAC). After increasing the load to 300 calls/sec Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine. I think the bottleneck is the Linux UDP buffer size of the proxy server. Here is the proxy server information:
kamailio autodetects and sets the buffer size to the maximum allowed. What are the number of children you have in config? Do you get any error messages in the syslog?
Cheers, Daniel
$ uname -a Linux lab-linux01 2.6.24-19-server #1 SMP Wed Jun 18 14:44:47 UTC 2008 x86_64 GNU/Linux
$ sudo sysctl -a | grep net.core.rmem_max net.core.rmem_max = 131071
The question is if I increase the linux UDP buffer size do I need to change any configuartion parameter (like MAX_RECV_BUFFER_SIZE) in Kamailio?
Thanks, Alex R
Windows Live™: Keep your life in sync. See how it works. http://windowslive.com/howitworks?ocid=TXT_TAGLM_WL_t1_allup_howitworks_022009
Kamailio (OpenSER) - Users mailing list Users@lists.kamailio.org http://lists.kamailio.org/cgi-bin/mailman/listinfo/users http://lists.openser-project.org/cgi-bin/mailman/listinfo/users
hello
What are the number of children you have in config?
fork=yes children=4
Do you get any error messages in the syslog?
not getting any error message in /var/log/syslog
Thanks, Ali
Date: Wed, 11 Feb 2009 17:21:46 +0200 From: miconda@gmail.com To: alex_rsm@hotmail.com CC: users@lists.kamailio.org Subject: Re: [Kamailio-Users] UDP packet loss
Hello,
On 02/11/2009 04:51 PM, Alex R.S.M wrote:
Hi,
I am performing SIP to SIP performance testing using Kamailio proxy (UAC-Kamailio-UAC). After increasing the load to 300 calls/sec Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine. I think the bottleneck is the Linux UDP buffer size of the proxy server. Here is the proxy server information:
kamailio autodetects and sets the buffer size to the maximum allowed. What are the number of children you have in config? Do you get any error messages in the syslog?
Cheers, Daniel
$ uname -a Linux lab-linux01 2.6.24-19-server #1 SMP Wed Jun 18 14:44:47 UTC 2008 x86_64 GNU/Linux
$ sudo sysctl -a | grep net.core.rmem_max net.core.rmem_max = 131071
The question is if I increase the linux UDP buffer size do I need to change any configuartion parameter (like MAX_RECV_BUFFER_SIZE) in Kamailio?
Thanks, Alex R
Windows Live™: Keep your life in sync. See how it works. http://windowslive.com/howitworks?ocid=TXT_TAGLM_WL_t1_allup_howitworks_022009
Kamailio (OpenSER) - Users mailing list Users@lists.kamailio.org http://lists.kamailio.org/cgi-bin/mailman/listinfo/users http://lists.openser-project.org/cgi-bin/mailman/listinfo/users
-- Daniel-Constantin Mierla http://www.asipto.com
_________________________________________________________________ Windows Live™: E-mail. Chat. Share. Get more ways to connect. http://windowslive.com/explore?ocid=TXT_TAGLM_WL_t2_allup_explore_022009
Hello,
On 02/11/2009 05:43 PM, Alex R.S.M wrote:
hello
What are the number of children you have in config?
fork=yes children=4
this is a bit low if you want to manage high traffic. Try with children=16 and see how the results are.
Cheers, Daniel
Do you get any error messages in the syslog?
not getting any error message in /var/log/syslog
Thanks, Ali
Date: Wed, 11 Feb 2009 17:21:46 +0200 From: miconda@gmail.com To: alex_rsm@hotmail.com CC: users@lists.kamailio.org Subject: Re: [Kamailio-Users] UDP packet loss
Hello,
On 02/11/2009 04:51 PM, Alex R.S.M wrote:
Hi,
I am performing SIP to SIP performance testing using Kamailio proxy (UAC-Kamailio-UAC). After increasing the load to 300 calls/sec Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine. I think the bottleneck is the Linux UDP buffer size of the proxy server. Here is the proxy server information:
kamailio autodetects and sets the buffer size to the maximum allowed. What are the number of children you have in config? Do you get any
error
messages in the syslog?
Cheers, Daniel
$ uname -a Linux lab-linux01 2.6.24-19-server #1 SMP Wed Jun 18 14:44:47 UTC
2008
x86_64 GNU/Linux
$ sudo sysctl -a | grep net.core.rmem_max net.core.rmem_max = 131071
The question is if I increase the linux UDP buffer size do I need to change any configuartion parameter (like MAX_RECV_BUFFER_SIZE) in Kamailio?
Thanks, Alex R
Windows Live™: Keep your life in sync. See how it works.
http://windowslive.com/howitworks?ocid=TXT_TAGLM_WL_t1_allup_howitworks_022009
Kamailio (OpenSER) - Users mailing list Users@lists.kamailio.org http://lists.kamailio.org/cgi-bin/mailman/listinfo/users http://lists.openser-project.org/cgi-bin/mailman/listinfo/users
-- Daniel-Constantin Mierla http://www.asipto.com
Windows Live™: E-mail. Chat. Share. Get more ways to connect. Check it out. http://windowslive.com/explore?ocid=TXT_TAGLM_WL_t2_allup_explore_022009
Hi,
As I mentioned in my previous email I am performing SIP to SIP performance testing using Kamailio proxy (UAC-Kamailio-UAC). After increasing the load to 300 calls/sec, Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine.
- UDP packet size on the Linux server is increased to 8M: net.core.rmem_max = 8388608
- the number of children used in Kamailio config increased to 16: fork=yes children=16
Here is there error I am getting in /var/log/syslog file:
Feb 13 15:17:39 lab-linux01 /sbin/kamailio[12014]: ERROR:tm:new_t: out of mem Feb 13 15:17:39 lab-linux01 /sbin/kamailio[12014]: ERROR:tm:t_newtran: new_t failed Feb 13 15:17:39 lab-linux01 /sbin/kamailio[12024]: ERROR:tm:new_t: out of mem Feb 13 15:17:39 lab-linux01 /sbin/kamailio[12024]: ERROR:tm:t_newtran: new_t failed
I am using 64M for the memory size (/etc/default/kamailio) # Amount of memory to allocate for the running Kamailio server (in Mb) MEMORY=64
Does it mean I need to increase this value?
Thanks,
Date: Wed, 11 Feb 2009 18:26:49 +0200 From: miconda@gmail.com To: alex_rsm@hotmail.com CC: users@lists.kamailio.org Subject: Re: [Kamailio-Users] UDP packet loss
Hello,
On 02/11/2009 05:43 PM, Alex R.S.M wrote:
hello
What are the number of children you have in config?
fork=yes children=4
this is a bit low if you want to manage high traffic. Try with children=16 and see how the results are.
Cheers, Daniel
Do you get any error messages in the syslog?
not getting any error message in /var/log/syslog
Thanks, Ali
Date: Wed, 11 Feb 2009 17:21:46 +0200 From: miconda@gmail.com To: alex_rsm@hotmail.com CC: users@lists.kamailio.org Subject: Re: [Kamailio-Users] UDP packet loss
Hello,
On 02/11/2009 04:51 PM, Alex R.S.M wrote:
Hi,
I am performing SIP to SIP performance testing using Kamailio proxy (UAC-Kamailio-UAC). After increasing the load to 300 calls/sec Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine. I think the bottleneck is the Linux UDP buffer size of the proxy server. Here is the proxy server information:
kamailio autodetects and sets the buffer size to the maximum allowed. What are the number of children you have in config? Do you get any
error
messages in the syslog?
Cheers, Daniel
$ uname -a Linux lab-linux01 2.6.24-19-server #1 SMP Wed Jun 18 14:44:47 UTC
2008
x86_64 GNU/Linux
$ sudo sysctl -a | grep net.core.rmem_max net.core.rmem_max = 131071
The question is if I increase the linux UDP buffer size do I need to change any configuartion parameter (like MAX_RECV_BUFFER_SIZE) in Kamailio?
Thanks, Alex R
Windows Live™: Keep your life in sync. See how it works.
http://windowslive.com/howitworks?ocid=TXT_TAGLM_WL_t1_allup_howitworks_022009
Kamailio (OpenSER) - Users mailing list Users@lists.kamailio.org http://lists.kamailio.org/cgi-bin/mailman/listinfo/users http://lists.openser-project.org/cgi-bin/mailman/listinfo/users
-- Daniel-Constantin Mierla http://www.asipto.com
Windows Live™: E-mail. Chat. Share. Get more ways to connect. Check it out. http://windowslive.com/explore?ocid=TXT_TAGLM_WL_t2_allup_explore_022009
-- Daniel-Constantin Mierla http://www.asipto.com
_________________________________________________________________ Windows Live™: Keep your life in sync. http://windowslive.com/howitworks?ocid=TXT_TAGLM_WL_t1_allup_howitworks_0220...
Hello,
On 02/13/2009 11:17 PM, Alex R.S.M wrote:
Hi,
As I mentioned in my previous email I am performing SIP to SIP performance testing using Kamailio proxy (UAC-Kamailio-UAC). After increasing the load to 300 calls/sec, Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine.
- UDP packet size on the Linux server is increased to 8M:
net.core.rmem_max = 8388608
- the number of children used in Kamailio config increased to 16:
fork=yes children=16
Here is there error I am getting in /var/log/syslog file:
Feb 13 15:17:39 lab-linux01 /sbin/kamailio[12014]: ERROR:tm:new_t: out of mem Feb 13 15:17:39 lab-linux01 /sbin/kamailio[12014]: ERROR:tm:t_newtran: new_t failed Feb 13 15:17:39 lab-linux01 /sbin/kamailio[12024]: ERROR:tm:new_t: out of mem Feb 13 15:17:39 lab-linux01 /sbin/kamailio[12024]: ERROR:tm:t_newtran: new_t failed
I am using 64M for the memory size (/etc/default/kamailio) # Amount of memory to allocate for the running Kamailio server (in Mb) MEMORY=64
Does it mean I need to increase this value?
Yes, you run out of share memory. Increase the value of MEMORY variable (it translates into -m command line option).
Cheers, Daniel
Thanks,
Date: Wed, 11 Feb 2009 18:26:49 +0200 From: miconda@gmail.com To: alex_rsm@hotmail.com CC: users@lists.kamailio.org Subject: Re: [Kamailio-Users] UDP packet loss
Hello,
On 02/11/2009 05:43 PM, Alex R.S.M wrote:
hello
What are the number of children you have in config?
fork=yes children=4
this is a bit low if you want to manage high traffic. Try with children=16 and see how the results are.
Cheers, Daniel
Do you get any error messages in the syslog?
not getting any error message in /var/log/syslog
Thanks, Ali
Date: Wed, 11 Feb 2009 17:21:46 +0200 From: miconda@gmail.com To: alex_rsm@hotmail.com CC: users@lists.kamailio.org Subject: Re: [Kamailio-Users] UDP packet loss
Hello,
On 02/11/2009 04:51 PM, Alex R.S.M wrote:
Hi,
I am performing SIP to SIP performance testing using Kamailio
proxy
(UAC-Kamailio-UAC). After increasing the load to 300 calls/sec Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine. I think the
bottleneck
is the Linux UDP buffer size of the proxy server. Here is the
proxy
server information:
kamailio autodetects and sets the buffer size to the maximum
allowed.
What are the number of children you have in config? Do you get any
error
messages in the syslog?
Cheers, Daniel
$ uname -a Linux lab-linux01 2.6.24-19-server #1 SMP Wed Jun 18 14:44:47 UTC
2008
x86_64 GNU/Linux
$ sudo sysctl -a | grep net.core.rmem_max net.core.rmem_max = 131071
The question is if I increase the linux UDP buffer size do I
need to
change any configuartion parameter (like MAX_RECV_BUFFER_SIZE) in Kamailio?
Thanks, Alex R
Windows Live™: Keep your life in sync. See how it works.
http://windowslive.com/howitworks?ocid=TXT_TAGLM_WL_t1_allup_howitworks_022009
Kamailio (OpenSER) - Users mailing list Users@lists.kamailio.org http://lists.kamailio.org/cgi-bin/mailman/listinfo/users http://lists.openser-project.org/cgi-bin/mailman/listinfo/users
-- Daniel-Constantin Mierla http://www.asipto.com
Windows Live™: E-mail. Chat. Share. Get more ways to connect.
Check it
out.
http://windowslive.com/explore?ocid=TXT_TAGLM_WL_t2_allup_explore_022009
-- Daniel-Constantin Mierla http://www.asipto.com
Windows Live™: Keep your life in sync. See how it works. http://windowslive.com/howitworks?ocid=TXT_TAGLM_WL_t1_allup_howitworks_022009
On Wednesday 11 February 2009, Alex R.S.M wrote:
I am performing SIP to SIP performance testing using Kamailio proxy (UAC-Kamailio-UAC). After increasing the load to 300 calls/sec Kamailio begins dropping UDP packets. (250 cps works fine). CPU utilization and network bandwidth looks fine. I think the bottleneck is the Linux UDP buffer size of the proxy server. Here is the proxy server information:
$ uname -a Linux lab-linux01 2.6.24-19-server #1 SMP Wed Jun 18 14:44:47 UTC 2008 x86_64 GNU/Linux
$ sudo sysctl -a | grep net.core.rmem_max net.core.rmem_max = 131071
The question is if I increase the linux UDP buffer size do I need to change any configuartion parameter (like MAX_RECV_BUFFER_SIZE) in Kamailio?
Hi Alex,
we're using a bigger rmem_max size, and not increased the MAX_RECV_BUFFER_SIZE. So far we don't have any problems. :-) The UDP receiver buffer is probed during the startup of the server.
Cheers,
Henning
-
Alex R.S.M -
Daniel-Constantin Mierla -
Henning Westerholt