Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-25 Thread Marcus Kool
Kool" An: "Jens Offenbach" , squid-users@lists.squid-cache.org Betreff: Re: Aw: Re: [squid-users] Squid3: 100 % CPU load during object caching On 07/24/2015 01:01 PM, Jens Offenbach wrote: @Marcus: I am not sure what exactly causes the problems, but could you please make a

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-25 Thread Jens Offenbach
, 24. Juli 2015 um 19:01 Uhr Von: "Marcus Kool" An: "Jens Offenbach" , squid-users@lists.squid-cache.org Betreff: Re: Aw: Re: [squid-users] Squid3: 100 % CPU load during object caching On 07/24/2015 01:01 PM, Jens Offenbach wrote: > @Marcus: > I am not sure what exactl

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-24 Thread Marcus Kool
: Freitag, 24. Juli 2015 um 14:33 Uhr Von: "Marcus Kool" An: "Jens Offenbach" , squid-users@lists.squid-cache.org Betreff: Re: [squid-users] Squid3: 100 % CPU load during object caching On 07/24/2015 03:25 AM, Jens Offenbach wrote: I have made a quick test of Squid 3.3.8 on Ub

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-24 Thread Jens Offenbach
: "Marcus Kool" An: "Jens Offenbach" , squid-users@lists.squid-cache.org Betreff: Re: [squid-users] Squid3: 100 % CPU load during object caching On 07/24/2015 03:25 AM, Jens Offenbach wrote: > I have made a quick test of Squid 3.3.8 on Ubuntu 15.04 and I get the same > proble

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-24 Thread Marcus Kool
liezer Croitoru" , "Amos Jeffries" , squid-users@lists.squid-cache.org Betreff: Re: [squid-users] Squid3: 100 % CPU load during object caching It is not easy for me, but I have tested Squid 3.3.8 from the Ubuntu packaging on a "real" physical infrastructure. I get the same

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-24 Thread Amos Jeffries
On 24/07/2015 7:49 p.m., Jens Offenbach wrote: > I have found something out... Hopefully, it helps to reproduce and solve the > issue. > > I got it working with a good download rate, but very high CPU usage on Squid > 3.3.8 and Squid 3.5.6. There seems to be problem with large files that get >

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-24 Thread Amos Jeffries
t; http://w1.wikisend.com/node-fs/download/6a004a416f65b4cdf7f8eff4ff961199/squid.strace >> >> I hope it can help you. >> *Gesendet:* Donnerstag, 23. Juli 2015 um 13:29 Uhr >> *Von:* "Marcus Kool" >> *An:* "Jens Offenbach" , "Eliezer Croitoru&qu

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-24 Thread Jens Offenbach
;Jens Offenbach" An: squid-users@lists.squid-cache.org Betreff: Re: [squid-users] Squid3: 100 % CPU load during object caching I have made a quick test of Squid 3.3.8 on Ubuntu 15.04 and I get the same problem: 100 % CPU usage, 500 KB/sec download rate.   Gesendet: Freitag, 24. Juli 2015 um 07:

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
ot; , squid-users@lists.squid-cache.org Betreff: Re: [squid-users] Squid3: 100 % CPU load during object caching It is not easy for me, but I have tested Squid 3.3.8 from the Ubuntu packaging on a "real" physical infrastructure. I get the same results on the physical machine (1x Intel(R)

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
Gesendet: Donnerstag, 23. Juli 2015 um 20:08 Uhr Von: "Marcus Kool" An: "Jens Offenbach" , "Amos Jeffries" , "Eliezer Croitoru" , squid-users@lists.squid-cache.org Betreff: Re: Aw: Re: [squid-users] Squid3: 100 % CPU load during object caching The strace

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Marcus Kool
*Gesendet:* Donnerstag, 23. Juli 2015 um 13:29 Uhr *Von:* "Marcus Kool" *An:* "Jens Offenbach" , "Eliezer Croitoru" , "Amos Jeffries" , squid-users@lists.squid-cache.org *Betreff:* Re: [squid-users] Squid3: 100 % CPU load during object caching I am not sure i

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
Ok. I am sorry, Please, try this one: http://wikisend.com/download/413650/squid.strace Regards, Jens   Gesendet: Donnerstag, 23. Juli 2015 um 16:25 Uhr Von: "Marcus Kool" An: "Jens Offenbach" Betreff: Re: Aw: Re: [squid-users] Squid3: 100 % CPU load during object cachin

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Amos Jeffries
On 23/07/2015 11:29 p.m., Marcus Kool wrote: > I am not sure if it is relevant, maybe it is: > > I am developing an ICAP daemon and after the ICAP server sends a "100 > continue" > Squid sends the object to the ICAP server in small chunks of varying sizes: > 4095, 5813, 1448, 4344, 1448, 1448, 289

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
uid.strace   I hope it can help you.   Gesendet: Donnerstag, 23. Juli 2015 um 13:29 Uhr Von: "Marcus Kool" An: "Jens Offenbach" , "Eliezer Croitoru" , "Amos Jeffries" , squid-users@lists.squid-cache.org Betreff: Re: [squid-users] Squid3: 100 % CPU load duri

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Marcus Kool
; '--with-large-files' '--with-default-user=proxy' '--enable-linux-netfilter' 'build_alias=x86_64-linux-gnu' 'CFLAGS=-g -O2 -fPIE -fstack-protector --param=ssp-buffer-size=4 -Wformat -Werror=format-security -Wall' 'LDFLAGS=-Wl,-Bsymbolic-functi

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
x27; '--with-pidfile=/var/run/squid3.pid' '--with-filedescriptors=65536' '--with-large-files' '--with-default-user=proxy' '--enable-linux-netfilter' 'build_alias=x86_64-linux-gnu' 'CFLAGS=-g -O2 -fPIE -fstack-protector --param=ssp-bu

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-22 Thread Jens Offenbach
ries" Betreff: Re: [squid-users] Squid3: 100 % CPU load during object caching On 22/07/2015 21:59, Eliezer Croitoru wrote: > Hey Jens, > > I have tested the issue with LARGE ROCK and not AUFS or UFS. > Using squid or not my connection to the server is about 2.5 MBps (20Mbps). >

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-22 Thread Eliezer Croitoru
On 22/07/2015 21:59, Eliezer Croitoru wrote: Hey Jens, I have tested the issue with LARGE ROCK and not AUFS or UFS. Using squid or not my connection to the server is about 2.5 MBps (20Mbps). Squid is sitting on an intel atom with SSD drive and on a HIT case the download speed is more then double

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-22 Thread Eliezer Croitoru
Von: "Eliezer Croitoru" An: squid-users@lists.squid-cache.org Betreff: Re: [squid-users] Squid3: 100 % CPU load during object caching Can you share the relevant squid.conf settings? Just to reproduce.. I have a dedicated testing server here which I can test the issue on. 8GB archive whic

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-22 Thread Jens Offenbach
18:28 Uhr Von: "Eliezer Croitoru" An: squid-users@lists.squid-cache.org Betreff: Re: [squid-users] Squid3: 100 % CPU load during object caching Can you share the relevant squid.conf settings? Just to reproduce.. I have a dedicated testing server here which I can test the issue on. 8GB

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-22 Thread Eliezer Croitoru
3.327152 3428139 7 total Can I do anything that helps to get ride of this problem? Gesendet: Dienstag, 21. Juli 2015 um 17:37 Uhr Von: "Amos Jeffries" An: "Jens Offenbach" , "squid-users@lists.squid-cache.org" Betreff: Re: Aw: Re: [squid-users] Squid3: 100 % CPU load

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-22 Thread Jens Offenbach
3428139 7 total Can I do anything that helps to get ride of this problem?   Gesendet: Dienstag, 21. Juli 2015 um 17:37 Uhr Von: "Amos Jeffries" An: "Jens Offenbach" , "squid-users@lists.squid-cache.org" Betreff: Re: Aw: Re: [squid-users] Squid3: 100 % CPU load durin

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-21 Thread Amos Jeffries
On 22/07/2015 12:31 a.m., Jens Offenbach wrote: > Thank you very much for your detailed explainations. We want to use Squid in > order to accelerate our automated software setup processes via Puppet. > Actually > Squid will host only a very short amount of large objects (10-20). Its > purpose

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-21 Thread Eliezer Croitoru
On 21/07/2015 10:59, Jens Offenbach wrote: Is there someting wrong with my config? I have already used Squid 3.3.14. I get the same result. Unfortunately, I was not able to build Squid 3.5.5 and 3.5.6. What was the issue? I am using 3.5.6 on 14.04.2 64 bit. Eliezer __

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-21 Thread Amos Jeffries
On 21/07/2015 7:59 p.m., Jens Offenbach wrote: > I am running Squid3 3.3.8 on Ubuntu 14.04. Squid3 has been installed from the > Ubuntu package repository. In my scenario, Squid has to cache big files >= 1 > GB. At the moment, I am getting very bad transfer rates lower that 1 MB/sec. > I have ch

[squid-users] Squid3: 100 % CPU load during object caching

2015-07-21 Thread Jens Offenbach
I am running Squid3 3.3.8 on Ubuntu 14.04. Squid3 has been installed from the Ubuntu package repository. In my scenario, Squid has to cache big files >= 1 GB. At the moment, I am getting very bad transfer rates lower that 1 MB/sec. I have checked the connectivity using iperf3. It gives my a band