Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
I have made a quick test of Squid 3.3.8 on Ubuntu 15.04 and I get the same problem: 100 % CPU usage, 500 KB/sec download rate.   Gesendet: Freitag, 24. Juli 2015 um 07:54 Uhr Von: "Jens Offenbach" An: "Marcus Kool" , "Eliezer Croitoru" , "Amos Jeffries" , squid-users@lists.squid-cache.org Betr

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
It is not easy for me, but I have tested Squid 3.3.8 from the Ubuntu packaging on a "real" physical infrastructure. I get the same results on the physical machine (1x Intel(R) Xeon(R) CPU E3-1225 V2 @ 3.20GHz, 32 GB RAM, 1 TB disk) where Squid is running: 100 % CPU usage, 500 KB/sec download rat

Re: [squid-users] squid youtube caching

2015-07-23 Thread dan
Not to go off-topic here, but you folks are all SSL Bumping youtube.com / googlevideo.com in order to do this caching, right? Want to make sure I’m not missing some secret way to make YouTube use plain HTTP. On Fri, Jul 24, 2015 at 8:24 AM, Eliezer Croitoru wrote: > Hey Joe, > I understand

Re: [squid-users] squid youtube caching

2015-07-23 Thread joe
hi Eliezer i do cache yt all is fine tks and i do can force html5 as bluecoat did i think they ar not secret any more all my problem or my Quest was as i sayd in first post i have 2 setup computer one winxp and one win7 with both using firefox v39 and latest identical flash player on winxp i get

Re: [squid-users] squid youtube caching

2015-07-23 Thread Eliezer Croitoru
Hey Joe, I understand the need for caching youtube but it might be not as possible as in the past. There was someone here on the list that offers a product that helps to cache youtube videos but I do not know the secret behind it. The partial content has special key in it and youtube kind o

Re: [squid-users] ecap and https

2015-07-23 Thread HackXBack
read the Documentation http://www.e-cap.org/Documentation -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/ecap-and-https-tp4672396p4672409.html Sent from the Squid - Users mailing list archive at Nabble.com. ___ sq

[squid-users] SIGTERM SIGKILL causes issues with squid shutdown during reboot

2015-07-23 Thread Stanford Prescott
After bumping Squid from 3.4.x to 3.5.x in our implementation of Squid in the Smoothwall Express v3.1 firewall distro we have begun to have complaints from our users about "erratic behavior" of Squid shutting down during reboots or network drops causing reboots. It appears that squid (v3.5.[5-6])

Re: [squid-users] squid youtube caching

2015-07-23 Thread joe
forgot on that link there is fmt=133&afmt=251 they ar the itag jumping this one frommy xp window the one work non range has one http://s.youtube.com/api/stats/qoe?event=streamingstats&fmt=43&cpn=b-DgHXDzC4p2xiSg&ei=VzGxVYbPIbGGiAaS05PoCg&el=detailpage&docid=BQnejVZLQ6w&ns=yt&fexp=901816%2C94

Re: [squid-users] squid youtube caching

2015-07-23 Thread joe
sorry i don't use authentication just simple nat forwerd to the transparent squid //Hi Joe, I had similar problem with youtube, I did not sure if it's the same with you, but I passed the //youtube.com domain out of the cache with 'cache deny' directive. i didnt get it !! the main domain youtube.c

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Marcus Kool
The strace output shows this loop: Squid reads 16K-1 bytes from FD 13webserver Squid writes 4 times 4K to FD 17 /var/cache/squid3/00/00/ Squid writes 4 times 4K to FD 12 browser But this loop does not explain the 100% CPU usage... Does Squid do a buffer reshuffle

Re: [squid-users] TCP_MISS in images

2015-07-23 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 23.07.15 23:57, Amos Jeffries пишет: > On 24/07/2015 4:02 a.m., Ulises Nicolini wrote: >> Hello, >> >> I have a basic squid 3.5 configuration with >> >> maximum_object_size_in_memory 64 KB >> maximum_object_size 10 KB >> minimum_object_size 5

Re: [squid-users] squid 3.5 with auth and chroot

2015-07-23 Thread Jorgeley Junior
Befor all, thanks so so much for the answears!!! It's exist, I'm sure. This is my chroot structre: / (linux root) /etc squid-3.5.6/ bin/ purge squidclient cache/ (squid

Re: [squid-users] ecap and https

2015-07-23 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 HHh. what this module does? And - for what you deny Accept-Encoding header?! 23.07.15 23:56, HackXBack пишет: > request_header_access Accept-Encoding deny all > loadable_modules /usr/local/lib/ecap_adapter_modifying.so > ecap_enable o

Re: [squid-users] TCP_MISS in images

2015-07-23 Thread Amos Jeffries
On 24/07/2015 4:02 a.m., Ulises Nicolini wrote: > Hello, > > I have a basic squid 3.5 configuration with > > maximum_object_size_in_memory 64 KB > maximum_object_size 10 KB > minimum_object_size 512 bytes > > refresh_pattern -i \.(gif|png|jpg|jpeg|ico)$ 1440 90% 10080 > override-expire ignor

Re: [squid-users] ecap and https

2015-07-23 Thread HackXBack
request_header_access Accept-Encoding deny all loadable_modules /usr/local/lib/ecap_adapter_modifying.so ecap_enable on ecap_service ecapModifier respmod_precache \ uri=ecap://e-cap.org/ecap/services/sample/modifying \ victim=bb \ replacement=aa adaptation_access ecapModifie

Re: [squid-users] squid youtube caching

2015-07-23 Thread Jorgeley Junior
Hi Joe, I had similar problem with youtube, I did not sure if it's the same with you, but I passed the youtube.com domain out of the cache with 'cache deny' directive. I'm using squid-3.5.6 and I'm in trouble with the authentication on chroot environment, so, maybe you cand help me, is your squid o

Re: [squid-users] TCP_MISS in images

2015-07-23 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Aha. So, another question. Does server uses compression? I.e. GZip, or something else? 23.07.15 22:53, Ulises Nicolini пишет: > Hello Yuri, > > All images have grater than 512 bytes > > 132Kb http://test-server.com/images/imagen3.jpg > 53Kb GET

Re: [squid-users] ecap and https

2015-07-23 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Sure. HTTPS also uses GZip ;) 23.07.15 23:33, HackXBack пишет: > when we can use ecap with https contents ? > Thanks. > > > > -- > View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/ecap-and-https-tp4672396.html > Sen

[squid-users] ecap and https

2015-07-23 Thread HackXBack
when we can use ecap with https contents ? Thanks. -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/ecap-and-https-tp4672396.html Sent from the Squid - Users mailing list archive at Nabble.com. ___ squid-users mailin

Re: [squid-users] squid 3.5.6 and ecap

2015-07-23 Thread Amos Jeffries
On 24/07/2015 4:05 a.m., Yuri Voinov wrote: > > No such file or directory > > means "No such file or directory" exactly. :) > > Your squid can't find libecap. > > Simple. > In particular it can't find the libecap with .so version 3. That so version number is used by libecap 1.0.x. Since yo

Re: [squid-users] squid 3.5.6 and ecap

2015-07-23 Thread HackXBack
nano /etc/ld.so.conf Add /usr/local/lib ldconfig Solved -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/squid-3-5-6-and-ecap-tp4672387p4672394.html Sent from the Squid - Users mailing list archive at Nabble.com. ___

Re: [squid-users] TCP_MISS in images

2015-07-23 Thread Ulises Nicolini
Hello Yuri, All images have grater than 512 bytes 132Kb http://test-server.com/images/imagen3.jpg 53Kb GET http://test-server.com/images/imagen1.gif 8Kb GET http://test-server.com/images/icono.png This is the list of the objects in the linux file system to confirm the flie sizes -rw-r--r-- 1

Re: [squid-users] squid 3.5.6 and ecap

2015-07-23 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 No such file or directory means "No such file or directory" exactly. :) Your squid can't find libecap. Simple. 23.07.15 21:18, HackXBack пишет: > No > such file or directory -BEGIN PGP SIGNATURE- Version: GnuPG v2 iQEcBAEBCAAGBQJV

Re: [squid-users] TCP_MISS in images

2015-07-23 Thread Yuri Voinov
-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Heh. Looks like images is less than: minimum_object_size 512 bytes this parameter. :) 23.07.15 22:02, Ulises Nicolini пишет: > minimum_object_size 512 bytes -BEGIN PGP SIGNATURE- Version: GnuPG v2 iQEcBAEBCAAGBQJVsRCPAAoJENNXIZxhPe

[squid-users] TCP_MISS in images

2015-07-23 Thread Ulises Nicolini
Hello, I have a basic squid 3.5 configuration with maximum_object_size_in_memory 64 KB maximum_object_size 10 KB minimum_object_size 512 bytes refresh_pattern -i \.(gif|png|jpg|jpeg|ico)$ 1440 90% 10080 override-expire ignore-no-cache ignore-private refresh_pattern -i (/cgi-bin/)

[squid-users] squid youtube caching

2015-07-23 Thread joe
my English not grait so be pattion tks hi i setup yt caching working perfect but i need to ask first squid 3.5.6 i need to know how is yt detect and send partial video i have 2 computer same flash v. same firefox v. all identical exept one windowsxp another is win7 i cache html5 on win7 yt send pa

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
Ok. I am sorry, Please, try this one: http://wikisend.com/download/413650/squid.strace Regards, Jens   Gesendet: Donnerstag, 23. Juli 2015 um 16:25 Uhr Von: "Marcus Kool" An: "Jens Offenbach" Betreff: Re: Aw: Re: [squid-users] Squid3: 100 % CPU load during object caching I get a 403 Access De

[squid-users] squid 3.5.6 and ecap

2015-07-23 Thread HackXBack
after installing libecap and ecap_adapter and compile squid with --enable-ecap when i want to start squid i got this error [] Restarting Squid HTTP Proxy 3.X: squid/usr/sbin/squid: error while loading shared libraries: libecap.so.3: cannot open shared object file: No such file or directory fai

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Amos Jeffries
On 23/07/2015 11:29 p.m., Marcus Kool wrote: > I am not sure if it is relevant, maybe it is: > > I am developing an ICAP daemon and after the ICAP server sends a "100 > continue" > Squid sends the object to the ICAP server in small chunks of varying sizes: > 4095, 5813, 1448, 4344, 1448, 1448, 289

Re: [squid-users] squid 3.5 with auth and chroot

2015-07-23 Thread Amos Jeffries
On 23/07/2015 11:23 p.m., Jorgeley Junior wrote: >> Hi guys. >> I have a RedHat 6.6 + squid 3.5.6 + basic_ncsa_auth + chroot and is >> crashing only when I do an authentication. >> >> Here is the main confs: >> auth_param basic program /libexec/basic_ncsa_auth /regras/usuarios >> auth_param basic c

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
I have attached strace to Squid and waited until the download rate has decreased to 500 KB/sec.   I used "cache_dir aufs /var/cache/squid3 88894 16 256 max-size=10737418240".   Here is the download link: http://w1.wikisend.com/node-fs/download/6a004a416f65b4cdf7f8eff4ff961199/squid.strace  

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Marcus Kool
I am not sure if it is relevant, maybe it is: I am developing an ICAP daemon and after the ICAP server sends a "100 continue" Squid sends the object to the ICAP server in small chunks of varying sizes: 4095, 5813, 1448, 4344, 1448, 1448, 2896, etc. Note that the interval of receiving the chunks i

Re: [squid-users] squid 3.5 with auth and chroot

2015-07-23 Thread Jorgeley Junior
> Hi guys. > I have a RedHat 6.6 + squid 3.5.6 + basic_ncsa_auth + chroot and is > crashing only when I do an authentication. > > Here is the main confs: > auth_param basic program /libexec/basic_ncsa_auth /regras/usuarios > auth_param basic children 10 startup=0 idle=1 > auth_param basic realm INT

Re: [squid-users] Squid3: 100 % CPU load during object caching

2015-07-23 Thread Jens Offenbach
A test with ROCK "cache_dir rock /var/cache/squid3 51200" gives very confusing results.   I cleared the cache: rm -rf /var/cache/squid3/* squid -z squid http_proxy=http://139.2.57.120:3128/ wget http://test-server/freesurfer-Linux-centos6_x86_64-stable-pub-v5.3.0.tar The download starts with 10