Re: [squid-users] How to mark HIT using qos_flow in squid mode SmpCarpCluster

On 5/06/2016 8:37 p.m., Dhani-Dhanu wrote: > Hallo > > First, i would to say thanks you for Support.. > > second, i have running squid 3.5.19 with SmpCarpCluster..And work very nice > and nothing problem. > > But i need to Bypass Cache HIT with qos_flows. On Standar Config qos_flows > working as

Re: [squid-users] Vary object loop returns

and by the way guys please dont use my patch for production they do have bug it was experimental only testing me and yuri i did not know it was going to cause trouble sorry for that good bye -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Vary-object-loop-re

Re: [squid-users] Vary object loop returns

right but the way im doing it dose not show you the same cat pic lol it just prevent caching identical object making it less and beter hit ratio . before the cache id the way its dose it prevent other browser from having cached object that why you see that varyEvaluateMatch: Oops. Not a Vary m

Re: [squid-users] Vary object loop returns

On 7/06/2016 6:20 a.m., Yuri Voinov wrote: > > By the way, we have another problem. Caching is greatly reduced by the > presence of User-Agent header Vary. Although I know that Amos says - he > says, we should break the Internet and cached separately all types of > user agents. Please do not put

Re: [squid-users] Vary object loop returns

On 7/06/2016 5:55 a.m., Yuri Voinov wrote: > > So. > > Squid DOES NOT and DON'T BE support gzip. The only way to do it - use > ecap + desupported ecap gzip adapter. Let's accept this. We can support > gzip. With restrictions. Ok. > > any other compression - false. No. No way. Get out. and so on.

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 This is true. However, we have no one bothers to intercept the request and tell the server that we only accept gzip encoding. What I personally do. My config, partially, contains this: request_header_access Accept-Encoding deny all request_header

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 07.06.2016 4:26, Amos Jeffries пишет: > On 6/06/2016 8:10 p.m., Yuri wrote: >> Heh, >> >> and breaking Internet... > > No it does not. Every HTTP agent has mandatory support for un-encoded > objects. The use of encodings is optional. > >> >> So,

Re: [squid-users] Vary object loop returns

On 7/06/2016 5:47 a.m., Heiler Bemerguy wrote: > > These are the variations for the "accept-encoding" tag I found when > sniffing my client's connections. And they're of all kind. Newer and > older browsers, mobile phones, windows updates, whatever.. > > It got a total of 11.437 requests from cli

Re: [squid-users] Vary object loop returns

On 6/06/2016 8:10 p.m., Yuri wrote: > Heh, > > and breaking Internet... No it does not. Every HTTP agent has mandatory support for un-encoded objects. The use of encodings is optional. > > So, for example, my Squid's built with ecap gzip support. What will be > result? Hmm. The ecap adaptor RE

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Joe, keep me linked. Your patches save my traffic. 07.06.2016 0:21, joe пишет: > like this link use lots a fkp command lol > http://api.footballaddicts.com/teams' > > 'accept="application%2Fvnd.livescore_app.api.v4.android+json", > if-none-match=

Re: [squid-users] Vary object loop returns

like this link use lots a fkp command lol http://api.footballaddicts.com/teams' 'accept="application%2Fvnd.livescore_app.api.v4.android+json", if-none-match="%22306f685f7466a258d4884f92bdf8259a%22", if-modified-since="Sun,%2005%20Jun%202016%2020%3A11%3A13%20GMT", accept-language="en", accept-enco

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 BTW, gyus. This is non-patched 3.5.19. 2016/06/06 23:08:24 kid1| varyEvaluateMatch: Oops. Not a Vary match on second attempt, 'https://connect.facebook.net/en_US/sdk.js' 'accept-encoding="gzip,%20deflate,%20sdch,%20br"' 2016/06/06 23:08:24 kid1| c

Re: [squid-users] Vary object loop returns

yup if user agents exist in vary that leads to many object same size i dont know if the servers use the user agents to send to specific mobile a smaller object same name or different compression but right now wat im doing is just tinny peace of it saving us more hit % it wont harm app mobile o

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 By the way, we have another problem. Caching is greatly reduced by the presence of User-Agent header Vary. Although I know that Amos says - he says, we should break the Internet and cached separately all types of user agents. However, this leads to

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Heh, and what about contains Accept-Encoding, how do your think? I know where you're going. :) They say that the spaces (%20) are not there. Unfortunately, they just come through a Vary header. If it is blocked via manipulation of headlines - we b

Re: [squid-users] Vary object loop returns

exactly squid dose not use compression but it use vary as key so it can find the object in the cache Yuri Voinov wrote > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA256 > > So. > > Squid DOES NOT and DON'T BE support gzip. The only way to do it - use > ecap + desupported ecap gzip adapter. L

Re: [squid-users] Vary object loop returns

right the acsess.log dose not show those %20 20 ar space in real accept-encoding: gzip, deflate <-- notice the space wen it reach function varyEvaluateMatch it shange some how to 20 and the % is mark the one internally wen its used by the destination server it has no mark %20 example

Re: [squid-users] Vary object loop returns

Web servers uses the "vary" tag, not "accept-encoding" tag exactly. Like these sniffed examples: Vary: * Vary: Accept Vary: Accept-Encoding Vary: Accept-Encoding Vary: Accept-Encoding, Accept-Encoding Vary: Accept-Encoding,Host Vary: Accept-Encoding, User-Agent Vary: Accept-Encoding,User-Agent

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 06.06.2016 23:47, Heiler Bemerguy пишет: > > > These are the variations for the "accept-encoding" tag I found when sniffing my client's connections. And they're of all kind. Newer and older browsers, mobile phones, windows updates, whatever.. > >

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 So. Squid DOES NOT and DON'T BE support gzip. The only way to do it - use ecap + desupported ecap gzip adapter. Let's accept this. We can support gzip. With restrictions. Ok. any other compression - false. No. No way. Get out. and so on. identi

Re: [squid-users] Vary object loop returns

These are the variations for the "accept-encoding" tag I found when sniffing my client's connections. And they're of all kind. Newer and older browsers, mobile phones, windows updates, whatever.. It got a total of 11.437 requests from clients to squid. *accept-encoding: gzip, deflate** **Ac

Re: [squid-users] Squid high memory usage

On 06/06/2016 07:27 AM, FredB wrote: Thanks for your answer What is cache_mem ? See also http://wiki.squid-cache.org/SquidFaq/SquidMemory Actually 25 Gb I tried different values, but I guess no matter, the problem is that the squid limit is only 50% of ram After that the swap is totally

Re: [squid-users] Vary object loop returns

it become same less hit caus firefox adding extra info and its marked out %20 so if u just take of %20 hit become low as original code that why we shuld remove full string %20gzip or anythink like that that make all the object with varyhas same string make hit % higher also i dont want to r

Re: [squid-users] logging and proxy pac file help

Ok, so I made some changes to the proxy.pac file and it looks like this now. function FindProxyForURL(url, host) {    //Don't proxy connections to the UTM web interface    if (shExpMatch(url, "https://borg.local*";)) return "DIRECT";    if (shExpMatch(url, "https://"; + dnsResolve(host) + "*")) r

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Ok, why not to replace %20 to original space symbol? 06.06.2016 20:27, joe пишет: > not good just to strip %20 lol as i post it remove also string was belong to > the date > we need to remove all of those string start with ,%20as ,%20sdch so

Re: [squid-users] Vary object loop returns

not good just to strip %20 lol as i post it remove also string was belong to the date we need to remove all of those string start with ,%20as ,%20sdch so its not eassy detection it kill if-modified-since="Mon,%2006%20Jun%202016%2014%3A31%3A32%20GMT", if you notice this string in vary has

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 I offering simple strip %20. From whole string. 06.06.2016 20:10, joe пишет: > fixed string search better thenvariant search ,%20 caus some > mobile app has > befor > 'http://api.footballaddicts.com/matches?date=2016-06-06&utc_offset

Re: [squid-users] Vary object loop returns

fixed string search better thenvariant search ,%20 caus some mobile app has befor 'http://api.footballaddicts.com/matches?date=2016-06-06&utc_offset=%2B03%3A00' 'accept="application%2Fvnd.livescore_app.api.v4.android+json", if-none-match="%223b23174cf97df7cb9fec26cdd9bac8ca%22", if-mo

Re: [squid-users] Vary object loop returns

this link has no vary to be afected and why your video link is segment mmm and akamaih lol let me turn off colaps and see if i get any err it play nice here any way i will work on patch 2 http://wsodprogrf.bbc.co.uk/russian/dps/2016/06/hoverboard%20paris%20duru_16x9_hi.mp4 GET /russian/dps/2016

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Third variant of patch seems not enough correct. Vary errors is absent, but hit ratio lower. Variant 2 works ok, with acceptable hit ratio and without visible problems with sites rendering. 06.06.2016 18:54, joe пишет: > ok then i will see wat ca

Re: [squid-users] Vary object loop returns

ok then i will see wat can i do to speed that up -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Vary-object-loop-returns-tp4677716p4677851.html Sent from the Squid - Users mailing list archive at Nabble.com. ___ sq

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 http://www.bbc.com/russian/multimedia/2016/06/160606_hoverboard_duru I see only first video segment. Second try gives an error. In access.log I see much memory hits for all video segments. URLs like this: http://bbcwshdod02-vh.akamaihd.net/z/rus

Re: [squid-users] Vary object loop returns

lol not that link it wont open to watch copy the top url page of that news -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Vary-object-loop-returns-tp4677716p4677849.html Sent from the Squid - Users mailing list archive at Nabble.com. ___

Re: [squid-users] Vary object loop returns

http://www.bbc.com/news/world-australia-36442209 working fine playback forwerd with cloaps on or off here is ok any link ?? Yuri Voinov wrote > Also some flash news video has playback problems with variant 3 > > > 06.06.2016 15:40, joe пишет: >> yup new test patch vary_experimental3.patch >>

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Variant 2 looks like more safe and gives more HIT ratio. 06.06.2016 18:30, joe пишет: > news video is it https or http > if its http please post link for me to test with it and see wat is the > problem to fix > > > Yuri Voinov wrote >> Also some

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 http://bbcwshdod02-vh.akamaihd.net/z/russian/dps/2016/06/bookfest_ast_16x9_,lo,med,hi,.mp4.csmil/1_8057c05957735258_Seg1-Frag28 06.06.2016 18:30, joe пишет: > news video is it https or http > if its http please post link for me to test with it a

Re: [squid-users] Vary object loop returns

-BEGIN PGP SIGNED MESSAGE- Hash: SHA256 Some of is http, YT is https 06.06.2016 18:30, joe пишет: > news video is it https or http > if its http please post link for me to test with it and see wat is the > problem to fix > > > Yuri Voinov wrote >> Also some flash news video has playba

Re: [squid-users] Vary object loop returns

news video is it https or http if its http please post link for me to test with it and see wat is the problem to fix Yuri Voinov wrote > Also some flash news video has playback problems with variant 3 > > > 06.06.2016 15:40, joe пишет: >> yup new test patch vary_experimental3.patch >>

Re: [squid-users] Vary object loop returns

Also some flash news video has playback problems with variant 3 06.06.2016 15:40, joe пишет: yup new test patch vary_experimental3.patch -- View this message in context: http://squid-web-proxy-cache.

Re: [squid-users] Vary object loop returns

variant 3 produced lower HIT. 06.06.2016 15:40, joe пишет: yup new test patch vary_experimental3.patch -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Vary-object-

Re: [squid-users] Vary object loop returns

Will test this patch version. Build with it now on production. 06.06.2016 15:40, joe пишет: yup new test patch vary_experimental3.patch -- View this message in context: http://squid-web-proxy-cache.1

Re: [squid-users] Vary object loop returns

thanks but you shuld thanks the dev team and other guys like yuri amos and so++ they did realy hard work i just done few im beginner UT wrote > Hi Joe, > Thanks for the reply, good luck for your patch, following progress of your > great job > > bye -- View this message in context: http:/

Re: [squid-users] Squid high memory usage

Thanks for your answer > What is cache_mem ? > See also http://wiki.squid-cache.org/SquidFaq/SquidMemory > Actually 25 Gb I tried different values, but I guess no matter, the problem is that the squid limit is only 50% of ram > > After that the swap is totally full and kswap process gone mad .

Re: [squid-users] Vary object loop returns

lol my first time attachment ewww -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Vary-object-loop-returns-tp4677716p4677837.html Sent from the Squid - Users mailing list archive at Nabble.com. ___ squid

Re: [squid-users] Vary object loop returns

yup new test patch vary_experimental3.patch -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Vary-object-loop-returns-tp4677716p4677836.html Sent from the Squid - Us

Re: [squid-users] Vary object loop returns

not yet until its almost bug free and wen the dev team approve it UT wrote > Hi All, > Any chance to see Joe's patch in the next build of Squid ? > > Bye. -- View this message in context: http://squid-web-proxy-cache.1019090.n4.nabble.com/Vary-object-loop-returns-tp4677716p4677835.html Sen

Re: [squid-users] Squid high memory usage

On 06/06/2016 04:27 AM, FredB wrote: Hello all, I'm trying to use a server with 64 Go of ram, but I'm faced with a problem, squid can't works with more than 50% of memory What is cache_mem ? See also http://wiki.squid-cache.org/SquidFaq/SquidMemory After that the swap is totally full and

Re: [squid-users] Vary object loop returns

Anyway effect is visible and reproduses. 06.06.2016 15:14, joe пишет: has nothing to do with collarsed_foarwarding on shuld look into collarsed_foarwarding function not varyEvaluateMatch Yuri Voinov wrote Turning on collarsed_foarwarding decreases HIT ratio to previous low level. Patch give

Re: [squid-users] Vary object loop returns

has nothing to do with collarsed_foarwarding on shuld look into collarsed_foarwarding function not varyEvaluateMatch Yuri Voinov wrote > Turning on collarsed_foarwarding decreases HIT ratio to previous low > level. > > Patch give high HIT only with disabled collapsed_forwarding. > > > 06.06

Re: [squid-users] Vary object loop returns

Turning on collarsed_foarwarding decreases HIT ratio to previous low level. Patch give high HIT only with disabled collapsed_forwarding. 06.06.2016 2:42, joe пишет: im re writing the varyEvaluateMatch function will see after i done test with new one for now last patch is good enough until the

Re: [squid-users] Vary object loop returns

amos right but just removing ,$20x string and keep the rest normal is it better so that way we wont fkp mobile app that depend on some info on vary my concern is making every app and browser happy without error and have beter caching % -- View this message in context: http://squid-web-pr

Re: [squid-users] Vary object loop returns

Heh, and breaking Internet... So, for example, my Squid's built with ecap gzip support. What will be result? 06.06.2016 6:02, Amos Jeffries пишет: On 6/06/2016 8:42 a.m., joe wrote: im re writing the varyEvaluateMatch function will see after i done test with new one for now last patch is g

[squid-users] Squid high memory usage

Hello all, I'm trying to use a server with 64 Go of ram, but I'm faced with a problem, squid can't works with more than 50% of memory After that the swap is totally full and kswap process gone mad ... I tried with vm.swappiness = 0 but same problem, perhaps a little better, I also tried memory_