Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-22 Thread Goswin von Brederlow
Amos Jeffries writes: > Strange that you should not know where the patch is Goswin since you > were the first and only one to mention it in this thread. > > The answer is "in the upstream bug report". > http://bugs.squid-cache.org/show_bug.cgi?id=2624 Actualy the answere is "in the Debian bugrep

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-22 Thread Luigi Gangitano
Hi debianers, I've contacted squid's upstream to help clarifying some details in this thread and am now forwarding Amos' reply: > Thanks Luigi, you may have to relay this back to the list. I can't seem to > post a reply to the thread. > > > I looked at that Debian bug a while back when first l

Re: Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-21 Thread Amos Jeffries
Strange that you should not know where the patch is Goswin since you were the first and only one to mention it in this thread. The answer is "in the upstream bug report". http://bugs.squid-cache.org/show_bug.cgi?id=2624 It should be noted that patch only affects the IMS replies apt gets back s

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-20 Thread Pierre Habouzit
On Wed, May 19, 2010 at 03:28:00PM +0200, Bjørn Mork wrote: > Pierre Habouzit writes: > > On Wed, May 19, 2010 at 10:42:55AM +0200, Bjørn Mork wrote: > > > >> 2) http proxy servers cannot always process pipelined requests due to > >>the complexity this adds (complexity is always bad for securi

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Goswin von Brederlow
Daniel Burrows writes: > On Wed, May 19, 2010 at 03:28:00PM +0200, Bjørn Mork was > heard to say: >> Pierre Habouzit writes: >> > This is bullshit. It's *VERY* easy to "support" pipelining: parse one >> > request at a time, and until you're done with a given request, you just >> > stop to watc

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Goswin von Brederlow
David Kalnischkies writes: > Hi all, > > i don't want to interrupt your battles so feel free to ignore me, > but i want to raise some questions (for you and me) none the less: > > The notice about the - in the eyes of the writer of this manpage > section - broken squid version 2.0.2 in the apt.co

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Goswin von Brederlow
Bjørn Mork writes: > Goswin von Brederlow writes: > >> A HTTP/1.1 conforming server or proxy > > This is not the real world... > >> is free to process pipelined >> requests serially one by one. The only requirement is that it does not >> corrupt the second request by reading all available data

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Goswin von Brederlow
Philipp Kern writes: > On 2010-05-19, Goswin von Brederlow wrote: >> Reading that I don't think that is really a pipelining issue. You do not >> need pipelineing for it to work. The real problem is keep-alive. The >> connection isn't destroyed after each request so you can put multiple >> reques

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Daniel Burrows
On Wed, May 19, 2010 at 03:28:00PM +0200, Bjørn Mork was heard to say: > Pierre Habouzit writes: > > This is bullshit. It's *VERY* easy to "support" pipelining: parse one > > request at a time, and until you're done with a given request, you just > > stop to watch the socket/file-descriptor for

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread David Kalnischkies
Hi all, i don't want to interrupt your battles so feel free to ignore me, but i want to raise some questions (for you and me) none the less: The notice about the - in the eyes of the writer of this manpage section - broken squid version 2.0.2 in the apt.conf manpage was changed the last time in 2

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Bjørn Mork
Goswin von Brederlow writes: > A HTTP/1.1 conforming server or proxy This is not the real world... > is free to process pipelined > requests serially one by one. The only requirement is that it does not > corrupt the second request by reading all available data into a buffer, > parsing the fir

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Eduard Bloch
#include * Robert Collins [Tue, May 18 2010, 02:02:59PM]: > Given that pipelining is broken by design, that the HTTP WG has And if not? Counter example, it seems to work just fine with my apt-cacher-ng proxy, at least bug reports related to that have appeared for about a year now. > increased th

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Goswin von Brederlow
Bjørn Mork writes: > Pierre Habouzit writes: >> On Wed, May 19, 2010 at 10:42:55AM +0200, Bjørn Mork wrote: >> >>> 2) http proxy servers cannot always process pipelined requests due to >>>the complexity this adds (complexity is always bad for security), and >> >> This is bullshit. It's *VE

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Goswin von Brederlow
Bjørn Mork writes: > Petter Reinholdtsen writes: >> [Roger Lynn] >>> But apt has been using pipelining for years. Why has this only just >>> become a problem? >> >> It has been a problem in Debian Edu for years. Just recently I >> figured out the cause and a workaround. > > And FWIW I have exp

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Philipp Kern
On 2010-05-19, Goswin von Brederlow wrote: > Reading that I don't think that is really a pipelining issue. You do not > need pipelineing for it to work. The real problem is keep-alive. The > connection isn't destroyed after each request so you can put multiple > requests into the stream and exploi

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Goswin von Brederlow
Robert Collins writes: > Well, I don't know why something has 'suddenly' become a problem: its > a known issue for years. The HTTP smuggling > [http://www.watchfire.com/resources/HTTP-Request-Smuggling.pdf] > attacks made that very obvious 5 years ago now. Reading that I don't think that is real

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Bjørn Mork
Pierre Habouzit writes: > On Wed, May 19, 2010 at 10:42:55AM +0200, Bjørn Mork wrote: > >> 2) http proxy servers cannot always process pipelined requests due to >>the complexity this adds (complexity is always bad for security), and > > This is bullshit. It's *VERY* easy to "support" pipelinin

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Pierre Habouzit
On Wed, May 19, 2010 at 10:42:55AM +0200, Bjørn Mork wrote: > 2) http proxy servers cannot always process pipelined requests due to >the complexity this adds (complexity is always bad for security), and This is bullshit. It's *VERY* easy to "support" pipelining: parse one request at a time, a

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-19 Thread Bjørn Mork
Petter Reinholdtsen writes: > [Roger Lynn] >> But apt has been using pipelining for years. Why has this only just >> become a problem? > > It has been a problem in Debian Edu for years. Just recently I > figured out the cause and a workaround. And FWIW I have experienced this problem for years t

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Petter Reinholdtsen
[Roger Lynn] > But apt has been using pipelining for years. Why has this only just > become a problem? It has been a problem in Debian Edu for years. Just recently I figured out the cause and a workaround. Happy hacking, -- Petter Reinholdtsen -- To UNSUBSCRIBE, email to debian-devel-requ..

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Robert Collins
Bah, link staleness. http://www.cgisecurity.com/lib/HTTP-Request-Smuggling.pdf just worked for me. Also, I realise that there may be a disconnect here: squid *shouldn't* break if a client attempts to pipeline through it - if it is, thats a bug to be fixed, squid just will not read the second requ

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Brian May
On 19 May 2010 13:51, Robert Collins wrote: > Well, I don't know why something has 'suddenly' become a problem: its > a known issue for years. The HTTP smuggling > [http://www.watchfire.com/resources/HTTP-Request-Smuggling.pdf] > attacks made that very obvious 5 years ago now. >From my Internet c

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Robert Collins
Well, I don't know why something has 'suddenly' become a problem: its a known issue for years. The HTTP smuggling [http://www.watchfire.com/resources/HTTP-Request-Smuggling.pdf] attacks made that very obvious 5 years ago now. http://en.wikipedia.org/wiki/HTTP_pipelining has a decent overview. Its

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Roger Lynn
On 18/05/10 03:10, Robert Collins wrote: > Given that pipelining is broken by design, that the HTTP WG has > increased the number of concurrent connections that are recommended, > and removed the upper limit - no. I don't think that disabling > pipelining hurts anyone - just use a couple more concu

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Goswin von Brederlow
Luigi Gangitano writes: > Il giorno 17/mag/2010, alle ore 09.02, Goswin von Brederlow ha scritto: >> Given that squid already has a patch, although only for newer versions, >> this really seems to be a squid bug. As such it should be fixed in >> squid as not only apt might trigger the problem. >

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread brian m. carlson
On Tue, May 18, 2010 at 02:09:13PM +0200, Mike Hommey wrote: > Mozilla browsers have had pipelining disabled for years, because > reality is that a whole lot of servers don't implement it properly if at > all. Actually, I've had pipelining enabled for some time, and it works just fine for me. I h

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Luigi Gangitano
Il giorno 17/mag/2010, alle ore 09.02, Goswin von Brederlow ha scritto: > Given that squid already has a patch, although only for newer versions, > this really seems to be a squid bug. As such it should be fixed in > squid as not only apt might trigger the problem. Goswin, can you please point me

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Mike Hommey
On Mon, May 17, 2010 at 09:54:28PM +0200, Florian Weimer wrote: > * Petter Reinholdtsen: > > > I am bothered by http://bugs.debian.org/56 >, and the fact > > that apt(-get,itude) do not work with Squid as a proxy. I would very > > much like to have apt work out of the box with Squid in Squeez

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Marvin Renich
* Goswin von Brederlow [100518 02:53]: > Marvin Renich writes: > > Documenting this problem somewhere that an admin would look when seeing > > the offending "Hash sum mismatch" message would also help. Turning off > > pipelining by default for everybody seems like the wrong solution to > > this

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-18 Thread Marvin Renich
* Robert Collins [100517 22:03]: > Given that pipelining is broken by design, that the HTTP WG has > increased the number of concurrent connections that are recommended, > and removed the upper limit - no. I don't think that disabling > pipelining hurts anyone - just use a couple more concurrent >

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-17 Thread Goswin von Brederlow
Marvin Renich writes: > * Robert Collins [100517 17:42]: >> Due to the widespread usage of intercepting proxies, its very hard, if >> not impossible, to determine if a proxy is in use. Its unwise, at >> best, to assume that no proxy configured == no proxy processing your >> traffic :(. >> >> -R

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-17 Thread Frank Lin PIAT
On Tue, 2010-05-18 at 14:02 +1200, Robert Collins wrote: > Given that pipelining is broken by design, that the HTTP WG has > increased the number of concurrent connections that are recommended, > and removed the upper limit - no. I don't think that disabling > pipelining hurts anyone - just use a c

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-17 Thread Robert Collins
Given that pipelining is broken by design, that the HTTP WG has increased the number of concurrent connections that are recommended, and removed the upper limit - no. I don't think that disabling pipelining hurts anyone - just use a couple more concurrent connections. -Rob -- To UNSUBSCRIBE, em

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-17 Thread Marvin Renich
* Robert Collins [100517 17:42]: > Due to the widespread usage of intercepting proxies, its very hard, if > not impossible, to determine if a proxy is in use. Its unwise, at > best, to assume that no proxy configured == no proxy processing your > traffic :(. > > -Rob IANADD, but if I had filed b

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-17 Thread Robert Collins
Due to the widespread usage of intercepting proxies, its very hard, if not impossible, to determine if a proxy is in use. Its unwise, at best, to assume that no proxy configured == no proxy processing your traffic :(. -Rob -- To UNSUBSCRIBE, email to debian-devel-requ...@lists.debian.org with a

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-17 Thread Florian Weimer
* Petter Reinholdtsen: > I am bothered by http://bugs.debian.org/56 >, and the fact > that apt(-get,itude) do not work with Squid as a proxy. I would very > much like to have apt work out of the box with Squid in Squeeze. To > fix it one can either change Squid to work with pipelining the wa

Re: APT do not work with Squid as a proxy because of pipelining default

2010-05-17 Thread Goswin von Brederlow
Petter Reinholdtsen writes: > I am bothered by http://bugs.debian.org/56 >, and the fact > that apt(-get,itude) do not work with Squid as a proxy. I would very > much like to have apt work out of the box with Squid in Squeeze. To > fix it one can either change Squid to work with pipelining

APT do not work with Squid as a proxy because of pipelining default

2010-05-16 Thread Petter Reinholdtsen
I am bothered by http://bugs.debian.org/56 >, and the fact that apt(-get,itude) do not work with Squid as a proxy. I would very much like to have apt work out of the box with Squid in Squeeze. To fix it one can either change Squid to work with pipelining the way APT uses, which the Squid main