Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-04 Thread Bastien ROUCARIES
On Tue, Oct 4, 2011 at 11:33 AM, Roger Leigh wrote: > On Tue, Oct 04, 2011 at 09:29:27AM +0200, Bastien ROUCARIES wrote: >> On Mon, Oct 3, 2011 at 8:33 PM, Simon McVittie wrote: >> > On Mon, 03 Oct 2011 at 17:11:21 +0200, Bastien ROUCARIES wrote: >> >> On Mon, Oct 3, 2011 at 3:02 PM, Florian Weim

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-04 Thread Roger Leigh
On Tue, Oct 04, 2011 at 09:29:27AM +0200, Bastien ROUCARIES wrote: > On Mon, Oct 3, 2011 at 8:33 PM, Simon McVittie wrote: > > On Mon, 03 Oct 2011 at 17:11:21 +0200, Bastien ROUCARIES wrote: > >> On Mon, Oct 3, 2011 at 3:02 PM, Florian Weimer wrote: > >> > Not necessarily.  -fPIC and -fPIE force

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-04 Thread Bastien ROUCARIES
On Mon, Oct 3, 2011 at 7:31 PM, Bernhard R. Link wrote: > * Bastien ROUCARIES [111003 17:27]: >> > Not necessarily.  -fPIC and -fPIE force calls to global functions >> > defined in the same translation unit to go through the PLT.  They >> > aren't translated to direct IP-relative calls.  For -fPI

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-04 Thread Bastien ROUCARIES
On Mon, Oct 3, 2011 at 8:33 PM, Simon McVittie wrote: > On Mon, 03 Oct 2011 at 17:11:21 +0200, Bastien ROUCARIES wrote: >> On Mon, Oct 3, 2011 at 3:02 PM, Florian Weimer wrote: >> > Not necessarily.  -fPIC and -fPIE force calls to global functions >> > defined in the same translation unit to go t

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Simon McVittie
On Mon, 03 Oct 2011 at 17:11:21 +0200, Bastien ROUCARIES wrote: > On Mon, Oct 3, 2011 at 3:02 PM, Florian Weimer wrote: > > Not necessarily.  -fPIC and -fPIE force calls to global functions > > defined in the same translation unit to go through the PLT.  They > > aren't translated to direct IP-rel

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Bernhard R. Link
* Alastair McKinstry [111003 12:48]: > I would defend static libs for scientific apps. Static libs show a > significant performance > benefit (2-40%, median around 5-10% but sometimes far more with C++ > apps) Are those numbers only the position independent code (I guess mostly the register avail

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Bernhard R. Link
* Bastien ROUCARIES [111003 17:27]: > > Not necessarily.  -fPIC and -fPIE force calls to global functions > > defined in the same translation unit to go through the PLT.  They > > aren't translated to direct IP-relative calls.  For -fPIC, this is > > required by the ELF specification (no kidding,

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Bastien ROUCARIES
On Mon, Oct 3, 2011 at 3:02 PM, Florian Weimer wrote: > * Adam Borowski: > >>> I would defend static libs for scientific apps. Static libs show a >>> significant performance benefit (2-40%, median around 5-10% but sometimes >>> far more with C++ apps) and so are standard in HPC still; >> >> If you

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Florian Weimer
* Bastien ROUCARIES: > On Mon, Oct 3, 2011 at 3:02 PM, Florian Weimer wrote: >> * Adam Borowski: >> I would defend static libs for scientific apps. Static libs show a significant performance benefit (2-40%, median around 5-10% but sometimes far more with C++ apps) and so are standa

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Florian Weimer
* Adam Borowski: >> I would defend static libs for scientific apps. Static libs show a >> significant performance benefit (2-40%, median around 5-10% but sometimes >> far more with C++ apps) and so are standard in HPC still; > > If you see that big a difference, you do a lot of cross-file calls in

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Florian Weimer
* Henrique de Moraes Holschuh: > On Sun, 02 Oct 2011, Florian Weimer wrote: >> Couldn't we get rid of static libraries altogether, replacing static >> linking with ahead-of-time dynamic linking? > > Well, the normal usecase for static libraries and static linking is to > produce self-contained obj

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Adam Borowski
On Mon, Oct 03, 2011 at 11:20:11AM +0100, Alastair McKinstry wrote: > On 2011-10-02 23:08, Henrique de Moraes Holschuh wrote: > >On Sun, 02 Oct 2011, Florian Weimer wrote: > >>Couldn't we get rid of static libraries altogether, replacing static > >>linking with ahead-of-time dynamic linking? > > >

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-03 Thread Alastair McKinstry
On 2011-10-02 23:08, Henrique de Moraes Holschuh wrote: On Sun, 02 Oct 2011, Florian Weimer wrote: Couldn't we get rid of static libraries altogether, replacing static linking with ahead-of-time dynamic linking? [1] but I don't feel strong enough about it to get in the way if we do decide to d

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-02 Thread Henrique de Moraes Holschuh
On Sun, 02 Oct 2011, Florian Weimer wrote: > Couldn't we get rid of static libraries altogether, replacing static > linking with ahead-of-time dynamic linking? Well, the normal usecase for static libraries and static linking is to produce self-contained objects. If you can link a bunch of dynamic

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-02 Thread Andreas Barth
* Florian Weimer (f...@deneb.enyo.de) [111002 21:59]: > Couldn't we get rid of static libraries altogether, replacing static > linking with ahead-of-time dynamic linking? Could you explain what this means for people not so deep into that? (E.g. how is the linking done? When? What does that mean fo

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-02 Thread Florian Weimer
* Kees Cook: > When we decide to build an entire architecture as PIE, then we'll also need > to build those static libs with -fPIE too. Couldn't we get rid of static libraries altogether, replacing static linking with ahead-of-time dynamic linking? There's still a theoretical difference between

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-01 Thread Kees Cook
On Thu, Sep 29, 2011 at 06:41:29AM +0900, Charles Plessy wrote: > Le Tue, Sep 27, 2011 at 06:01:54PM -0700, Kees Cook a écrit : > > On Fri, Sep 23, 2011 at 08:17:54AM +0200, Raphael Hertzog wrote: > > > Two hardening features are not enabled by default: PIE and bindnow. > > > If your package su

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-01 Thread Kees Cook
On Wed, Sep 28, 2011 at 11:38:06PM +0200, Mike Hommey wrote: > On Wed, Sep 28, 2011 at 10:52:15PM +0300, Riku Voipio wrote: > > On Tue, Sep 27, 2011 at 06:01:54PM -0700, Kees Cook wrote: > > > Just to be explicit, PIE tends to have small (<1%) performance hits on > > > register-starved architecture

Re: Bits from dpkg developers - dpkg 1.16.1

2011-10-01 Thread Kees Cook
On Wed, Sep 28, 2011 at 10:52:15PM +0300, Riku Voipio wrote: > On Tue, Sep 27, 2011 at 06:01:54PM -0700, Kees Cook wrote: > > Just to be explicit, PIE tends to have small (<1%) performance hits on > > register-starved architectures (i386) in most cases, for for certain work > > loads (e.g. python)

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-28 Thread Charles Plessy
Le Tue, Sep 27, 2011 at 06:01:54PM -0700, Kees Cook a écrit : > On Fri, Sep 23, 2011 at 08:17:54AM +0200, Raphael Hertzog wrote: > > Two hardening features are not enabled by default: PIE and bindnow. > > If your package supports PIE, you might want to consider enabling it. > > If the binarie

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-28 Thread Mike Hommey
On Wed, Sep 28, 2011 at 10:52:15PM +0300, Riku Voipio wrote: > On Tue, Sep 27, 2011 at 06:01:54PM -0700, Kees Cook wrote: > > Just to be explicit, PIE tends to have small (<1%) performance hits on > > register-starved architectures (i386) in most cases, for for certain work > > loads (e.g. python)

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-28 Thread Riku Voipio
On Tue, Sep 27, 2011 at 06:01:54PM -0700, Kees Cook wrote: > Just to be explicit, PIE tends to have small (<1%) performance hits on > register-starved architectures (i386) in most cases, for for certain work > loads (e.g. python) the hit is large (~15%). On architectures with plenty > of registers

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-28 Thread Bernhard R. Link
* Ian Jackson [110927 20:21]: > Bernhard R. Link writes ("Re: Bits from dpkg developers - dpkg 1.16.1"): > > CFLAGS and LDFLAGS (and CPPFLAGS and so on) are in my opionion normal > > things to be in a users environment, so a package's rules file should > > in

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-27 Thread Kees Cook
On Fri, Sep 23, 2011 at 08:17:54AM +0200, Raphael Hertzog wrote: > Two hardening features are not enabled by default: PIE and bindnow. > If your package supports PIE, you might want to consider enabling it. > If the binaries are long running processes like daemons, and as such > the startup

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-27 Thread Ian Jackson
Bernhard R. Link writes ("Re: Bits from dpkg developers - dpkg 1.16.1"): > CFLAGS and LDFLAGS (and CPPFLAGS and so on) are in my opionion normal > things to be in a users environment, so a package's rules file should > in my eyes not depend on them not being set or ha

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-27 Thread Bernhard R. Link
* Bernd Zeimetz [110927 15:36]: > > I'm one of the submitters of one of the bugs which requested this > > change. This is a reversion of dpkg to a previous behaviour, and it > > /un/breaks packages. Or at least I think it unbreaks much more than > > it breaks. > > ACtually I think that is true -

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-27 Thread Bernd Zeimetz
On 09/24/2011 05:48 PM, Ian Jackson wrote: > Joey Hess writes ("Re: Bits from dpkg developers - dpkg 1.16.1"): >> Raphael Hertzog wrote: >>> * dpkg-buildpackage no longer exports >>> CFLAGS/CXXFLAGS/LDFLAGS/CPPFLAGS/FFLAGS >> >> | You don

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-27 Thread Ian Jackson
I wrote: > Joey Hess writes ("Re: Bits from dpkg developers - dpkg 1.16.1"): > > My concern is that we now have a whole history of ill-considered changes > > to the build flags. To the point that it's possible to argue that every > > build flag change save one*

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-27 Thread Ian Jackson
Joey Hess writes ("Re: Bits from dpkg developers - dpkg 1.16.1"): > Ian Jackson wrote: > > It was always completely wrong of dpkg-buildpackage to set these > > variables. Source packages are entitled to assume that strange > > environment variables which cause th

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-26 Thread Scott Kitterman
On Monday, September 26, 2011 08:21:19 PM Raphael Hertzog wrote: > On Mon, 26 Sep 2011, Scott Kitterman wrote: > > I can see where this might be useful for final work before an upload, > > what is one expected to do when one is doing successive builds where > > things change every time while workin

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-26 Thread Raphael Hertzog
On Mon, 26 Sep 2011, Scott Kitterman wrote: > I can see where this might be useful for final work before an upload, what is > one expected to do when one is doing successive builds where things change > every time while working on a package? dpkg-buildpackage -b, "Oh, fail", > "dpkg-source --co

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-26 Thread Scott Kitterman
On Friday, September 23, 2011 08:17:54 AM Raphael Hertzog wrote: > * “dpkg-source -b” on a “2.0” or “3.0 (quilt)” source package will fail > if it detects upstream changes which are not managed by a quilt patch. > > You are expected to call “dpkg-source --commit” if you want to > record thos

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-25 Thread Paul Wise
On Mon, Sep 26, 2011 at 12:26 AM, Michael Gilbert wrote: > I should have been more explicit.  I was referring to dpkg-buildflags > default outputs above. I see, agreed then. > I'm ok with the fact that each individual package will need to > be changed to support this (vice forcing it into gcc).

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-25 Thread Michael Gilbert
Paul Wise wrote: > On Sun, Sep 25, 2011 at 5:11 AM, Michael Gilbert wrote: > > > I think it would be better to enable all security-enhancing flags by > > default (at least all of the included ones so far, which are fairly > > well-tested). Yes, these two do have a larger potential to reduce > > p

Re: Format 3.0 (git) (was: Re: single-debian-patch (was Re: Bits from dpkg developers - dpkg 1.16.1))

2011-09-24 Thread Henrique de Moraes Holschuh
On Sat, 24 Sep 2011, Charles Plessy wrote: > If in a large number of cases where one would like to turn off the patch > system > of the 3.0 (quilt) format, the source package is stored in a Git repository, > then one way to move forward would be to make the format 3.0 (git) available > in Debian.

Re: Format 3.0 (git) (was: Re: single-debian-patch (was Re: Bits from dpkg developers - dpkg 1.16.1))

2011-09-24 Thread Paul Wise
On Sat, Sep 24, 2011 at 2:30 PM, Charles Plessy wrote: > If in a large number of cases where one would like to turn off the patch > system > of the 3.0 (quilt) format, the source package is stored in a Git repository, > then one way to move forward would be to make the format 3.0 (git) available

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-24 Thread Joey Hess
Ian Jackson wrote: > I'm one of the submitters of one of the bugs which requested this > change. This is a reversion of dpkg to a previous behaviour, and it > /un/breaks packages. Or at least I think it unbreaks much more than > it breaks. > > It was always completely wrong of dpkg-buildpackage

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-24 Thread Paul Wise
On Sun, Sep 25, 2011 at 5:11 AM, Michael Gilbert wrote: > I think it would be better to enable all security-enhancing flags by > default (at least all of the included ones so far, which are fairly > well-tested). Yes, these two do have a larger potential to reduce > performance, but its also suffi

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-24 Thread Michael Gilbert
berta...@ptitcanardnoir.org wrote: > On Fri, Sep 23, 2011 at 11:53:36AM +0200, Marco d'Itri wrote: > > On Sep 23, Raphael Hertzog wrote: > > > > > Two hardening features are not enabled by default: PIE and bindnow. > > Why? > > I guess because they have more impact on performance than the oth

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-24 Thread Ian Jackson
Joey Hess writes ("Re: Bits from dpkg developers - dpkg 1.16.1"): > Raphael Hertzog wrote: > > * dpkg-buildpackage no longer exports > > CFLAGS/CXXFLAGS/LDFLAGS/CPPFLAGS/FFLAGS > > | You don't know how many packages are broken or no longer > | policy compl

Format 3.0 (git) (was: Re: single-debian-patch (was Re: Bits from dpkg developers - dpkg 1.16.1))

2011-09-23 Thread Charles Plessy
Hello everybody, If in a large number of cases where one would like to turn off the patch system of the 3.0 (quilt) format, the source package is stored in a Git repository, then one way to move forward would be to make the format 3.0 (git) available in Debian. What are the blocking points ? Che

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-23 Thread gregor herrmann
On Fri, 23 Sep 2011 08:17:54 +0200, Raphael Hertzog wrote: > * “dpkg-source -b” on a “2.0” or “3.0 (quilt)” source package will fail > if it detects upstream changes which are not managed by a quilt patch. > * When dpkg-source automatically applies patches at the start of the > build process,

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-23 Thread Joey Hess
Raphael Hertzog wrote: > * dpkg-buildpackage no longer exports CFLAGS/CXXFLAGS/LDFLAGS/CPPFLAGS/FFLAGS | You don't know how many packages are broken or no longer | policy compliant because they were relying on those environment | variables Who said that? Oh, yeah it was you. How are we supposed

Re: single-debian-patch (was Re: Bits from dpkg developers - dpkg 1.16.1)

2011-09-23 Thread Raphael Hertzog
On Fri, 23 Sep 2011, Adam Borowski wrote: > Old-style: rm -rf .pc debian/patches > New-style: echo "single-debian-patch" >debian/source/options --single-debian-patch is no longer "new" at this point. The fact that you were not using it and relying on dpkg-source to generate a different patch at ea

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-23 Thread bertagaz
On Fri, Sep 23, 2011 at 11:53:36AM +0200, Marco d'Itri wrote: > On Sep 23, Raphael Hertzog wrote: > > > Two hardening features are not enabled by default: PIE and bindnow. > Why? I guess because they have more impact on performance than the others. > > If your package supports PIE, you migh

single-debian-patch (was Re: Bits from dpkg developers - dpkg 1.16.1)

2011-09-23 Thread Adam Borowski
On Fri, Sep 23, 2011 at 08:17:54AM +0200, Raphael Hertzog wrote: > we just released dpkg 1.16.1 to unstable. It comes with several disruptive > changes that you need to be aware of. Please read carefully. > * “dpkg-source -b” on a “2.0” or “3.0 (quilt)” source package will fail > if it detects u

Re: Bits from dpkg developers - dpkg 1.16.1

2011-09-23 Thread Marco d'Itri
On Sep 23, Raphael Hertzog wrote: > Two hardening features are not enabled by default: PIE and bindnow. Why? > If your package supports PIE, you might want to consider enabling it. > If the binaries are long running processes like daemons, and as such > the startup performance penalty of