Bug#836377: reproducible-builds: Locale C.UTF-8 not inherited by build terminal

2016-09-02 Thread Ben Finney
Package: qa.debian.org
Severity: normal

The package ‘dput’ explicitly sets the ‘LC_ALL’ environment variable
to “C.UTF-8”, and exports that value to sub-processes
https://sources.debian.net/src/dput/0.10.1/debian/rules/>.

Yet the latest reproducible-build attempt reports failure
https://tests.reproducible-builds.org/debian/rb-pkg/unstable/amd64/dput.html>.

Specifically, the build system does not detect a UTF-8 locale:

=
Traceback (most recent call last):
  […]
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2009' in position 
186: ordinal not in range(128)
E: pybuild pybuild:276: test: plugin distutils failed with: exit code=1: 
python2.7 setup.py test 
dh_auto_test: pybuild --test -i python{version} -p 2.7 returned exit code 13
debian/rules:24: recipe for target 'build' failed
make: *** [build] Error 25
dpkg-buildpackage: error: debian/rules build gave error exit status 2
=

This happens only on the reproducible build server; when running on a
system that actually has a UTF-8 terminal locale, the build succeeds.

-- 
 \ “Nothing worth saying is inoffensive to everyone. Nothing worth |
  `\saying will fail to make you enemies. And nothing worth saying |
_o__)will not produce a confrontation.” —Johann Hari, 2011 |
Ben Finney 


signature.asc
Description: PGP signature


Bug#836377: build system terminal locale not inherited by build programs

2016-09-02 Thread Ben Finney
Control: retitle -1 build system terminal locale not inherited by build programs

On 02-Sep-2016, Ben Finney wrote:

> This happens only on the reproducible build server; when running on
> a system that actually has a UTF-8 terminal locale, the build
> succeeds.

Correction, it happens also on the regular buildd
https://buildd.debian.org/status/package.php?p=dput>.

I still am clueless why the program would not receive the UTF-8
capable locale.

-- 
 \  “Better not take a dog on the space shuttle, because if he |
  `\   sticks his head out when you're coming home his face might burn |
_o__)up.” —Jack Handey |
Ben Finney 


signature.asc
Description: PGP signature


Processed: Bug#836377: build system terminal locale not inherited by build programs

2016-09-02 Thread Debian Bug Tracking System
Processing control commands:

> retitle -1 build system terminal locale not inherited by build programs
Bug #836377 [qa.debian.org] reproducible-builds: Locale C.UTF-8 not inherited 
by build terminal
Changed Bug title to 'build system terminal locale not inherited by build 
programs' from 'reproducible-builds: Locale C.UTF-8 not inherited by build 
terminal'.

-- 
836377: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=836377
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems




Bug#836377: reproducible-builds: Locale C.UTF-8 not inherited by build terminal

2016-09-02 Thread Mattia Rizzolo
[ adding reproducible-builds@ to the loop, after bouncing the first
email ]

On Fri, Sep 02, 2016 at 09:53:07PM +1000, Ben Finney wrote:
> The package ‘dput’ explicitly sets the ‘LC_ALL’ environment variable
> to “C.UTF-8”, and exports that value to sub-processes
> https://sources.debian.net/src/dput/0.10.1/debian/rules/>.
> 
> Yet the latest reproducible-build attempt reports failure
> https://tests.reproducible-builds.org/debian/rb-pkg/unstable/amd64/dput.html>.

This started to happen the 2016-08-27 with 0.10; the 2016-08-26 the
version 0.9.6.4 build happily succeeded (both in unstable/i386).

I'm not aware of any change of any sort in our infrastructure that day.

> Specifically, the build system does not detect a UTF-8 locale:
> 
> =
> Traceback (most recent call last):
>   […]
> UnicodeEncodeError: 'ascii' codec can't encode character u'\u2009' in 
> position 186: ordinal not in range(128)
> E: pybuild pybuild:276: test: plugin distutils failed with: exit code=1: 
> python2.7 setup.py test 
> dh_auto_test: pybuild --test -i python{version} -p 2.7 returned exit code 13
> debian/rules:24: recipe for target 'build' failed
> make: *** [build] Error 25
> dpkg-buildpackage: error: debian/rules build gave error exit status 2
> =

I kinda of leen toward some kind of regression in dput itself, not sure
what (and haven't digged deeper).

> This happens only on the reproducible build server; when running on a
> system that actually has a UTF-8 terminal locale, the build succeeds.

In the first build we export LANG=C, I wonder if that messes with
python's encoding foo.

-- 
regards,
Mattia Rizzolo

GPG Key: 66AE 2B4A FCCF 3F52 DA18  4D18 4B04 3FCD B944 4540  .''`.
more about me:  https://mapreri.org : :'  :
Launchpad user: https://launchpad.net/~mapreri  `. `'`
Debian QA page: https://qa.debian.org/developer.php?login=mattia  `-


signature.asc
Description: PGP signature


Bug#836377: build system terminal locale not inherited by build programs

2016-09-02 Thread Ben Finney
On 02-Sep-2016, Mattia Rizzolo wrote:
> [ adding reproducible-builds@ to the loop, after bouncing the first
> email ]

The bug also appears on the normal buildd hosts. Should we remove
 from the loop?

> This started to happen the 2016-08-27 with 0.10; the 2016-08-26 the
> version 0.9.6.4 build happily succeeded (both in unstable/i386).

It is triggered by a change in the build system; earlier, it produced
only ASCII output. So the problem may have existed prior to 0.10 but
not been exposed.

> In the first build we export LANG=C, I wonder if that messes with
> python's encoding foo.

It could. Should that not be changed to ‘LANG=C.UTF-8’, since there
does not seem any good reason to avoid a Unicode locale?

-- 
 \ “We are no more free to believe whatever we want about God than |
  `\ we are free to adopt unjustified beliefs about science or |
_o__)  history […].” —Sam Harris, _The End of Faith_, 2004 |
Ben Finney 


signature.asc
Description: PGP signature


Processed: Re: Bug#836377: build system terminal locale not inherited by build programs

2016-09-02 Thread Debian Bug Tracking System
Processing control commands:

> reassign -1 dput
Bug #836377 [qa.debian.org] build system terminal locale not inherited by build 
programs
Bug reassigned from package 'qa.debian.org' to 'dput'.
Ignoring request to alter found versions of bug #836377 to the same values 
previously set
Ignoring request to alter fixed versions of bug #836377 to the same values 
previously set
> severity -1 serious
Bug #836377 [dput] build system terminal locale not inherited by build programs
Severity set to 'serious' from 'normal'

-- 
836377: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=836377
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems



Bug#836377: build system terminal locale not inherited by build programs

2016-09-02 Thread Holger Levsen
control: reassign -1 dput
control: severity -1 serious
# failing to build on the buildds is RC by definition
thanks

Hi Ben,

On Fri, Sep 02, 2016 at 10:40:17PM +1000, Ben Finney wrote:
> The bug also appears on the normal buildd hosts. Should we remove
>  from the loop?

then I suppose this is an RC bug in dput :-D

> It could. Should that not be changed to ‘LANG=C.UTF-8’, since there
> does not seem any good reason to avoid a Unicode locale?

we actually do this variation on purpose, to catch problems with
non-UTF8 locales :-)


-- 
cheers,
Holger


signature.asc
Description: Digital signature


Re: Bug#836342: UDD/testing_autoremovals_gatherer.pl: Version in autoremoval notice may not be version actually checked

2016-09-02 Thread Paul Wise
Control: reassign -1 qa.debian.org
Control: retitle -1 UDD/testing_autoremovals_gatherer.pl: Version in 
autoremoval notice may not be version actually checked

On Fri, 2016-09-02 at 08:16 +0100, Rebecca N. Palmer wrote:

> That script looks like it gets version and bug information in one fetch 
> from UDD 
> (https://anonscm.debian.org/git/mirror/release-tools.git/tree/mailer/mail_autoremovals.pl#101),
>  
> which I took to mean the problem was in what generated that information, 
> but I don't know Perl.

Looks like you are right. Sorry for second-guessing you and not investigating :(

-- 
bye,
pabs

https://wiki.debian.org/PaulWise


signature.asc
Description: This is a digitally signed message part


Processed: Re: Bug#836342: UDD/testing_autoremovals_gatherer.pl: Version in autoremoval notice may not be version actually checked

2016-09-02 Thread Debian Bug Tracking System
Processing control commands:

> reassign -1 qa.debian.org
Bug #836342 [release.debian.org] Version in autoremoval notice may not be 
version
Bug reassigned from package 'release.debian.org' to 'qa.debian.org'.
Ignoring request to alter found versions of bug #836342 to the same values 
previously set
Ignoring request to alter fixed versions of bug #836342 to the same values 
previously set
> retitle -1 UDD/testing_autoremovals_gatherer.pl: Version in autoremoval 
> notice may not be version actually checked
Bug #836342 [qa.debian.org] Version in autoremoval notice may not be version
Changed Bug title to 'UDD/testing_autoremovals_gatherer.pl: Version in 
autoremoval notice may not be version actually checked' from 'Version in 
autoremoval notice may not be version'.

-- 
836342: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=836342
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems