Bug#929224: marked as done (apt-cacher-ng, debootstrap and deb.debian.org combination fails)

[Debian Bug Tracking System]

Your message dated Sat, 26 Oct 2019 08:27:51 -0700
with message-id <875zkb5xxk@iris.silentflame.com>
and subject line Re: debootstrap & apt-cacher-ng: works here
has caused the Debian Bug report #929224,
regarding apt-cacher-ng, debootstrap and deb.debian.org combination fails
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
immediately.)


-- 
929224: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=929224
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
Package: apt-cacher-ng, debootstrap
Version: 3.2-1, 1.0.114
X-debbugs-cc: debian-ad...@lists.debian.org

Dear maintainers and DSA,

The combination of apt-cacher-ng, debootstrap and the deb.debian.org
service fails:

root@iris:/srv/chroot>http_proxy=http://localhost:3142 debootstrap sid chr/ 
http://deb.debian.org/debian
I: Target architecture can be executed
I: Retrieving InRelease
I: Retrieving Release
E: Failed getting release file 
http://deb.debian.org/debian/dists/sid/Release

However, replacing deb.debian.org with cdn-fastly.deb.debian.org
succeeds.  And note that apt can happily use the combination of
apt-cacher-ng and .

I thought that the problem is that apt-cacher-ng is not able to resolve
SRV records.  However, I'm not so sure about that now.  debootstrap uses
wget to download stuff, so I tried this:

root@iris:/srv/chroot>http_proxy=http://localhost:3142 wget 
http://deb.debian.org/debian/dists/sid/Release
URL transformed to HTTPS due to an HSTS policy
--2019-05-19 07:54:37--  https://deb.debian.org/debian/dists/sid/Release
Resolving localhost (localhost)... ::1, 127.0.0.1
Connecting to localhost (localhost)|::1|:3142... connected.
Proxy tunneling failed: CONNECT denied (ask the admin to allow HTTPS 
tunnels)Unable to establish SSL connection.

I then tried passing --no-hsts to wget, which allowed the download to
succeed, and after that the file was cached by apt-cacher-ng so
--no-hsts was no longer needed.

I don't know whether debootstrap needs to start passing --no-hsts to
wget, or apt-cacher-ng should be fixed, or there is a configuration
problem with the deb.debian.org service.  But since this is our main
CDN, it seems like it ought to be possible to use the combination of
apt-cacher-ng, deb.debian.org and debootstrap.

-- 
Sean Whitton


signature.asc
Description: PGP signature
--- End Message ---
--- Begin Message ---
Dear Felix,

On Sat 19 Oct 2019 at 12:18PM -07, Felix Lechner wrote:

> Perhaps the problem is (or temporarily was) in the HTTP headers from
> deb.debian.org?

Thank you for following up on this.  It seems to work here now too, so I
think it must have been that the HTTP headers from deb.debian.org were
working differently for a while, indeed.

-- 
Sean Whitton


signature.asc
Description: PGP signature
--- End Message ---

Bug#943572: d-i.debian.org: d-i scripts on dillon.d.o use /srv/mirrors

[Aurelien Jarno]

Package: d-i.debian.org
Severity: normal

DSA would like to move dillon to another ganeti cluster with no local
mirror. It seems that the d-i scripts use /srv/mirrors, at least the
following crontab entry:

55 */4 * * * cd $DI; mr -q up ; cd $DI/scripts/testing-summary; ./gen-summary 
/srv/mirrors/debian > $WWW/testing-summary.html ; ~/bin/push-www

Can you please confirm that /srv/mirrors is still used? Does it need a
full mirror or a partial mirror without pool/?

-- System Information:
Debian Release: bullseye/sid
  APT prefers testing
  APT policy: (990, 'testing'), (500, 'unstable'), (1, 'experimental')
Architecture: amd64 (x86_64)

Kernel: Linux 5.2.0-2-amd64 (SMP w/4 CPU cores)
Kernel taint flags: TAINT_WARN, TAINT_OOT_MODULE, TAINT_UNSIGNED_MODULE
Locale: LANG=fr_FR.UTF-8, LC_CTYPE=fr_FR.UTF-8 (charmap=UTF-8), LANGUAGE=fr 
(charmap=UTF-8)
Shell: /bin/sh linked to /bin/dash
Init: systemd (via /run/systemd/system)
LSM: AppArmor: enabled

Debian udeb Site Down?

[Lonnie Cumberland]

Hi All,

I was able to build the Debian-Installer without any issues up until about
2 days ago but now it seems as though something may be wrong with the
Debian udeb site as I am getting build errors:

-
lonnie@debian:~/CloudCore/test/debian-installer/installer/build$ fakeroot
make build_netboot-gtk
WARNING: mirror 'https://brave-browser-apt-release.s3.brave.com' appears to
be invalid; skipping
WARNING: mirror 'https://brave-browser-apt-release.s3.brave.com' appears to
be invalid; skipping
WARNING: mirror 'http://dl.google.com/linux/chrome/deb' appears to be
invalid; skipping
WARNING: mirror 'http://dl.google.com/linux/chrome/deb' appears to be
invalid; skipping
Using generated sources.list.udeb:
   deb [trusted=yes]
copy:/home/lonnie/CloudCore/test/debian-installer/installer/build/
localudebs/
   deb http://deb.debian.org/debian unstable main/debian-installer
make[2]: 'sources.list.udeb' is up to date.
Ign:1 copy:/home/lonnie/CloudCore/test/debian-installer/installer/build
localudebs/ InRelease
Ign:2 copy:/home/lonnie/CloudCore/test/debian-installer/installer/build
localudebs/ Release
Ign:3 copy:/home/lonnie/CloudCore/test/debian-installer/installer/build
localudebs/ Packages
Ign:3 copy:/home/lonnie/CloudCore/test/debian-installer/installer/build
localudebs/ Packages
Ign:3 copy:/home/lonnie/CloudCore/test/debian-installer/installer/build
localudebs/ Packages
Get:3 copy:/home/lonnie/CloudCore/test/debian-installer/installer/build
localudebs/ Packages [20 B]
Get:4 http://deb.debian.org/debian unstable InRelease [139 kB]
Get:5 http://deb.debian.org/debian unstable/main/debian-installer amd64
Packages [51.6 kB]
Fetched 190 kB in 0s (403 kB/s)
Reading package lists... Done
Reading package lists... Done
Building dependency tree... Done
dh_testroot
dh_testroot: dh_testroot must be called from the source root
get-packages udeb acpi-modules-5.2.0-3-amd64-di alsa-utils-udeb anna
archdetect bogl-bterm-udeb brltty-udeb busybox-udeb ca-certificates-udeb
cdebconf-gtk-terminal cdebconf-gtk-udeb cdebconf-newt-terminal
cdebconf-newt-udeb cdebconf-priority cdebconf-text-udeb cdebconf-udeb
choose-mirror choose-mirror-bin console-setup-linux-fonts-udeb
console-setup-pc-ekmap console-setup-udeb debian-archive-keyring-udeb
di-utils di-utils-reboot di-utils-shell di-utils-terminfo
download-installer env-preseed espeak-ng-data-udeb espeakup-udeb ethdetect
fat-modules-5.2.0-3-amd64-di fb-modules-5.2.0-3-amd64-di file-preseed
fontconfig-udeb fonts-android-udeb fonts-dejavu-mono-udeb fonts-dejavu-udeb
fonts-farsiweb-udeb fonts-freefont-udeb fonts-khmeros-udeb fonts-knda-udeb
fonts-lao-udeb fonts-lohit-guru-udeb fonts-mlym-udeb fonts-noto-hinted-udeb
fonts-sil-abyssinica-udeb fonts-sil-padauk-udeb fonts-taml-udeb
fonts-telu-udeb fonts-thai-tlwg-udeb fonts-tibetan-machine-udeb
fonts-ukij-uyghur-udeb gpgv-udeb gtk2-engines-udeb haveged-udeb hw-detect
initrd-preseed input-modules-5.2.0-3-amd64-di installation-locale kbd-udeb
kernel-image-5.2.0-3-amd64-di libasound2-udeb libatk-adaptor-udeb
libatk-bridge-2.0-0-udeb libatk1.0-udeb libatspi0-udeb libblkid1-udeb
libbsd0-udeb libc6-udeb libcairo2-udeb libcrypto1.1-udeb libdatrie1-udeb
libdbus-1-3-udeb libdebconfclient0-udeb libdebian-installer4-udeb
libdrm2-udeb libevdev2-udeb libexpat1-udeb libffi6-udeb libfontenc1-udeb
libfreetype6-udeb libfribidi0-udeb libgail18-udeb libgcrypt20-udeb
libgdk-pixbuf2.0-0-udeb libglib2.0-udeb libgpg-error0-udeb libgtk2.0-0-udeb
libharfbuzz0-udeb libiw30-udeb libkmod2-udeb libmtdev1-udeb
libnewt0.52-udeb libnl-3-200-udeb libnl-genl-3-200-udeb libpango1.0-udeb
libpci3-udeb libpciaccess0-udeb libpcre2-8-0-udeb libpcre3-udeb
libpixman-1-0-udeb libpng16-16-udeb libslang2-udeb libssl1.1-udeb
libtextwrap1-udeb libthai-data-udeb libthai0-udeb libtinfo6-udeb
libudev1-udeb libuuid1-udeb libvte9-udeb libx11-6-udeb libxau6-udeb
libxcb1-udeb libxcursor1-udeb libxdmcp6-udeb libxext6-udeb libxfixes3-udeb
libxfont2-udeb libxft2-udeb libxi6-udeb libxinerama1-udeb libxkbfile1-udeb
libxrender1-udeb libxshmfence1-udeb localechooser lowmemcheck main-menu
media-retriever mountmedia mouse-modules-5.2.0-3-amd64-di nano-udeb
ndisc6-udeb net-retriever netcfg network-preseed
nic-modules-5.2.0-3-amd64-di nic-pcmcia-modules-5.2.0-3-amd64-di
nic-usb-modules-5.2.0-3-amd64-di nic-wireless-modules-5.2.0-3-amd64-di
pciutils-udeb pcmcia-modules-5.2.0-3-amd64-di pcmciautils-udeb
preseed-common rdnssd-udeb rescue-check rootskel rootskel-gtk save-logs
sound-modules-5.2.0-3-amd64-di speakup-modules-5.2.0-3-amd64-di udev-udeb
udpkg usb-modules-5.2.0-3-amd64-di usb-storage-modules-5.2.0-3-amd64-di
util-linux-udeb wget-udeb wide-dhcpv6-client-udeb wpasupplicant-udeb
x11-xkb-utils-udeb xkb-data-udeb xserver-xorg-core-udeb
xserver-xorg-input-evdev-udeb xserver-xorg-video-fbdev-udeb zlib1g-udeb
make[3]: 'sources.list.udeb' is up to date.
Ign:1 copy:/home/lonnie/CloudCore/test/debian-installer/installer/build
localudebs/ InRelease
Ign:2 copy:/home/lon

Bug#943572: d-i.debian.org: d-i scripts on dillon.d.o use /srv/mirrors

[Cyril Brulebois]

Hi,

and thanks for the report.

Aurelien Jarno  (2019-10-26):
> DSA would like to move dillon to another ganeti cluster with no local
> mirror. It seems that the d-i scripts use /srv/mirrors, at least the
> following crontab entry:
> 
> 55 */4 * * * cd $DI; mr -q up ; cd $DI/scripts/testing-summary; ./gen-summary 
> /srv/mirrors/debian > $WWW/testing-summary.html ; ~/bin/push-www

Just checked what happens with http://deb.debian.org/debian instead
(network mirror support is what I use when I run this script locally),
and that seems fine.

Fixed in git, and deployed in the crontab:
  
https://salsa.debian.org/installer-team/d-i/commit/369054e0d3fdc7e9ef7e4987a4adaf191b4569c0

> Can you please confirm that /srv/mirrors is still used? Does it need a
> full mirror or a partial mirror without pool/?

The dose checks used to need access to mirrors, but they seem to have
been commented out by mistake:
  
https://salsa.debian.org/installer-team/d-i/commit/3d25abea44bb9122ee404394f6e84d67aa874b31

Those checks need access to Packages files. When re-enabling them,
we can probably move to fetching those files from the network as well.


Adding Holger to copy for awareness, but it doesn't look like we have
more things depending on mirrors; so we can probably consider
everything's good unless Holger knows about anything else?


Cheers,
-- 
Cyril Brulebois (k...@debian.org)
D-I release manager -- Release team member -- Freelance Consultant


signature.asc
Description: PGP signature

Re: Bug#734717: tasksel not installing task--desktop - confirmed

[Holger Wansing]

Version: 3.53


Holger Wansing  wrote:
> I tested this with buster alpha5 netinst image, and I can confirm this:
> tasksel does not install the packages which are listed (those are Recommends) 
> in task-german-desktop task (anymore?).
> 
> 
> I did two test installs:
> 1. install standard and lxde task with tasksel from within d-i while choosing
> German as language/Germany as country. This results in task-german-desktop 
> not 
> being installed, so for example firefox-esr-l10n-de and libreoffice-l10n-de 
> are not installed.
> 
> 2. install only standard task with tasksel from within d-i, reboot into
> new system and install lxde task with tasksel from there. The result is the
> same as above. All packages listed (under Recommends) for task-german-desktop 
> were not installed!
> 
> 
> So it seems that OP is right and task--desktop tasks are completely 
> ignored...
> 
> This makes large parts of the tasksel package selection concept useless!

I tested this again with a buster netinst image, and everything is fine now.

So this seems to have been fixed in the meantime.
Thus closing this bug


Holger


-- 
Holger Wansing 
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076

Re: Debian udeb Site Down?

[John Paul Adrian Glaubitz]

Hi Lonnie!

> On Oct 26, 2019, at 8:19 PM, Lonnie Cumberland  wrote:
> 
> I was able to build the Debian-Installer without any issues up until about 2 
> days ago but now it seems as though something may be wrong with the Debian 
> udeb site as I am getting build errors:

You need to update the kernel ABI version to 5.3.0-1 in build/config/common as 
the Linux kernel package was updated a few days ago in unstable.

Adrian

Bug#734717: marked as done (tasksel not installing task--desktop)

[Debian Bug Tracking System]

Your message dated Sat, 26 Oct 2019 20:47:14 +0200
with message-id <20191026204714.4df1071ea2bba3129d0db...@mailbox.org>
and subject line Re: Bug#734717: tasksel not installing task--desktop 
- confirmed
has caused the Debian Bug report #734717,
regarding tasksel not installing task--desktop
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact ow...@bugs.debian.org
immediately.)


-- 
734717: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=734717
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems
--- Begin Message ---
Package: tasksel
Version: 3.18

Installed the base system, upgraded to Sid and run Tasksel to install
the desktop task.
Previously, during the system installation process, Debian was
configured to use Spanish and once rebooted Gnome was shown in
Spanish, but not Iceweasel nor Libreoffice, which depend on
task-spanish-desktop. Installing the package manually solved the
problem.

This was tested also on Wheezy and the translations are automatically
installed, so it may be a bug of current Sid version and the
automatically installation of the package task--desktop.
Other languages were not tested.
--- End Message ---
--- Begin Message ---
Version: 3.53


Holger Wansing  wrote:
> I tested this with buster alpha5 netinst image, and I can confirm this:
> tasksel does not install the packages which are listed (those are Recommends) 
> in task-german-desktop task (anymore?).
> 
> 
> I did two test installs:
> 1. install standard and lxde task with tasksel from within d-i while choosing
> German as language/Germany as country. This results in task-german-desktop 
> not 
> being installed, so for example firefox-esr-l10n-de and libreoffice-l10n-de 
> are not installed.
> 
> 2. install only standard task with tasksel from within d-i, reboot into
> new system and install lxde task with tasksel from there. The result is the
> same as above. All packages listed (under Recommends) for task-german-desktop 
> were not installed!
> 
> 
> So it seems that OP is right and task--desktop tasks are completely 
> ignored...
> 
> This makes large parts of the tasksel package selection concept useless!

I tested this again with a buster netinst image, and everything is fine now.

So this seems to have been fixed in the meantime.
Thus closing this bug


Holger


-- 
Holger Wansing 
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076--- End Message ---

Bug#943572: d-i.debian.org: d-i scripts on dillon.d.o use /srv/mirrors

[Holger Wansing]

Hi,

Cyril Brulebois  wrote:
> Hi,
> 
> and thanks for the report.
> 
> Aurelien Jarno  (2019-10-26):
> > DSA would like to move dillon to another ganeti cluster with no local
> > mirror. It seems that the d-i scripts use /srv/mirrors, at least the
> > following crontab entry:
> > 
> > 55 */4 * * * cd $DI; mr -q up ; cd $DI/scripts/testing-summary; 
> > ./gen-summary /srv/mirrors/debian > $WWW/testing-summary.html ; 
> > ~/bin/push-www
> 
> Just checked what happens with http://deb.debian.org/debian instead
> (network mirror support is what I use when I run this script locally),
> and that seems fine.
> 
> Fixed in git, and deployed in the crontab:
>   
> https://salsa.debian.org/installer-team/d-i/commit/369054e0d3fdc7e9ef7e4987a4adaf191b4569c0
> 
> > Can you please confirm that /srv/mirrors is still used? Does it need a
> > full mirror or a partial mirror without pool/?
> 
> The dose checks used to need access to mirrors, but they seem to have
> been commented out by mistake:
>   
> https://salsa.debian.org/installer-team/d-i/commit/3d25abea44bb9122ee404394f6e84d67aa874b31
> 
> Those checks need access to Packages files. When re-enabling them,
> we can probably move to fetching those files from the network as well.
> 
> 
> Adding Holger to copy for awareness, but it doesn't look like we have
> more things depending on mirrors; so we can probably consider
> everything's good unless Holger knows about anything else?

I looked into topics on my responsibility, and there seem to be no such
things there.
So, nothing I am aware of.


Holger


-- 
Holger Wansing 
PGP-Fingerprint: 496A C6E8 1442 4B34 8508  3529 59F1 87CA 156E B076

Re: Debian udeb Site Down?

[Lonnie Cumberland]

Hi Adrian,

Thanks for answering my post.  I'm not really clear on how to update the
kernel ABI version to 5.3.0-1 in build/config/common.

I actually just did a fresh git pull following

https://wiki.debian.org/DebianInstaller/CheckOut
and then the build
https://wiki.debian.org/DebianInstaller/Build

like normal, but still the same results. Seems like it probably is a simple
fix, but I am not sure how to go about it.

I am now guessing that it is something on the host and not in the D-I
building, correct?
Thanks,
Lonnie


On Sat, Oct 26, 2019 at 2:46 PM John Paul Adrian Glaubitz <
glaub...@physik.fu-berlin.de> wrote:

> Hi Lonnie!
>
> > On Oct 26, 2019, at 8:19 PM, Lonnie Cumberland 
> wrote:
> >
> > I was able to build the Debian-Installer without any issues up until
> about 2 days ago but now it seems as though something may be wrong with the
> Debian udeb site as I am getting build errors:
>
> You need to update the kernel ABI version to 5.3.0-1 in
> build/config/common as the Linux kernel package was updated a few days ago
> in unstable.
>
> Adrian
>

Re: Debian udeb Site Down?

[John Paul Adrian Glaubitz]

On 10/27/19 12:04 AM, Lonnie Cumberland wrote:
> Thanks for answering my post.  I'm not really clear on how to update the 
> kernel ABI version to 5.3.0-1 in build/config/common.
Just update this line:

> https://salsa.debian.org/installer-team/debian-installer/blob/master/build/config/common#L14

Replace "5.2.0-3" with "5.3.0-1".

Adrian

-- 
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer - glaub...@debian.org
`. `'   Freie Universitaet Berlin - glaub...@physik.fu-berlin.de
  `-GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913

Re: Debian udeb Site Down?

[Lonnie Cumberland]

Thanks so very much Adrian, that did the trick.

If there is ever anything that I can help you with then please let me know
and I'll be glad to do what I can.

Just a side question on this. If this replacement is now needed, why is it
not put into the repository to be there by default?  I am testing the
change on a Debian 9 setup as well, but was just curious why it needs to be
manually changed instead. Any ideas?

On Sat, Oct 26, 2019 at 6:20 PM John Paul Adrian Glaubitz <
glaub...@physik.fu-berlin.de> wrote:

> On 10/27/19 12:04 AM, Lonnie Cumberland wrote:
> > Thanks for answering my post.  I'm not really clear on how to update the
> kernel ABI version to 5.3.0-1 in build/config/common.
> Just update this line:
>
> >
> https://salsa.debian.org/installer-team/debian-installer/blob/master/build/config/common#L14
>
> Replace "5.2.0-3" with "5.3.0-1".
>
> Adrian
>
> --
>  .''`.  John Paul Adrian Glaubitz
> : :' :  Debian Developer - glaub...@debian.org
> `. `'   Freie Universitaet Berlin - glaub...@physik.fu-berlin.de
>   `-GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913
>