Hi Andreas, Andreas Hasenack wrote on 08/03/2023: > Hi, > > taking this as a sample: > > https://autopkgtest.ubuntu.com/packages/f/fdroidserver/lunar/ppc64el > <https://autopkgtest.ubuntu.com/packages/f/fdroidserver/lunar/ppc64el> > > It looks like something got slower since a few days ago, and tests > started being killed due to a timeout ("kind: install" timeout, which > has a default of 3000s in autopkgtest). > > By the end of February 2023, the passing tests were taking about 20min. > Then a little bit more up to 26min in March 2nd, and then they all > started to fail. > > Looking at the logs, we see apt-get install being interrupted by the > autopkgtest timeout mid package download: > > Get:242 http://ftpmaster.internal/ubuntu <http://ftpmaster.internal/ubuntu> > lunar/universe ppc64el apksigner all 31.0.2-1 [438 kB] > Get:243 http://ftpmaster.internal/ubuntu <http://ftpmaster.internal/ubuntu> > lunar/main ppc64el openjdk-17-jdk-headless ppc64el 17.0.6+10-1 [217 MB] > autopkgtest-virt-ssh [04:23:09]: ------- nova console-log > 766e17f7-5365-4cdf-8202-35b6b88a7cdc > (adt-lunar-ppc64el-fdroidserver-20230303-012357-lrg-root5) ------
For some reason a few days ago the connection between te bos01 and bos02 datacenters to ftpmaster.internal got extremely slow. Download speeds are of the order of 100kB/s, sometimes even less, while downloading from the Internet (archive.ubuntu.com) works just fine (so it is not storage). AIUI the connection from bos0[12] to ftpmaster passes through an haproxy and then an IPsec tunnel crossing an ocean. While maybe not ideal, the link was ~10 times faster up to a few days ago. I filed a ticket about it with the details I could gather. If that's not sorted out Soon(tm) we can workaround the issue by switching to us.archive.ubuntu.com or by bumping the timeouts. Paride -- ubuntu-devel mailing list ubuntu-devel@lists.ubuntu.com Modify settings or unsubscribe at: https://lists.ubuntu.com/mailman/listinfo/ubuntu-devel
