[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-12-29 Thread Launchpad Bug Tracker
[Expired for Auto Package Testing because there has been no activity for 60 days.] ** Changed in: auto-package-testing Status: Incomplete => Expired -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https:

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-10-31 Thread Mario Limonciello
We're not going to re-introduce those tests in fwupd outside of upstream CI. ** Changed in: fwupd (Ubuntu) Status: New => Won't Fix -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-07-27 Thread Brian Murray
** Tags removed: update-excuse -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: network-based tests failed to run Status in Auto Package Testing: Incomp

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-07-25 Thread Paride Legovini
To reiterate on comment 15, I believe the failure is not due to a proxy issue. ** Changed in: auto-package-testing Status: New => Incomplete ** Changed in: fwupd (Ubuntu) Status: Won't Fix => New -- You received this bug notification because you are a member of Canonical's Ubuntu

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-07-19 Thread Brian Murray
Using fwupdmgr refresh also worked in both data centers, here is one example: ubuntu@creation-test-1:~$ fwupdmgr refresh Updating lvfs Downloading… [ |] failed to download file: Failed to connect to cdn.fwupd.org port 443 after 6 ms: Timeout wa

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-07-19 Thread Mario Limonciello
fwupdmgr refresh would download content from the CDN. -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: network-based tests failed to run Status in Auto Pa

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-07-19 Thread Brian Murray
I've tested using wget with the proxy server configured to download a file from fwupd.org in both data centers and did not encounter an issue. http_proxy=http://squid.internal:3128 https_proxy=http://squid.internal:3128 wget http://cdn.fwupd.org/downloads/01b95b0206f1a42a2bf95a432d162ef1f9f1f71edb

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-07-16 Thread Brian Murray
** Tags added: adt-297 -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: network-based tests failed to run Status in Auto Package Testing: New Status in

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-07-13 Thread Mario Limonciello
Because of this in fwupd 1.9.3 release we've disabled network tests by default, and CI test suites will need to opt in. https://github.com/fwupd/fwupd/commit/1d1e03fe02ad4b4bea41e9f7888d37fceb351174 1.9.3 is now in Debian unstable and mantic/proposed and I confirmed it's working. If the autopkg

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-29 Thread Zixing Liu
** Tags added: update-excuse ** Tags added: mantic -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: network-based tests failed to run Status in Auto Pack

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-22 Thread Zixing Liu
On line 749 of the https://autopkgtest.ubuntu.com/results/autopkgtest- mantic-vorlon-ppa/mantic/s390x/f/fwupd/20230623_011450_1ce26@/log.gz log, it showed: ``` 452s FuEngine plugins disabled: test, test_ble ``` Somehow the test plugins were disabled. This likely caused the failures.

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-22 Thread Zixing Liu
The `failed to find 08d460be0f1f9f128413f816022a6439e0078018` part is suspicious. The `failed to load emulation data` was likely the old network/proxy problem. The patch only included the endianness handling for a particular device. The hash is probably in the wrong endianness order, I suppose?

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-22 Thread Mario Limonciello
To me; looks like the same proxy issue as before. -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: network-based tests failed to run Status in Auto Packag

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-22 Thread Steve Langasek
https://autopkgtest.ubuntu.com/results/autopkgtest-mantic-vorlon- ppa/mantic/s390x/f/fwupd/20230623_011450_1ce26@/log.gz shows a failure: [...] 165s failed to load emulation data: emulation is not allowed from config 165s FAIL: fwupd/fwupd.test (Child process exited with code 1) [...] 165s Update

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-22 Thread Steve Langasek
working on building it in a ppa here https://launchpad.net/~canonical- foundations/+archive/ubuntu/ppa (just have to wait a cycle because I set up the new ppa with the wrong options initially) then will trigger an autopkgtest for it. -- You received this bug notification because you are a member

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-22 Thread Mario Limonciello
Any chance you can test the potential fix on the real hardware without needing to make a round trip to the archive to see if it works? https://github.com/fwupd/fwupd/pull/5929 -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Pac

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-21 Thread Mario Limonciello
This looks like a real failure now with the emulated "Wacom Intuos" device. I'll bring it upstream. -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: netwo

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-21 Thread Brian Murray
I also think it is no longer, but was at one point, a proxy issue. The amd64 tests have now passed although we did not make any changes to the proxy configuration. Additionally, as Paride mentioned the tests are failing on s390x regardless of the data center. Does s390x have the necessary capabili

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-20 Thread Paride Legovini
I am not sure anymore it's a proxy issue; can we make a step back and re-check that conclusion? >From the test logs I don't see obvious "failed to download" errors, on the contrary looks like the download is working. Moreover looks like to me that fwupd/1.9.1-1 always failed on s390x regardless of

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-17 Thread Mario Limonciello
It's not the daemon that downloads stuff, it's the client (via fwupdmgr). This should respect the environment variables http_proxy and https_proxy, so perhaps they're not set in the process environment for some reason. Can you set them in /etc/environment perhaps? -- You received this bug notifi

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-14 Thread Paride Legovini
On the proxy settings: looks like this is one case where we set the proxy variables in autopkgtest environment, but there's is a daemon involved (fwupd) with its own environment where proxy vars are not set (same situation we have e.g. with Docker). I had a quick look at fwupd and apparently it us

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-08 Thread Mario Limonciello
As a fundamental question - do you think that pulling artifacts from LVFS by autopkgtest is reasonable? These were originally intended for gating upstream CI so that no code got introduced that broke existing devices that supported emulation data. It's a LOT less likely that such breakage happens

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-08 Thread Brian Murray
I'll retry the s390x test as that also ran in bos01 as we might get lucky. Getting the amd64 tests to pass will require some proxy server changes though. -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-08 Thread Brian Murray
Thanks for the links Mario, this is quite helpful. In one of the test runs, https://autopkgtest.ubuntu.com/results/autopkgtest- mantic/mantic/ppc64el/f/fwupd/20230513_202849_b9c5e@/log.gz, we can see fwupd.test fail downloading. Downloading… [*** ]Downloading…

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-07 Thread Mario Limonciello
Thanks for sharing link. Here's one that failed and I retried and it worked. https://autopkgtest.ubuntu.com/results/autopkgtest- mantic/mantic/ppc64el/f/fwupd/20230513_202849_b9c5e@/log.gz https://autopkgtest.ubuntu.com/results/autopkgtest- mantic/mantic/ppc64el/f/fwupd/20230514_032026_71fd9@/log

Re: [Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-06 Thread Brian Murray
On Tue, Jun 06, 2023 at 10:37:02PM -, Mario Limonciello wrote: > Yes, but the logs are destroyed when you hit retry so I don't have the > logs of fail followed by pass. This is true of build logs but not autopkgtest log files. Here you can see multiple failures with fwupd 1.9.1-1 on amd64. ht

Re: [Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-06 Thread Steve Langasek
On Tue, Jun 06, 2023 at 10:37:02PM -, Mario Limonciello wrote: > Yes, but the logs are destroyed when you hit retry so I don't have the > logs of fail followed by pass. No, autopkgtest logs are not destroyed. That is only true for package build logs. -- You received this bug notification be

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-06 Thread Mario Limonciello
Yes, but the logs are destroyed when you hit retry so I don't have the logs of fail followed by pass. -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: netw

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-06 Thread Steve Langasek
Mario, you asserted that there were jobs that "failed once and hit retry and they pass". But the links you posted are to the test runs for fwupd 1.9.1-1, which have never passed. Are you saying that there were individual tests within the two runs of 1.9.1-1/amd64 that demonstrated flakiness? (if

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-06 Thread Mario Limonciello
Look at proposed migration. Here's two: https://autopkgtest.ubuntu.com/results/autopkgtest- mantic/mantic/amd64/f/fwupd/20230518_091353_f87ab@/log.gz https://autopkgtest.ubuntu.com/results/autopkgtest- mantic/mantic/arm64/f/fwupd/20230514_021241_b9c5e@/log.gz -- You received this bug notificat

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-06-06 Thread Brian Murray
@Mario - Could you elaborate on the issues you are seeing with the autopkgtest environment including links to log files and examples? My team and I would like to resolve any issues you are seeing. -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is su

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-05-30 Thread Mario Limonciello
I noticed that a bunch of the test runs blocking promotion passes, but some failed. Including some jobs that failed once and hit retry and they pass. So perhaps this is specific to certain autopkgtest hosts? -- You received this bug notification because you are a member of Canonical's Ubuntu QA

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-05-30 Thread Brian Murray
We should definitely look into the logging and why it is more cryptic in the autopkgtest environment. However, I also wonder if the test would succeed in lgw01. This is something that could be tested from the staging environment. -- You received this bug notification because you are a member of

[Canonical-ubuntu-qa] [Bug 2021908] Re: fwupd: network-based tests failed to run

2023-05-30 Thread Zixing Liu
** Also affects: fwupd (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Canonical's Ubuntu QA, which is subscribed to Auto Package Testing. https://bugs.launchpad.net/bugs/2021908 Title: fwupd: network-based tests failed to