Hey Miro,

Sad to hear that it's been so rough.

On Wed, Apr 7, 2021 at 9:59 AM Miro Hrončok <mhron...@redhat.com> wrote:

> Hello,
> I was torn whether to share this here or not. I don't want to be the one
> who
> always complains about things, but at the end I've decided that without
> honest
> feedback, there cannot be progress (and I've realized I already am that
> guy).
>
> Please don't take this feedback personally, I know that building things is
> hard.
> I don't criticize people, but the tools.
>
> Almost 2 years ago, we've decided to be the early adopters of gating in
> Fedora
> with the python-virtualenv package:
>
>    https://src.fedoraproject.org/rpms/python-virtualenv/c/66b7533376f
>
> Gating has proved more problematic than useful. It almost never works
> reliably,
> the problems are impossible to decipher and/or debug. Too often we had to
> ask
> for a CI-expert human intervention or straight out waive the results.
>
> The humans we've contacted were always very friendly, helpful and they
> were able
> to solve our issues. However, human-operated CIs unfortunately don't scale
> very
> well.
>

Heh heh.

At first, we assumed the issues will get ironed out with time, but there
> seem to
> be no visible progress.
>
> Moreover, the gating caught 0 issues, because we already test our changes
> via
> Pull Requests.
>
I'm not sure if others have similar experience, or if we just got unlucky :(
>

Martin Pitt recently posted a blog post about how he's been using the same
tests and environments upstream in Pull Requests + downstream in Fedora
gating. He also talks about "Fedora Gating woes" there. Perhaps similar
concerns and pragmatic solutions.

https://cockpit-project.org/blog/fmf-unified-testing.html

Cheers,

Stef


>
> After a very bumpy ride, we've now removed the (quite incomprehensible)
> gating
> config, because frankly, it just gets in the way:
>
>    https://src.fedoraproject.org/rpms/python-virtualenv/pull-request/39
>
> We will continue to run the CI in pull requests (which isn't perfect
> either but
> at least we have redundancy and we see visible progress there over time)
> and to
> run tests in %check (which works perfectly, but has many unfortunate
> limitations).
>
> Let me be 100% clear: The situation wrt CI is complex and brings many
> interesting challenges, but if I compare it with the dark ages before
> that, I
> would not trade. Thank you everybody for making Fedora a better place to
> contribute to.
>
> --
> Miro Hrončok
> --
> Phone: +420777974800
> IRC: mhroncok
> _______________________________________________
> CI mailing list -- c...@lists.fedoraproject.org
> To unsubscribe send an email to ci-le...@lists.fedoraproject.org
> Fedora Code of Conduct:
> https://docs.fedoraproject.org/en-US/project/code-of-conduct/
> List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
> List Archives:
> https://lists.fedoraproject.org/archives/list/c...@lists.fedoraproject.org
> Do not reply to spam on the list, report it:
> https://pagure.io/fedora-infrastructure
>


-- 
Stef Walter (he / his)
Linux Engineering
Red Hat
_______________________________________________
devel mailing list -- devel@lists.fedoraproject.org
To unsubscribe send an email to devel-le...@lists.fedoraproject.org
Fedora Code of Conduct: 
https://docs.fedoraproject.org/en-US/project/code-of-conduct/
List Guidelines: https://fedoraproject.org/wiki/Mailing_list_guidelines
List Archives: 
https://lists.fedoraproject.org/archives/list/devel@lists.fedoraproject.org
Do not reply to spam on the list, report it: 
https://pagure.io/fedora-infrastructure

Reply via email to