On Wed, Jun 14, 2017 at 10:07 AM, Nathan Froyd <nfr...@mozilla.com> wrote:
> On Wed, Jun 14, 2017 at 12:54 PM, Steve Fink <sf...@mozilla.com> wrote: > > On 06/14/2017 09:23 AM, Andrew Swan wrote: > >> I would hope that if we have promising or widely used webextension > >> experiments, that the relevant peers would be aware of them when > reviewing > >> changes that might affect them but of course changing IDL bindings is > only > >> one of a number of ways that a change to central could break an existing > >> experiment. This is one of the drawbacks of having out-of-tree code, I > >> think its up to us (the webextensions maintainers) to either deal with > >> this > >> or get experiments worked into automation if this becomes a real problem > >> in > >> practice. > > > > Whoa. Experiments aren't tested in automation? > > Whoa. We're going to still have to think about interface compat with > external clients in a post-57 world? This is the first I've heard of > this. > > > Can they be, please? At least snapshotted versions. > > +1 Almost anything automation-related would be better than "hope > peers think hard about this". > I'm not sure what you mean by "they". We have support in the browser for loading experiments, but we don't have a way to sign them for running in release. So some individuals have created experiments that they have used locally but there is no centralized list of them and none of them are widely used. Making experiments more usable by creating a process for getting experiments reviewed and signed is something we'd like to do and a testing strategy certainly needs to be part of that. But realistically that is not going to happen until 57 is out the door. More generally, I think the principle that we can't complain about internal changes that break out-of-tree code if nothing breaks in automation is fair (speaking from the webextensions perspective, not for devtools, test pilot, etc) and we're not asking for any exception from that rule. Or, as a more direct answer to nfroyd: no, you don't need to think about compatibility with out-of-tree code post-57 (at least as far as extensions are concerned). -Andrew _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
