On Wednesday, March 21, 2018 at 3:30:48 PM UTC+1, Boris Zbarsky wrote: > The point is to gather data on how this behaves in the wild. If the > study is opt-in, then you have to try to figure out what part of the > effect you're seeing (if any) is just selection effects.
>From my understanding of Patrick's original message, the control in this study >isn't "the 50% of Nightly users who don't have DoH enabled", but instead the >existing DNS calls on each and every resolve: On Saturday, March 17, 2018 at 11:51:02 AM UTC+1, Patrick McManus wrote: > This initial test is focused on performance feasibility assessment and we > won't actually be using the DNS data returned from the DoH server (i.e. the > traditional DNS service is used in parallel and only those answers are used > - the code calls this shadow mode.) While yes, self-selection bias could still influence the results, it isn't obvous to me at least that it would be significant. > So this doesn't _need_ to be opt-out, as long as you're willing to not > believe any data it produces. But then what's the point? Thats seems like an exageration. -Tom _______________________________________________ dev-platform mailing list dev-platform@lists.mozilla.org https://lists.mozilla.org/listinfo/dev-platform
