*Meeting theme: Coming to the end of train-81*
*First off, if you are reading this and think you should be in an FxA
meeting today (Monday), you are mistaken. All meetings are moved to
Tuesday. It's public holiday in the US and Canada.*
Action items from last time:
- DONE - stomlinson to ask jrgm & jbuck what content-experiments is
being used.
- NO STATUS - rfeeley to add a feature card to "fxa-features"
- DONE - vlad to do merge from 79-80 w/ firstrun fix.
- NOT DONE - stomlinson to copy SMS feature doc to GitHub - I keep
adding to the doc!
Discussion:
- The US and Canada are off on Monday (now today). All meetings moved to
Tuesday.
- g-k mentions there is some interest in splitting out the Google
Analytics collector and re-using that in other projects. Two sentence
summary: We send some metrics to GA, but we do not use ga.js, instead, we
send all metrics to our own backend and then forward those metrics to GA.
All sent data is scrubbed of PII before being sent, allowing us to use some
of GA's features while respecting user privacy.
- train-80 is out the door! Thanks for wrangling jrgm and vladikoff.
- jrgm is going to push the auth-server again with the customs-server
talking to tigerblood (the Mozilla IP reputation service).
- train-81 is going to be cut tomorrow (Tuesday)
- train-81's strings are to be cut last Friday - vlad is on the case.
- Vlad's Web Sessions work is coming along, Vijay has been helping with
a lot of reviews. Some of the auth-server endpoints need to be tweaked
slightly, as well as some additional tests, docs, and cleanup. Vlad is to
deploy to a box this week.
- The Send SMS work is progressing well. The auth-server, customs-server
and JS-client portions have all merged.
- We may try to merge what content-server work we have ready early
(probably train-82) even if the feature is not fully ready. The
idea is to
have the initial work merged and only available by typing a magic
incantation in the URL bar, that way we can have UX and
Softvision start to
test and we can work through some kinks. We'll then refine based on their
findings.
- pb and I got together to add flow metrics.
- We are trying to figure out if there are any A/B test opportunities
against existing flows. The only one that immediately comes to
mind is how
the App Store links perform, but we would hope with the send SMS form,
those links would perform worse.
- I need to add a QA test plan for Softvision to the feature doc.
- The fxa-auth-mailer repo is going to be integrated into the
fxa-auth-server repo. We have had these repos separate for the last several
years and the housekeeping has been a drag. There's not much of a reason to
use two repos, so we are going to merge them.
- A surprising % of people have > 1 account stored in localStorage
whenever they visit the /signin page. Nearly 10%.
- The connect another device experiment was rolled out to ~ 50% of
users, but we didn't see a drastic bump in our DataDog metrics and were
confused. I investigated and have a theory.
- When CAD was first released, we rolled the experiment out to 2.5%
of users. 1.25% of users were in the treatment group, 1.25% in
the control
group. These users went through both the signup AND the signin flow. We
then bumped to a 50% release, with 25% of users in the control group, 25%
in the treatment group. Of that 25%, only 10% report metrics to
DataDog. We
are back to 2.5% of users reporting about CAD. In the same
release, we did
[1] and limited CAD to only be visible to users that sign up.
Since roughly
half of our users sign up and half sign in, we lost 50% of the
users going
through the flow. Back to 1.25% reporting to DataDog.
Action items for next time:
- jbuck to add SMS creds to sops (thanks pb!)
- jbuck to ask travis to add cash to SMS account
- vlad to cut strings on Friday
- stomlinson to move meetings in calendar
- vlad to deploy web sessions to a box
- stomlinson to figure out why more people aren't seeing CAD
- stomlinson to bug alex about
https://github.com/mozilla/fxa-auth-mailer/issues/256
Shane
[1] - https://github.com/mozilla/fxa-content-server/pull/4672
_______________________________________________
Dev-fxacct mailing list
[email protected]
https://mail.mozilla.org/listinfo/dev-fxacct
