wrote a simple script that signs into Fxa with existing user and verifies signed in state. Run against all 72 saucelabs configs (cloud webdriver testing)… here’s what we found:
Likely webdriver browser issues: * Linux Chrome 29+ (28 and earlier are passing) * iphone/ipad iOS 6.1 and 7.0 are failing (6.0 and 7.1 are passing) Windows opera failing - Need to investigate Win IE8/9 failing - known issue - bug logged already Run using default selenium version which is 2.30 https://github.com/edmoz/services-tools/blob/master/fxa-webdriver-tests/multiSmokeFxaAll.py test_fxa_signin (multiSmokeFxaAll.FxaTest Linux android 4 0) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux android 4 3) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux android 4 2) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux android 4 1) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 9 iphone 7 0) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 ipad 6 1) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 iphone 6 1) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 9 ipad 7 0) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 28) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 27) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux firefox 27) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux firefox 28) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux firefox 26) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux android 4 0) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux firefox 29) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome 27) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux android 4 3) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux opera 12) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 chrome 33) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux android 4 1) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux android 4 2) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 9 firefox 26) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome 32) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome 33) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome 30) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 chrome 28) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome 31) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome 28) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome 29) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 9 chrome 31) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome 34) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 firefox 28) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 iexplore 10) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 9 chrome 32) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 firefox 27) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 iexplore 11) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 chrome 31) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 firefox 29) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 firefox 26) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 chrome beta) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 ipad 6 0) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 chrome 27) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 chrome 32) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 chrome 30) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 chrome 28) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 chrome 29) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 chrome 33) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 chrome 27) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 chrome beta) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 28) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 27) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux firefox 29) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux firefox 28) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux firefox 27) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux firefox 26) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Linux opera 12) ... ok test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 iexplore 8) ... FAIL test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 7 iexplore 9) ... FAIL test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 29) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 30) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 31) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 32) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 33) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Linux chrome 34) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 ipad 6 0) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 8 iphone 6 0) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 9 ipad 7 1) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest OS X 10 9 iphone 7 1) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 opera 10) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 1 opera 9) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 opera 10) ... ERROR test_fxa_signin (multiSmokeFxaAll.FxaTest Windows 8 opera 9) ... ERROR _______________________________________________ Dev-fxacct mailing list [email protected] https://mail.mozilla.org/listinfo/dev-fxacct
