Okay, the External Facing messaging is along the lines of: Skinny: Issue resolved. ☺ “Yer Bug Is Fixed!”
Some references were made to Han Solo on the intercom when they were trying to rescue the Princess, but were removed. Can’t really say more, but they tell me the Root Cause has been addressed, and stuff is in place to see that it doesn’t happen again. Huge Thanks to all who raised the alarm. The lack of an alarm here is also being looked into, as that issue should never have slipped thru the cracks, but it did. “ Inconceivable! “ You keep using that word… Have a most excellent rest of the week, and a glorious Memorial Day Weekend for the USA folks. … who are not On Call. Aloha, Michael. -- Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been Processed." | Got the Junk Mail Reporting Tool<http://www.microsoft.com/en-us/download/details.aspx?id=18275> ? From: frnk...@iname.com [mailto:frnk...@iname.com] Sent: Wednesday, May 25, 2016 3:08 PM To: 'Jaren Angerbauer' <jarenangerba...@gmail.com>; Michael Wise <michael.w...@microsoft.com> Cc: mailop <mailop@mailop.org> Subject: RE: [mailop] Connection failures to Hotmail domains Finally has a chance to look at my logs … looking at error count over time (all U.S. Central) I see the following: Server 1: 1 25 12:3 1 25 12:4 4 25 13:1 22 25 13:2 22 25 13:3 24 25 13:4 31 25 13:5 18 25 14:0 8 25 14:1 16 25 14:2 5 25 14:3 19 25 14:4 15 25 14:5 18 25 15:0 7 25 15:1 6 25 15:2 4 25 15:3 11 25 15:4 2 25 15:5 8 25 16:0 9 25 16:1 6 25 16:2 7 25 16:3 9 25 16:4 6 25 16:5 4 25 17:0 Server 2: 2 25 12:4 1 25 13:0 14 25 13:1 10 25 13:2 24 25 13:3 20 25 13:4 11 25 13:5 11 25 14:0 19 25 14:1 11 25 14:2 9 25 14:3 12 25 14:4 14 25 14:5 7 25 15:0 8 25 15:1 16 25 15:2 8 25 15:3 17 25 15:4 17 25 15:5 7 25 16:0 12 25 16:1 12 25 16:2 27 25 16:3 13 25 16:4 18 25 16:5 4 25 17:0 So it’s off its peak, but not resolved. Frank From: mailop [mailto:mailop-boun...@mailop.org] On Behalf Of Jaren Angerbauer Sent: Wednesday, May 25, 2016 3:50 PM To: Michael Wise <michael.w...@microsoft.com<mailto:michael.w...@microsoft.com>> Cc: mailop <mailop@mailop.org<mailto:mailop@mailop.org>> Subject: Re: [mailop] Connection failures to Hotmail domains Thanks Mike. If you can, any update you receive (and can disclose) would be greatly appreciated. --Jaren On Wed, May 25, 2016 at 2:29 PM, Michael Wise via mailop <mailop@mailop.org<mailto:mailop@mailop.org>> wrote: Oh yeah, we're aware. Hearing some reports that the issue may have been mitigated, but until I hear anything from Inside the House, can't really comment except to say ... PRI:0, being worked on as I type. But not by me, as I have no insight into the inner workings. Aloha, Michael. -- Michael J Wise | Microsoft | Spam Analysis | "Your Spam Specimen Has Been Processed." | Got the Junk Mail Reporting Tool ? -----Original Message----- From: mailop [mailto:mailop-boun...@mailop.org<mailto:mailop-boun...@mailop.org>] On Behalf Of Al Iverson Sent: Wednesday, May 25, 2016 1:19 PM To: mailop <mailop@mailop.org<mailto:mailop@mailop.org>> Subject: Re: [mailop] Connection failures to Hotmail domains You're not alone. It's quite widespread. Multiple folks have talked to Microsoft people about the issue, they are aware. Regards, Al -- Al Iverson https://na01.safelinks.protection.outlook.com/?url=www.aliverson.com&data=01%7c01%7cmichael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=aAsiNeE1mgSCmbWOUv3P%2b9YXhGHv2v45p1LBMnD%2bdJs%3d (312)725-0130<tel:%28312%29725-0130> On Wed, May 25, 2016 at 3:08 PM, Keenan Tims <kt...@stargate.ca<mailto:kt...@stargate.ca>> wrote: > I'm seeing 90+% of our connection attempts to the MXes for > 'hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fhotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=WcnB99sJ8QXnYKT9JfwX%2b4nIHrMbewnqgzRveNclMgE%3d>' > and other Hotmail domains > (mx[1-4].hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fhotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=WcnB99sJ8QXnYKT9JfwX%2b4nIHrMbewnqgzRveNclMgE%3d>) > are > either timing out (30s) or getting connection refused since ~11:00am > PDT. Anyone else seeing this? I've tested from a few off-net points > and am seeing the same. Mail is starting to pile up in our queues in > quantity. Given the scale of what this appears to be I assume the team > is already hard at work on it, but the lack of mention here concerns > me, so sorry for the noise if this is too obvious for the list ;-). > > Our primary outbound relays are within > 64.253.128.0/19<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2f64.253.128.0%2f19&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=e8YB03fu%2fj7z%2bTHqL1%2fJdTSKLaEJfsNk66YUjPHua2U%3d> > > Here are a couple representative logs: > > 2016-05-25T12:55:19.470647-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MXsluy496C%2bNr5cTD0tHz51uUD1RnK64N6iX06lGb5M%3d>[65.55.37.104]:25: > Connection timed out > 2016-05-25T12:55:49.504155-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MXsluy496C%2bNr5cTD0tHz51uUD1RnK64N6iX06lGb5M%3d>[207.46.8.167]:25: > Connection timed out > 2016-05-25T12:55:49.513775-07:00 skaro postfix/smtp[6486]: connect to > mx2.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx2.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=EiKvze9OjZIKUCFOCmjh3IGXPXehpljcYuJMkbAQnZI%3d>[65.55.33.119]:25: > Connection refused > 2016-05-25T12:56:19.550093-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MXsluy496C%2bNr5cTD0tHz51uUD1RnK64N6iX06lGb5M%3d>[134.170.2.199]:25: > Connection timed out > 2016-05-25T12:56:49.583216-07:00 skaro postfix/smtp[6486]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MXsluy496C%2bNr5cTD0tHz51uUD1RnK64N6iX06lGb5M%3d>[65.54.188.110]:25: > Connection timed out > 2016-05-25T12:56:49.585566-07:00 skaro postfix/smtp[6486]: 3F2D5FFC9B: > to=<indra_...@hotmail.com<mailto:indra_...@hotmail.com>>, relay=none, > delay=120, > delays=0.17/0/120/0, dsn=4.4.1, status=deferred (connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MXsluy496C%2bNr5cTD0tHz51uUD1RnK64N6iX06lGb5M%3d>[65.54.188.110]:25: > Connection timed out) > > 2016-05-25T12:59:32.971606-07:00 skaro postfix/smtp[5033]: connect to > mx3.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx3.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=dCzjZoFyxKDMOEfZrpolrF0%2ffdyEKszUcaAaruWVIQM%3d>[65.55.37.72]:25: > Connection timed out > 2016-05-25T12:59:32.995152-07:00 skaro postfix/smtp[5033]: connect to > mx4.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx4.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=rvBc%2fA7L3nxd5D%2b7UlFlhKUC44OPwL6wPxcIJOdalvE%3d>[65.54.188.126]:25: > Connection refused > 2016-05-25T13:00:03.033047-07:00 skaro postfix/smtp[5033]: connect to > mx2.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx2.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=EiKvze9OjZIKUCFOCmjh3IGXPXehpljcYuJMkbAQnZI%3d>[207.46.8.167]:25: > Connection timed out > 2016-05-25T13:00:33.066589-07<tel:33.066589-07>:00 skaro postfix/smtp[5033]: > connect to > mx4.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx4.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=rvBc%2fA7L3nxd5D%2b7UlFlhKUC44OPwL6wPxcIJOdalvE%3d>[207.46.8.199]:25: > Connection timed out > 2016-05-25T13:00:33.076153-07<tel:33.076153-07>:00 skaro postfix/smtp[5033]: > connect to > mx2.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx2.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=EiKvze9OjZIKUCFOCmjh3IGXPXehpljcYuJMkbAQnZI%3d>[65.55.33.119]:25: > Connection refused > 2016-05-25T13:00:33.080762-07<tel:33.080762-07>:00 skaro postfix/smtp[5033]: > 25B4FFFC00: > to=<cynthia_lamber...@outlook.com<mailto:cynthia_lamber...@outlook.com>>, > relay=none, delay=91, > delays=0.78/0/90/0, dsn=4.4.1, status=deferred (connect to > mx2.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx2.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=EiKvze9OjZIKUCFOCmjh3IGXPXehpljcYuJMkbAQnZI%3d>[65.55.33.119]:25: > Connection refused) > > 2016-05-25T13:02:08.167728-07:00 skaro postfix/smtp[7967]: connect to > mx4.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx4.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=rvBc%2fA7L3nxd5D%2b7UlFlhKUC44OPwL6wPxcIJOdalvE%3d>[65.55.37.88]:25: > Connection timed out > 2016-05-25T13:02:08.177325-07:00 skaro postfix/smtp[7967]: connect to > mx4.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx4.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=rvBc%2fA7L3nxd5D%2b7UlFlhKUC44OPwL6wPxcIJOdalvE%3d>[65.55.37.120]:25: > Connection refused > 2016-05-25T13:02:38.208945-07:00 skaro postfix/smtp[7967]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MXsluy496C%2bNr5cTD0tHz51uUD1RnK64N6iX06lGb5M%3d>[65.54.188.72]:25: > Connection timed out > 2016-05-25T13:03:08.242467-07:00 skaro postfix/smtp[7967]: connect to > mx1.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx1.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=MXsluy496C%2bNr5cTD0tHz51uUD1RnK64N6iX06lGb5M%3d>[207.46.8.167]:25: > Connection timed out > 2016-05-25T13:03:38.275974-07:00 skaro postfix/smtp[7967]: connect to > mx3.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx3.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=dCzjZoFyxKDMOEfZrpolrF0%2ffdyEKszUcaAaruWVIQM%3d>[207.46.8.199]:25: > Connection timed out > 2016-05-25T13:03:38.278894-07:00 skaro postfix/smtp[7967]: 7DA71FFC4D: > to=<brendayle...@outlook.com<mailto:brendayle...@outlook.com>>, relay=none, > delay=3265, > delays=3145/0/120/0, dsn=4.4.1, status=deferred (connect to > mx3.hotmail.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fmx3.hotmail.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=dCzjZoFyxKDMOEfZrpolrF0%2ffdyEKszUcaAaruWVIQM%3d>[207.46.8.199]:25: > Connection timed out) > > Keenan > > Stargate Connections AS19171 > > > _______________________________________________ > mailop mailing list > mailop@mailop.org<mailto:mailop@mailop.org> > https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fchill > i.nosignal.org<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2fi.nosignal.org&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=8A%2brFXyKeZKl1myXsOp5SgScgq1Zg3VAb2E4iZ5xEMw%3d>%2fcgi-bin%2fmailman%2flistinfo%2fmailop&data=01%7c01%7c > michael.wise%40microsoft.com<https://na01.safelinks.protection.outlook.com/?url=http%3a%2f%2f40microsoft.com&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=ZPD16jMm%2felTFvatPumCsE8v9V2e2lYlUnWhrsZdaRM%3d>%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f9 > 88bf86f141af91ab2d7cd011db47%7c1&sdata=1lBgm%2bJnd7TLKgze60qkqXI10v4xy > E3BKYe42l%2fS5Z0%3d _______________________________________________ mailop mailing list mailop@mailop.org<mailto:mailop@mailop.org> https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fchilli.nosignal.org%2fcgi-bin%2fmailman%2flistinfo%2fmailop&data=01%7c01%7cmichael.wise%40microsoft.com%7c0a5ec58b131c4c5a5f2708d384dad364%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=1lBgm%2bJnd7TLKgze60qkqXI10v4xyE3BKYe42l%2fS5Z0%3d _______________________________________________ mailop mailing list mailop@mailop.org<mailto:mailop@mailop.org> https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop<https://na01.safelinks.protection.outlook.com/?url=https%3a%2f%2fchilli.nosignal.org%2fcgi-bin%2fmailman%2flistinfo%2fmailop&data=01%7c01%7cMichael.Wise%40microsoft.com%7c48d9e3321c44425173ad08d384e8ffe2%7c72f988bf86f141af91ab2d7cd011db47%7c1&sdata=IOE4DY5jgxxa9aqTaCT%2bbLZdt6fq21EuV%2bU5a8O3G4k%3d>
_______________________________________________ mailop mailing list mailop@mailop.org https://chilli.nosignal.org/cgi-bin/mailman/listinfo/mailop
