Re: qwest outage no notice

2010-01-09 Thread virendra rode
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, Martin Hannigan wrote: > On Sat, Jan 9, 2010 at 9:37 AM, Paul Wall wrote: > >> On Thu, Jan 7, 2010 at 5:04 AM, Mike >> wrote: >>> We just had a qwest outage of about 2 mins at 1:41am pst. When I called >> to >>> report it I was told it was a

Re: qwest outage no notice

2010-01-09 Thread Martin Hannigan
On Sat, Jan 9, 2010 at 9:37 AM, Paul Wall wrote: > On Thu, Jan 7, 2010 at 5:04 AM, Mike > wrote: > > We just had a qwest outage of about 2 mins at 1:41am pst. When I called > to > > report it I was told it was a 200+ emergency software upgrade due to a > > security concern, and that we will get

Re: qwest outage no notice

2010-01-09 Thread Bob Bradlee
On Sat, 09 Jan 2010 07:00:42 -0800, Mike wrote: >Qwest NEVER EVER provides SLA adjustments, no longer how long it's down >or what their own role in it being down is. They toss it from department If they honored every SLA adjustment they would not be able to pay the current stockholders a 6.8%

Re: qwest outage no notice

2010-01-09 Thread Mike
Paul Wall wrote: On Thu, Jan 7, 2010 at 5:04 AM, Mike wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later after the fact. That's n

Re: qwest outage no notice

2010-01-09 Thread Paul Wall
On Thu, Jan 7, 2010 at 5:04 AM, Mike wrote: > We just had a qwest outage of about 2 mins at 1:41am pst. When I called to > report it I was told it was a 200+ emergency software upgrade due to a > security concern, and that we will get a notice later after the fact. That's not a maintenance, that'

Re: qwest outage no notice

2010-01-08 Thread Jack Bates
Scott Weeks wrote: Try no notice at all and 4 GigEs of upstream bandwidth down at 1:30am. :-( Honestly, I feel for them. They probably left it up to the account reps, which means the smaller circuits probably got notified and the HUGE wholesale accounts were not. Oh, well. That's why we hav

Re: qwest outage no notice

2010-01-07 Thread Scott Weeks
--- mike-na...@tiedyenetworks.com wrote: From: Mike Ok, so the next question is, what harm would a simple advance notice of 'emergency maintenance' caused, vs the very real hassle and inconvenience that DS3-down in the middle of the night caused for operations staff? I personally was yanked o

RE: qwest outage no notice

2010-01-07 Thread Dylan Ebner
is is related. They told me it was a bad switch, but that sounded funny. Dylan Ebner -Original Message- From: Jack Bates [mailto:jba...@brightok.net] Sent: Thursday, January 07, 2010 10:25 AM To: sth...@nethelp.no Cc: nanog@nanog.org Subject: Re: qwest outage no notice sth...@nethelp.no

RE: qwest outage no notice

2010-01-07 Thread Greg Olson
Probably related to this: http://www.theregister.co.uk/2010/01/07/juniper_critical_router_bug/ -Original Message- From: Chris De Young [mailto:c...@arizona.edu] Sent: Thursday, January 07, 2010 9:32 AM To: Mike Cc: NANOG list Subject: Re: qwest outage no notice Mike wrote: > We j

Re: qwest outage no notice

2010-01-07 Thread Bret Clark
This is one reason why companies should use twitter...great for those impromptu emergency messages. Our electrical utility company uses twitter and I have to admit that it's nice to know what is going on ahead of time even if it is a short message! On Thu, 2010-01-07 at 10:31 -0700, Chris De Youn

Re: qwest outage no notice

2010-01-07 Thread Chris De Young
Mike wrote: > We just had a qwest outage of about 2 mins at 1:41am pst. When I called > to report it I was told it was a 200+ emergency software upgrade due to > a security concern, and that we will get a notice later after the fact. Hmm - I got notice in advance. I'll have to go search for the em

RE: qwest outage no notice

2010-01-07 Thread Richey
That should read... Yeah, they refused to notify due to [marketing] concerns from what they Richey -Original Message- From: Mike [mailto:mike-na...@tiedyenetworks.com] Sent: Thursday, January 07, 2010 12:04 PM Cc: nanog@nanog.org Subject: Re: qwest outage no notice > Yeah, t

Re: qwest outage no notice

2010-01-07 Thread Mike
Yeah, they refused to notify due to security concerns from what they told me last night. Notification was performed after maintenance was complete. Ok, so the next question is, what harm would a simple advance notice of 'emergency maintenance' caused, vs the very real hassle and inconvenie

Re: qwest outage no notice

2010-01-07 Thread Jack Bates
sth...@nethelp.no wrote: We received 7 Juniper Security Advisories today. My guess is that this is the reason for the Qwest outage you've seen. Yeah, they refused to notify due to security concerns from what they told me last night. Notification was performed after maintenance was complete.

RE: qwest outage no notice

2010-01-07 Thread Matlock, Kenneth L
per advisory to me. Ken Matlock Network Analyst Exempla Healthcare (303) 467-4671 matlo...@exempla.org -Original Message- From: JoeSox [mailto:joe...@gmail.com] Sent: Thursday, January 07, 2010 8:25 AM To: nanog@nanog.org Subject: Re: qwest outage no notice My QWest account manag

Re: qwest outage no notice

2010-01-07 Thread JoeSox
On Thu, Jan 7, 2010 at 4:06 AM, wrote: >> We just had a qwest outage of about 2 mins at 1:41am pst. When I called >> to report it I was told it was a 200+ emergency software upgrade due to >> a security concern, and that we will get a notice later after the fact. >> Normally we get notices in adv

Re: qwest outage no notice

2010-01-07 Thread Steven Saner
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Jan 7, 2010, at 4:04 AM, Mike wrote: We just had a qwest outage of about 2 mins at 1:41am pst. When I called to report it I was told it was a 200+ emergency software upgrade due to a security concern, and that we will get a notice later aft

Re: qwest outage no notice

2010-01-07 Thread Chris Adams
Once upon a time, Mike said: > We just had a qwest outage of about 2 mins at 1:41am pst. When I called > to report it I was told it was a 200+ emergency software upgrade due to > a security concern, and that we will get a notice later after the fact. > Normally we get notices in advance, even f

Re: qwest outage no notice

2010-01-07 Thread Jeremy Rossi
Give the nature of the issue from juniper I am guessing that a large number of companies were doing upgrades over the last few days as fast as they could. http://j.mp/8XaReK has the details I know of now. On Jan 7, 2010, at 5:14 AM, Steve Ryan wrote: > Any other specifics? Got a trouble tick

RE: qwest outage no notice

2010-01-07 Thread Jason Shearer
Notices were left at the discretion of Qwest account teams. There was no mass notification. Jason -Original Message- From: Mike [mailto:mike-na...@tiedyenetworks.com] Sent: Thursday, January 07, 2010 4:04 AM To: NANOG list Subject: qwest outage no notice We just had a qwest outage of a

Re: qwest outage no notice

2010-01-07 Thread sthaug
> We just had a qwest outage of about 2 mins at 1:41am pst. When I called > to report it I was told it was a 200+ emergency software upgrade due to > a security concern, and that we will get a notice later after the fact. > Normally we get notices in advance, even for software upgrades due to >

Re: qwest outage no notice

2010-01-07 Thread Steve Ryan
Any other specifics? Got a trouble ticket ID? I'm located in the NW (Talent, Oregon, just over CA border..) and we have a few customers on Qwest T1's and the like. We also have a customer who gets MPLS directly from Q. We've yet to hear of any outages for our customers - but I suppose the