I agree with Wanda. I would add that we netboot/customize when we have a
complete failure on the rootvg. The mksysb's are made weekly and stored on
node pairs (in addition to being backed up to ADSM). In this manner we can
get the rootvg rebuilt without going to tape, and then get picky about what
we really need to bring back.
Make sure that boot self-discovery and the ODM do not disagree (you never
know after a while of small hardware changes - this has bit us in the
past). Then once you've restored /dev and other important directories make
sure it matches the physical.
David
"Prather, Wanda" <[EMAIL PROTECTED]>@VM.MARIST.EDU> on 03/22/2001
12:17:42 PM
Please respond to "ADSM: Dist Stor Manager" <[EMAIL PROTECTED]>
Sent by: "ADSM: Dist Stor Manager" <[EMAIL PROTECTED]>
To: [EMAIL PROTECTED]
cc:
Subject: Re: Disaster Happened!
Yeah, been there done that about 9 months ago, and on an SP node, I think
at
AIX 4.3.2.
Nothing sneaky;
Just as you are doing, we reloaded the image from a mksysb tape, then
restored each filesystem from TSM to get current.
If you've got multiple tape drives, open another window and start the
restore of /home in parallel with /var -- and you can go /home faster!
-----Original Message-----
From: David Longo [mailto:[EMAIL PROTECTED]]
Sent: Thursday, March 22, 2001 2:09 PM
To: [EMAIL PROTECTED]
Subject: Disaster Happened!
I'll try to make this brief. Last night we were doing upgrades on some of
our systems, most notably and RS6000 SP Node running AIX 4.3.3. During OS
maintenance level update we lost connectivity from Control W/S with CDROM
to
the Client SP NOde - It went downhill from there! WE shortly couldn't even
getb into the Node even from TTY.
With great effort from IBM support we got in and got the NOde back in
config but no way to get back where we were. Had to reload a new image on
the node and then we loaded the TSM 4.1.0.0 client. (The node originally
had 3.1.0.6 client with API interfacing to ORacle's EBU for Oracle 7.3.4
database _ Peoplesoft App.) DB's are on Extrenal IBM ESS so shouild be
o.k.
We have restored /usr, now restoring /var and will go to /home and then /.
Looks good so far. We have never restored a complete AIX system from ADSM
and certainlyu not an SP NODE. I just got back in from 3 hours sleep while
another guy got us this far.
I plan to call Tivoli, but wanted to check with anybody that has done this
or similar with AIX. And anybody that also has SP experience would be
helpful.
Are we going down wrong path? What are gotcha's? What about SP issues?
Default assumption is after we resotre these rootvg filesystems, we can
reboot and everybody will live happily everafter?!?!?!
We will not reboot until I can get some good feeling that it will come up
as
we may not be able to get back in. I know this may not make good sense as
I'm not 10% today but that's why we are checking with others. I will also
try to get "DR restore manual" from onluine at Tivle/IBM also.
(We are alsio restoring a 30+ GB Novell volume - gues how long that will
ytake!!)
THanks in advance for any helpful comments.
I will post our "Final Answer" when it's all back up!
David B. Longo
System Administrator
Health First, Inc.
3300 Fiske Blvd.
Rockledge, FL 32955-4305
PH 321.434.5536
Pager 321.634.8230
Fax: 321.434.5525
[EMAIL PROTECTED]
"MMS <health-first.org>" made the following
annotations on 03/22/01 14:14:48
----------------------------------------------------------------------------
--
This message is for the named person's use only. It may contain
confidential, proprietary, or legally privileged information. No
confidentiality or privilege is waived or lost by any mistransmission. If
you receive this message in error, please immediately delete it and all
copies of it from your system, destroy any hard copies of it, and notify
the
sender. You must not, directly or indirectly, use, disclose, distribute,
print, or copy any part of this message if you are not the intended
recipient. Health First reserves the right to monitor all e-mail
communications through its networks. Any views or opinions expressed in
this message are solely those of the individual sender, except (1) where
the
message states such views or opinions are on behalf of a particular entity;
and (2) the sender is authorized by the entity to give such views or
opinions.
=======================================
