Re: Re: command to query how much data is stored
Kelly Lipp wrote: > > Now the big dogs will weigh in with the perfect 300 character SQL > select statement with it summarized, etc, but this will get you > started. It sounded more to me like Richard is looking for "query stgpool"... :) Well, if he doesn't want to do the math by hand, something like this: select stgpool_name, cast((est_capacity_mb*pct_utilized/100) - as decimal(16,2)) as "UTILIZED_MB" from stgpools =Dave (not a big dog) > -Original Message- > From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Cheung, > Richard > Sent: Monday, November 10, 2008 10:55 PM > To: ADSM-L@VM.MARIST.EDU > Subject: [ADSM-L] command to query how much data is stored > > What is the command to show how much data is currently stored in a > storage pool - eg tapepool? Not for any specific individual nodes - > just at a pure 'how much data is in a storage pool' level? -- Hello World.David Bronder - Systems Admin Segmentation Fault ITS-SPA, Univ. of Iowa Core dumped, disk trashed, quota filled, soda warm. [EMAIL PROTECTED]
Re: reclamation
. Richard - it is not reclaiming anything, because you don't have any tapes to reclaim. The script you are using that shows tapes awaiting reclamation at 99% utilized is misleading you. That is showing you how many tapes you could reclaim if you set the threshold to 1. The basic prioblem is that % utilized is PERCENT FULL, while % reclaimable (and the threshold you set on the UPDATE STGPOOL command) is PERCENT EMPTY. It will not add up exactly, but (% utilized) + (% reclaimable) = 100% (approximately) (I'm not going to go into why this does not add up exactly, but it won't.) So when you update the storage pool to set the threshold to be 99, it will only reclaim tapes that are 1% full and 99% empty. You clearly have none. You're actually in pretty good shape considering your threshold is set to 60. You do not have any almost-empty tapes to reclaim. If you're running out of scratch tapes, try setting the threshold to 50, and then LOWERING it a point at a time to see how many you get. You might start seeing significant reclamation activity with the threshold set somewhere around 45. I'm constantly adjusting mine up or down a point at a time, to achieve the level of reclamation necessary to insure an adequate supply of scratch tapes. One reason this is confusing, is that the default value is 50. The default of which - emptiness or fullness? Well, at 50 it doesn't matter, because 50% full = 50% empty after all. Richard, you are not the first person to fall for this, and you will not be the last. It confuses me sometimes too. Roger Deschner University of Illinois at Chicago [EMAIL PROTECTED] An optimist is someone who says a glass is half full. = == A pessimist says it's half empty. An engineering consultant says, === === "Looks like you've got twice as much glass as you need." === >I don't necessarily want to modify the current reclamation threshold >value on my tape storage pool (currently at 60) > >But I do want to do some manual reclamations to gain back some of these >volumes at > 99% - some one off processes... I would have thought >issuing manual "reclaim stgpool threshold=99" should have >done this?? > > > >-Original Message- >From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf Of >Jim Neal >Sent: Tuesday, 11 November 2008 9:33 AM >To: ADSM-L AT VM.MARIST DOT EDU >Subject: Re: [ADSM-L] reclamation > >Hi Richard, > >I believe the command you want to use is: > >upd stg recl=99 reclaimpr=X (where x=number of reclaim >processes >to start). > >-Original Message- >From: ADSM: Dist Stor Manager [mailto:ADSM-L AT VM.MARIST DOT EDU] On Behalf Of >Cheung, Richard >Sent: Monday, November 10, 2008 2:56 PM >To: ADSM-L AT VM.MARIST DOT EDU >Subject: [ADSM-L] reclamation > >Hi.. > >I have done some checks on my system on the Number of tapes to be >reclaimed in my main tape pool, and discover the following: > >No of tapes awaiting reclamation at > 99% utilized = 86 >No of tapes awaiting reclamation at > 80% utilized = 51 >No of tapes awaiting reclamation at > 70% utilized = 36 >No of tapes awaiting reclamation at > 60% utilized = 23 >No of tapes awaiting reclamation at > 50% utilized = 2 > >To facilitate this, I thought I would do some manual reclamations to >clear the back log... > >However when I enter in > >Reclaim stgpool threshold=99 wait=no > >It tells me 'there is no data to be processed' > >Not sure why it would tell me that if there is supposedly 86 tapes at >99%> pct util awaiting reclamation? > >Any one has any suggestions? > >Richard
Re: Re: command to query how much data is stored
How about 'select sum(physical_mb) from occupancy where stgpool_name='TAPEPOOL'? On Tue, Nov 11, 2008 at 3:01 AM, David Bronder <[EMAIL PROTECTED]>wrote: > Kelly Lipp wrote: > > > > Now the big dogs will weigh in with the perfect 300 character SQL > > select statement with it summarized, etc, but this will get you > > started. > > It sounded more to me like Richard is looking for "query stgpool"... :) > > Well, if he doesn't want to do the math by hand, something like this: > > select stgpool_name, cast((est_capacity_mb*pct_utilized/100) - >as decimal(16,2)) as "UTILIZED_MB" from stgpools > > =Dave (not a big dog) > > > > -Original Message- > > From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of > Cheung, Richard > > Sent: Monday, November 10, 2008 10:55 PM > > To: ADSM-L@VM.MARIST.EDU > > Subject: [ADSM-L] command to query how much data is stored > > > > What is the command to show how much data is currently stored in a > > storage pool - eg tapepool? Not for any specific individual nodes - > > just at a pure 'how much data is in a storage pool' level? > > > -- > Hello World.David Bronder - Systems > Admin > Segmentation Fault ITS-SPA, Univ. of > Iowa > Core dumped, disk trashed, quota filled, soda warm. > [EMAIL PROTECTED] >
Include/Exclude tester?
Has someone created an include/exclude tester to show me the errors of my ways (besides from the client side)? I have this statement in my CLOPTSET: INCLEXCL EXCLUDE *:\...\Sophos\* and FORCE=YES Yet I still see boxes that have this cloptset assigned to them backing up files like: \PROGRAM FILES\SOPHOS\SOPHOS ANTI-VIRUS\ AGEN-HTK.IDE Please show me the errors of my way and how to properly exclude *EVERY* directory that contains the name/word "sophos" in it!
Re: Include/Exclude tester?
I think that only excludes files with the immediate parent directory named "sophos" Keep that and add: *:\...\sophos\...\* Regards, Shawn Shawn Drew Internet [EMAIL PROTECTED] Sent by: ADSM-L@VM.MARIST.EDU 11/11/2008 01:42 PM Please respond to ADSM-L@VM.MARIST.EDU To ADSM-L cc Subject [ADSM-L] Include/Exclude tester? Has someone created an include/exclude tester to show me the errors of my ways (besides from the client side)? I have this statement in my CLOPTSET: INCLEXCL EXCLUDE *:\...\Sophos\* and FORCE=YES Yet I still see boxes that have this cloptset assigned to them backing up files like: \PROGRAM FILES\SOPHOS\SOPHOS ANTI-VIRUS\ AGEN-HTK.IDE Please show me the errors of my way and how to properly exclude *EVERY* directory that contains the name/word "sophos" in it! This message and any attachments (the "message") is intended solely for the addressees and is confidential. If you receive this message in error, please delete it and immediately notify the sender. Any use not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval. The internet can not guarantee the integrity of this message. BNP PARIBAS (and its subsidiaries) shall (will) not therefore be liable for the message if modified. Please note that certain functions and services for BNP Paribas may be performed by BNP Paribas RCC, Inc.
Recovery Log Query
Hi TSM Server version 5.3.3.1 I have a query regarding some unusual activity a couple of nights ago. Our recovery log is 12gb and is in NORNAL mode I ran a full database backup at 16:00 Saturday - that should clear the log down During the night, the log appears to go to 80%. Or so the following messages indicated: 09-11-2008 05:18:59 ANR2997W The server log is 80 percent full. The server will delay transactions by 3 milliseconds. (SESSION: 1734316) 09-11-2008 05:26:51 ANR2997W The server log is 80 percent full. The server will delay transactions by 3 milliseconds. 09-11-2008 06:19:46 ANR2997W The server log is 80 percent full. The server will delay transactions by 3 milliseconds. (SESSION: 1744757) Then 09-11-2008 06:19:49 ANR2996I The server log is 5 percent full. The server is no longer delaying transactions.(SESSION: 1734370) The next full database did not run until approx. 16:00 on Sunday afternoon. So if the database backup did not clear the log to 5% used, what could have. There is no activity other than a few backups between the last ANR2997W message and the ANR2996I message. Thoughts? Jeff White This e-mail and any attachments are confidential and intended solely for the addressee and may also be privileged or exempt from disclosure under applicable law. If you are not the addressee, or have received this e-mail in error, please notify the sender immediately, delete it from your system and do not copy, disclose or otherwise act upon any part of this e-mail or its attachments. Internet communications are not guaranteed to be secure or virus-free. The Barclays Group does not accept responsibility for any loss arising from unauthorised access to, or interference with, any Internet communications by any third party, or from the transmission of any viruses. Replies to this e-mail may be monitored by the Barclays Group for operational or business reasons. Any opinion or other information in this e-mail or its attachments that does not relate to the business of the Barclays Group is personal to the sender and is not given or endorsed by the Barclays Group. Barclays Bank PLC.Registered in England and Wales (registered no. 1026167). Registered Office: 1 Churchill Place, London, E14 5HP, United Kingdom. Barclays Bank PLC is authorised and regulated by the Financial Services Authority.
Re: NDMP restore
Once again the answer was read the fantastic manual. Thank you for pointing me to the correct one. Andy Huebner -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Michael Green Sent: Tuesday, November 11, 2008 1:51 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] NDMP restore Search ibm.com/redbooks for a Redbook called "Using the IBM System Storage N Series with IBM Tivoli Storage Manager". Catalog number SG247243-00. It explains really well how to utilise BA client on a windows host to restore NDMP backup using TOC. -- Warm regards, Michael Green On Tue, Nov 11, 2008 at 12:53 AM, Huebner,Andy,FORT WORTH,IT <[EMAIL PROTECTED]> wrote: > I may be missing something. What do you mean the client GUI? Are you using > the BA Client from a different host to restore NDMP data? > > Andy Huebner > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Ribeiro, > Ricardo > Sent: Monday, November 10, 2008 3:57 PM > To: ADSM-L@VM.MARIST.EDU > Subject: Re: [ADSM-L] NDMP restore > > We use the regular TSM client GUI, it works pretty good so far... > The other option is to use the command line, but you will need to know > the path of the file(S) you are restoring. > I have not try the ISC GUI yet. > > -Original Message- > From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of > Huebner,Andy,FORT WORTH,IT > Sent: Monday, November 10, 2008 2:50 PM > To: ADSM-L@VM.MARIST.EDU > Subject: [ADSM-L] NDMP restore > > We are new to the NDMP side of TSM. One of the things we found out was > that ISC cannot load a TOC with 545K objects. This is an IBM confirmed > limitation of the ISC and is based on the size of the TOC. > For those with NDMP, how do you handle file restores if the user is > unsure of a file's name or date from which to restores? Do you dump the > TOC, or is there a command I have missed? > It all works fine from the command line if we know the file name and > date. > > TSM - AIX 5.4.2.0 > NDMP - EMC Celerra > ISC - 6.0.1 > Frustration - 10.0 > > > Andy Huebner > > > > This e-mail (including any attachments) is confidential and may be > legally privileged. If you are not an intended recipient or an > authorized representative of an intended recipient, you are prohibited > from using, copying or distributing the information in this e-mail or > its attachments. If you have received this e-mail in error, please > notify the sender immediately by return e-mail and delete all copies of > this message and any attachments. > Thank you. > > > This e-mail (including any attachments) is confidential and may be legally > privileged. If you are not an intended recipient or an authorized > representative of an intended recipient, you are prohibited from using, > copying or distributing the information in this e-mail or its attachments. If > you have received this e-mail in error, please notify the sender immediately > by return e-mail and delete all copies of this message and any attachments. > Thank you. > This e-mail (including any attachments) is confidential and may be legally privileged. If you are not an intended recipient or an authorized representative of an intended recipient, you are prohibited from using, copying or distributing the information in this e-mail or its attachments. If you have received this e-mail in error, please notify the sender immediately by return e-mail and delete all copies of this message and any attachments. Thank you.
CBRM - Centera and my TSM server.
Can someone give me a clue ? I've been tasked to back up our Centera... I have no working knowledge of CBRM and have not been through any previous exercises to define NDMP operations on TSM. What I have: TSM server EE 5.4.3 on AIX. CBRM version 2.2. T950 library with 10 LTO4 drives. I have the host defined, I have a STG defined for TOC and I have a separate domain defined for just this process. I inititated the nas backup and it appeared the data was being sent to the TSM server around 175 gb of data. The STG had no data, No tapes were mounted but my recovery log grew throughout the process. I'm working with a vendor that has some experiencing setting this up and appears to be lost down the wrong track. I was able to locate some documentation on this and it appears that I have to define a separate library for this processing. Can anyone give me some background on how this is supposed to work ? And possibly what I am missing. Thanks, Duane
Re: command to query how much data is stored
I see it's been about a day, and I'd hate for you to be disappointed, Kelly, so here goes. select stgpool_name, sum(est_capacity_mb*pct_utilized/100) from volumes group by stgpool_name OK, so it's short by about 200 characters -- I'll just have to try harder next time. :o) disclaimer: I didn't take the time to test it, but it should work with minimal troubleshooting. Alex Paschal Storage Solutions Engineer MSI Systems Integrators Your Business. Better. -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Kelly Lipp Sent: Monday, November 10, 2008 10:06 PM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] command to query how much data is stored Tsm> audit license Tsm> query auditocc pooltype=primary Will show all nodes capacity in the primary storage pools. I think query auditocc pooltype=primary node=nodename or perhaps q auditocc nodename pooltype=primary will do it as well. Now the big dogs will weigh in with the perfect 300 character SQL select statement with it summarized, etc, but this will get you started. Kelly Lipp CTO STORServer, Inc. 485-B Elkton Drive Colorado Springs, CO 80907 719-266-8777 www.storserver.com -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Cheung, Richard Sent: Monday, November 10, 2008 10:55 PM To: ADSM-L@VM.MARIST.EDU Subject: [ADSM-L] command to query how much data is stored What is the command to show how much data is currently stored in a storage pool - eg tapepool? Not for any specific individual nodes - just at a pure 'how much data is in a storage pool' level? http://www.santos.com/library/logo.gif";> Santos Ltd A.B.N. 80 007 550 923 Disclaimer: The information contained in this email is intended only for the use of the person(s) to whom it is addressed and may be confidential or contain privileged information. If you are not the intended recipient you are hereby notified that any perusal, use, distribution, copying or disclosure is strictly prohibited. If you have received this email in error please immediately advise us by return email and delete the email without making a copy. Please consider the environment before printing this email This message (including any attachments) is intended only for the use of the individual or entity to which it is addressed and may contain information that is non-public, proprietary, privileged, confidential, and exempt from disclosure under applicable law or may constitute as attorney work product. If you are not the intended recipient, you are hereby notified that any use, dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this communication in error, notify us immediately by telephone and (i) destroy this message if a facsimile or (ii) delete this message immediately if this is an electronic communication. Thank you.
Re: Recovery Log Query
You likely have a backup session that is "pinning" the log in place until the backup completes. Create a TSM script that runs QUERY LOG >> every minute or so. Examine the file every day to see if the same sort of thing happens regularly. Note the timestamps, and discover what clients are backing up when the log starts to grow. Oh, and your company's email server spews an "address change" email to everyone who responds to ADSM-L emails. You might want to have your mail admin look into that. -- Mark Stapleton ([EMAIL PROTECTED]) CDW Berbee System engineer 7145 Boone Avenue North, Suite 140 Brooklyn Park MN 55428-1511 763-592-5963 www.berbee.com From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Jeff White > I have a query regarding some unusual activity a couple of nights ago. > > Our recovery log is 12gb and is in NORNAL mode > > I ran a full database backup at 16:00 Saturday - that should clear the > log down. During the night, the log appears to go to 80%. Or so the following > messages indicated: > > 09-11-2008 05:18:59 ANR2997W The server log is 80 percent full. > The > server will delay transactions by 3 milliseconds. (SESSION: 1734316) > 09-11-2008 05:26:51 ANR2997W The server log is 80 percent full. > The > server will delay transactions by 3 milliseconds. > 09-11-2008 06:19:46 ANR2997W The server log is 80 percent full. > The > server will delay transactions by 3 milliseconds. (SESSION: 1744757) > > Then > > 09-11-2008 06:19:49 ANR2996I The server log is 5 percent full. The > server is no longer delaying transactions.(SESSION: 1734370) > > The next full database did not run until approx. 16:00 on Sunday > afternoon. > So if the database backup did not clear the log to 5% used, what could > have. > There is no activity other than a few backups between the last ANR2997W > message and the ANR2996I message. > > Thoughts? > > Jeff White
Re: CBRM - Centera and my TSM server.
For the Celerra, the NDMP manuals is at powerlink.emc.com, requires powerlink account Under support, technical documentation and Advisories, Hardware/platforms Documentation, Celerra network server, installation/configuration scroll down for NDMP -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Ochs, Duane Sent: Tuesday, November 11, 2008 9:19 AM To: ADSM-L@VM.MARIST.EDU Subject: CBRM - Centera and my TSM server. Can someone give me a clue ? I've been tasked to back up our Centera... I have no working knowledge of CBRM and have not been through any previous exercises to define NDMP operations on TSM. What I have: TSM server EE 5.4.3 on AIX. CBRM version 2.2. T950 library with 10 LTO4 drives. I have the host defined, I have a STG defined for TOC and I have a separate domain defined for just this process. I inititated the nas backup and it appeared the data was being sent to the TSM server around 175 gb of data. The STG had no data, No tapes were mounted but my recovery log grew throughout the process. I'm working with a vendor that has some experiencing setting this up and appears to be lost down the wrong track. I was able to locate some documentation on this and it appears that I have to define a separate library for this processing. Can anyone give me some background on how this is supposed to work ? And possibly what I am missing. Thanks, Duane
Re: CBRM - Centera and my TSM server.
There are 2 webcast which may be helpful Tivoli Storage Manager (TSM) Backup Considerations with Nseries http://www-01.ibm.com/support/docview.wss?rs=2077&context=SSGSG7&dc=DA41 0&dc=DA450&dc=DA430&dc=DA440&dc=D600&dc=D700&dc=DB510&dc=DB520&dc=D800&d c=D900&dc=DA900&dc=DA800&dc=DB540&dc=DB400&dc=DB560&dc=DB530&dc=DA600&dc =DB550&dc=D100&dc=DA420&dc=DA460&dc=DB300&dc=DA470&dc=DA480&dc=DB100&dc= DA4A10&dc=DA4A20&dc=DA700&dc=DA4A30&dc=DA400&dc=DA100&dc=DA500&dc=D200&d c=DB700&dc=DB600&q1=tste_webcast&uid=swg27010813&loc=en_US&cs=UTF-8&lang =all Tivoli Storage Manager: Overview, setup, and usage of NDMP operations http://www-01.ibm.com/support/docview.wss?rs=2077&context=SSGSG7&dc=DA41 0&dc=DA450&dc=DA430&dc=DA440&dc=D600&dc=D700&dc=DB510&dc=DB520&dc=D800&d c=D900&dc=DA900&dc=DA800&dc=DB540&dc=DB400&dc=DB560&dc=DB530&dc=DA600&dc =DB550&dc=D100&dc=DA420&dc=DA460&dc=DB300&dc=DA470&dc=DA480&dc=DB100&dc= DA4A10&dc=DA4A20&dc=DA700&dc=DA4A30&dc=DA400&dc=DA100&dc=DA500&dc=D200&d c=DB700&dc=DB600&q1=tste_webcast&uid=swg27010609&loc=en_US&cs=UTF-8&lang =all -Original Message- From: ADSM: Dist Stor Manager [mailto:[EMAIL PROTECTED] On Behalf Of Ochs, Duane Sent: Tuesday, November 11, 2008 9:19 AM To: ADSM-L@VM.MARIST.EDU Subject: CBRM - Centera and my TSM server. Can someone give me a clue ? I've been tasked to back up our Centera... I have no working knowledge of CBRM and have not been through any previous exercises to define NDMP operations on TSM. What I have: TSM server EE 5.4.3 on AIX. CBRM version 2.2. T950 library with 10 LTO4 drives. I have the host defined, I have a STG defined for TOC and I have a separate domain defined for just this process. I inititated the nas backup and it appeared the data was being sent to the TSM server around 175 gb of data. The STG had no data, No tapes were mounted but my recovery log grew throughout the process. I'm working with a vendor that has some experiencing setting this up and appears to be lost down the wrong track. I was able to locate some documentation on this and it appears that I have to define a separate library for this processing. Can anyone give me some background on how this is supposed to work ? And possibly what I am missing. Thanks, Duane
