Is anyone getting > 100MB/s on a NetApp SM2Tape backup?
All, We are implementing an IBM N-Series Filer cluster (rebranded NetApp) and working on getting the full-volume DR backups setup. We are using SnapMirror2Tape with 3-way NDMP (don't want to dedicate FC tape drives from our Library Mgr environment, and we have 10gb Ethernet from the Filer to the TSM Server). TSM Server 6.2.2 AIX on P-series. Tape is IBM 3592, disk is IBM DS8k. When we started testing, we were only getting about 60-80MB/s throughput. After turning off, we are now up to 90MB/s. Filer cpu is < 40%. We have run the following tests: NDMP Dump to null = 300-400MB/s (disk is not the bottleneck) NDMP Dump to the other Filer in the cluster = 104MB/s (takes TSM & tape out of the equation) NDMP Dump to another vol on the same Filer = 110MB/s (takes network out of the equation) We're not getting much help from IBM Support, and at least one person has said that 100MB/s is about the best you can expect. So I'm curious if anyone is getting more than that, and if not, what is holding it back? I have at least one Windows 2008R2 SQL Server running under VMWare that has proven it can restore between 225-325MB/s on the same 10gb network, so I don't understand why we can't achieve better performance on a backup that is supposedly block level? Thanks, Steve Schaub Systems Engineer II, Windows Backup/Recovery BlueCross BlueShield of Tennessee - Please see the following link for the BlueCross BlueShield of Tennessee E-mail disclaimer: http://www.bcbst.com/email_disclaimer.shtm
Size of actice data pool ?
Hi all, given the following setup: TSM 5.5 Primary storage pool of device class FILE Copy ool on LTO -tapes, managed by DRM Primary pool ist copied daily to the copy pool Since the Copy pool is reaching some limitations ( # of tapes, vault capacity) we are thinking about setting up an active data pool and copying the active data pool to the copy pool. The question: How to estimate the size of the active data pool in compared to the primary pool? Is there something like: QUERY OCCUPANCY ACTIVEDATAONLY=YES ? Can it be done with some SQL query? I can geht the numbers (active/inactive) from the backups table, but it does not give the size of the backed up objects. Any hints on this? regards Günther -- Guenther Bergmann, Am Kreuzacker 10, 63150 Heusenstamm, Germany Guenther_Bergmann at gbergmann dot de
Re: Size of actice data pool ?
You can run a preview on the "copy activedata" command.(i.e. copy active data xxx preview=yes) This should tell you what you want to know. Regards, Shawn Shawn Drew Internet guenther_bergm...@gbergmann.de Sent by: ADSM-L@VM.MARIST.EDU 04/27/2012 11:35 AM Please respond to ADSM-L@VM.MARIST.EDU To ADSM-L cc Subject [ADSM-L] Size of actice data pool ? Hi all, given the following setup: TSM 5.5 Primary storage pool of device class FILE Copy ool on LTO -tapes, managed by DRM Primary pool ist copied daily to the copy pool Since the Copy pool is reaching some limitations ( # of tapes, vault capacity) we are thinking about setting up an active data pool and copying the active data pool to the copy pool. The question: How to estimate the size of the active data pool in compared to the primary pool? Is there something like: QUERY OCCUPANCY ACTIVEDATAONLY=YES ? Can it be done with some SQL query? I can geht the numbers (active/inactive) from the backups table, but it does not give the size of the backed up objects. Any hints on this? regards Günther -- Guenther Bergmann, Am Kreuzacker 10, 63150 Heusenstamm, Germany Guenther_Bergmann at gbergmann dot de This message and any attachments (the "message") is intended solely for the addressees and is confidential. If you receive this message in error, please delete it and immediately notify the sender. Any use not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval. The internet can not guarantee the integrity of this message. BNP PARIBAS (and its subsidiaries) shall (will) not therefore be liable for the message if modified. Please note that certain functions and services for BNP Paribas may be performed by BNP Paribas RCC, Inc.
Re: Size of actice data pool ?
Another option that may quickly give you some rough information is query filespace. A spreadsheet with filespace size times percentage full for the pertinent filespaces will give you an estimate of the data involved. This depends also on backup excludes that may be involved. Bob. -Original Message- From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Shawn Drew Sent: Friday, April 27, 2012 11:10 AM To: ADSM-L@VM.MARIST.EDU Subject: Re: [ADSM-L] Size of actice data pool ? You can run a preview on the "copy activedata" command.(i.e. copy active data xxx preview=yes) This should tell you what you want to know. Regards, Shawn Shawn Drew Internet guenther_bergm...@gbergmann.de Sent by: ADSM-L@VM.MARIST.EDU 04/27/2012 11:35 AM Please respond to ADSM-L@VM.MARIST.EDU To ADSM-L cc Subject [ADSM-L] Size of actice data pool ? Hi all, given the following setup: TSM 5.5 Primary storage pool of device class FILE Copy ool on LTO -tapes, managed by DRM Primary pool ist copied daily to the copy pool Since the Copy pool is reaching some limitations ( # of tapes, vault capacity) we are thinking about setting up an active data pool and copying the active data pool to the copy pool. The question: How to estimate the size of the active data pool in compared to the primary pool? Is there something like: QUERY OCCUPANCY ACTIVEDATAONLY=YES ? Can it be done with some SQL query? I can geht the numbers (active/inactive) from the backups table, but it does not give the size of the backed up objects. Any hints on this? regards Günther -- Guenther Bergmann, Am Kreuzacker 10, 63150 Heusenstamm, Germany Guenther_Bergmann at gbergmann dot de This message and any attachments (the "message") is intended solely for the addressees and is confidential. If you receive this message in error, please delete it and immediately notify the sender. Any use not in accord with its purpose, any dissemination or disclosure, either whole or partial, is prohibited except formal approval. The internet can not guarantee the integrity of this message. BNP PARIBAS (and its subsidiaries) shall (will) not therefore be liable for the message if modified. Please note that certain functions and services for BNP Paribas may be performed by BNP Paribas RCC, Inc. This electronic transmission and any documents accompanying this electronic transmission contain confidential information belonging to the sender. This information may be legally privileged. The information is intended only for the use of the individual or entity named above. If you are not the intended recipient, you are hereby notified that any disclosure, copying, distribution, or the taking of any action in reliance on or regarding the contents of this electronically transmitted information is strictly prohibited.
Re: Is anyone getting > 100MB/s on a NetApp SM2Tape backup?
Additional data 1. The option we turned off that gave us our latest boost was "Options ndmpd.offset_map.enable off" 2. I ran 4 concurrent SMTape backups to TSM yesterday evening. Total data throughput was 1,597,200 MB over 121 minutes, which works out to 220 MB/s or 780 GB/hr. when I ran 4 concurrent backups (same volumes) with the above option on a few weeks ago, we got 83 MB/s or 292 Gb/hr. So what we are seeing is some sort of per-thread NDMP limit. Any ideas? -steve From: Schaub, Steve Sent: Friday, April 27, 2012 9:50 AM To: 'ADSM: Dist Stor Manager' Subject: Is anyone getting > 100MB/s on a NetApp SM2Tape backup? All, We are implementing an IBM N-Series Filer cluster (rebranded NetApp) and working on getting the full-volume DR backups setup. We are using SnapMirror2Tape with 3-way NDMP (don't want to dedicate FC tape drives from our Library Mgr environment, and we have 10gb Ethernet from the Filer to the TSM Server). TSM Server 6.2.2 AIX on P-series. Tape is IBM 3592, disk is IBM DS8k. When we started testing, we were only getting about 60-80MB/s throughput. After turning off, we are now up to 90MB/s. Filer cpu is < 40%. We have run the following tests: NDMP Dump to null = 300-400MB/s (disk is not the bottleneck) NDMP Dump to the other Filer in the cluster = 104MB/s (takes TSM & tape out of the equation) NDMP Dump to another vol on the same Filer = 110MB/s (takes network out of the equation) We're not getting much help from IBM Support, and at least one person has said that 100MB/s is about the best you can expect. So I'm curious if anyone is getting more than that, and if not, what is holding it back? I have at least one Windows 2008R2 SQL Server running under VMWare that has proven it can restore between 225-325MB/s on the same 10gb network, so I don't understand why we can't achieve better performance on a backup that is supposedly block level? Thanks, Steve Schaub Systems Engineer II, Windows Backup/Recovery BlueCross BlueShield of Tennessee - Please see the following link for the BlueCross BlueShield of Tennessee E-mail disclaimer: http://www.bcbst.com/email_disclaimer.shtm
