Hi Marc, It's big news that it's possible to copy a single *nix filesystem (not GPFS) using multiple streams to transfer data without VIRTUALMOUNTPOINTs or scripts/3-d party software. This is reflected in the link provided: "Multiple sessions are used when you specify multiple file specifications on a backup command". Can you provide more detail?
Efim > On 10 Feb 2022, at 17:58, Marc Lanteigne <marclantei...@ca.ibm.com> wrote: > > Hi Bjørn, > > You don't need to split large filesystems to get multiple backup sessions. > If you use a resourceutilization larger than 2, you may get multiple > sessions. With a value of 2, you will get 2 threads, a producer (queries > server and scans filesystem for changed files) and a consumer (does the > actual backup of the data). As you increase the resourceutilization, you > get more producers and consumers. It's not a 1:1 ratio though, there's a > table in this page that shows the potential number of producers and > consumers depending on the resourceutilization value: > https://www.ibm.com/docs/en/spectrum-protect/8.1.12?topic=sessions-optimizing-multiple > > <https://www.ibm.com/docs/en/spectrum-protect/8.1.12?topic=sessions-optimizing-multiple> > > One thing to keep in mind is that it's not a guarantee that you will get > that number of sessions. It is an opportunistic process. If you have a > high resourceutilization and the client determines that there's benefits > to more sessions, it will start more. For example, a small filesystem may > not see many sessions while a large would. It's all relative to the amount > of work that has to be done. So, multiple sessions won't start right away. > As it's scanning the filesystem, it will add more sessions as time > elapsed. It's explained in further details in the link I shared above and > how much time needs to be elapse. > > None of this is new, it's been that way for years. > > Thanks, > Marc... > > Marc Lanteigne > Spectrum Protect Specialist AVP / SRT > IBM Systems, Spectrum Protect / Plus > > "ADSM: Dist Stor Manager" <ADSM-L@VM.MARIST.EDU > <mailto:ADSM-L@VM.MARIST.EDU>> wrote on 02/10/2022 > 10:21:31 AM: > >> From: "Bjørn Nachtwey" <bjoern.nacht...@gwdg.de >> <mailto:bjoern.nacht...@gwdg.de>> >> To: ADSM-L@VM.MARIST.EDU <mailto:ADSM-L@VM.MARIST.EDU> >> Date: 02/10/2022 10:22 AM >> Subject: [EXTERNAL] [ADSM-L] Does newer clients do parallelization >> by themselves? >> Sent by: "ADSM: Dist Stor Manager" <ADSM-L@VM.MARIST.EDU >> <mailto:ADSM-L@VM.MARIST.EDU>> >> >> Hi all, >> >> I tried to get the answer by asking the support, but unfortunately they >> just gave me advise on how to use VIRTUALMOUNTPOINTs ... >> >> well, >> setting as well the MAXNUMMP as the RESOURECEUTILIZATION > 1 I do >> observe several client backup sessions in the ISP server each >> transferring data -- even if only one DOMAIN was defined. >> Hugh, I do know the client works parallel on several DOMAINS, so using >> VIRTUALMOUNTPOINT definitions allows to increase the the effective >> bandwidth. >> >> Due to my observation: >> Do the newer clients like 8.1.12 use any kind of internal >> parallelization, so it's not necessary to split large data folder to >> several virtual ones? >> If so, does it effect the file tree walk as well as the transfer of the >> data? >> >> Thanks & best >> Bjørn >> >> -- >> > -------------------------------------------------------------------------------------------------- >> Bjørn Nachtwey >> >> Arbeitsgruppe "IT-Infrastruktur“ >> E-Mail:bjoern.nacht...@gwdg.de >> > -------------------------------------------------------------------------------------------------- >> Gesellschaft für wissenschaftliche Datenverarbeitung mbH Göttingen > (GWDG) >> Burckhardtweg 4, 37077 Göttingen, URL:https:// >> urldefense.proofpoint.com/v2/url? <http://urldefense.proofpoint.com/v2/url?> >> u=https-3A__gwdg.de&d=DwIFaQ&c=jf_iaSHvJObTbx- >> siA1ZOg&r=hMBqtRSV0jXgOdXEmlNk_- >> O9LHkPCGSh9PJBRSlL8Q4&m=vaIKa3FRrsuWVc3OPhbxfBsMnLflXcnk1a_nCvLfsb0&s=- >> rBpA_7soXgDii94uki8AOwubNSlSLYf5YXCTaUmPEY&e= >> >> Support: Tel.: +49 551 39-30000, URL:https:// >> urldefense.proofpoint.com/v2/url? <http://urldefense.proofpoint.com/v2/url?> >> u=https-3A__gwdg.de_support&d=DwIFaQ&c=jf_iaSHvJObTbx- >> siA1ZOg&r=hMBqtRSV0jXgOdXEmlNk_- >> > O9LHkPCGSh9PJBRSlL8Q4&m=vaIKa3FRrsuWVc3OPhbxfBsMnLflXcnk1a_nCvLfsb0&s=b8KGF9fEn1HqXXcuvm4MoX30tj2pZ3ByOoFXldlzIEc&e= >> Sekretariat: Tel.: +49 551 39-30001, E-Mail:g...@gwdg.de >> >> Geschäftsführer: Prof. Dr. Ramin Yahyapour >> Aufsichtsratsvorsitzender: Prof. Dr. Norbert Lossau >> Sitz der Gesellschaft: Göttingen >> Registergericht: Göttingen, Handelsregister-Nr. B 598 >> >> Zertifiziert nach ISO 9001 >> > --------------------------------------------------------------------------------------------------
