Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Skylar
Thompson
Sent: 20. januar 2017 15:43
To: ADSM-L@VM.MARIST.EDU
Subject: Re: [ADSM-L] Advice for archiving 80 billion of small files.
Do you need to recover files individually? If so, then image backup (at least
on its own) won&#
Bo,
What is the total space occupied by this data?
-Rick
-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of Bo
Nielsen
Sent: Friday, January 20, 2017 9:18 AM
To: ADSM-L@VM.MARIST.EDU
Subject: [ADSM-L] Advice for archiving 80 billion of small
Whenever we have a situation like this we always tar.gz into one file first,
before archiving to TSM .. either the top level directory or multiple lower
level directories, if it makes sense to do so, based on what the retrieval
expectations might be.
Also very useful is to tar.gz verbosely, wri
Do you need to recover files individually? If so, then image backup (at
least on its own) won't be a good option. One thing you could do is tar up
chunks (maybe a million files) and archive/backup those chunks. Keep a
catalog (hopefully a database with indexes) of which files are in which tar
ball
On 20.1.2017. 15:31, Zoltan Forray wrote:
> TAR and/or GZip?
We do it here that way.
Regards,
--
Sasa Drnjevic
www.srce.unizg.hr
>
> On Fri, Jan 20, 2017 at 9:27 AM, Anderson Douglas
> wrote:
>
>> Try image backup
>>
>> Em 20/01/2017 12:23, "Bo Nielsen" escreveu:
>>
>>> Hi all,
>>>
>>> I ne
Good one. :-)
-Original Message-
From: ADSM: Dist Stor Manager [mailto:ADSM-L@VM.MARIST.EDU] On Behalf Of
Anderson Douglas
Sent: Friday, January 20, 2017 9:27 AM
To: ADSM-L@VM.MARIST.EDU
Subject: Re: Advice for archiving 80 billion of small files.
Try image backup
Em 20/01/2017 12:23
TAR and/or GZip?
On Fri, Jan 20, 2017 at 9:27 AM, Anderson Douglas
wrote:
> Try image backup
>
> Em 20/01/2017 12:23, "Bo Nielsen" escreveu:
>
> > Hi all,
> >
> > I need advice.
> > I must archive 80 billion small files, but that is not possible, as I see
> > it.
> > since it will fill in the T
Try image backup
Em 20/01/2017 12:23, "Bo Nielsen" escreveu:
> Hi all,
>
> I need advice.
> I must archive 80 billion small files, but that is not possible, as I see
> it.
> since it will fill in the TSM's Database about 73 Tb.
> The filespace is mounted on a Linux server.
> Is there a way to pa
Hi all,
I need advice.
I must archive 80 billion small files, but that is not possible, as I see it.
since it will fill in the TSM's Database about 73 Tb.
The filespace is mounted on a Linux server.
Is there a way to pack/zip the files, so it's a smaller number of files.
anybody who has tried this
