[Bacula-users] Backup of directory structures
Hi, I am looking at Bacula but the line # Files deleted after a Full save will be included in a restoration. in http://www.bacula.org/rel-manual/Current_State_Bacula.html under Current Implementation Restrictions makes me a little apprhensive. Is Bacula actually not able to backup Directory structures?? i.e If in a Directory "dir1" I have "file1", "file2" & "file3" and I take a full backup "backup1" on "Day1" the I delete "file2" from "dir1" and take a differential backup "backup2". Now I should be able to restore "dir1" from "backup2" with only "file1" and "file2" Thankyou so much kind regards Siju --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77&alloc_id492&op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Re: Backup of directory structures
On 6/20/05, Siju George <[EMAIL PROTECTED]> wrote: > Hi, > > > I am looking at Bacula > > but the line > > # Files deleted after a Full save will be included in a restoration. > > in > > http://www.bacula.org/rel-manual/Current_State_Bacula.html > > under > > Current Implementation Restrictions > > makes me a little apprhensive. > > Is Bacula actually not able to backup Directory structures?? > > i.e > > If in a Directory "dir1" I have "file1", "file2" & "file3" and I take a > full backup "backup1" on "Day1" the I delete "file2" from "dir1" and > take a differential backup "backup2". > > Now I should be able to restore "dir1" from "backup2" with only "file1" > and "file2" Sorry :-( this should read as "file1" & "file3" > > Thankyou so much > > kind regards > > Siju > --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77&alloc_id492&op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On 6/28/05, Martin Simmons <[EMAIL PROTECTED]> wrote: > >>>>> On Mon, 20 Jun 2005 10:20:49 +0200, Arno Lehmann <[EMAIL PROTECTED]> > >>>>> said: > > Arno> Hello, > > Arno> Siju George wrote: > > >> On 6/20/05, Siju George <[EMAIL PROTECTED]> wrote: > >> > >>> Hi, > >>> > >>> > >>> I am looking at Bacula > >>> but the line > >>> # Files deleted after a Full save will be included in a restoration. > >>> in > >>> http://www.bacula.org/rel-manual/Current_State_Bacula.html > >>> under > >>> Current Implementation Restrictions > >>> makes me a little apprhensive. > >>> Is Bacula actually not able to backup Directory structures?? > >>> > >>> i.e > >>> > >>> If in a Directory "dir1" I have "file1", "file2" & "file3" and I take a > >>> full backup "backup1" on "Day1" the I delete "file2" from "dir1" and > >>> take a differential backup "backup2". > >>> > >>> Now I should be able to restore "dir1" from "backup2" with only "file1" > >>> and "file2" > >> > >> > >> Sorry :-( this should read as "file1" & "file3" > >> > > Arno> You _can_ restore file1 file2 and file3 in dir1. However, when you use > Arno> bacula to manage a restore and tell it to make a complete restore it > Arno> will restore all three files. > Arno> If you tell bacula to only use the differential backup then, of > course, > Arno> file2 will not be restored. Usually you will not do this because it's > Arno> baculas job to keep track which jobs and volumes it needs to restore > :-) > > Arno> So, of course bacula saves and retrieves directory structure, but it > Arno> does not keep track of deletions. > > Arno> The latter would require a complete compare of all directory entries > to > Arno> be backed up with what bacula has in its catalog and thus would be > very > Arno> resource intensive. > > Done correctly, it should be possible to do all the work in restore for > filesystems that work properly. Backup just has to record the inode number > for each changed file. > Could you please explain how??? kind regards Siju --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77&alloc_id492&op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On 6/28/05, Martin Simmons <[EMAIL PROTECTED]> wrote: > Siju> Could you please explain how??? > > For each file saved in the backup, you record its full path and some unique id > that remains unchanged during renaming (e.g. the inode number on UNIX). For > each dir saved, you also record the names of the all files/dirs in that dir. > You do both of these things for the initial full backup and subsequent > incr/diff backups. > > During the restore of the full backup, you create a table mapping the unique > ids to the full paths. Then during the restores of the incr/diff backups, you > can search the table for each unique id being restored and decide if the file > is new or renamed (or newly hard-linked). For directories you can check the > list of names in that directory to detect deleted or renamed files. > > This only works on filesystems where renaming a file will change its ctime (or > some other property) and where deleting a file will change the mtime (or some > other property) of its directory. > > This is how ufsdump and star work. > Thanks a million Martin for the explanation but it seems a little complicating for me at present. The only backup utility I ever used is the windows one. There you can take a normal backup first ( full backup) and then take differential backup every time and if you restore a differential backup you will get exactly the same contents that was there at the time the differential backup was taken. Is there no utility in Linux that will simply do this??? Thanks a lot again kind regards Siju --- SF.Net email is sponsored by: Discover Easy Linux Migration Strategies from IBM. Find simple to follow Roadmaps, straightforward articles, informative Webcasts and more! Get everything you need to get up to speed, fast. http://ads.osdn.com/?ad_idt77&alloc_id492&op=click ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
Re: [Bacula-users] Re: Backup of directory structures
On 6/28/05, Kern Sibbald <[EMAIL PROTECTED]> wrote:
> On Tuesday 28 June 2005 12:57, Martin Simmons wrote:
> ...
> >
> > >> it Arno> does not keep track of deletions.
> >
> > Arno> The latter would require a complete compare of all directory
> >
> > >> entries to Arno> be backed up with what bacula has in its catalog and
> > >> thus would be very Arno> resource intensive.
> >
> > Kern> One day in the near future, I will do exactly this. I've now
> > finally figured Kern> out a simple way to do this -- but darn, I forgot to
> > write it down. Oh well, Kern> it will come to me again :-)
> >
> > >> Done correctly, it should be possible to do all the work in restore
> > >> for filesystems that work properly. Backup just has to record the
> > >> inode number for each changed file.
> >
> > Kern> The problem is that inode is a machine specific concept. Though it
> > can be Kern> simulated, it doesn't exist on Win32 or Mac (well perhaps on
> > OS X). Though Kern> this would work nicely as you say, I always like to do
> > things in machine Kern> independent ways.
> >
> > Good luck remembering it -- I don't see how you can do it without the inode
> > number to detect which files are the same!
> >
>
> To track deletions, you don't need the inode, just the full path and filename.
> If it is no longer there, it is no longer there. If it is there and has been
> re-created with a different inode, it will be backed up because of the time
> change, so there is no problem.
>
> My "trick" for keeping track of deletions is the following. Assuming the user
> turns on this option, after all the files have been backed up, but before the
> job has terminated, the FD will make a pass through all the files and send
> their names to the DIR (*exactly* the same as what a Verify job currently
> does). This will probably be done at the same time the files are being sent
> to the SD avoiding a second pass. The DIR will then compare that to what is
> stored in the catalog. Any files in the catalog but not in what the FD sent
> will receive a catalog File entry that indicates that at that point in time
> the file was deleted.
>
> During a restore, any file initially picked up by some backup (Full, ...) then
> subsequently having a File entry marked "delete" will be removed from the
> tree, so will not be restored. If a file with the same name is later OK it
> will be inserted in the tree -- this already happens. All will be consistent
> except for possible changes during the running of the FD.
>
> Since I'm on the subject, some of you may be wondering what the utility of the
> in memory tree is if you are going to restore everything (at least it comes
> up from time to time on the list). Well, it is still *very* useful because
> it allows only the last item found for a particular filename (full path) to
> be entered into the tree, and thus if a file is backed up 10 times, only the
> last copy will be restored. I recently (last Friday) restored a complete
> directory, and the Full and all the Differential and Incremental backups
> spanned 3 Volumes. The first Volume was not even mounted because all the
> files had been updated and hence backed up since the Full backup was made.
> In this case, the tree saved me a *lot* of time.
>
Thanks a million Kern for the wonderful details :-)
I really appreciate it :-)
Good luck on implementation and hope Debian people will soon make a
Package as soon as it is released :-)
Till then I need to find a temporary solution!
thanks a lot again
kind regards
Siju
> However, if you have a quadrillion files and building the tree takes 24 hours,
> you could certainly question the utility of building the tree.
>
> One more little item: over the weekend, a user complained that bscan didn't
> rebuild his catalog correctly. My answer is: not true. It worked with what
> it had. However, if you feed it only one tape per bscan and your backup(s)
> span two Volumes, bscan will hiccup as it did at some point and your catalog
> will not be correct (Bacula's records span volumes and bscan hiccups then
> ignores partial records). Moral of the story:
>
> 1. Back up your catalog in a separate job each night.
>
> 2. Make a bootstrap file for your catalog and write it to another computer,
> then you won't need to use bscan to get your catalog back.
>
> 3. If you *really* need to use bscan, be sure to feed it *all* the appropriate
> volumes in a *single* bscan execution (not one for each tape) with the
> volumes specified in the right order. This was clearly and correctly
> documented, IMO, but I've added more to this effect ...
>
> --
> Best regards,
>
> Kern
>
> (">
> /\
> V_V
>
---
SF.Net email is sponsored by: Discover Easy Linux Migration Strategies
from IBM. Find simple to follow Roadmaps, straightforward articles,
informative Webcasts and more! Get everything you need to get up to
speed, fast. http://ads.osdn.co
Re: [Bacula-users] Re: Backup of directory structures
On 6/28/05, Kern Sibbald <[EMAIL PROTECTED]> wrote: > On Monday 27 June 2005 22:24, Martin Simmons wrote: > > >>>>> On Mon, 20 Jun 2005 10:20:49 +0200, Arno Lehmann <[EMAIL PROTECTED]> > > >>>>> said: > > > > Arno> Hello, > > > > Arno> Siju George wrote: > > >> On 6/20/05, Siju George <[EMAIL PROTECTED]> wrote: > > >>> Hi, > > >>> > > >>> > > >>> I am looking at Bacula > > >>> but the line > > >>> # Files deleted after a Full save will be included in a restoration. > > >>> in > > >>> http://www.bacula.org/rel-manual/Current_State_Bacula.html > > >>> under > > >>> Current Implementation Restrictions > > >>> makes me a little apprhensive. > > >>> Is Bacula actually not able to backup Directory structures?? > > >>> > > >>> i.e > > >>> > > >>> If in a Directory "dir1" I have "file1", "file2" & "file3" and I take > > >>> a full backup "backup1" on "Day1" the I delete "file2" from "dir1" > > >>> and take a differential backup "backup2". > > >>> > > >>> Now I should be able to restore "dir1" from "backup2" with only > > >>> "file1" and "file2" > > >> > > >> Sorry :-( this should read as "file1" & "file3" > > > > Arno> You _can_ restore file1 file2 and file3 in dir1. However, when you > > use Arno> bacula to manage a restore and tell it to make a complete restore > > it Arno> will restore all three files. > > Arno> If you tell bacula to only use the differential backup then, of > > course, Arno> file2 will not be restored. Usually you will not do this > > because it's Arno> baculas job to keep track which jobs and volumes it > > needs to restore :-) > > > > Arno> So, of course bacula saves and retrieves directory structure, but > > it Arno> does not keep track of deletions. > > > > Arno> The latter would require a complete compare of all directory > > entries to Arno> be backed up with what bacula has in its catalog and thus > > would be very Arno> resource intensive. > > One day in the near future, I will do exactly this. I've now finally figured > out a simple way to do this -- but darn, I forgot to write it down. Oh well, > it will come to me again :-) > > > > > Done correctly, it should be possible to do all the work in restore for > > filesystems that work properly. Backup just has to record the inode number > > for each changed file. > > The problem is that inode is a machine specific concept. Though it can be > simulated, it doesn't exist on Win32 or Mac (well perhaps on OS X). Though > this would work nicely as you say, I always like to do things in machine > independent ways. > For the time being is it possible to accomplish this with AMANDA kind regards Siju --- This SF.Net email is sponsored by the 'Do More With Dual!' webinar happening July 14 at 8am PDT/11am EDT. We invite you to explore the latest in dual core and dual graphics technology at this free one hour event hosted by HP, AMD, and NVIDIA. To register visit http://www.hp.com/go/dualwebinar ___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
[Bacula-users] Invitation to connect on LinkedIn
LinkedIn I'd like to add you to my professional network on LinkedIn. - Siju Confirm that you know Siju George https://www.linkedin.com/e/isd/822149925/aUbi06cw/ Every day, millions of professionals like Siju George use LinkedIn to connect with colleagues, find experts, and explore opportunities. -- (c) 2009, LinkedIn Corporation -- Come build with us! The BlackBerry(R) Developer Conference in SF, CA is the only developer event you need to attend this year. Jumpstart your developing skills, take BlackBerry mobile applications to market and stay ahead of the curve. Join us from November 9 - 12, 2009. Register now! http://p.sf.net/sfu/devconference___ Bacula-users mailing list Bacula-users@lists.sourceforge.net https://lists.sourceforge.net/lists/listinfo/bacula-users
