Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Lloyd Brown
On 03/31/2016 12:20 PM, Dimitri Maziuk wrote: > On 03/31/2016 12:35 PM, Lloyd Brown wrote: > >> > ... Unfortunately, I'm >> > not exaggerating to say that we have users with file profiles that >> > consist of 35million files (or more) with average file sizes less than >> > 10kb. The user might be

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Dimitri Maziuk
On 03/31/2016 12:35 PM, Lloyd Brown wrote: > ... Unfortunately, I'm > not exaggerating to say that we have users with file profiles that > consist of 35million files (or more) with average file sizes less than > 10kb. The user might be long-gone, and eligible for deletion, but it > takes forever

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Lloyd Brown
On 03/31/2016 11:26 AM, Phil Stracchino wrote: >> First, each user directory is an individual share or volume in ZFS >> > parlance. They're thin-provisioned volumes, on top of a storage pool. >> > Any export I do, be it NFS, iSCSI, CIFS, etc., would be done at that >> > level, and not above. The

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Phil Stracchino
On 03/31/16 13:21, Lloyd Brown wrote: > On 03/31/2016 11:07 AM, Phil Stracchino wrote: >> But if the NAS supports iSCSI-target mode, export the entire shared >> volume from the NAS as a single iSCSI target to the backup server, and >> back up the NAS all at once over iSCSI without having to worry a

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Lloyd Brown
On 03/31/2016 11:07 AM, Phil Stracchino wrote: > No, Lloyd, I think you're misunderstanding Josh's suggestion. > > Let the user NFS hosts continue to automount their user home directories > over NFS, just as you are now. Don't change anything there. It's not > broke, don't "fix" it. > > But if

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Phil Stracchino
On 03/31/16 12:51, Lloyd Brown wrote: > > > On 03/31/2016 10:35 AM, Josh Fisher wrote: >> I see your point. Why NFS, then? Rather than hundreds of automount >> mountpoints, a single iSCSI target could expose the user home >> directories with a single mountpoint, assuming the NAS device supports

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Lloyd Brown
On 03/31/2016 10:35 AM, Josh Fisher wrote: > I see your point. Why NFS, then? Rather than hundreds of automount > mountpoints, a single iSCSI target could expose the user home > directories with a single mountpoint, assuming the NAS device supports > iSCSI. Several reasons. The problems I've

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Phil Stracchino
On 03/31/16 12:35, Josh Fisher wrote: > I see your point. Why NFS, then? Rather than hundreds of automount > mountpoints, a single iSCSI target could expose the user home > directories with a single mountpoint, assuming the NAS device supports > iSCSI. This is IMO the best suggestion yet, short

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Josh Fisher
On 3/31/2016 10:34 AM, Lloyd Brown wrote: > > On 03/31/2016 06:40 AM, Josh Fisher wrote: >> I don't know if that will work, with or without onefs=no. It is not so >> much NFS as it is autofs. I suggest onefs=yes and specifying each and >> every mountpoint in the job's FileSet, rather than just th

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Marcel De Boer
Hi! If it's possible with the NFS server and the exported directory structure, you could also statically mount the entire directory containing all home directories and backup that. I.e. if the automounter mounts /userhomedirs/userX from the server under /home/userX, you could also do a seconda

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Lloyd Brown
On 03/31/2016 06:40 AM, Josh Fisher wrote: > > I don't know if that will work, with or without onefs=no. It is not so > much NFS as it is autofs. I suggest onefs=yes and specifying each and > every mountpoint in the job's FileSet, rather than just the automount > root directory. Autofs purposeful

Re: [Bacula-users] backing up automounted FS

2016-03-31 Thread Josh Fisher
On 3/30/2016 11:42 AM, Lloyd Brown wrote: Okay. I'm hoping that someone can give me some kind of helpful suggestions here. I'm having trouble figuring out the best way to manage backups for some automounted user directories. In short, I need to back up a set of NFS-shared filesystems that re

Re: [Bacula-users] backing up automounted FS

2016-03-30 Thread Dimitri Maziuk
On 03/30/2016 12:04 PM, Lloyd Brown wrote: > ... it's actually an Oracle ZFS-based appliance I wonder if you can send a zfs incremental snapshot to a linux box? (Where you can run bacula-fd.) -- Dimitri Maziuk Programmer/sysadmin BioMagResBank, UW-Madison -- http://www.bmrb.wisc.edu signatur

Re: [Bacula-users] backing up automounted FS

2016-03-30 Thread Lloyd Brown
On 03/30/2016 10:48 AM, Phil Stracchino wrote: > First piece of advice: Don't back up over NFS if you have any choice at > all. Put a client on the NFS server instead and back up there. Trying > to back up an NFS-mounted filesystem over the NFS mount very, very, > *very* rarely ends well. It

Re: [Bacula-users] backing up automounted FS

2016-03-30 Thread Phil Stracchino
On 03/30/16 11:42, Lloyd Brown wrote: > Okay. I'm hoping that someone can give me some kind of helpful > suggestions here. I'm having trouble figuring out the best way to > manage backups for some automounted user directories. > > In short, I need to back up a set of NFS-shared filesystems that

[Bacula-users] backing up automounted FS

2016-03-30 Thread Lloyd Brown
Okay. I'm hoping that someone can give me some kind of helpful suggestions here. I'm having trouble figuring out the best way to manage backups for some automounted user directories. In short, I need to back up a set of NFS-shared filesystems that represent users' home directories on my system.