Re: [Bacula-users] Large maildir backup

2009-04-03 Thread mehma sarja
Michael, This is a work in progress and I'll keep everyone posted on what my configs are once I know something works. I have re-compiled bacula with batch mode turned on. Yudhvir === On Sun, Nov 30, 2008 at 9:18 AM, Michael Galloway wrote: > On Thu, Nov 27, 2008 at 04:03:50PM +0100, Daniel Betz

Re: [Bacula-users] Large maildir backup

2008-11-30 Thread Michael Galloway
On Thu, Nov 27, 2008 at 04:03:50PM +0100, Daniel Betz wrote: > Hi! > > I have the same problem with large amount of files on one filesystem ( > Maildir ). > Now i have 2 concurrent jobs running and the time for the backups need half > the time. > I havent tested 4 concurrent jobs jet .. :-) > >

Re: [Bacula-users] Large maildir backup

2008-11-28 Thread Alan Brown
On Thu, 27 Nov 2008, Kjetil Torgrim Homme wrote: > this may be good for Maildir, but with Cyrus IMAPD, which uses short > filenames like "1432.", "1433.", this *reduced* performance by a few > percent in one test we did. How many files/dorectory were you testing with? In some cases our users were

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Jesper Krogh
Daniel Betz wrote: > Hi! > > I have the same problem with large amount of files on one filesystem ( > Maildir ). > Now i have 2 concurrent jobs running and the time for the backups need half > the time. > I havent tested 4 concurrent jobs jet .. :-) That would be a really nice feature to have

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Jesper Krogh
Kjetil Torgrim Homme wrote: > Jesper Krogh <[EMAIL PROTECTED]> writes: > >> Can you give us the time for doing a tar to /dev/null of the fileset. >> >> time tar cf /dev/null /path/to/maildir >> >> Then we have a feeling about the "actual read time" for the file of >> the filesystem. > > if you're

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Daniel Betz
to:[EMAIL PROTECTED] > Gesendet: Donnerstag, 27. November 2008 15:42 > An: bacula-users@lists.sourceforge.net > Betreff: Re: [Bacula-users] Large maildir backup > > Hi Alan, > > i did that already (expect the superblocks). I think it the ext3 itself > in combination with the

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Kjetil Torgrim Homme
Alan Brown <[EMAIL PROTECTED]> writes: > Ext3 will perform a lot better if you use tune2fs and enable the > following features: > > dir_index > Use hashed b-trees to speed up lookups in large > directories. this may be good for Maildir, but with Cyrus IMAPD, whic

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Kjetil Torgrim Homme
Jesper Krogh <[EMAIL PROTECTED]> writes: > Can you give us the time for doing a tar to /dev/null of the fileset. > > time tar cf /dev/null /path/to/maildir > > Then we have a feeling about the "actual read time" for the file of > the filesystem. if you're using GNU tar, it will *not* read the fil

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Boris Kunstleben onOffice Software GmbH
Bacula-users] Large maildir backup On Thu, 27 Nov 2008, Boris Kunstleben onOffice Software GmbH wrote: > any idea if there is a better filesystem, im using ext3 on the clients > and xfs on the director I believe XFS copes fine with overstuffed directories. Ext3 will perform a lot better if y

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Boris Kunstleben onOffice Software GmbH
er, Stefan Becker -- - Ursprüngliche Nachricht - Von: Mike Holden <[EMAIL PROTECTED]> Gesendet: Donnerstag, 27. November 2008 14:43:46 An: Betreff: Re: [Bacula-users] Large maildir backup Boris Kun

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Silver Salonen
On Thursday 27 November 2008 16:29:50 you wrote: > Silver Salonen wrote: > > And when you have many incrementals in a row while restoring, you end up > > seeing many duplicate messages, that have been deleted or moved during these > > incrementals. > > > > For such case use snapshots - freez

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Alan Brown
On Thu, 27 Nov 2008, Boris Kunstleben onOffice Software GmbH wrote: > any idea if there is a better filesystem, im using ext3 on the clients > and xfs on the director I believe XFS copes fine with overstuffed directories. Ext3 will perform a lot better if you use tune2fs and enable the following

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Mike Holden
Boris Kunstleben onOffice Software GmbH wrote: > any idea if there is a better filesystem, im using ext3 on the clients and > xfs on the director ext3 is possibly not a good fs for a Maildir. Can't offer you any personal accounts, but I was looking at Google for something else regarding filesystem

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Boris Kunstleben onOffice Software GmbH
-- - Ursprüngliche Nachricht - Von: Alan Brown <[EMAIL PROTECTED]> Gesendet: Donnerstag, 27. November 2008 12:46:24 An: Boris Kunstleben onOffice Software GmbH <[EMAIL PROTECTED]> Cc: Betreff: Re: [Bacula-users] Large ma

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Alan Brown
On Thu, 27 Nov 2008, Boris Kunstleben onOffice Software GmbH wrote: > i am doing exactly that since last Thursday. > I have about 1.6TB in Maildirs and an huge number of small files. I have to > say it is awfull slow. Backing up a directory with about 190GB of Maildirs > took "Elapsed time: 1 da

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Arno Lehmann
Hi, 27.11.2008 12:15, James Cort wrote: > Arno Lehmann wrote: >> - Tune your catalog database for faster inserts. That can mean moving >> it to a faster machine, assigning more memory for it, or dropping some >> indexes (during inserts). If you're not yet using batch inserts, try >> to recompil

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread James Cort
Arno Lehmann wrote: > - Tune your catalog database for faster inserts. That can mean moving > it to a faster machine, assigning more memory for it, or dropping some > indexes (during inserts). If you're not yet using batch inserts, try > to recompile Bacula with batch-inserts enabled. Is that w

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Arno Lehmann
Hi, 27.11.2008 11:31, Boris Kunstleben wrote: > Hi, > > i am doing exactly that since last Thursday. > I have about 1.6TB in Maildirs and an huge number of small files. I have to > say it is awfull slow. Backing up a directory with about 190GB of Maildirs > took "Elapsed time: 1 day 14 hours 4

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Jesper Krogh
Boris Kunstleben onOffice Software GmbH wrote: > Hi, > > i am doing exactly that since last Thursday. > I have about 1.6TB in Maildirs and an huge number of small files. I have to > say it is awfull slow. Backing up a directory with about 190GB of Maildirs > took "Elapsed time: 1 day 14 hours 4

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Boris Kunstleben
Hi, i am doing exactly that since last Thursday. I have about 1.6TB in Maildirs and an huge number of small files. I have to say it is awfull slow. Backing up a directory with about 190GB of Maildirs took "Elapsed time: 1 day 14 hours 49 mins 34 secs". On the other hand i have a server with Doc

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Boris Kunstleben onOffice Software GmbH
fan Becker -- - Ursprüngliche Nachricht - Von: Silver Salonen <[EMAIL PROTECTED]> Gesendet: Donnerstag, 27. November 2008 10:15:48 An: bacula-users Betreff: Re: [Bacula-users] Large maildir backup On Thursday 27 Nov

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Boris Kunstleben onOffice Software GmbH
er, Stefan Becker -- - Ursprüngliche Nachricht - Von: Silver Salonen <[EMAIL PROTECTED]> Gesendet: Donnerstag, 27. November 2008 10:15:48 An: bacula-users Betreff: Re: [Bacula-users] Large maildir bac

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Silver Salonen
On Thursday 27 November 2008 11:07:41 James Cort wrote: > Silver Salonen wrote: > > On Thursday 27 November 2008 09:50:14 Proskurin Kirill wrote: > >> Hello all! > >> > >> Soon I will deploy a large email server - it will use maildirs and will > >> be about 1Tb of mail with really many small files

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread James Cort
Silver Salonen wrote: > On Thursday 27 November 2008 09:50:14 Proskurin Kirill wrote: >> Hello all! >> >> Soon I will deploy a large email server - it will use maildirs and will >> be about 1Tb of mail with really many small files. >> >> It is any hints to make a backup via bacula of this? >> > I

Re: [Bacula-users] Large maildir backup

2008-11-27 Thread Silver Salonen
On Thursday 27 November 2008 09:50:14 Proskurin Kirill wrote: > Hello all! > > Soon I will deploy a large email server - it will use maildirs and will > be about 1Tb of mail with really many small files. > > It is any hints to make a backup via bacula of this? > > > -- > Best regards, > Prosk

[Bacula-users] Large maildir backup

2008-11-27 Thread Proskurin Kirill
Hello all! Soon I will deploy a large email server - it will use maildirs and will be about 1Tb of mail with really many small files. It is any hints to make a backup via bacula of this? -- Best regards, Proskurin Kirill ---