Re: Backup strategy for large mailbox stores

2010-02-16 Thread Eric Luyten
On Mon, February 15, 2010 6:27 pm, Vincent Fox wrote: > I suppose replication and snapshots are out of the question for you? > > > We run ZFS so snapshots are atomic and nearly instant. > Thus we keep 14 days of daily snaps in our production pool > for recovery purposes. In our setup the total of

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Eric Luyten
On Tue, February 16, 2010 12:34 am, John Madden wrote: > Out of curiousity, how good is zfs with full fs scans when running in > the 100-million file count range? What do you see in terms of aggregate > MB/s throughput? ZFS is awesome. We have a ZFS pool composed of nine LUNs on an iSCSI-connec

Re: Using xfer to migrate mailboxes to a new server

2010-02-16 Thread David Mayo
Hi all, We are in the process of moving our mailboxes from a Cyrus 2.2 server to a Cyrus 2.3 server. I have several comments regarding this which I was planning to share with the list - so this seems an opportune moment. Simon Fraser wrote: > On Mon, 2010-02-15 at 15:25 +0200, Elver Loho wrote

Re: Using xfer to migrate mailboxes to a new server

2010-02-16 Thread Simon Fraser
On Tue, 2010-02-16 at 11:29 +, David Mayo wrote: > >> localhost.localdomain> xfer user.elver 192.168.0.180 > >> xfermailbox: Server(s) unavailable to complete operation > > > > There should be a bit more information in the log, too. While debugging > > the authentication and permissions I fou

Urgent: Cyrus troube after upgrade

2010-02-16 Thread Matthias Wulkow
Hello, I manually upgraded cyrus 2.3.7 (CentOS 5.4) to cyrus 2.3.16. Note: I created the cyrus 2.3.16 rpm myself with the rpm src from here: http://www.invoca.ch/pub/packages/cyrus-imapd/ doing just rpmbuild --rebuild xxx.rpm Now when I want to start cyrus: /etc/init.d/cyrus-imapd start or serv

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Adam Tauno Williams
On Tue, 2010-02-16 at 15:49 +0100, Matthias Wulkow wrote: > Hello, > I manually upgraded cyrus 2.3.7 (CentOS 5.4) to cyrus 2.3.16. > Note: I created the cyrus 2.3.16 rpm myself with the rpm src from here: > http://www.invoca.ch/pub/packages/cyrus-imapd/ > doing just rpmbuild --rebuild xxx.rpm > Now

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Matthias Wulkow
Hello Adam, > (a) disable selinux SELinux is disabled already. > (b) make sure the cyrus user account is not disabled. How can I enable/disable a cyrus accounts? The user(s) are set as system users and identified by sasl. No mysql configuation. The system was fully working BEFORE the upgrad

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Adam Tauno Williams
On Tue, 2010-02-16 at 15:59 +0100, Matthias Wulkow wrote: > Hello Adam, > > (a) disable selinux > SELinux is disabled already. > > (b) make sure the cyrus user account is not disabled. > How can I enable/disable a cyrus accounts? > The user(s) are set as system users and identified by sasl. No my

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Matthias Wulkow
Hello Adam, > If you just try to run "/usr/lib/cyrus-imapd/cyrus-master > -C /etc/imapd.conf -M /etc/cyrus.conf -p /var/run/cyrus-master.pid" > > does the master daemon start? This works but I have to append & to make run in the background. Probably I should run it with NOHUP or so.. The us

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Patrick Boutilier
On 02/16/2010 11:48 AM, Matthias Wulkow wrote: Hello Adam, > If you just try to run "/usr/lib/cyrus-imapd/cyrus-master > -C /etc/imapd.conf -M /etc/cyrus.conf -p /var/run/cyrus-master.pid"> > does the master daemon start? This works but I have to append& to make run in the background.

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Adam Tauno Williams
On Tue, 2010-02-16 at 16:48 +0100, Matthias Wulkow wrote: > > If you just try to run "/usr/lib/cyrus-imapd/cyrus-master > > -C /etc/imapd.conf -M /etc/cyrus.conf -p /var/run/cyrus-master.pid" > > > does the master daemon start? > This works but I have to append & to make run in the background.

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Matthias Wulkow
Hello Patrick, I didn't try yet to remove the deliver file (and stop/start cyrus) as users are using it and I would like to test as few as possible... Regaring these errors, isn't maybe better to use lmtp instead of lmtpunix which requires this socket? From the cyrus.conf: # at least one LMTP

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Patrick Boutilier
On 02/16/2010 12:03 PM, Matthias Wulkow wrote: Hello Patrick, I didn't try yet to remove the deliver file (and stop/start cyrus) as users are using it and I would like to test as few as possible... Regaring these errors, isn't maybe better to use lmtp instead of lmtpunix which requires this soc

Re: Urgent: Cyrus troube after upgrade

2010-02-16 Thread Matthias Wulkow
Hi Patrick & Adam, well I have restartet cyrus (master) and deleted ther deliver.db file. Until now I have no error messages in the logs anymore. And the mails from fetchmail come in again. At least the things work properly again. THANK YOU BOTH!!! Now I will have to check what is wrong with

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Michael Bacon
For those of you doing ZFS, what do you use to back up the data after a zfs snapshot? We're currently on UFS, and would love to go to ZFS, but haven't figured out how to replace ufsdump in our backup strategy. Michael Bacon ITS Messaging UNC Chapel Hill --On February 16, 2010 9:49:07 AM +0100

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Dietmar Rieder
On 02/16/2010 05:32 PM, Michael Bacon wrote: > For those of you doing ZFS, what do you use to back up the data after a zfs > snapshot? We're currently on UFS, and would love to go to ZFS, but haven't > figured out how to replace ufsdump in our backup strategy. what about "zfs send"? see man zfs

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Michael Bacon
Received wisdom I've had on zfs send and receive is that they're not production-ready backup solutions, but were basically afterthoughts the zfs team tacked on. Michael --On February 16, 2010 5:46:52 PM +0100 Dietmar Rieder wrote: > On 02/16/2010 05:32 PM, Michael Bacon wrote: >> For those o

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Vincent Fox
Michael Bacon wrote: > For those of you doing ZFS, what do you use to back up the data after a zfs > snapshot? We're currently on UFS, and would love to go to ZFS, but haven't > figured out how to replace ufsdump in our backup strategy. > There are other commercial backup solutions however we

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Michael Bacon
--On February 16, 2010 9:35:56 AM -0800 Vincent Fox wrote: > Michael Bacon wrote: >> For those of you doing ZFS, what do you use to back up the data after a >> zfs snapshot? We're currently on UFS, and would love to go to ZFS, but >> haven't figured out how to replace ufsdump in our backup st

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Patrick Boutilier
On 02/16/2010 01:48 PM, Michael Bacon wrote: --On February 16, 2010 9:35:56 AM -0800 Vincent Fox wrote: Michael Bacon wrote: For those of you doing ZFS, what do you use to back up the data after a zfs snapshot? We're currently on UFS, and would love to go to ZFS, but haven't figured out how

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Andrew Morgan
On Tue, 16 Feb 2010, Vincent Fox wrote: > There are other commercial backup solutions however we were > already a NetBackup shop. So we simply set our backups to run > against the m...@yesterday path. A locally-written script managing > the snapshot process rolls @yesterday into a date-coded for

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Vincent Fox
Andrew Morgan wrote: > Is there really a significant downside to performing backups on a hot > cyrus mailstore? Should I care if Suzie's INBOX was backed up at 3am > and Sally's INBOX was backed up at 4am? > > Vincent, on a slightly related note, what is your server and SAN > hardware? > I dunn

Re: Using xfer to migrate mailboxes to a new server

2010-02-16 Thread Wesley Craig
On 16 Feb 2010, at 06:35, Simon Fraser wrote: > On Tue, 2010-02-16 at 11:29 +, David Mayo wrote: >> Some additional things to look out for: >> >> - You must run this command on the existing back-end This is true, but I'm not 100% positive why it's implemented this way. The (trivial) bit of

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Clement Hermann (nodens)
On 16/02/2010 19:45, Vincent Fox wrote: > Andrew Morgan wrote: >> Is there really a significant downside to performing backups on a hot >> cyrus mailstore? Should I care if Suzie's INBOX was backed up at 3am >> and Sally's INBOX was backed up at 4am? >> >> Vincent, on a slightly related note, what

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Vincent Fox
Clement Hermann (nodens) wrote: > The snapshot approach (we use ext3 and lvm, soon ext4) is promising, as > a simple tar is faster than using the full backup suite on a filesystem > with a lot of small files (atempo here). But you need the spare space > locally, or you need to do it over the net

Re: Backup strategy for large mailbox stores

2010-02-16 Thread Andy Bennett
Hi, > Is there really a significant downside to performing backups on a hot > cyrus mailstore? Should I care if Suzie's INBOX was backed up at 3am and > Sally's INBOX was backed up at 4am? Whilst Cyrus is running, the state of any databases might be inconsistent on disk. This will mean you mi