Re: [Dovecot] repeating dsync - questions

2013-04-08 Thread Bob Gustafson
OK, success: see timings (real nn) below commands. Initial copy of Maildir from live system to test sys (14G of data) rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir real 37m Then 1st 'dsync -R backup maildir:~/Maildir' real 828m Then 2nd rsync to pick up new mail - **don't t

Re: [Dovecot] repeating dsync - questions

2013-04-08 Thread Bob Gustafson
My need at the moment is only a *one* time deal. I just need to copy/convert all of the messages over to the new system and new (sdbox) format *once*. Then all of the clients can start from zero to build their caches based on the new mail box (not that many clients). --- I will take a look at t

Re: [Dovecot] repeating dsync - questions

2013-04-08 Thread Timo Sirainen
On 8.4.2013, at 1.32, Bob Gustafson wrote: > Ok, how is this for a scheme: > > 1) Initially rsync Maildir to destination system > 2) Do initial 'dsync backup' from Maildir to sdbox on destination system > 3) Do a 2nd rsync of new Maildir data from live system to destination > system, but don't c

Re: [Dovecot] repeating dsync - questions

2013-04-07 Thread Bob Gustafson
Ok, see interspersed. On Mon, 2013-04-08 at 00:53 +0300, Timo Sirainen wrote: > On 8.4.2013, at 0.10, Bob Gustafson wrote: > > >>> I am still on my quest for a quick way to move mail from a live Maildir > >>> system to a 'soon to be live' sdbox system. > >>> > >>> I copy Maildir to new system u

Re: [Dovecot] repeating dsync - questions

2013-04-07 Thread Timo Sirainen
On 8.4.2013, at 0.10, Bob Gustafson wrote: >>> I am still on my quest for a quick way to move mail from a live Maildir >>> system to a 'soon to be live' sdbox system. >>> >>> I copy Maildir to new system using: >>> rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir >>> >>> Then

Re: [Dovecot] repeating dsync - questions

2013-04-07 Thread Bob Gustafson
On Sun, 2013-04-07 at 20:50 +0300, Timo Sirainen wrote: > On 7.4.2013, at 17.12, Bob Gustafson wrote: > > > I am still on my quest for a quick way to move mail from a live Maildir > > system to a 'soon to be live' sdbox system. > > > > I copy Maildir to new system using: > > rsync -ar --times h

Re: [Dovecot] repeating dsync - questions

2013-04-07 Thread Timo Sirainen
On 7.4.2013, at 17.12, Bob Gustafson wrote: > I am still on my quest for a quick way to move mail from a live Maildir > system to a 'soon to be live' sdbox system. > > I copy Maildir to new system using: > rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir > > Then I convert fro

Re: [Dovecot] repeating dsync - questions

2013-04-07 Thread Bob Gustafson
I am still on my quest for a quick way to move mail from a live Maildir system to a 'soon to be live' sdbox system. I copy Maildir to new system using: rsync -ar --times hoho4:/home/bobgus/Maildir/ /home/bobgus/Maildir Then I convert from Maildir to sdbox with: dsync mirror maildir:~/Maildir The

Re: [Dovecot] repeating dsync - questions

2013-04-06 Thread Bob Gustafson
I whacked Maildir and sdbox and started over. Tweek of rsync script - removed trailing / on destination. Did yum update, restart Avoided running Firefox on that machine.. It is now running the 1st pass of dsync - estimated finish is about 4.3 hours on 14G of mails vmstat 2 shows no swapping (

Re: [Dovecot] repeating dsync - questions

2013-04-06 Thread Ken A
Maybe take a look at "vmstat 2" and see if i/o is blocking a lot or you are hitting swap space? Someone else may be more informed about the inner workings of dsync and how it handles maildir as opposed to mbox. Best of luck, Ken On 4/6/2013 1:09 AM, Bob Gustafson wrote: > Something must be wrong

Re: [Dovecot] repeating dsync - questions

2013-04-05 Thread Bob Gustafson
Something must be wrong with my setup. It took 14+ hours for the first dsync pass and it hasn't finished yet on the rerun to pick up the latest mail (around 12+ hours). I have about 9 GB of mail! The destination system is not fast, but.. Maybe I will wait for the 2.2 release.. Thanks for your res

Re: [Dovecot] repeating dsync - questions

2013-04-05 Thread Ken A
It's about 300GB of mboxes (I don't know how many messages) and dsync took about 3 hours from scratch in the destination. But, when I sync more frequently, it's much quicker, and depends on the number of changes. With no changes it runs in about 15 min. Ken A. On 4/5/2013 1:54 PM, Bob Gustafson w

Re: [Dovecot] repeating dsync - questions

2013-04-05 Thread Bob Gustafson
I tried that a week or so ago, with a 'dsync -R backup', but got the funny named directories, so I read more and am trying the 'dsync mirror' which doesn't require the -R. How long does the sync step take for you? (Normalize to # of messages..) Bob G On Apr 5, 2013, at 13:48, Ken A wrote: >

Re: [Dovecot] repeating dsync - questions

2013-04-05 Thread Ken A
I've found that when going in one direction, using "backup -R" rather than mirror, works better. I'm going from mbox to sdbox, but doing roughly the same thing you are, rsync and then dsync. Ken A. On 4/5/2013 10:40 AM, Bob Gustafson wrote: > > I'm moving/converting email from one system to anot

[Dovecot] repeating dsync - questions

2013-04-05 Thread Bob Gustafson
I'm moving/converting email from one system to another The source system is: Dual core x86_64 6GB memory 180 GB raid1 disks ext4 Fedora 9 Dovecot 1.0.15 Maildir format The destination system is: Dual core x86_64 2GB memory 1TB raid1 disks ext4 Fedora 18 Dovecot 2.1.15 sdbox format I am moving m