Re: [Dovecot] dsync replication errors

2015-09-08 Thread Timo Sirainen
On 08 Sep 2015, at 11:20, Sergey Schwartz wrote: > > I use mdbox and probably have similar issue, but in my case only shared > mailboxes were affected. Yes, shared mailboxes don't work nicely with replication. Replication is locking only the original user, so for shared mailboxes multiple dsy

Re: [Dovecot] dsync replication errors

2015-09-07 Thread Timo Sirainen
On 08 Sep 2015, at 01:16, Gedalya wrote: > > On 02/17/2013 03:21 AM, Timo Sirainen wrote: >> Although there's still some mail >> duplication problem with maildir that doesn't log any errors about it. >> I'm not sure why that happens. > > While you're around, Timo :-) > > I've had such an issue

Re: [Dovecot] dsync replication errors

2015-09-07 Thread Gedalya
On 02/17/2013 03:21 AM, Timo Sirainen wrote: Although there's still some mail duplication problem with maildir that doesn't log any errors about it. I'm not sure why that happens. While you're around, Timo :-) I've had such an issue recently with 2.2.18, using Maildir, where emails were being

Re: [Dovecot] dsync replication does not replicate new subfolders

2014-05-08 Thread Timo Sirainen
On 16.4.2014, at 10.26, Nikolaos Milas wrote: > I decided I should create a new one dedicated on it because that thread > includes other issues as well, and the issue in question still remains > unresolved although it is an important one (and I am hoping to attract Timo's > attention on it, to

[Dovecot] dsync replication does not replicate new subfolders

2014-04-16 Thread Nikolaos Milas
Hello, Although this issue has been raised in another thread: https://www.mail-archive.com/dovecot@dovecot.org/msg57281.html I decided I should create a new one dedicated on it because that thread includes other issues as well, and the issue in question still remains unresolved although it

Re: [Dovecot] dsync replication questions

2014-04-07 Thread Teemu Huovila
On 04/07/2014 12:22 PM, Simon Fraser wrote: > Thank you. Is it still only the changes that are synced each way, or > the entire mailbox? I'm trying to gauge the performance hit for enabling > this on larger mailboxes. (I could, of course, run some tests, but > someone may already have done that) C

Re: [Dovecot] dsync replication questions

2014-04-07 Thread Simon Fraser
On Fri, 2014-04-04 at 15:41 +0300, Teemu Huovila wrote: > Hi > > On 04/04/2014 03:38 PM, Simon Fraser wrote: > > It does help, thank you. Do you also know what the '-f' option does? > According to the dsync-man page it: > > Makes dsync run in "full sync" mode rather than "fast sync" mode. In fas

Re: [Dovecot] dsync replication questions

2014-04-04 Thread Teemu Huovila
Hi On 04/04/2014 03:38 PM, Simon Fraser wrote: > It does help, thank you. Do you also know what the '-f' option does? According to the dsync-man page it: Makes dsync run in "full sync" mode rather than "fast sync" mode. In fast sync mode dsync might skip syncing a mailbox, if both locations had

Re: [Dovecot] dsync replication questions

2014-04-04 Thread Simon Fraser
On Fri, 2014-04-04 at 15:34 +0300, Teemu Huovila wrote: > -d Use a default location for the replica. As far as I can tell this is > obtained from userdb variable mail_replica. > -N Sync all (visible?) namespaces (only makes sense when syncing with a > remote host, with potentially different name

Re: [Dovecot] dsync replication questions

2014-04-04 Thread Teemu Huovila
On 04/04/2014 12:42 PM, Nikolaos Milas wrote: > Anyone please? > > How can we determine whether we need to configure > "replication_dsync_parameters = -d -N -l 30 -U" as indicated on the wiki2 (or > some variation thereof) or not? I am definitely not Timo, but I will try a short answer based on

Re: [Dovecot] dsync replication questions

2014-04-04 Thread Nikolaos Milas
On 4/4/2014 1:17 μμ, Alan McGinlay wrote: It does appear to be completely undocumented, We would appreciate if Timo can kindly provide us with -at least- some details! I tried looking in the source code but just ended up going in circles (i'm not familiar with it at all). I faced the sa

Re: [Dovecot] dsync replication questions

2014-04-04 Thread Alan McGinlay
On 2014-04-04 11:42, Nikolaos Milas wrote: On 31/3/2014 12:03 μμ, Simon Fraser wrote: On Fri, 2014-03-28 at 11:58 +0200, Nikolaos Milas wrote: >Question 2a: What do options "-d -N -l 30 -U" signify in >"replication_dsync_parameters = -d -N -l 30 -U"? I'd also be interested to know the answer to

Re: [Dovecot] dsync replication questions

2014-04-04 Thread Nikolaos Milas
On 31/3/2014 12:03 μμ, Simon Fraser wrote: On Fri, 2014-03-28 at 11:58 +0200, Nikolaos Milas wrote: >Question 2a: What do options "-d -N -l 30 -U" signify in >"replication_dsync_parameters = -d -N -l 30 -U"? I'd also be interested to know the answer to this part. I found mention of the '-f' o

Re: [Dovecot] dsync replication questions

2014-03-31 Thread Simon Fraser
On Fri, 2014-03-28 at 11:58 +0200, Nikolaos Milas wrote: > Question 2a: What do options "-d -N -l 30 -U" signify in > "replication_dsync_parameters = -d -N -l 30 -U"? I'd also be interested to know the answer to this part. I found mention of the '-f' option, and adding '-f' to that list appears

Re: [Dovecot] dsync replication questions

2014-03-29 Thread Nikolaos Milas
On 28/3/2014 10:40 μμ, Nikolaos Milas wrote: When I started the server (vmail.example.com), mirroring started and completed fine (after a few hours). However, since then, I am not seeing a continued mirroring between the two. I would expect changes to one of the masters to be propagated in r

Re: [Dovecot] dsync replication questions

2014-03-28 Thread Nikolaos Milas
On 28/3/2014 11:58 πμ, Nikolaos Milas wrote: When I started the server (vmail.example.com), mirroring started and completed fine (after a few hours). However, since then, I am not seeing a continued mirroring between the two. I would expect changes to one of the masters to be propagated in r

[Dovecot] dsync replication questions

2014-03-28 Thread Nikolaos Milas
I am running two servers with Dovecot v2.2.12 on CentOS x86_64 (5.10 and 6.5 respectively) and users are virtual over ldap. I have setup our main internal server (vmail.example.com) with dsync replication according to the first part of http://wiki2.dovecot.org/Replication. The second one (vma

[Dovecot] Dsync replication with LDAP and auth_bind=yes

2014-03-02 Thread Michał Franczak
Hello, I have working dovecot configuration with LDAP based authentication in Active Directory. I'd like to use dsync replication but dovecot can't do user lookups. Is it possible to configure replication in such architecture? doveadm user '*' Returns only one local dovecot user. dovecot --ver

Re: [Dovecot] dsync replication: quota counted twice

2013-04-08 Thread Oli Schacher
On Mon, 8 Apr 2013 15:14:18 +0300 Timo Sirainen wrote: > > ok, thanks for the clarification. Using two different tables does > > the trick. I'll probably also have to disable the quota-warning > > scripts on one of the servers. Currently, both servers run the > > script when a account goes overqu

Re: [Dovecot] dsync replication: quota counted twice

2013-04-08 Thread Timo Sirainen
On 8.4.2013, at 14.56, Oli Schacher wrote: > On Mon, 8 Apr 2013 13:15:54 +0300 > Timo Sirainen wrote: > > >> There's no way to make quota work reliably that way. You need to use >> different quota backends. Either two mysql databases (or tables), or >> the other Dovecot could simply be using a

Re: [Dovecot] dsync replication: quota counted twice

2013-04-08 Thread Oli Schacher
On Mon, 8 Apr 2013 13:15:54 +0300 Timo Sirainen wrote: > There's no way to make quota work reliably that way. You need to use > different quota backends. Either two mysql databases (or tables), or > the other Dovecot could simply be using a dict file quota. > ok, thanks for the clarification.

Re: [Dovecot] dsync replication: quota counted twice

2013-04-08 Thread Timo Sirainen
On 8.4.2013, at 13.05, Oli Schacher wrote: > I enabled quota + warnings in my replication test setup and now > whenever a mail gets delivered the quota is counted twice (probably due > to both servers using the same mysql quota backend) Yes. Dovecot doesn't know that they are the same quota back

[Dovecot] dsync replication: quota counted twice

2013-04-08 Thread Oli Schacher
Hi I enabled quota + warnings in my replication test setup and now whenever a mail gets delivered the quota is counted twice (probably due to both servers using the same mysql quota backend) and quota warnings are fired too early. After a doveadm quota recalc -u the quota is correct again. How do

Re: [Dovecot] dsync replication: assertion failed: (ibc->value_input == NULL)

2013-03-25 Thread Timo Sirainen
On 25.3.2013, at 9.31, Oli Schacher wrote: > current hg (33e78edac8f5) > > Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(): Panic: file > dsync-ibc-stream.c: line 527 (dsync_ibc_stream_input_next): assertion failed: > (ibc->value_input == NULL) Fixed: http://hg.dovecot.org/dovecot-2.2

[Dovecot] dsync replication: assertion failed: (ibc->value_input == NULL)

2013-03-25 Thread Oli Schacher
current hg (33e78edac8f5) Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(): Panic: file dsync-ibc-stream.c: line 527 (dsync_ibc_stream_input_next): assertion failed: (ibc->value_input == NULL) Mar 25 07:47:27 fumailsynctest2 dovecot: dsync-remote(): Error: Raw backtrace: /usr/lib64/dovec

Re: [Dovecot] dsync replication errors

2013-02-19 Thread Timo Sirainen
On 19.2.2013, at 13.48, Charles Marcus wrote: > On 2013-02-18 10:39 PM, Timo Sirainen wrote: >> On 18.2.2013, at 23.50, Michael Grimm wrote: >>> With "doveconf -H dovecot%9d" I do end in tons of reported collisions like >>> ... >>> | doveconf: Error: Duplicate host hashes: dovecot1368344 and d

Re: [Dovecot] dsync replication errors

2013-02-19 Thread Charles Marcus
On 2013-02-18 10:39 PM, Timo Sirainen wrote: On 18.2.2013, at 23.50, Michael Grimm wrote: With "doveconf -H dovecot%9d" I do end in tons of reported collisions like ... | doveconf: Error: Duplicate host hashes: dovecot1368344 and dovecot2055005 | doveconf: Error: Duplicate host hashes: dovecot

Re: [Dovecot] dsync replication errors

2013-02-18 Thread Timo Sirainen
On 18.2.2013, at 23.50, Michael Grimm wrote: >> % doveconf -H dovecot%2d >> No duplicate host hashes in dovecot0 .. dovecot99 > > With "doveconf -H dovecot%9d" I do end in tons of reported collisions like ... > | doveconf: Error: Duplicate host hashes: dovecot1368344 and dovecot2055005 > | dovec

Re: [Dovecot] dsync replication errors

2013-02-18 Thread Michael Grimm
On 18.02.2013, at 07:07, Timo Sirainen wrote: > On 17.2.2013, at 22.04, Michael Grimm wrote: >> First of all: whenever you referred to "hostname" in this thread you have >> been using it as a synonym for the local part [1] of a FQDN, right? > > I mean what gethostname() function returns, which

Re: [Dovecot] dsync replication errors

2013-02-18 Thread Michael Grimm
On 18.02.2013, at 07:49, Timo Sirainen wrote: > On Sun, 2013-02-17 at 12:30 +0200, Timo Sirainen wrote: >> (So yeah, ideally there should be checks for detecting hostname hash >> collisions..) > > Added to v2.2 hg: > > % doveconf -H dovecot%2d > No duplicate host hashes in dovecot0 .. dovecot9

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Timo Sirainen
On Sun, 2013-02-17 at 12:30 +0200, Timo Sirainen wrote: > (So yeah, ideally there should be checks for detecting hostname hash > collisions..) Added to v2.2 hg: % doveconf -H dovecot%d No duplicate host hashes in dovecot0 .. dovecot9 % doveconf -H dovecot%2d No duplicate host hashes in dovecot0

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Timo Sirainen
On 17.2.2013, at 22.04, Michael Grimm wrote: > On 17.02.2013, at 11:08, Timo Sirainen wrote: > >> There may be some other features that require unique hostnames in >> future. Anything where multiple Dovecot servers need to communicate >> between each others. > > I'd like to come back to that i

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Michael Grimm
On 17.02.2013, at 21:04, Michael Grimm wrote: > BTW: I had had defined "hostname=" in dovecot.conf identically using > completely different *but* identical FQDNs "mail.my-domain.tld" because of: s/using completely different/using completely different to locally reported by resolver/g Regards

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Reindl Harald
Am 17.02.2013 21:04, schrieb Michael Grimm: > On 17.02.2013, at 11:08, Timo Sirainen wrote: > >> There may be some other features that require unique hostnames in >> future. Anything where multiple Dovecot servers need to communicate >> between each others. > > I'd like to come back to that is

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Michael Grimm
On 17.02.2013, at 11:08, Timo Sirainen wrote: > There may be some other features that require unique hostnames in > future. Anything where multiple Dovecot servers need to communicate > between each others. I'd like to come back to that issue in order to understand your statement cited below.

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Reindl Harald
Am 17.02.2013 11:08, schrieb Timo Sirainen: >> What parts of Dovecot would be involved? I'm curious because my production >> mailservers use identical hostnames in their jails ever since running >> Dovecot (starting 1.x). > > Mainly that maildir filenames are used as GUIDs. If two have the sam

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Timo Sirainen
On 17.2.2013, at 12.19, Michael Grimm wrote: > On 17.02.2013, at 11:08, Timo Sirainen wrote: >> On Sun, 2013-02-17 at 10:44 +0100, Michael Grimm wrote: > Although even if it does, other parts of Dovecot still use only the hostname part to guarantee global uniqueness of things. So bet

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Michael Grimm
On 17.02.2013, at 11:08, Timo Sirainen wrote: > On Sun, 2013-02-17 at 10:44 +0100, Michael Grimm wrote: >>> Although even if it does, other parts of Dovecot still use only the >>> hostname part to guarantee global uniqueness of things. So better to have >>> unique hostnames. >> >> What parts o

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Timo Sirainen
On Sun, 2013-02-17 at 10:44 +0100, Michael Grimm wrote: > > Although even if it does, other parts of Dovecot still use only the > > hostname part to guarantee global uniqueness of things. So better to have > > unique hostnames. > > What parts of Dovecot would be involved? I'm curious because my

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Michael Grimm
On 17.02.2013, at 06:23, Timo Sirainen wrote: > On 17.2.2013, at 7.06, Timo Sirainen wrote: >> On 17.2.2013, at 0.12, Michael Grimm wrote: >>> Hmm. Both jails run at distinct servers. ssh replication uses different >>> domains, though. But, both jails are named identically "test", and both >>

Re: [Dovecot] dsync replication errors

2013-02-17 Thread Timo Sirainen
On Sat, 2013-02-16 at 19:32 +0100, Oli Schacher wrote: > There seems to be an issue left when expunging a large amount of > messages from the Trash. I managed to get it twice so far by expunging > ~3k messages. I'll try to create a reproducible test script for this > scenario. I can currently only

Re: [Dovecot] dsync replication errors

2013-02-16 Thread Timo Sirainen
On 17.2.2013, at 7.06, Timo Sirainen wrote: > On 17.2.2013, at 0.12, Michael Grimm wrote: > >> Hmm. Both jails run at distinct servers. ssh replication uses different >> domains, though. But, both jails are named identically "test", and both >> jails resolve to identical hostnames "test" if u

Re: [Dovecot] dsync replication errors

2013-02-16 Thread Timo Sirainen
On 17.2.2013, at 0.12, Michael Grimm wrote: >>> I might add that both servers run inside FreeBSD jails (if that might make >>> the difference to your test setup. >> >> Inside jail Dovecot sees two different hostnames (same as "hostname" >> command)? > > Hmm. Both jails run at distinct servers.

Re: [Dovecot] dsync replication errors

2013-02-16 Thread Michael Grimm
On 16.02.2013, at 20:09, Timo Sirainen wrote: > On 16.2.2013, at 20.26, Michael Grimm wrote: >> Sorry to say, but I am still able to break replicator with v2.2.beta1 >> (35194cf0693e) under the conditions outlined below. > > I wonder if locking is working correctly in your setup. Your users hav

Re: [Dovecot] dsync replication errors

2013-02-16 Thread Timo Sirainen
On 16.2.2013, at 20.26, Michael Grimm wrote: > Timo Sirainen wrote: > >> I did a bunch of dsync fixes today in hg. With the new locking >> behavior (and other fixes) you shouldn't be able to break it anymore. > > Sorry to say, but I am still able to break replicator with v2.2.beta1 > (35194cf0

Re: [Dovecot] dsync replication errors

2013-02-16 Thread Oli Schacher
On Sat, 16 Feb 2013 17:20:22 +0200 Timo Sirainen wrote: > I did a bunch of dsync fixes today in hg. With the new locking > behavior (and other fixes) you shouldn't be able to break it anymore. > Thanks for the fixes, Timo! I can confirm I'm no longer able to break anything with the tests I've

Re: [Dovecot] dsync replication errors

2013-02-16 Thread Michael Grimm
Timo Sirainen wrote: > I did a bunch of dsync fixes today in hg. With the new locking > behavior (and other fixes) you shouldn't be able to break it anymore. Sorry to say, but I am still able to break replicator with v2.2.beta1 (35194cf0693e) under the conditions outlined below. > On 2013-02-01

Re: [Dovecot] dsync replication errors

2013-02-16 Thread Timo Sirainen
I did a bunch of dsync fixes today in hg. With the new locking behavior (and other fixes) you shouldn't be able to break it anymore. On Fri, 2013-02-01 at 21:53 +0100, Michael Grimm wrote: > [Sorry Oli for my previous mail to your address, only. Resent here] > > Oli Schacher wrote: > > > There

Re: [Dovecot] dsync replication errors

2013-02-01 Thread Michael Grimm
[Sorry Oli for my previous mail to your address, only. Resent here] Oli Schacher wrote: > There still seems to be a problem when changes to both mailboxes at > the same time are involved I can confirm your observation, although triggered by a different test scenario, similar to the one I did us

Re: [Dovecot] dsync replication errors

2013-02-01 Thread Oli Schacher
On Thu, 31 Jan 2013 22:17:28 +0200 Timo Sirainen wrote: > On Thu, 2013-01-31 at 21:51 +0200, Timo Sirainen wrote: > > On 31.1.2013, at 19.41, Oli Schacher wrote: > > > > >>> Jan 31 17:13:11 doco1 dovecot: dsync-local(user1): Error: > > >>> Mailbox INBOX: Remote didn't send mail > > >>> GUID=33d

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Timo Sirainen
On Thu, 2013-01-31 at 21:51 +0200, Timo Sirainen wrote: > On 31.1.2013, at 19.41, Oli Schacher wrote: > > >>> Jan 31 17:13:11 doco1 dovecot: dsync-local(user1): Error: Mailbox > >>> INBOX: Remote didn't send mail GUID=33dabe0f11980a51200c960042f4 > >>> (UID=104) > > I guess there's some bug

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Timo Sirainen
On 31.1.2013, at 19.41, Oli Schacher wrote: >>> Jan 31 17:13:11 doco1 dovecot: dsync-local(user1): Error: Mailbox >>> INBOX: Remote didn't send mail GUID=33dabe0f11980a51200c960042f4 >>> (UID=104) I guess there's some bug that causes this to happen in some situations.. But the reason for ma

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Oli Schacher
On Thu, 31 Jan 2013 18:49:18 +0200 Timo Sirainen wrote: > > http://hg.dovecot.org/dovecot-2.2/rev/86629f621fe4 should fix this > crash. > > The duplication happens because maildir somehow messes up itself. I > guess I should look into it. > thanks, much appreciated! > > test 3: mdbox again,

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Timo Sirainen
On 31.1.2013, at 18.37, Oli Schacher wrote: > I updated to the latest hg, including the "remote cmd exit wait" update. > > It looks better now, but I still manage to break things :-) > > # > test 2: append only 100 messages, but use maildir again instead of > mdbox. > still produces

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Oli Schacher
On Thu, 31 Jan 2013 17:09:20 +0200 Timo Sirainen wrote: > > See if http://hg.dovecot.org/dovecot-2.2/rev/1d88f01ba2aa helps? > I updated to the latest hg, including the "remote cmd exit wait" update. It looks better now, but I still manage to break things :-) # test 1: append 10

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Timo Sirainen
On 31.1.2013, at 15.36, Oli Schacher wrote: > On Thu, 31 Jan 2013 15:24:06 +0200 > Timo Sirainen wrote: > >> On 31.1.2013, at 15.10, Oli Schacher wrote: >> >>> connect thunderbird to account user1 on server1 >>> result: login ok, mdbox visible on disk, 0 messages >>> >>> in thunderbird copy

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Oli Schacher
On Thu, 31 Jan 2013 15:24:06 +0200 Timo Sirainen wrote: > On 31.1.2013, at 15.10, Oli Schacher wrote: > > > connect thunderbird to account user1 on server1 > > result: login ok, mdbox visible on disk, 0 messages > > > > in thunderbird copy exactly 100 messages from a spambox to user1's > > in

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Timo Sirainen
On 31.1.2013, at 15.10, Oli Schacher wrote: > connect thunderbird to account user1 on server1 > result: login ok, mdbox visible on disk, 0 messages > > in thunderbird copy exactly 100 messages from a spambox to user1's > inbox on server1 spambox not being in server1? So not IMAP COPY command,

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Oli Schacher
> > I tried with mdbox now.. same problem, although I don't see > > "Expunged message reappeared" anymore , but still tons of these: > > > > Server1: > > Jan 31 13:38:05 doco1 dovecot: doveadm: Error: dsync-remote(user1): > > Error: Mailbox INBOX: Remote didn't send mail > > GUID=caec8e2a84650a51

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Timo Sirainen
On 31.1.2013, at 14.46, Oli Schacher wrote: > On Thu, 31 Jan 2013 14:27:08 +0200 > Timo Sirainen wrote: > >> Oh. But it's still beta1. There are several fixes done to dsync since >> beta1, including a fix for these maildir errors. I should release >> beta2 or maybe rc1 soon. >> > > hmm.. actu

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Oli Schacher
On Thu, 31 Jan 2013 14:27:08 +0200 Timo Sirainen wrote: > Oh. But it's still beta1. There are several fixes done to dsync since > beta1, including a fix for these maildir errors. I should release > beta2 or maybe rc1 soon. > hmm.. actually I think I built it from the latest hg (but I must admit

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Timo Sirainen
On 31.1.2013, at 14.06, Oli Schacher wrote: >> b) Switch to v2.2 (latest hg version). It has a rewritte dsync that >> works better. > > the testsetup is already on 2.2 hg Oh. But it's still beta1. There are several fixes done to dsync since beta1, including a fix for these maildir errors. I sh

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Oli Schacher
> a) Use mdbox format instead of maildir. It works better with dsync. ok, I'll try that (although I was hoping I could avoid migrating all boxes on the server I was planning to use this feature) > > b) Switch to v2.2 (latest hg version). It has a rewritte dsync that > works better. the test

Re: [Dovecot] dsync replication errors

2013-01-31 Thread Timo Sirainen
On 31.1.2013, at 12.27, Oli Schacher wrote: > I'm trying to build a cluster of two servers with dsync replication > (based on http://wiki2.dovecot.org/Replication). My test setup works > fine for very simple tests, I can log in to both servers, copy a > message to one of the servers and it succes

[Dovecot] dsync replication errors

2013-01-31 Thread Oli Schacher
Hi I'm trying to build a cluster of two servers with dsync replication (based on http://wiki2.dovecot.org/Replication). My test setup works fine for very simple tests, I can log in to both servers, copy a message to one of the servers and it successfully apperars in the other account. But, if I tr

Re: [Dovecot] dsync replication available for testing

2012-08-25 Thread Timo Sirainen
On 25.8.2012, at 19.09, Michael Grimm wrote: >> Not enable mail_log for doveadm: >> >> protocol !doveadm { >> mail_plugins = $mail_plugins = mail_log >> } > > JFTR: That didn't work. This would omit it from the local dsync. >> or alternatively override it only for the dsync command with dovead

Re: [Dovecot] dsync replication available for testing

2012-08-25 Thread Michael Grimm
On 23.08.2012, at 22:01, Timo Sirainen wrote: > On 19.8.2012, at 12.51, Michael Grimm wrote: 1) I see a lot of error messages whenever replicator is in action like (although everything is being synced correctly): | mail dovecot: dsync-local(test): Error: remote: dsync

Re: [Dovecot] dsync replication available for testing

2012-08-23 Thread Timo Sirainen
On 19.8.2012, at 12.51, Michael Grimm wrote: >>> 1) I see a lot of error messages whenever replicator is in action like >>> (although everything is being synced correctly): >>> >>> | mail dovecot: dsync-local(test): Error: remote: >>> dsync-remote(test): Info: save: box=INBOX, uid=27, >>> m

Re: [Dovecot] dsync replication available for testing

2012-08-19 Thread Michael Grimm
On 08.03.2012, at 12:35, Timo Sirainen wrote: > On Thu, 2012-03-08 at 11:26 +0100, Michael Grimm wrote: >> Now some observations regarding replicator: >> >> 1) I see a lot of error messages whenever replicator is in action like >> (although everything is being synced correctly): >> >>| mai

Re: [Dovecot] Dsync replication

2012-07-28 Thread Timo Sirainen
On 18.7.2012, at 19.24, l...@airstreamcomm.net wrote: >> Anyway, in my small installation I'm using it in active-active mode and it >> works well enough. I've even configured my clients intentionally so that >> they use different servers. > > Does dsync replication only work between two hosts?

Re: [Dovecot] Dsync replication

2012-07-21 Thread Daniel Parthey
l...@airstreamcomm.net wrote: > On 7/6/12 9:56 PM, Timo Sirainen wrote: > >On 6.7.2012, at 23.28, l...@airstreamcomm.net wrote: > > > >>Thanks, that certainly helps identify the configuration options. However I > >>am more concerned about the experiences of others who have actually used > >>the rep

Re: [Dovecot] Dsync replication

2012-07-18 Thread l...@airstreamcomm.net
On 7/6/12 9:56 PM, Timo Sirainen wrote: On 6.7.2012, at 23.28, l...@airstreamcomm.net wrote: Thanks, that certainly helps identify the configuration options. However I am more concerned about the experiences of others who have actually used the replication. What is the rate of change on your

Re: [Dovecot] Dsync replication

2012-07-06 Thread Timo Sirainen
On 6.7.2012, at 23.28, l...@airstreamcomm.net wrote: > Thanks, that certainly helps identify the configuration options. However I am > more concerned about the experiences of others who have actually used the > replication. What is the rate of change on your mail cluster, how many > concurrent

Re: [Dovecot] Dsync replication

2012-07-06 Thread l...@airstreamcomm.net
...@dovecot.org] On Behalf Of l...@airstreamcomm.net Sent: Friday, July 06, 2012 3:28 AM To: dovecot@dovecot.org Subject: [Dovecot] Dsync replication I have been loosely following discussions dsync replication, but I am wondering if this tool still in a testing phase or has it been committed as a

Re: [Dovecot] Dsync replication

2012-07-05 Thread Костырев Александр Алексеевич
: Friday, July 06, 2012 3:28 AM To: dovecot@dovecot.org Subject: [Dovecot] Dsync replication I have been loosely following discussions dsync replication, but I am wondering if this tool still in a testing phase or has it been committed as a production part of Dovecot? I would like to do some testing

[Dovecot] Dsync replication

2012-07-05 Thread l...@airstreamcomm.net
I have been loosely following discussions dsync replication, but I am wondering if this tool still in a testing phase or has it been committed as a production part of Dovecot? I would like to do some testing with the protocol to see if it's capable of handling the change rate our mail service

Re: [Dovecot] dsync replication available for testing

2012-03-08 Thread Michael Grimm
Hi -- On 08.03.2012 12:35, Timo Sirainen wrote: On Thu, 2012-03-08 at 11:26 +0100, Michael Grimm wrote: You can do for example: service config { unix_listener config { user = vmail } } I will try that later. It seems to me, that whenever a larger number of mails arrive on both s

Re: [Dovecot] dsync replication available for testing

2012-03-08 Thread Timo Sirainen
On Thu, 2012-03-08 at 11:26 +0100, Michael Grimm wrote: > Let me start with replicator's configuration ... > > > Below is a configuration for virtual user setup. > [...] > > service doveadm { > > # if you're using a single virtual user, set this to > > # start ssh as vmail (not root) > > use

Re: [Dovecot] dsync replication available for testing

2012-03-08 Thread Michael Grimm
Hi -- On 04.03.2012 11:44, Timo Sirainen wrote: In dovecot-2.1 hg you can now test dsync-based replication. Everything isn't finished yet, but it appears to work and I've enabled it for my @dovecot.fi mails. I did give it a try starting some days ago, and I can confirm that you are right,

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Timo Sirainen
On 5.3.2012, at 14.35, Jan-Frode Myklebust wrote: > On Mon, Mar 05, 2012 at 12:45:26PM +0200, Timo Sirainen wrote: >>> >>> So, ideally (for us), dovecot should keep a log over which accounts are >>> active (has received or checked mail), and only sync users that has been >>> active for the last $

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Timo Sirainen
On 5.3.2012, at 15.11, Attila Nagy wrote: >> dsync doesn't currently take enough advantage of modseqs and send only the >> changed data. > Hm. What is your estimate about the performance capability of the current > "best" replication scheme available in Dovecot? > I know it's hard to tell, becau

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Attila Nagy
On 03/05/12 13:48, Timo Sirainen wrote: On 5.3.2012, at 14.15, Attila Nagy wrote: On 03/04/12 11:44, Timo Sirainen wrote: In dovecot-2.1 hg you can now test dsync-based replication. Everything isn't finished yet, but it appears to work and I've enabled it for my @dovecot.fi mails. Some issue

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Timo Sirainen
On 5.3.2012, at 14.15, Attila Nagy wrote: >>> On 03/04/12 11:44, Timo Sirainen wrote: In dovecot-2.1 hg you can now test dsync-based replication. Everything isn't finished yet, but it appears to work and I've enabled it for my @dovecot.fi mails. Some issues: >>> Do you plan

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Jan-Frode Myklebust
On Mon, Mar 05, 2012 at 12:45:26PM +0200, Timo Sirainen wrote: > > > > So, ideally (for us), dovecot should keep a log over which accounts are > > active (has received or checked mail), and only sync users that has been > > active for the last $timeperiode on startup. > > Well, all of this could

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Attila Nagy
On 03/05/12 11:08, Timo Sirainen wrote: On 5.3.2012, at 9.25, Attila Nagy wrote: On 03/04/12 11:44, Timo Sirainen wrote: In dovecot-2.1 hg you can now test dsync-based replication. Everything isn't finished yet, but it appears to work and I've enabled it for my @dovecot.fi mails. Some issues

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Timo Sirainen
On 5.3.2012, at 10.35, Jan-Frode Myklebust wrote: >> 1) Replicator syncs all users at startup. If you can change your userdb >> iteration to return only one test user for replicator that avoids it. (You >> may be able to do protocol replicator { userdb {..} } and protocol >> !replicator { .. })

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Timo Sirainen
On 5.3.2012, at 9.25, Attila Nagy wrote: > On 03/04/12 11:44, Timo Sirainen wrote: >> In dovecot-2.1 hg you can now test dsync-based replication. Everything isn't >> finished yet, but it appears to work and I've enabled it for my @dovecot.fi >> mails. Some issues: >> > Do you plan to make it mo

Re: [Dovecot] dsync replication available for testing

2012-03-05 Thread Jan-Frode Myklebust
On Sun, Mar 04, 2012 at 01:38:14PM +0200, Timo Sirainen wrote: > > > > Great news. I would love to test it, if I will be able to run this on a > > test > > account, only. All other users should become synced the "old way" for the > > time > > being. > > > > Would that be possible with the cu

Re: [Dovecot] dsync replication available for testing

2012-03-04 Thread Attila Nagy
Hi, On 03/04/12 11:44, Timo Sirainen wrote: In dovecot-2.1 hg you can now test dsync-based replication. Everything isn't finished yet, but it appears to work and I've enabled it for my @dovecot.fi mails. Some issues: - public namespace isn't replicated at all - shared namespace is replicate

Re: [Dovecot] dsync replication available for testing

2012-03-04 Thread Timo Sirainen
On 4.3.2012, at 23.39, Michael Grimm wrote: >> Anyway, replicator simply runs doveadm, so there's not much that can go >> wrong. So >> you could even ignore 1) and just let it sync everyone at startup. > > Does that mean that the new functionality (queue) does only run dsync > replication > the

Re: [Dovecot] dsync replication available for testing

2012-03-04 Thread Michael Grimm
Hi -- On 04.03.2012, at 12:38, Timo Sirainen wrote: > On 4.3.2012, at 13.34, Michael Grimm wrote: >> On 04.03.2012, at 11:44, Timo Sirainen wrote: >>> In dovecot-2.1 hg you can now test dsync-based replication. >> >> Great news. I would love to test it, if I will be able to run this on a test >

Re: [Dovecot] dsync replication available for testing

2012-03-04 Thread Timo Sirainen
On 4.3.2012, at 13.34, Michael Grimm wrote: > On 04.03.2012, at 11:44, Timo Sirainen wrote: > >> In dovecot-2.1 hg you can now test dsync-based replication. > > Great news. I would love to test it, if I will be able to run this on a test > account, only. All other users should become synced the

Re: [Dovecot] dsync replication available for testing

2012-03-04 Thread Michael Grimm
Hi -- On 04.03.2012, at 11:44, Timo Sirainen wrote: > In dovecot-2.1 hg you can now test dsync-based replication. Great news. I would love to test it, if I will be able to run this on a test account, only. All other users should become synced the "old way" for the time being. Would that be p

[Dovecot] dsync replication available for testing

2012-03-04 Thread Timo Sirainen
In dovecot-2.1 hg you can now test dsync-based replication. Everything isn't finished yet, but it appears to work and I've enabled it for my @dovecot.fi mails. Some issues: - public namespace isn't replicated at all - shared namespace is replicated, but not private mail flags - I've only tes