dovecot proxy/director and high availability design

2015-07-20 Thread Chad M Stewart
I'm trying to determine which dovecot components to use and how to order them in the network path from client to mail store. If I have say 1,000 users, all stored in MySQL (or LDAP) and have 4 mail stores, configured into 2, 2 node pods. MS1 and MS2 are pod1 and are configured with replicati

Re: dovecot proxy/director and high availability design

2015-07-20 Thread Chad M Stewart
o do something like round robin DNS > that mail clients will automatically attempt to connect to the other IP if > they cannot get to the first address. Unfortunately mail applications don’t > really do this like web browsers do … > > ~ Laz Peterson > Paravis, LLC > >

Re: dovecot proxy/director and high availability design

2015-07-21 Thread Chad M Stewart
On 2015-07-21 02:54 PM, Laz C. Peterson wrote: The consensus seems to say no to RR DNS … I am going to take that into serious consideration. With this proxy setup you describe, what would happen if HAProxy or Dovecot Proxy were to fail? Multiple instances of each. I'll be using SmartOS as th

multiple messages per second to a single mailbox

2015-08-12 Thread Chad M Stewart
Dovecot 2.2.18 on CentOS 6 I have a pair of servers setup with MySQL, Postfix, and Dovecot. Replication is setup and working between the two dovecot instances. The problem I'm running into is that a single mailbox receives a lot of messages, at times the rate is multiple messages per second.

Re: multiple messages per second to a single mailbox

2015-08-12 Thread Chad M Stewart
On Aug 12, 2015, at 11:04 AM, Andrzej A. Filip wrote: > > <..snip..> > Could you provide the following info: > a) mailbox type (maildir/mbox/dbox/...) maildir > [mail_location in dovecot's config] /srv/mail/// > b) file system type (ext2/ext3/ext4/fat32/...) > [provided by "df -T" command

Re: multiple messages per second to a single mailbox

2015-08-12 Thread Chad M Stewart
On Aug 12, 2015, at 11:25 AM, Chad M Stewart wrote: > <..snip..> > Since I posted I've changed a couple of things: ulimit -n 8192, and disabled > fsync as in mail_fsync = never. I'm not sure if I'll put it back in the LMTP > section or not. Given all the

Re: multiple messages per second to a single mailbox

2015-08-12 Thread Chad M Stewart
On Aug 12, 2015, at 11:58 AM, Daniel Tröder wrote: > On 08/12/2015 17:19, Chad M Stewart wrote: >> What I'm seeing is very high load on the system (40) and queues building on >> the Postfix side. > High load means, that there are a lot of processes waiting to run. The

Re: multiple messages per second to a single mailbox

2015-08-14 Thread Chad M Stewart
The problem happened again this morning. Removing fsync calls helped, but I'm not sure about leaving that enabled long term. I still believe the problem is multiple dovecot processes trying to write to a single folder at the same time. (If I could run dtrace I might be able to cobble togethe

Re: multiple messages per second to a single mailbox

2015-08-14 Thread Chad M Stewart
On Aug 14, 2015, at 1:01 PM, Andrzej A. Filip wrote: > > > Are docecot and postfix located on the same server? > Can postfix access (deliver) directly maildir file directory dovecot uses? > For the moment yes they are on the same server. I designed it to be modular, the various components

Re: multiple messages per second to a single mailbox

2015-08-17 Thread Chad M Stewart
On Aug 17, 2015, at 9:30 AM, Gregory Finch wrote: <..snip..> > With that many messages, it may be the index updates that are slowing > things down. Depending on your needs or how you use this folder (it > sounds automated to me), you may not need the indexes on disk at all. If > you set the ind