Re: Cyrus-imapd memory tuning

2014-03-13 Thread Frank Richter
On Thu, Mar 13, 2014, at 04:18 AM, David R Bosso wrote: I've been wondering if anyone has any positive experience with using recent XFS. We use XFS on 5 backends (virtual servers, Scientific Linux 6) with 15 partitions altogether (500 to 800 GB each) for many years without serious crashes.

Re: Cyrus-imapd memory tuning

2014-03-12 Thread Bron Gondwana
On Thu, Mar 13, 2014, at 04:18 AM, David R Bosso wrote: > I've been wondering if anyone has any positive experience with using recent > XFS. This question comes up every so often. I tried a couple of years back, and the server crashed within 6 hours under the heavy load of copying data in, and

Re: Cyrus-imapd memory tuning

2014-03-12 Thread Bron Gondwana
On Thu, Mar 13, 2014, at 04:18 AM, David R Bosso wrote: > Just curious about what filesystem (and any special mount options) you're > using these days for large cyrus stores. We've been using ext4 for a while > now (we used to use reiser) and have seen performance degradation over > time. I've

Re: Cyrus-imapd memory tuning

2014-03-12 Thread David R Bosso
--On March 12, 2014 11:53:03 PM +1100 Bron Gondwana wrote: > > Looks like on a medium-loaded server we have about 15,000 connections open > at the moment. It's about 40% masters, 40% replicas, 20% unallocated. > >> About disk, what is the high size of a single partition managed by Cyrus? > > We

Re: Cyrus-imapd memory tuning

2014-03-12 Thread Bron Gondwana
On Wed, Mar 12, 2014, at 08:11 PM, Marco wrote: > > On Mon, Mar 10, 2014, at 07:49 PM, Marco wrote: > >> With 8GB RAM, > > > > I would recommend you increase that... > [...] > > As an interesting datapoint, the big ones cost about US$20k fully > > stocked, including 40Tb of RAID6 storage for emai

Re: Cyrus-imapd memory tuning

2014-03-12 Thread Marco
> On Mon, Mar 10, 2014, at 07:49 PM, Marco wrote: >> With 8GB RAM, > > I would recommend you increase that... [...] > As an interesting datapoint, the big ones cost about US$20k fully > stocked, including 40Tb of RAID6 storage for email, plus 6Tb of > RAID1 for search indexes and 800Gb of RAID1

Re: Cyrus-imapd memory tuning

2014-03-10 Thread Andrew Morgan
On Mon, 10 Mar 2014, Marco wrote: > My server is: > Red Hat Enterprise Linux Server release 6.3 (Santiago) > Without problems I read something like this: > > total used free sharedbuffers cached > Mem: 80619767651020 410956 01355964

Re: Cyrus-imapd memory tuning

2014-03-10 Thread Bron Gondwana
On Mon, Mar 10, 2014, at 07:49 PM, Marco wrote: > With 8GB RAM, I would recommend you increase that... even before you swap, you'll be seeing a drop in performance as hot files (indexes, mailboxes.db) get evicted from cache. Memory is relatively cheap these days. I realise you may be constrain

Re: Cyrus-imapd memory tuning

2014-03-10 Thread Marco
[...] > So best would be to use pmap on a "typical" imapd on your system and > add some margin for additional helper around to get a estimate how > far you can get. I'll try to understand carefully. I estimated memory usage with 'ps' and the RSS field. I'm trying with pmap. I now see value

Re: Cyrus-imapd memory tuning

2014-03-10 Thread lst_hoe02
Zitat von Marco : Hello cyrus users, I have a Cyrus-imapd server with 2400 mailboxes imap accessed by Open-Xchange client. Days ago this Cyrus-Imapd server experiences an Out of Memory and it starts to sacrifice childs: In average I have about 400 max simoultaneous connections and I have n

Cyrus-imapd memory tuning

2014-03-10 Thread Marco
Hello cyrus users, I have a Cyrus-imapd server with 2400 mailboxes imap accessed by Open-Xchange client. Days ago this Cyrus-Imapd server experiences an Out of Memory and it starts to sacrifice childs: 2014-03-04T15:25:48.927562+01:00 ucstore-csi kernel: imapd: page allocation failure. or