Re: [Dovecot] Indexes to MLC-SSD

2011-11-29 Thread Dovecot-GDH
https://github.com/facebook/flashcache/blob/master/doc/flashcache-doc.txt On Nov 28, 2011, at 4:04 PM, Micah Anderson wrote: > Dovecot-GDH writes: > >> If I/O performance is a concern, you may be interested in ZFS and Flashcache. >> >> Specifically, ZFS' ZIL (ZFS Intent Log) and its L2ARC (Lay

Re: [Dovecot] Indexes to MLC-SSD

2011-11-28 Thread Micah Anderson
Dovecot-GDH writes: > If I/O performance is a concern, you may be interested in ZFS and Flashcache. > > Specifically, ZFS' ZIL (ZFS Intent Log) and its L2ARC (Layer 2 Adaptive Read > Cache) > ZFS does run on Linux http://zfs-fuse.net > > Flashcache: https://github.com/facebook/flashcache/ That

Re: [Dovecot] Indexes to MLC-SSD

2011-11-24 Thread Patrick Westenberg
On Tue, 22 Nov 2011 11:45:47 +0100, Jan-Frode Myklebust wrote: Ah, then Timo's reply was right. He suggested you do the lmtp-deliveries to the same server that you would send you imap-user to. You can do this trough dovecot director and lmtp-proxying. So instead of: lmtp:unix:priv

Re: [Dovecot] Indexes to MLC-SSD

2011-11-22 Thread Jan-Frode Myklebust
On Tue, Nov 22, 2011 at 11:17:12AM +0100, Patrick Westenberg wrote: > > No. I want to know if dovecot writes to the indexes if it receives a > mail via lmtp. > > Someone proposed to store the index files on a locally installed SSD > on a frontend (imap) machine and stick the users to that machin

Re: [Dovecot] Indexes to MLC-SSD

2011-11-22 Thread Patrick Westenberg
Jan-Frode Myklebust schrieb: I wondered that too. It looked to me like you tried to ask where the lmtp-service picks up the path to indexes, right? AFAIU it picks that up from the /var/run/dovecot/auth-master socket. No. I want to know if dovecot writes to the indexes if it receives a mail vi

Re: [Dovecot] Indexes to MLC-SSD

2011-11-21 Thread Jan-Frode Myklebust
On Mon, Nov 21, 2011 at 10:45:49PM +0100, Patrick Westenberg wrote: > Timo Sirainen schrieb: > >On Wed, 2011-11-16 at 19:40 +0100, Patrick Westenberg wrote: > >>I already use lmtp:unix:private/dovecot-lmtp as transport but where is > >>the link to the indexes? > > > >You can switch to lmtp:tcp:1.2.

Re: [Dovecot] Indexes to MLC-SSD

2011-11-21 Thread Patrick Westenberg
Timo Sirainen schrieb: On Wed, 2011-11-16 at 19:40 +0100, Patrick Westenberg wrote: I already use lmtp:unix:private/dovecot-lmtp as transport but where is the link to the indexes? You can switch to lmtp:tcp:1.2.3.4:24 where 1.2.3.4 would be Dovecot LMTP proxy, which would forward the connectio

Re: [Dovecot] Indexes to MLC-SSD

2011-11-16 Thread Timo Sirainen
On Wed, 2011-11-16 at 19:40 +0100, Patrick Westenberg wrote: > Timo Sirainen schrieb: > > On Mon, 2011-11-07 at 01:08 +0100, Patrick Westenberg wrote: > >> > >> My mail exchangers use dovecot-lda and I think indexes will be written > >> from these servers too or am I wrong with this? > > > > You ca

Re: [Dovecot] Indexes to MLC-SSD

2011-11-16 Thread Patrick Westenberg
Timo Sirainen schrieb: On Mon, 2011-11-07 at 01:08 +0100, Patrick Westenberg wrote: My mail exchangers use dovecot-lda and I think indexes will be written from these servers too or am I wrong with this? You can use LMTP and LMTP proxying. I already use lmtp:unix:private/dovecot-lmtp as tran

Re: [Dovecot] Indexes to MLC-SSD

2011-11-16 Thread Timo Sirainen
On Mon, 2011-11-07 at 01:08 +0100, Patrick Westenberg wrote: > Ed W schrieb: > > > See the "sticky" in my reply. You use one of several techniques to > > ensure that users always end up on the server with the indexes on. That > > way much of the IO is served from that local machine and you only

Re: [Dovecot] indexes permissions problem

2011-11-15 Thread Timo Sirainen
On Thu, 2011-11-10 at 00:30 -0800, Mark Hanford wrote: > I've got a centos 6 server running Dovecot 2.0.beta6 (3156315704ef). > For legacy reasons (I'm moving mail from a Dovecot 1.1.1 and FreeBSD box > with user home directories NFS mounted), my index files are setup to be > in /u/indexes/ >

[Dovecot] indexes permissions problem

2011-11-10 Thread Mark Hanford
Hey all, I did a search but didn't find the answer to my problem, so here goes. I've got a centos 6 server running Dovecot 2.0.beta6 (3156315704ef). For legacy reasons (I'm moving mail from a Dovecot 1.1.1 and FreeBSD box with user home directories NFS mounted), my index files are setup to be

Re: [Dovecot] Indexes to MLC-SSD

2011-11-06 Thread Patrick Westenberg
Ed W schrieb: See the "sticky" in my reply. You use one of several techniques to ensure that users always end up on the server with the indexes on. That way much of the IO is served from that local machine and you only access the SAN for the (in theory much less frequent) access to the mail fi

Re: [Dovecot] Indexes to MLC-SSD

2011-11-05 Thread Stan Hoeppner
On 11/3/2011 10:21 AM, Ed W wrote: > >> I'm using NexentaStor (Solaris, ZFS) to export iSCSI-LUNs and I was >> thinking about a SSD based LUN for the indexes. As I'm using multiple >> servers this LUN will use OCFS2. > > Given that the SAN always has the network latency behind it, might you > be

Re: [Dovecot] Indexes to MLC-SSD

2011-11-05 Thread Ed W
On 03/11/2011 16:53, Patrick Westenberg wrote: > Ed W schrieb: > >>> I'm using NexentaStor (Solaris, ZFS) to export iSCSI-LUNs and I was >>> thinking about a SSD based LUN for the indexes. As I'm using multiple >>> servers this LUN will use OCFS2. >> >> Given that the SAN always has the network lat

Re: [Dovecot] Indexes to MLC-SSD

2011-11-04 Thread Felipe Scarel
I'm using the GIT version, that 0.5 version is quite a bit outdated. I was not all that worried about using ZFS on this experiment because we do have the old mail storage on ext3 synchronized and ready to switch back, and I could disable dedup and compression on-the-fly if needed (which eventually

Re: [Dovecot] Indexes to MLC-SSD

2011-11-04 Thread Stan Hoeppner
On 11/3/2011 1:24 PM, Felipe Scarel wrote: > Reasons to choose ZFS were snapshots, and mainly dedup and compression > capabilities. I know, it's ironic since I'm not able to use them now due to > severe performance issues with them (mostly dedup) turned on. > > I do like the emphasis on data integ

Re: [Dovecot] Indexes to MLC-SSD

2011-11-03 Thread Felipe Scarel
Reasons to choose ZFS were snapshots, and mainly dedup and compression capabilities. I know, it's ironic since I'm not able to use them now due to severe performance issues with them (mostly dedup) turned on. I do like the emphasis on data integrity and fast on-the-fly configurability of ZFS to an

Re: [Dovecot] Indexes to MLC-SSD

2011-11-03 Thread Dan Swartzendruber
Patrick Westenberg wrote: Ed W schrieb: I'm using NexentaStor (Solaris, ZFS) to export iSCSI-LUNs and I was thinking about a SSD based LUN for the indexes. As I'm using multiple servers this LUN will use OCFS2. Given that the SAN always has the network latency behind it, might you be better t

Re: [Dovecot] Indexes to MLC-SSD

2011-11-03 Thread Patrick Westenberg
Ed W schrieb: I'm using NexentaStor (Solaris, ZFS) to export iSCSI-LUNs and I was thinking about a SSD based LUN for the indexes. As I'm using multiple servers this LUN will use OCFS2. Given that the SAN always has the network latency behind it, might you be better to look at putting the SSDs

Re: [Dovecot] Indexes to MLC-SSD

2011-11-03 Thread Ed W
> I'm using NexentaStor (Solaris, ZFS) to export iSCSI-LUNs and I was > thinking about a SSD based LUN for the indexes. As I'm using multiple > servers this LUN will use OCFS2. Given that the SAN always has the network latency behind it, might you be better to look at putting the SSDs in the fron

Re: [Dovecot] Indexes to MLC-SSD

2011-11-03 Thread Ed W
On 03/11/2011 11:32, Felipe Scarel wrote: > I'm using native ZFS (http://zfsonlinux.org) on production here (15k+ > users, over 2TB of mail data) with little issues. Dedup and compression > disabled, mind that. > OT: but what were the rough criteria that led you to using ZFS over say LVM with EXT4

Re: [Dovecot] Indexes to MLC-SSD

2011-11-03 Thread Felipe Scarel
-boun...@dovecot.org [mailto:dovecot-boun...@dovecot.org] On > Behalf Of Patrick Westenberg > Sent: Tuesday, November 01, 2011 5:19 PM > To: dovecot@dovecot.org > Subject: Re: [Dovecot] Indexes to MLC-SSD > > Dovecot-GDH schrieb: > > If I/O performance is a concern, you may be i

Re: [Dovecot] Indexes to MLC-SSD

2011-11-01 Thread Dan Swartzendruber
nberg Sent: Tuesday, November 01, 2011 5:19 PM To: dovecot@dovecot.org Subject: Re: [Dovecot] Indexes to MLC-SSD Dovecot-GDH schrieb: > If I/O performance is a concern, you may be interested in ZFS and Flashcache. > > Specifically, ZFS' ZIL (ZFS Intent Log) and its L2ARC (Layer 2 Ad

Re: [Dovecot] Indexes to MLC-SSD

2011-11-01 Thread Patrick Westenberg
Dovecot-GDH schrieb: If I/O performance is a concern, you may be interested in ZFS and Flashcache. Specifically, ZFS' ZIL (ZFS Intent Log) and its L2ARC (Layer 2 Adaptive Read Cache) ZFS does run on Linux http://zfs-fuse.net I'm using NexentaStor (Solaris, ZFS) to export iSCSI-LUNs and I was

Re: [Dovecot] Indexes to MLC-SSD

2011-11-01 Thread Dovecot-GDH
If I/O performance is a concern, you may be interested in ZFS and Flashcache. Specifically, ZFS' ZIL (ZFS Intent Log) and its L2ARC (Layer 2 Adaptive Read Cache) ZFS does run on Linux http://zfs-fuse.net Flashcache: https://github.com/facebook/flashcache/ Both of these techniques can use a pair

Re: [Dovecot] Indexes to MLC-SSD

2011-10-27 Thread Ed W
On 27/10/2011 03:36, Stan Hoeppner wrote: > On 10/26/2011 4:13 PM, Patrick Westenberg wrote: >> Hi all, >> >> is anyone on this list who dares/dared to store his index files on a >> MLC-SSD? > I have not. But I can tell you that a 32GB Corsair MLC SSD in my > workstation died after 4 months of lau

Re: [Dovecot] Indexes to MLC-SSD

2011-10-26 Thread Stan Hoeppner
On 10/26/2011 4:13 PM, Patrick Westenberg wrote: > Hi all, > > is anyone on this list who dares/dared to store his index files on a > MLC-SSD? I have not. But I can tell you that a 32GB Corsair MLC SSD in my workstation died after 4 months of laughably light duty. It had nothing to do with cell

[Dovecot] Indexes to MLC-SSD

2011-10-26 Thread Patrick Westenberg
Hi all, is anyone on this list who dares/dared to store his index files on a MLC-SSD? Regards, Patrick

Re: [Dovecot] About using Dovecot indexes with Thunderbird/kmail

2011-09-21 Thread Anton Aylward
Charles Marcus said the following on 09/21/2011 08:05 AM: On 2011-09-20 5:37 PM, Anton Aylward wrote: Charles Marcus said the following on 09/20/2011 04:22 PM: On 2011-09-20 4:03 PM, Anton Aylward wrote: I wish that Thunderbird would NOT index mail on my laptop, but it does. So turn it (GLO

Re: [Dovecot] About using Dovecot indexes with Thunderbird/kmail

2011-09-21 Thread Charles Marcus
On 2011-09-20 5:37 PM, Anton Aylward wrote: Charles Marcus said the following on 09/20/2011 04:22 PM: On 2011-09-20 4:03 PM, Anton Aylward wrote: I wish that Thunderbird would NOT index mail on my laptop, but it does. So turn it (GLODA) off... Ah https://wiki.mozilla.org/Thunderbird:Using

Re: [Dovecot] About using Dovecot indexes with Thunderbird/kmail

2011-09-21 Thread Anton Aylward
Willie Gillespie said the following on 09/20/2011 11:35 PM: On 09/20/2011 03:37 PM, Anton Aylward wrote: https://wiki.mozilla.org/Thunderbird:Using_Gloda Well it is off, but I still have these index files ... So perhaps its not index that taking all the space and gets rebuilt when T Bird says i

Re: [Dovecot] About using Dovecot indexes with Thunderbird/kmail

2011-09-20 Thread Willie Gillespie
On 09/20/2011 03:37 PM, Anton Aylward wrote: https://wiki.mozilla.org/Thunderbird:Using_Gloda Well it is off, but I still have these index files ... So perhaps its not index that taking all the space and gets rebuilt when T Bird says its downloading the headers and indexing ... Just have to as

Re: [Dovecot] About using Dovecot indexes with Thunderbird/kmail

2011-09-20 Thread Anton Aylward
Charles Marcus said the following on 09/20/2011 04:22 PM: On 2011-09-20 4:03 PM, Anton Aylward wrote: I wish that Thunderbird would NOT index mail on my laptop, but it does. So turn it (GLODA) off... Ah https://wiki.mozilla.org/Thunderbird:Using_Gloda Well it is off, but I still have thes

Re: [Dovecot] About using Dovecot indexes with Thunderbird/kmail

2011-09-20 Thread Charles Marcus
On 2011-09-20 4:03 PM, Anton Aylward wrote: I wish that Thunderbird would NOT index mail on my laptop, but it does. So turn it (GLODA) off... -- Best regards, Charles

[Dovecot] About using Dovecot indexes with Thunderbird/kmail

2011-09-20 Thread Anton Aylward
rd on my laptop and KMail2 on my desktop. Dovecot indexes. GOOD! The trouble is that the mail readers want their own indexes :-( I wish that Thunderbird would NOT index mail on my laptop, but it does. I wish Kmail2 would not use nepomuk/akonadi to index the mail but it does. Why can't

Re: [Dovecot] Dovecot indexes

2011-07-11 Thread William Blunn
On 08/07/2011 11:35, Mike Prispan wrote: could someone answer my following questions about dovecot indexes? - If I delete dovecot indexes, it recreates them without any problem, right? AFAIK, for mbox and Maildir: True, for sdbox and mdbox: False. - If dovecot recreates indexes, it does

Re: [Dovecot] Dovecot indexes

2011-07-11 Thread Willie Gillespie
On 07/08/2011 04:35 AM, Mike Prispan wrote: Hi, could someone answer my following questions about dovecot indexes? - If I delete dovecot indexes, it recreates them without any problem, right? I believe this depends. Maildir and mbox I don't think care. However, dbox and mdbox do and y

[Dovecot] Dovecot indexes

2011-07-08 Thread Mike Prispan
Hi, could someone answer my following questions about dovecot indexes? - If I delete dovecot indexes, it recreates them without any problem, right? - If dovecot recreates indexes, it does not affect users (they don't have to download all emails again, seen flag is not lost etc.) or is ther

Re: [Dovecot] Indexes.

2010-12-03 Thread Robert Schetterer
Am 03.12.2010 12:14, schrieb Andre Nathan: > On Thu, 2010-12-02 at 13:40 +0100, Robert Schetterer wrote: >> hm , i have no problems with ocfs2 (1.4.3-1: amd64 ) on drbd ubuntu > lucid >> using dovecot vers 2 recommended settings for cluster file systems >> i have my index files in the maildir dir

Re: [Dovecot] Indexes.

2010-12-03 Thread Andre Nathan
On Thu, 2010-12-02 at 13:40 +0100, Robert Schetterer wrote: > hm , i have no problems with ocfs2 (1.4.3-1: amd64 ) on drbd ubuntu lucid > using dovecot vers 2 recommended settings for cluster file systems > i have my index files in the maildir dir Robert, are you running an active-active setup wi

Re: [Dovecot] Indexes.

2010-12-02 Thread Noel Butler
On Thu, 2010-12-02 at 12:41 -0200, Henrique Fernandes wrote: > > No, i don't have a list where i can ask! =/ > https://www.redhat.com/mailman/listinfo/redhat-list is the more "general" list, its low traffic so you wont be inconvenienced by subscribing . or maybe more specific... https://www.

Re: [Dovecot] Indexes.

2010-12-02 Thread Henrique Fernandes
Did you see the IO wait in the picture i send ? We did not use GFS cause we need an fencing hardware, they don't garante data without an fencing harware... Anyway, we change to storage so we now are able to give a biger quota. Before use to be 200 mb and pretty much alluser uses pop. We have 900

Re: [Dovecot] Indexes.

2010-12-02 Thread Robert Schetterer
Am 02.12.2010 14:53, schrieb Henrique Fernandes: > I have abou 9000 clients. many clients > > 500 GB of storage used small store anyway you shouldnt run into problems with that > > About the mail option at ocfs2 store creating, i guess the other guy > that format the storage system did not use

Re: [Dovecot] Indexes.

2010-12-02 Thread Robert Schetterer
Am 02.12.2010 14:10, schrieb Henrique Fernandes: > With recomendation settings do you have ? http://wiki2.dovecot.org/MailLocation/SharedDisk and a few more optimizes about maildir > > how many clients ? i started the server not long ago so they are less yet ( about 100 maildirs ) but i have my

Re: [Dovecot] Indexes.

2010-12-02 Thread Henrique Fernandes
With recomendation settings do you have ? how many clients ? sorry, i did not say i use dovecot 2.0.6 []'sf.rique On Thu, Dec 2, 2010 at 10:40 AM, Robert Schetterer wrote: > Am 02.12.2010 13:13, schrieb Henrique Fernandes: > > Hello people! > > > > I have huge problems with IO wait becase dov

Re: [Dovecot] Indexes.

2010-12-02 Thread Robert Schetterer
Am 02.12.2010 13:13, schrieb Henrique Fernandes: > Hello people! > > I have huge problems with IO wait becase dovecot configured to use maildir > is under OCFS2 1.4. Now i have an question to OCFS2 each disk action is > really heavy becaue it has no index. > > Now i am thinking in what can be do

[Dovecot] Indexes.

2010-12-02 Thread Henrique Fernandes
Hello people! I have huge problems with IO wait becase dovecot configured to use maildir is under OCFS2 1.4. Now i have an question to OCFS2 each disk action is really heavy becaue it has no index. Now i am thinking in what can be done to heltp my system to use less disk. Looking for index and

Re: [Dovecot] Indexes recovery failed

2008-11-24 Thread Timo Sirainen
On Nov 24, 2008, at 1:00 PM, Daniel Watts wrote: Perhaps dovecot could try the fix but if it still fails just go and delete the indexes itself? It's not really possible to delete indexes automatically because of a crash. May I ask why? This is bascially what we do manually if we encounter

Re: [Dovecot] Indexes recovery failed

2008-11-24 Thread Daniel Watts
Timo, If it happens again, please make a copy of the files before deleting. It's a lot easier to debug these bugs if I can see the dovecot.index and dovecot.index.log contents. I will do - have asked my sysadmin to make backups the next time it happens. Perhaps dovecot could try the fix but

Re: [Dovecot] Indexes recovery failed

2008-11-24 Thread Timo Sirainen
On Nov 24, 2008, at 11:14 AM, Daniel Watts wrote: Nov 19 17:11:32 mink dovecot: Panic: IMAP([EMAIL PROTECTED]): file mail-transaction-log.c: line 341 (mail_transaction_log_set_mailbox_sync_pos): assertion failed: (file_offset >= log->head->saved_tail_offset) I'll see if I can get this fix

[Dovecot] Indexes recovery failed

2008-11-24 Thread Daniel Watts
Hi Timo, Was getting the following error repeatedly in my mail client (squirremail) "error: connection dropped by IMAP server" Looked at the logs for this user and found the following: Nov 19 17:11:32 mink dovecot: IMAP([EMAIL PROTECTED]): broken sync positions in index file /virtual/store2/

Re: [Dovecot] Indexes

2008-01-13 Thread Daniel L. Miller
Timo Sirainen wrote: On Wed, 2008-01-02 at 09:55 -0800, Daniel L. Miller wrote: Timo Sirainen wrote: On Mon, 2007-12-31 at 10:54 -0800, Daniel L. Miller wrote: When something "bad" happens to the indexes, my e-mail client (Thunderbird) reports an "unable to succeed" error on

Re: [Dovecot] Indexes

2008-01-10 Thread Timo Sirainen
On Wed, 2008-01-02 at 09:55 -0800, Daniel L. Miller wrote: > Timo Sirainen wrote: > > On Mon, 2007-12-31 at 10:54 -0800, Daniel L. Miller wrote: > > > >> When something "bad" happens to the indexes, my e-mail client > >> (Thunderbird) reports an "unable to succeed" error on opening a > >> mail

Re: [Dovecot] Indexes

2008-01-02 Thread Daniel L. Miller
Timo Sirainen wrote: On Mon, 2007-12-31 at 10:54 -0800, Daniel L. Miller wrote: When something "bad" happens to the indexes, my e-mail client (Thunderbird) reports an "unable to succeed" error on opening a mailbox. Leaving that mailbox and coming back works fine. Is this expected behaviou

Re: [Dovecot] Indexes

2008-01-01 Thread Timo Sirainen
On Mon, 2007-12-31 at 10:54 -0800, Daniel L. Miller wrote: > When something "bad" happens to the indexes, my e-mail client > (Thunderbird) reports an "unable to succeed" error on opening a > mailbox. Leaving that mailbox and coming back works fine. Is this > expected behaviour? It's expected,

Re: [Dovecot] Indexes

2007-12-31 Thread Daniel L. Miller
Scott Silva wrote: on 12/31/2007 10:54 AM Daniel L. Miller spake the following: When something "bad" happens to the indexes, my e-mail client (Thunderbird) reports an "unable to succeed" error on opening a mailbox. Leaving that mailbox and coming back works fine. Is this expected behaviour?

Re: [Dovecot] Indexes

2007-12-31 Thread Scott Silva
on 12/31/2007 10:54 AM Daniel L. Miller spake the following: When something "bad" happens to the indexes, my e-mail client (Thunderbird) reports an "unable to succeed" error on opening a mailbox. Leaving that mailbox and coming back works fine. Is this expected behaviour? You need to at lea

[Dovecot] Indexes

2007-12-31 Thread Daniel L. Miller
To be more specific: Alert The current command did not succeed. The mail server responded: Internal error occurred. Refer to server log for more information. [timestamp] -- Daniel

[Dovecot] Indexes

2007-12-31 Thread Daniel L. Miller
When something "bad" happens to the indexes, my e-mail client (Thunderbird) reports an "unable to succeed" error on opening a mailbox. Leaving that mailbox and coming back works fine. Is this expected behaviour? -- Daniel

Re: [Dovecot] Quick question on multiple access to dovecot indexes

2007-05-26 Thread Adam McDougall
and it > seems like dovecot doesn't like multiple access to the dovecot indexes for the > one user since I currently have them stored in a nfs home directory. Is this > a bad thing? Must I keep a seperate index location per server? So you're using NFS? Have you rea

Re: [Dovecot] Quick question on multiple access to dovecot indexes

2007-05-26 Thread Timo Sirainen
On Fri, 2007-05-25 at 11:28 -0400, Adam McDougall wrote: > I have up to 4 servers that will run dovecot behind a load balancer, which > means > the same user might be accessing the same mailbox from multiple servers, and > it > seems like dovecot doesn't like multiple a

[Dovecot] Quick question on multiple access to dovecot indexes

2007-05-25 Thread Adam McDougall
I have up to 4 servers that will run dovecot behind a load balancer, which means the same user might be accessing the same mailbox from multiple servers, and it seems like dovecot doesn't like multiple access to the dovecot indexes for the one user since I currently have them stored in