Re: cyrus perdtion , connections not dying

2008-04-04 Thread Robert Banz
Why are you using perdition, when you could be using Cyrus' "murder" clustering which will work to the same end, with added bonuses of being able to share folders between users on both servers, easier administration, etc. -rob On Apr 4, 2008, at 9:51 AM, Andrew Morgan wrote: > On Fri, 4

Re: Cyrus infrastructure performance less than expected

2008-04-28 Thread Robert Banz
> > I don't have any system log that complains about something and the > only > Cyrus message I got is a DB4 warning about lockers. I think the DB4 in > question is the TLS sessions cache DB and in my case the number of > lockers can be as high as 8 000... Dump Berkeley DB with a quickness, and

Re: choosing a file system

2008-12-30 Thread Robert Banz
On Dec 30, 2008, at 8:49 AM, LALOT Dominique wrote: > Hello, > > We are using cyrus-imap for a long time. Our architecture is a SAN > from EMC and thanks to our "DELL support" we are obliged to install > redhat. The only option we have is to use ext3fs on rather old > kernels. We have 4000

Re: choosing a file system

2008-12-30 Thread Robert Banz
On Dec 30, 2008, at 9:06 AM, Pascal Gienger wrote: > LALOT Dominique wrote: > >> zfs (but we should switch to solaris or freebsd and throw away our >> costly >> SAN) > > Why that? SAN volumes are running very fine with Solaris 10 hosts > (SPARC > and x86). You have extended multipathing (sym

Re: choosing a file system

2009-01-08 Thread Robert Banz
On Jan 8, 2009, at 4:46 PM, Bron Gondwana wrote: > On Thu, Jan 08, 2009 at 08:01:04AM -0800, Vincent Fox wrote: >> (Summary of filesystem discussion) >> >> You left out ZFS. >> >> Sometimes Linux admins remind me of Windows admins. >> >> I have adminned a half-dozen UNIX variants professionally b

Re: choosing a file system

2009-01-08 Thread Robert Banz
> > There's a significant upfront cost to learning a whole new system > for one killer feature, especially if it comes along with signifiant > regressions in lots of other features (like a non-sucky userland > out of the box). ... The "non-sucky" userland comment is simply a matter of preference,

Re: Implement Cyrus IMAPD in High Load Enviromment

2009-09-29 Thread Robert Banz
With my ever-growing experience with these things, I'm tending to think that application-level HA solutions are a much more robust way of dealing with the potential failure modes of hardware or software. While this doesn't mean you shouldn't buy reasonably robust hardware (not the cheapest

Re: Cyrus Aggregator

2010-01-11 Thread Robert Banz
Wow, did I miss something? It's not called "murder" anymore? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: OT: Enhanced IMAP protocol

2010-01-14 Thread Robert Banz
An extension or protocol enhancement is only good as the client implementations are -- and we know how successful that's been for other optional capabilities -- such as ACL management. On Jan 14, 2010, at 9:42 AM, kael wrote: > On 01/06/2010 08:47 AM, Rob Banz wrote: >> I would argue that it

Re: Nginx configuration for imap

2010-03-17 Thread Robert Banz
memcached would certainly be fast, but what sort of authentication rate are you talking about here. My bet is that you've got other bits of system, such as the authentication validation with the target IMAP server, that will be more of a dominant term when it comes to the performance of your system

Re: Nginx configuration for imap

2010-03-18 Thread Robert Banz
On Thu, Mar 18, 2010 at 3:49 AM, ram wrote: > > On Wed, 2010-03-17 at 22:45 -0700, Robert Banz wrote: > > > > > > memcached would certainly be fast, but what sort of authentication > > rate are you talking about here. My bet is that you've got other bits > &

Re: tool for migration to cyrus ?

2006-07-17 Thread Robert Banz
I found the "mailutil" program, which is distributed in the UW imapd distribution, particularly well suited for this. It allows you to transfer the contents of one c-client supported mail hierarchy to another, such as a local mail store to a cyrus-hosted IMAP space. The 'transfer' funct

Re: Cyrus::SIEVE::managesieve documentation?

2006-07-19 Thread Robert Banz
On Jul 19, 2006, at 11:23, Chris St. Pierre wrote: Ditto here. I tried emailing the guy listed in the Cyrus::SIEVE::managesieve man page, but the address no longer appears to be active. As of now, my options appear to be: 1. Learn Ruby, and write the first (and probably last) Ruby script at

Re: hardware recommendations for MURDER?

2006-07-20 Thread Robert Banz
My personal leaning is towards Sun hardware with RHEL4 but I wanted to get some fresh opinions. Thought this topic worth a rehash since 2004 data is useful but not current enough IMO. (sun just announce a 3u dual proc 16G ram box with 24TB of disk space for ~$70k for example) I admit a f

Re: Performance and cheap storage

2006-07-23 Thread Robert Banz
I'm not a postfix expert, however, if it's like any other MTA it's "queue" directory is usually what runs pretty hot. The first thing I would do is isolate the MTA-related stuff to a very fast piece disk that is *not* the same storage that houses you Cyrus mailboxes & databases. The se

Re: Idea for filtered access to cyrus

2006-08-02 Thread Robert Banz
Cyrus gets this and slices off the +filter= and places the value "foo" into a FILTER variable. On the mail delivery side: LMTP is changed to look for X-IMAP- FILTER headers and to store the value of the header as an IMAP flag. Assuming X-IMAP-Filter: foo then we add /filter=foo to the IMAP f

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 12:40, Elizabeth Schwartz wrote: Is anyone happily running all of the above? All of the above except NIS? Any tuning hints? I'm running Solaris 10 (06/06), cyrus 2.3.7 (Blastwave build) , sendmail 8.13.8 (ditto), mailspool on a zfs filesystem, authenticating via NIS. I'v

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 13:59, Elizabeth Schwartz wrote: >There's a bug in ZFS regarding performance problems when fsync'ing >file descriptors -- there's apparently going to be a patch coming >"real soon now" -- your options are: Thanks! Ugh, that would be bad news. Except, I think the delay is ha

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 4:46 PM, Chaskiel M Grundman wrote: --On Thursday, October 05, 2006 04:13:18 PM -0400 Elizabeth Schwartz <[EMAIL PROTECTED]> wrote: http://www.gsd.harvard.edu/users/betsys/dapptrace.timed The interesting bit seems to be here: . . -> mynewstate(0x165769, 0x4

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 10:05 PM, Kjetil Torgrim Homme wrote: On Thu, 2006-10-05 at 16:46 -0400, Chaskiel M Grundman wrote: mynewstate is taking 8s to run, and very little of the time is taken up in local subroutines. auth_unix.c:mynewstate calls getpwnam, and then iterates over all the groups us

Re: Cyrus, Solaris 10, ZFS? (and NIS?)

2006-10-05 Thread Robert Banz
On Oct 5, 2006, at 10:50 PM, Elizabeth Schwartz wrote: On 10/5/06, Igor Brezac <[EMAIL PROTECTED]> wrote: Already done. man imapd.conf :) unix_group_enable: 0 Cool :) I was looking at an older cyrus distribution that doesn't seem to have it... -rob Cyrus Home Page: http://cyrusim

Re: very slow syncing, any ideas?

2006-10-20 Thread Robert Banz
On Oct 20, 2006, at 04:09, Michael Menge wrote: Hi, i had much better performance with mailutil from UW-Imapd. It uses the IMAP-protocol like imapscyn but is not a scipt but a binary program and uses the imap APPEND command and does noe checks to see wich E-Mails are on the new server.

Re: ZFS fsync performance and cyrus (was Patches used at FastMail.FM)

2007-01-08 Thread Robert Banz
On Jan 8, 2007, at 21:08, Rob Mueller wrote: We are using 2.3.7 on Debian Sarge. We will maybe move to solaris because of the features of ZFS. Does anyone know the status of ZFS + fsync performance problems? http://www.irbs.net/internet/info-cyrus/0610/0058.html Supposedly fixed in Solaris

Re: Connection throttling POP3.

2007-05-21 Thread Robert Banz
On May 21, 2007, at 21:50, Daniel O'Connor wrote: On Tuesday 22 May 2007 05:10, Matthew Schumacher wrote: I'm getting some spammer trying to guess usernames and passwords: I use the following to protect my SSH server (well not the SSH server per se, just me reading logfiles the next day) ht

Re: Connection throttling POP3.

2007-05-22 Thread Robert Banz
On May 22, 2007, at 10:34, Philip H. O'Neill wrote: We do the same but there is an issues. One File::Tail delays polling the log for up to 30 seconds unless you tell it otherwise. So it will allow a number of attempts before reading the log. If you increase the polling you add load to the s

Re: Cyrus & ZFS performance

2007-07-04 Thread Robert Banz
On Jul 4, 2007, at 12:59 PM, Vincent Fox wrote: > Dale Ghent wrote: >> each with a zpool comprising of a mirror between two se3511s on our >> SAN... > Sun recommends against the 3511 in most literature I read, saying that > the SATA drives > are slower and not going to handle as much IOPS loading

xfer problem - unified murder

2007-07-24 Thread Robert Banz
Hey all, I'm currently testing out a two-server + mupdate master unified murder cluster. I was testing the mailbox xfer functionality -- I created a mail box (this one empty), and tried to move it between servers and got this: Jul 24 16:09:57 ms4.mail.umbc.edu imap[15165]: [ID 813612 loca

Re: rename bunch of folders [auf Viren überpr üft]

2007-08-01 Thread Robert Banz
On Aug 1, 2007, at 09:19, Hans Moser wrote: > Hans Moser schrieb: > >> If I do this outside IMAPd (i.e. by shell's mv command), I have to >> run >> reconstruct to repair mailboxes.db, right? > First I remove the Spam dir in the file system. > # rm -rf /var/imap/users/foo/Spam > > When I dump ma

Odd mailbox xfer result

2007-08-07 Thread Robert Banz
Hi, I've got a 'traditional' Cyrus cluster, 2.3.8 running on Solaris x86. Everything seems to be fine, and we're about to go "live" and in production... however... Earlier today I was testing how well transferring my rather massive personal folder hierarchy from one backend server to anot

Re: Odd mailbox xfer result

2007-08-07 Thread Robert Banz
>> >> So, anyone seen anything like this before? I did some looking around >> on bugzilla, and nothing jumped out at me. > > Look for bug 2917 `xfer copies the last message instead of sieve > scripts to the remote server'. The patch is there too. Wow, how did I miss that one? Thanks! -rob

Re: SQUAT config

2007-08-14 Thread Robert Banz
> > Last question: i'm really not sure i understand what the benefit of > having a SQUAT index is (aside from avoiding seeing "SQUAT failed to > open index file" in the log). I mean, i get that it makes searching > faster. But does this have to do with, let's say, clicking on a > mailbox > folder

Re: SQUAT config

2007-08-14 Thread Robert Banz
On Aug 14, 2007, at 9:32 PM, brian wrote: > brian wrote: >> I'd like to index my mailboxes using squatter and have a couple of >> questions. >> > > ~groan~ I had one more question. The squatter man page says: > > -s Skip mailboxes whose index file is older than their current > squat > file

Re: SQUAT config

2007-08-16 Thread Robert Banz
>> > > Yes, i see, that's to invoke it. But i'm also reading that the config > must be in imapd.conf yet i've seen no example for the syntax to do so > (nor what is required (or even suggested)). > > I'm also wondering how to have squatter run against all IMAP > mailboxes. > Do i need to specify

Re: SSL/TLS certificates with virtual domains

2007-08-23 Thread Robert Banz
> > How much configuration similarity does there have to be between the > different config files? Can I change anything except for the > tls_[*]_file directives? > > Thanks very much for the information! I think this could work for us. Make one master imapd.conf file with everything but the cert

sieve and date

2007-08-28 Thread Robert Banz
Following on to the sieve & vacation discussion -- anyone have any interest in the sieve "date" extension? Sounds like it'd be awfully nice to have, for example, being able to wrap your vacation in a date- range conditional... -rob Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus

Re: sieve and date

2007-08-29 Thread Robert Banz
Here's the extension I'm referring to: http://tools.ietf.org/wg/sieve/draft-freed-sieve-date-index-06.txt On Aug 29, 2007, at 09:38, Jan Schneider wrote: > Zitat von Robert Banz <[EMAIL PROTECTED]>: > >> >> >> Following on to the sieve & vacation

squatter problem

2007-09-05 Thread Robert Banz
Hidey ho everybody, So, one of my backend mailservers in my cyrus cluster is doing something silly: Sep 5 02:00:00 ms1.mail.umbc.edu master[29759]: [ID 392559 local6.debug] about to exec /local/cyrus/bin/squatter Sep 5 02:00:00 ms1.mail.umbc.edu squatter[29759]: [ID 621814 local6.notice]

Re: squatter problem

2007-09-05 Thread Robert Banz
On Sep 5, 2007, at 14:49, Michael D. Sofka wrote: > On Wednesday 05 September 2007 09:44:16 am Robert Banz wrote: > >> Sep 5 02:00:00 ms1.mail.umbc.edu squatter[29759]: [ID 454541 >> local6.debug] skipping mailbox user/a28/Spam >> Sep 5 02:00:00 ms1.mail.umbc.edu squ

Re: squatter problem

2007-09-05 Thread Robert Banz
> > Are you running the command line squatter as root? If so, then maybe > there's a file early in the squatter run that's root owned and causing > squatter to abort when run as the cyrus user - I'm afriad I don't know > much about squatter, but that would be my first suspicion. > Another theory

Re: Murder works wonderfully but alarms users

2007-09-10 Thread Robert Banz
Its much more productive to eliminate the complaining users and replace them with something less alarmist. On Sep 10, 2007, at 11:59, Gary Mills wrote: > We have a Cyrus murder configuration with one proxy front-end and > one storage back-end. I'm very pleased with it. However, users who > h

Re: Quick Utilities for getting into user mail file

2007-09-19 Thread Robert Banz
> > Currently, I'm modifying a pinerc file and running PC-Pine to do > this if > necessary. Are there any other tools available for this kind of > quick and > dirty mailbox manipulation? Modifying config files on a per-user > basis is > kind of a pain, and running webmail can be slow with h

Re: delete messages from INBOX.Trash INBOX.Junk

2007-09-20 Thread Robert Banz
Going this same direction... With our previous mail system, we used to chug through our users' Spam & Trash folders, and send them a weekly notification reminding them of the messages they had in these folders, and how many would be deleted in the next week. Anyone done something similar w

Re: delete messages from INBOX.Trash INBOX.Junk

2007-09-20 Thread Robert Banz
> > I have an 'expire' set from inside 'cyradm' to automatically delete > messages over a specific number of days old. I don't generate any > emails to my users telling them what nor how many will be deleted... > I just delete them nightly, or rather let cyrus do the deleting. Our users need some

Re: Cyrus 2.3.9: Errors compiling outside source directory

2007-09-23 Thread Robert Banz
I have a repository copy of the cyrus source, and build in an 'lndir'- d tree. Sadly, while building-outside-the-source tree should work fine, every once and awhile you run into gotchas like this which aren't work the time tracking down. lndir symlink trees give you almost the same functi

Re: duplicate messages

2007-09-28 Thread Robert Banz
> >> it appears that after Cyrus gets the message it gets >> duplicated. Anyone have any suggestions? > > > Sieve rules? > I always think its because the users are staring at their mail clients cross-eyed. ;) Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.

Nifty imapmagicplus usage

2007-10-03 Thread Robert Banz
So, I got an iPhone this week. Totally rocks -- even if I can't hack it. But, I was a bit frustrated by it showing *every* folder I had in its IMAP client. I mean, really, I'm not going to want to read my managers "mathematica license information" folder while I'm sportin' the iPhone tr

Re: LARGE single-system Cyrus installs?

2007-10-04 Thread Robert Banz
> > One of the things Rob Banz recently did here was to move the data/ > config/proc directory from a "real" fs to tmpfs. This reduces the > disk IO from Cyrus process creation/management. > > So the way we do stuff here is that each Cyrus backend has its own > ZFS pool. That zpool is divided up in

Re: LARGE single-system Cyrus installs?

2007-10-05 Thread Robert Banz
On Oct 5, 2007, at 10:01, John Madden wrote: >> I think that this is partly because ext3 does more aggressive read >> ahead >> (which would be a mixed blessing under heavy load), partly because >> reiserfs suffers from fragmentation. I imagine that there is >> probably a >> tipping point u