Re: Adding archiving to an existing Cyrus installation

2017-11-09 Thread Bron Gondwana
On Fri, 10 Nov 2017, at 00:02, Nic Bernstein wrote: > Bron, > Thanks for the response. Your solution has pointed us towards the > proper approach. We are using ZFS, so would be performing ZFS > send/receive replication rather than "mv", to move the filesystems. > Our typical approach for this

Re: Adding archiving to an existing Cyrus installation

2017-11-09 Thread Nic Bernstein
Bron, Thanks for the response.  Your solution has pointed us towards the proper approach.  We are using ZFS, so would be performing ZFS send/receive replication rather than "mv", to move the filesystems. Our typical approach for this sort of thing, then, would be: * Create a filesystem snaps

Re: Adding archiving to an existing Cyrus installation

2017-11-04 Thread Bron Gondwana
Hi Nic, Sorry I didn't get back to answering you on this the other day! So... this one is kinda tricky, because everything is going to be on "spool", but here's how I would do it. Before: /mnt/smalldisk/conf -> meta files only /mnt/bigdisk/spool -> all email right now Stage 1: splitting: /mnt/

Re: Adding archiving to an existing Cyrus installation

2017-11-04 Thread Nic Bernstein
Thanks much to you  both for your comments and suggestions.  We had already considered creating a temporary "staging" partition and shuffling mailboxes around, as Michael discussed, but have the same reservations about it.  Since we're dealing with nearly 6TB of data, most of it old, this schem

Re: Adding archiving to an existing Cyrus installation

2017-11-03 Thread Michael Menge
Hi, Quoting Reinaldo Gil Lima de Carvalho : I think that singleinstancestore (message hard links) will not survive when moving from one partition to the other and storage total size will increase significantly. thanks for the hint. This was not a problem while migration to the meta-data pa

Re: Adding archiving to an existing Cyrus installation

2017-11-03 Thread Reinaldo Gil Lima de Carvalho
I think that singleinstancestore (message hard links) will not survive when moving from one partition to the other and storage total size will increase significantly. Reinaldo Gil Lima de Carvalho 2017-11-03 12:22 GMT-03:00 Michael Menge : > Hi Nic, > > Quoting Nic Bernstein : > > Friends, >> I

Re: Adding archiving to an existing Cyrus installation

2017-11-03 Thread Michael Menge
Hi Nic, Quoting Nic Bernstein : Friends, I have a client with Cyrus 2.5.10 installed.  Last year we migrated their old 2.3.18 system to 2.5.10, with an eye towards an eventual move to 3.0.x.  Based on Bron's most excellent email of last year, ([Subject: Cyrus database and file usage data]

Adding archiving to an existing Cyrus installation

2017-10-30 Thread Nic Bernstein
Friends, I have a client with Cyrus 2.5.10 installed.  Last year we migrated their old 2.3.18 system to 2.5.10, with an eye towards an eventual move to 3.0.x.  Based on Bron's most excellent email of last year, ([Subject: Cyrus database and file usage data] from Cyrus Devel of 8 January 2016)

Re: Archiving

2016-05-11 Thread Roberto Bartali via Info-cyrus
chado via Info-cyrus ha scritto: Hello, AFAIK, the one with potential to scale is https://www.enkive.org Regards. André Felipe Paul Bronson via Info-cyrus wrote .. Any good open source archiving software out there? Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info:

Re: Archiving

2016-05-10 Thread Andre Felipe Machado via Info-cyrus
Hello, AFAIK, the one with potential to scale is https://www.enkive.org Regards. Andr� Felipe Paul Bronson via Info-cyrus wrote .. Any good open source archiving software out there? Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu

Archiving

2016-04-09 Thread Paul Bronson via Info-cyrus
Any good open source archiving software out there? Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pipermail/info-cyrus/ To Unsubscribe: https://lists.andrew.cmu.edu/mailman/listinfo/info-cyrus

Re: Archiving old email?

2015-12-28 Thread Bron Gondwana via Info-cyrus
On Mon, Dec 28, 2015, at 02:28, Patrick Goetz via Info-cyrus wrote: > On 12/26/2015 04:44 PM, Bron Gondwana via Info-cyrus wrote: > > > > Each mailbox can have its storage split between two drives - one that's > > high speed with recent mail, and slower speed drives for bulk storage. > > > > At Fas

Re: Archiving old email?

2015-12-27 Thread Patrick Goetz via Info-cyrus
On 12/26/2015 04:44 PM, Bron Gondwana via Info-cyrus wrote: Each mailbox can have its storage split between two drives - one that's high speed with recent mail, and slower speed drives for bulk storage. At FastMail, we store the current week's email on SSDs in RAID1, and the remainder (almost a

Re: Archiving old email?

2015-12-26 Thread Bron Gondwana via Info-cyrus
l mail > caches as part of a live mail system. I find that the probability of > needing to look at mail more than 5 years old is roughly 0%/year. > > I was going to ask if anyone had any ideas about archiving old mail, but > then noticed that cyrus 3.0 is going to suppor

Archiving old email?

2015-12-26 Thread Patrick Goetz via Info-cyrus
ng to look at mail more than 5 years old is roughly 0%/year. I was going to ask if anyone had any ideas about archiving old mail, but then noticed that cyrus 3.0 is going to support some kind of archiving system: Archive support has arrived! Requires addition of an archive partition. (Se

Re: mail archiving -- large mail stores [mailpiler]

2014-02-15 Thread Adam Tauno Williams
ng; but I'd just have Postfix shove a copy of every passing message into the service. Not sure that Cyrus would play a role in archiving. I have archived to Cyrus in the past but the mailboxes become truly enormous rather quickly when accumulating all mail. And Cyrus's indexing services

mail archiving -- large mail stores

2014-02-04 Thread mayak
hi all, i just ran across this project: http://www.mailpiler.org is there an argument to do that, or just create an archive user in cyrus that has a multi-multi gigabyte mail drop? many thanks m Cyrus Home Page: http://www.cyrusimap.org/ List Archives/Info: http://lists.andrew.cmu.edu/pip

Re: Ever growing mailboxes and archiving

2011-04-20 Thread Pascal Gienger
Vincent Fox wrote: > On 4/20/2011 12:50 AM, Rudy Gevaert wrote: >> >> Hi Vincent, >> >> How do you make the snapshot consistent (netbackup+vmware snapshot)? >> >> Do you stop cyrus? > I'll have to ask our backup admin if you want technical specifics > and guarantees, but my understanding was that

Re: Ever growing mailboxes and archiving

2011-04-20 Thread Vincent Fox
On 4/20/2011 12:50 AM, Rudy Gevaert wrote: > > Hi Vincent, > > How do you make the snapshot consistent (netbackup+vmware snapshot)? > > Do you stop cyrus? I'll have to ask our backup admin if you want technical specifics and guarantees, but my understanding was that the process included an atomic s

Re: Ever growing mailboxes and archiving

2011-04-20 Thread Rudy Gevaert
On 04/18/2011 05:19 PM, Vincent Fox wrote: > I've recently started working with netbackup7 ability to backup > the VMware image This allows the backup of a large SAN LUN > to take place on the head node. Currently using it on our Sympa > list-server node which has same problem as Cyrus, many sm

Re: Ever growing mailboxes and archiving

2011-04-19 Thread Bron Gondwana
On Tue, Apr 19, 2011 at 11:03:09AM +0200, Paolo Cravero wrote: > On 18/04/2011 19.41, Bron Gondwana wrote: > > > You probably want to add yourself to the CC list on: > > > > http://bugzilla.cyrusimap.org/show_bug.cgi?id=3384 > > > > Where we're discussing precisely how to implement something like

Re: Ever growing mailboxes and archiving

2011-04-19 Thread Paolo Cravero
On 18/04/2011 17.19, Vincent Fox wrote: > What web-based client? Why would you expect it to die? It is Open Xchange. Some users do not organize messages in folders, just leave everything in the INBOX. So, depending on the (web)client implementation, such a huge number of items can be a perform

Re: Ever growing mailboxes and archiving

2011-04-19 Thread Paolo Cravero
On 18/04/2011 19.41, Bron Gondwana wrote: > You probably want to add yourself to the CC list on: > > http://bugzilla.cyrusimap.org/show_bug.cgi?id=3384 > > Where we're discussing precisely how to implement something like this. Well, Bron, you ended the discussion pretty fast with an elegant solu

Re: Ever growing mailboxes and archiving

2011-04-18 Thread Bron Gondwana
On Mon, Apr 18, 2011 at 11:11:23AM -0500, Jeff wrote: > On Mon, Apr 18, 2011 at 4:58 AM, Paolo Cravero wrote: > > Good morning. > > I am looking for a server-side archiving solution to be applied to a > > relatively large cyrus installation. > > > > The customer e

Re: Ever growing mailboxes and archiving

2011-04-18 Thread Jeff
On Mon, Apr 18, 2011 at 4:58 AM, Paolo Cravero wrote: > Good morning. > I am looking for a server-side archiving solution to be applied to a > relatively large cyrus installation. > > The customer eats up ca 4 TB of data over about 4000 accounts. No quota. > > The competi

Re: Ever growing mailboxes and archiving

2011-04-18 Thread Vincent Fox
On 4/18/2011 2:58 AM, Paolo Cravero wrote: > The competition is: who will die first? The web-based client or our > SAN+backup system? :-) What web-based client? Why would you expect it to die? As to SAN, this maybe related. We have found netbackup on large Cyrus mail-store volumes are a prob

Ever growing mailboxes and archiving

2011-04-18 Thread Paolo Cravero
Good morning. I am looking for a server-side archiving solution to be applied to a relatively large cyrus installation. The customer eats up ca 4 TB of data over about 4000 accounts. No quota. The competition is: who will die first? The web-based client or our SAN+backup system? :-) I am

Re: Archiving emails with Cyrus

2008-11-24 Thread Nik Conwell
On Nov 24, 2008, at 10:36 AM, John Madden wrote: > On Monday 24 November 2008 08:56:35 am Alexandros Gougousoudis wrote: >> There must be a process in cyrus, which copies these emails into a >> (zip)-file and/or into a database, to have them somehow accessable. >> Cyrus must do this with the admi

Re: Archiving emails with Cyrus

2008-11-24 Thread John Madden
On Monday 24 November 2008 08:56:35 am Alexandros Gougousoudis wrote: > There must be a process in cyrus, which copies these emails into a > (zip)-file and/or into a database, to have them somehow accessable. > Cyrus must do this with the administrator account, because the imap > credentials of all

Re: Archiving emails with Cyrus

2008-11-24 Thread Adam Tauno Williams
> Adam Tauno Williams schrieb: > > Are you looking to archive message for data-retention or because you > > need to recover capacity? > I'll need both, sooner or later. For the moment it'll be enough to gain > some more capacity. Thanks for your answer. > >> Thunderbird offers the possibility to

Re: Archiving emails with Cyrus

2008-11-24 Thread Alexandros Gougousoudis
Hi Adam, Adam Tauno Williams schrieb: > Are you looking to archive message for data-retention or because you > need to recover capacity? > > I'll need both, sooner or later. For the moment it'll be enough to gain some more capacity. Thanks for your answer. >> Thunderbird offers the possibil

Re: Archiving emails with Cyrus

2008-11-24 Thread Adam Tauno Williams
> we use Cyrus 2.2 on a Debian Etch Linux with Sasl and Thunderbird as a > IMAP mailclient for our users. The problem is, that the mailboxes become > very big, so I look for an automatic archiving software, which takes the > mails out of the mailbox into a file and a searchable databa

Archiving emails with Cyrus

2008-11-24 Thread Alexandros Gougousoudis
Hi, we use Cyrus 2.2 on a Debian Etch Linux with Sasl and Thunderbird as a IMAP mailclient for our users. The problem is, that the mailboxes become very big, so I look for an automatic archiving software, which takes the mails out of the mailbox into a file and a searchable database. Thunderbird

server side archiving & grooming of mail stores

2008-09-24 Thread lartc
hi all, i'm looking for direction on how to move messages of a certain age from one mailbox to an archive mailbox. are there server side utilities to do this? many thanks charles Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archive

Archiving Cyrus Mail (slightly OT)

2008-05-14 Thread Forrest Aldrich
I've got several thousand emails from the early 90's that I have, packed into a Cyrus Mail system, which I backup regularly. I had thought it might be nifty to utilize one of the Email archiving solutions out there (Zoe, DevonThink, DBMail, etc) to allow me to do better searches,

Re: archiving emails

2007-06-21 Thread Sandy Drobic
Diego M. Vadell wrote: > Hi, >I did that with postfix, making a virtual alias with pcre. From the top of > my head, it was something like this: > > @domain.com ($1)@domain.com,($1)@archive.domain.com > > This syntax is surely wrong, but the idea is to use pcre to match the > userna

Re: archiving emails

2007-06-21 Thread Diego M. Vadell
Hi, I did that with postfix, making a virtual alias with pcre. From the top of my head, it was something like this: @domain.com ($1)@domain.com,($1)@archive.domain.com This syntax is surely wrong, but the idea is to use pcre to match the username part and put it in the virtual alias

Re: archiving emails

2007-06-21 Thread Boris Andratzek
Rudy Gevaert wrote: > Mike Zupan wrote: >> I am looking to archive emails hopefully for all sent/received emails. I >> am using postfix 2.3 as a MTA and cyrus 2.3 >> >> I am looking to do something like >> >> [EMAIL PROTECTED] while it goes to that address >> in cyrus v

Re: archiving emails

2007-06-20 Thread Rudy Gevaert
Mike Zupan wrote: > I am looking to archive emails hopefully for all sent/received emails. I > am using postfix 2.3 as a MTA and cyrus 2.3 > > I am looking to do something like > > [EMAIL PROTECTED] while it goes to that address > in cyrus via postfix it also goes to

archiving emails

2007-06-20 Thread Mike Zupan
I am looking to archive emails hopefully for all sent/received emails. I am using postfix 2.3 as a MTA and cyrus 2.3 I am looking to do something like [EMAIL PROTECTED] while it goes to that address in cyrus via postfix it also goes to [EMAIL PROTECTED] Can this be done in cyrus via lmtpd or su

Mail Archiving .. is there any ready tool

2006-02-17 Thread Ramprasad
Is there any ready tool I can use with cyrus for mail archiving. I would like to have all mails archived into a searchable , indexed repository and can be used by end user if possible Thanks Ram Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http

Re: Auto-Archiving, and Unread Threshold Alert

2005-05-11 Thread Marco Colombo
On Wed, 2005-05-11 at 14:38 +0200, Marco Colombo wrote: [...] > for user in users: > mesgs = check_one(user) > if mesgs: > print "user %s has %d messages." % (user, len(check_one(user))) ^^^ Well, make the last lin

Re: Auto-Archiving, and Unread Threshold Alert

2005-05-11 Thread Marco Colombo
On Tue, 2005-05-10 at 22:41 +0800, Senandung Mendonan wrote: > Hi, > > I need to do the following in Cyrus IMAP 2.2.12:- > > 1. Daily auto-archiving > - On 12am each day, an IMAP/Cyrus agent runs through each user's > mailbox, and sort out all existing mails into tod

Re: Auto-Archiving, and Unread Threshold Alert

2005-05-10 Thread Ken Murchison
Senandung Mendonan wrote: On 5/10/05, Michael King <[EMAIL PROTECTED]> wrote: My guess would be the Cyrus::IMAP Perl module as a place to start. Otherwise, I don't know of any way to automate this using the cyrus distribution. Thanks for the pointer, though I'm not really sure how to implement usi

Re: Auto-Archiving, and Unread Threshold Alert

2005-05-10 Thread Senandung Mendonan
EMAIL PROTECTED] On Behalf Of Senandung Mendonan > > Sent: Tuesday, May 10, 2005 9:41 AM > > To: info-cyrus@lists.andrew.cmu.edu > > Subject: Auto-Archiving, and Unread Threshold Alert > > > > Hi, > > > > I need to do the following in Cyrus IMAP 2.2.12:- > &

RE: Auto-Archiving, and Unread Threshold Alert

2005-05-10 Thread Michael King
L PROTECTED] [mailto:owner-info- > [EMAIL PROTECTED] On Behalf Of Senandung Mendonan > Sent: Tuesday, May 10, 2005 9:41 AM > To: info-cyrus@lists.andrew.cmu.edu > Subject: Auto-Archiving, and Unread Threshold Alert > > Hi, > > I need to do the following in Cyrus IMAP 2.2.12:-

Auto-Archiving, and Unread Threshold Alert

2005-05-10 Thread Senandung Mendonan
Hi, I need to do the following in Cyrus IMAP 2.2.12:- 1. Daily auto-archiving - On 12am each day, an IMAP/Cyrus agent runs through each user's mailbox, and sort out all existing mails into today, yesterday, last week, and last month folders. 2. Unread threshold alerts - Every 5 minutes, an

Exporting mail from the cyrus spool for archiving

2005-04-26 Thread J.P. Trosclair
ments are still available. I've got the flushing part figured out, it's just exporting the mail for archiving to a good format based on the criteria above that I'm not sure about. Any suggestions would be appreciated.   Thanks in advance,J.P.      

Re: rollback to archiving checkpoint? Need help!!

2005-04-04 Thread William K. Hardeman
--On Tuesday, April 05, 2005 5:38 AM +0200 Alex Meier <[EMAIL PROTECTED]> wrote: Could there be a way to extract to extract the mail bodies from the __db.XXX files (for example by forcing the system into an inconsistent state so that cyrus uses its binary checkpoint and archiving fi

Re: rollback to archiving checkpoint? Need help!!

2005-04-04 Thread Michael Loftis
e only way you'll recover mail is with proper backups *or* forensic recovery on the drive/filesystem itself. Could there be a way to extract to extract the mail bodies from the __db.XXX files (for example by forcing the system into an inconsistent state so that cyrus uses its binary checkpoin

Re: rollback to archiving checkpoint? Need help!!

2005-04-04 Thread Alex Meier
e by forcing the system into an inconsistent state so that cyrus uses its binary checkpoint and archiving files to recover) - or are the mail bodies _really_ just stored in the individual files (which have been definitely deleted) as Jules Agee pointed out? What do you think - imagine you are allowe

Re: rollback to archiving checkpoint? Need help!!

2005-04-04 Thread Jules Agee
Alex Meier wrote: Hi, list! is there a possibility to rollback the cyrus databases to a recent checkpoint? As I have understood the mechanisms, there is a archiving checkpoint process which stores the changes to the mail database to a log. How does this work? Is it possible to rollback a few hours

Re: rollback to archiving checkpoint? Need help!!

2005-04-04 Thread Michael Loftis
--On Monday, April 04, 2005 23:22 +0200 Alex Meier <[EMAIL PROTECTED]> wrote: Hi, list! is there a possibility to rollback the cyrus databases to a recent checkpoint? As I have understood the mechanisms, there is a archiving checkpoint process which stores the changes to the mail databas

Re: rollback to archiving checkpoint? Need help!!

2005-04-04 Thread Michael Loftis
I should also add the logs are not for rollback purposes, they're for consistent recovery of the system to a known working state, IE to recover from unclean shutdowns. --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.

rollback to archiving checkpoint? Need help!!

2005-04-04 Thread Alex Meier
Hi, list! is there a possibility to rollback the cyrus databases to a recent checkpoint? As I have understood the mechanisms, there is a archiving checkpoint process which stores the changes to the mail database to a log. How does this work? Is it possible to rollback a few hours? It'

Re: Archiving mailbox

2004-11-03 Thread Jason DiCioccio
I wrote the following ruby script a while back that should do what you want to do. It rotates based on time, and can be run from a cron job each night or something. It reads from a file called 'mblist' which is in the following format: Mailbox:Days e.g. Shared Folders.list.bugtraq:30 This wou

Archiving mailbox

2004-11-03 Thread Johan Barelds
Hi all, Just started with Cyrus and it works fine. I have a mailbox for collecting spam. I would like to archive mail after a certain period or size. Does someone know if there are any utils to do this job? Thanks already! -- Kind Regards / Met vriendelijke groet, Johan Barelds, Good-IT! Strijp

archiving listserves

2002-03-01 Thread Lance Hoffmeyer
I am looking for some suggestions on how people archive mailing lists. Every month I change Listserv.info-cyrus to Listserv.info-cyrus.2002-February When I used mh I used to convert to mbox format and then use hypermail to archive in web format so it could be viewed and searched in a web browser

Re: Re[2]: Archiving mailboxes

2001-06-15 Thread Jen Wu
ted in (configurable auto archiving of folders). On another note, the only MUA I've found that supports the IMAP servers my ISPs use and supports filtering into IMAP folders is Netscape. I don't think Netscape is a great MUA, but it's the only the that does everything. Mulberry looke

Re[2]: Archiving mailboxes

2001-06-15 Thread Kevin J. Menard, Jr.
Hey Jen-Mei, Sunday, May 27, 2001, 11:10:07 PM, you wrote: JMW> That doesn't really help, unfortunately. The idea is that on a JMW> particular client, someone might want to archive all messages older JMW> than 30 days to an identical folder (same place in tree, etc.) JMW> locally. I don't kno

Re: Archiving mailboxes

2001-05-27 Thread Jen-Mei Wu
That doesn't really help, unfortunately. The idea is that on a particular client, someone might want to archive all messages older than 30 days to an identical folder (same place in tree, etc.) locally. I don't know of any MUA that does this, but if someone can think of one, I'd love to hear it!

Re: Archiving mailboxes

2001-05-26 Thread Nuno Silva
...and on MUAs that support filters (mozilla, outlook, etc) you can add a rule to copy incoming messages from the mailling list XYZ to local folder XPTO. This should do the trick :) Hope it helps, Nuno Silva Cillian Sharkey wrote: > Jen-Mei Wu <[EMAIL PROTECTED]> wrote: > >>One major user c

Re: Archiving mailboxes

2001-05-25 Thread Cillian Sharkey
Jen-Mei Wu <[EMAIL PROTECTED]> wrote: > One major user complaint about quotas is that there's no easy way for > them to archive mail. For example, if they have 20 folders on their > server (some of them being mailing lists) and they want these archived > to their client mail program, they have to

Archiving mailboxes

2001-05-23 Thread Jen-Mei Wu
I have a concern about users filling up their mailboxes. The problem is that when people get used to being able to access all their e-mail on the server, very few things get copied down. Quotas help, but they don't do the trick completely. One major user complaint about quotas is that there's n