[Dovecot] Corrupted index cache file still occurs with Dovecot 1.2.9

2010-01-11 Thread Stuart Rowan

Timo Sirainen wrote, on 28/07/09 19:24:

On Tue, 2009-07-28 at 19:17 +0100, Stuart Rowan wrote:

dovecot: 2009-07-28 10:23:16 Error: IMAP(strr): Corrupted index cache file 
/home/local/strr/Maildir/dovecot.index.cache: record continues outside its 
allocated size
dovecot: 2009-07-28 10:23:56 Error: IMAP(strr): Corrupted index cache file 
/home/local/strr/Maildir/dovecot.index.cache: record continues outside its 
allocated size


These are kind of annoying. Apparently they still happens in some
conditions, but I've really no idea how to reproduce/fix them. Anyway
I'm going to simplify the code in a few months, maybe after that there
will be no more cache corruption. :)


Hi Timo,

Dovecot continues to serve us extremely well: I turned on squat based FTS 
last week and I am amazed how much snappier Thunderbird's Search is at 
finding messages now :)


The index corruption issues continues to dog us though. Attached text file 
shows this corruption (I've masked the differing user names and full paths) 
as listed by the log file produced since 06:00 this morning.


Cheers,
Stu.


tigris:~# dovecot --version ; dovecot --build-options ; perl -pe '$u = 'user'; 
s/(?<=IMAP\()(\w+)\)/$u)/;s@(?<= /home/local/)(.*?)(?=/dove)@$u/ ... @' 


Re: [Dovecot] dovecot cannot access a specific folder

2010-01-11 Thread Steffen Kaiser

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Sat, 9 Jan 2010, Spyros Tsiolis wrote:

Jan 09 11:25:01 IMAP(postmas...@webmail.domain.gr): Error: 
stat(/var/MailRoot/domains/webmail.domain.gr/postmaster/Maildir/tmp) 
failed: Permission denied (euid=501(vmail) egid=502(vmail) missing +x 
perm: /var/MailRoot)


"/var/MailRoot" is the root path/folder for XMail. An smtp/pop3 server.

Should I go ahead and chmod the folder or should I try to find a more
delicate solution to this ?


The question seems to be: What credentials uses XMail to access the Mails, 
is 501:502 correct?


You will need to allow Dovecot to cross /var/MailRoot :-)

Regards,

- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)

iQEVAwUBS0sI1b+Vh58GPL/cAQLzYgf/cBbMiylnzbnb67Fv9ayA07xk9T+qzlpl
ImO8N0qQHjwqiUiZRMsHVGQnbt07dFvsh7ImCRp4Jn6JV5HiTJpVacEr+KP4KOj3
eLuJxlRMbhMDWP/87HcBVSWsB2TOmqnyF0iE1KUZQx/qQl8ih51Dzpj+MQixhDwK
TZ4mow9EvvNksL4RuqqcHWvpqSwyphuyKUROcxumrRLGzEKxa/xuDT25gFT7ye/5
hfsECLjOzTW5yvd/2QawG4r+26xZUdd7bRFdDQtp0UNNYmuw4X+kbpaah4Y/+IiG
nul1PuCFHNnUD7hY/ZgoVDCC+nkIYGnqJTaYNaR9rIbLn2bAgpBu3g==
=RXsI
-END PGP SIGNATURE-


Re: [Dovecot] sieve 0.1.14: vacation encodes Subject twice

2010-01-11 Thread Roland Rosenfeld
On Fri, 08 Jan 2010, Stephan Bosch wrote:

>> If I understand this right, sieve should do the RFC2047 encoding
>> only if the string is non-ASCII.  But the RFC2047 encoded string is
>> already ASCII, so it should not be encoded a second time.

> Fixed:
>
> http://hg.rename-it.nl/dovecot-1.2-sieve/rev/219a6f0d6bf6

Great job, many thanks.  Works now like a charm.

Tscho

Roland

-- 
Roland Rosenfeld  -  Content Delivery  -  NED  -  Technik
NetCologne Gesellschaft für Telekommunikation mbH  -  HRB 25580, AG Köln
Am Coloneum 9   50829 Köln   Tel.: +49-221--373   Fax: +49-221--7373
Geschäftsführer: Werner Hanf, Karl-Heinz Zankel


[Dovecot] shared namespace bug?

2010-01-11 Thread Patrick Kaiser
Hi,

finally i got shared namespace up and running. 
But for example if user peter.griffin shares his inbox 
to another user, the LIST "" "*" output on telnet
looks like:

a02 LIST "" "*"
* LIST (\HasNoChildren) "/" "Trash"
* LIST (\HasNoChildren) "/" "INBOX"
* LIST (\Noselect) "/" "shared/peter.griffi"
* LIST (\HasChildren) "/" "shared/peter.griffin"
* LIST (\HasNoChildren) "/" "shared/peter.griffinINBOX"
a02 OK List completed.


To share the inbox I previously run as logged in user peter.griffin

a02 SETACL inbox peter.griffin lwxrk


If I look in thunderbird, i can see under "share" two folders:
peter.griffi and peter.griffin.  Have i made something wrong,
or is this a bug?

Hope someone can help me.


thanks, patrick


-- 
Name  : Patrick Kaiser
Email : patrick.kai...@argonius.de
Phone : +49 (178) 8452388
Website   : http://www.argonius.de
GPG Key   : http://www.argonius.de/key.pub


Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Alexander Chekalin
Oh, I finally find out the problem. If Dovecot see in the IMAP mailbox 
two message files named equally (say in cur/ and new/ dirs) it renames 
one of them into new name dispute this is the same message.


I'm not sure if this is intended behaviour. It is quite easy to see such 
situation when doing periodical rsync (SMTP put message to new/ dir, 
then rsync copy it to second server, then message on the first server 
move to cur/, and second rsync results in two files on second server).


It there any workaround?

Yours,
  Alexander Chekalin

04.01.2010 18:41, Timo Sirainen wrote:

On 4.1.2010, at 15.32, Alexander Chekalin wrote:


The problem is that files in Maildirs on First server are named like that:

1262610335.H798006P5447.first.domain.my,S=1962:2,
1262610402.H529761P5596.first.domain.my,S=2975:2,
1262610410.H787724P5657.first.domain.my,S=75691:2,
...

and the files on Second server should be named like

1262610335.H798006P5447.second.domain.my,S=1962:2,
1262610402.H529761P5596.second.domain.my,S=2975:2,
1262610410.H787724P5657.second.domain.my,S=75691:2,


No, they shouldn't. The maildir filename must be globally unique. Otherwise it 
doesn't matter what it is. Just keep them as they are.

The main problem with rsync is going to be if two servers have the same 
filename, but one has renamed its flags. So there are two identical base 
filenames but with different flags. Then Dovecot will log a warning about 
duplicate message and rename one of the files.





Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Charles Marcus
On 2010-01-11, Alexander Chekalin (acheka...@lazurit.com) wrote:
> I'm not sure if this is intended behaviour. It is quite easy to see
> such situation when doing periodical rsync (SMTP put message to new/
> dir, then rsync copy it to second server, then message on the first
> server move to cur/, and second rsync results in two files on second
> server).
> 
> It there any workaround?

I would only use rsync for migrating to a new box, or for backups only...

It soundslike you're using the wrong tool for the job - maybe you should
be using something like imapsync?

Or, please describe what you are trying to accomplish?


Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Geert Hendrickx
On Mon, Jan 11, 2010 at 02:18:07PM +0200, Alexander Chekalin wrote:
> Oh, I finally find out the problem. If Dovecot see in the IMAP mailbox
> two message files named equally (say in cur/ and new/ dirs) it renames
> one of them into new name dispute this is the same message.
> 
> I'm not sure if this is intended behaviour. It is quite easy to see such
> situation when doing periodical rsync (SMTP put message to new/ dir, then
> rsync copy it to second server, then message on the first server move to
> cur/, and second rsync results in two files on second server).
> 
> It there any workaround?


You could use imapsync instead: http://www.linux-france.org/prj/imapsync/


It synchronizes two IMAP mailboxes (including message flags etc) independent
of the underlying implementation.


Geert



-- 
Geert Hendrickx  -=-  g...@telenet.be  -=-  PGP: 0xC4BB9E9F
This e-mail was composed using 100% recycled spam messages!


Re: [Dovecot] Moving

2010-01-11 Thread Stewart Dean

Now that you're back in your native land. .
If and only if you're interested, I'D be interested in hearing what you 
thought of America: the things/customs that you thought were just plain 
wrong or stupid, the things/customs you liked, things that made you 
think, things that make you feel relieved to be "back home"
I'm always curious about how others see my screwy country and its 
inhabitants...


Timo Sirainen wrote:

On 2.1.2010, at 23.18, Timo Sirainen wrote:

  

I'm moving back to Finland tomorrow. It's probably going to take a week or so 
until things settle down and I'm again back to coding.



And now I'm without internet at home, hopefully my mobile 3g connection opens 
in a few days.. And in any case I'll get cable modem by Saturday.
  


--
 Once upon a time, the Internet was a friendly, 
neighbors-helping-neighbors small town, and no one locked their doors. 
Now it's like an apartment in Bed-Stuy: you need three heavy duty 
pick-proof locks, one of those braces that goes from the lock to the 
floor, and bars on the windows  Stewart Dean, Unix System Admin, 
Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 
845-758-7035


Re: [Dovecot] Moving

2010-01-11 Thread Stewart Dean

My apologies for posting this to the list; I meant to send it Timo only


Now that you're back in your native land. .
If and only if you're interested, I'D be interested in hearing what 
you thought of America


--
 Once upon a time, the Internet was a friendly, 
neighbors-helping-neighbors small town, and no one locked their doors. 
Now it's like an apartment in Bed-Stuy: you need three heavy duty 
pick-proof locks, one of those braces that goes from the lock to the 
floor, and bars on the windows  Stewart Dean, Unix System Admin, 
Bard College, New York 12504 sd...@bard.edu voice: 845-758-7475, fax: 
845-758-7035




Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Alexander Chekalin

Yes, I'm trying to make some backup solution.

The idea was to have two identical (well, nearly identical) servers with 
the same software and data on them, and while the first do its job as 
SMTP and POP3/IMAP4 server, the second server just get copy of first's 
current state (that is, copy user db and mail spool). In case of 
something wrong with 1st server I'll just put its IP on second one and 
will go on.


And the problem is that rsynced mailboxes sometimes have duplicates that 
may confuse users. It happens when box changes between rsyncs by means 
of Dovecot's ordinary operations (when msg file move from new/ to cur/ 
on 1st server and after rsync to 2nd this may produce two files with 
same filename in new/ and cur/, and Dovecot for some reason renames one 
of it).


Doing this using imapsync won't work. It is slow (hours vs minutes with 
rsync) so I can't run it every 5 minutes, and, moreover, it crashes on 
some messages, so can not rely on it in production.


Yours,
  Alexander

11.01.2010 15:07, Charles Marcus wrote:

On 2010-01-11, Alexander Chekalin (acheka...@lazurit.com) wrote:

I'm not sure if this is intended behaviour. It is quite easy to see
such situation when doing periodical rsync (SMTP put message to new/
dir, then rsync copy it to second server, then message on the first
server move to cur/, and second rsync results in two files on second
server).

It there any workaround?


I would only use rsync for migrating to a new box, or for backups only...

It soundslike you're using the wrong tool for the job - maybe you should
be using something like imapsync?

Or, please describe what you are trying to accomplish?




Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Tom Hendrikx
Hi,

This is a general backup issue (files changing during backup run) and
nothing Dovecot specific. You should look into something that gives you
a consistent view of the data, f.i. LVM snapshots (when you're running
linux).

Regards,
Tom

Alexander Chekalin wrote:
> Yes, I'm trying to make some backup solution.
> 
> The idea was to have two identical (well, nearly identical) servers with
> the same software and data on them, and while the first do its job as
> SMTP and POP3/IMAP4 server, the second server just get copy of first's
> current state (that is, copy user db and mail spool). In case of
> something wrong with 1st server I'll just put its IP on second one and
> will go on.
> 
> And the problem is that rsynced mailboxes sometimes have duplicates that
> may confuse users. It happens when box changes between rsyncs by means
> of Dovecot's ordinary operations (when msg file move from new/ to cur/
> on 1st server and after rsync to 2nd this may produce two files with
> same filename in new/ and cur/, and Dovecot for some reason renames one
> of it).
> 
> Doing this using imapsync won't work. It is slow (hours vs minutes with
> rsync) so I can't run it every 5 minutes, and, moreover, it crashes on
> some messages, so can not rely on it in production.
> 
> Yours,
>   Alexander
> 
> 11.01.2010 15:07, Charles Marcus wrote:
>> On 2010-01-11, Alexander Chekalin (acheka...@lazurit.com) wrote:
>>> I'm not sure if this is intended behaviour. It is quite easy to see
>>> such situation when doing periodical rsync (SMTP put message to new/
>>> dir, then rsync copy it to second server, then message on the first
>>> server move to cur/, and second rsync results in two files on second
>>> server).
>>>
>>> It there any workaround?
>>
>> I would only use rsync for migrating to a new box, or for backups only...
>>
>> It soundslike you're using the wrong tool for the job - maybe you should
>> be using something like imapsync?
>>
>> Or, please describe what you are trying to accomplish?
> 



Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Anton Dollmaier

Hi,


The idea was to have two identical (well, nearly identical) servers with
the same software and data on them, and while the first do its job as
SMTP and POP3/IMAP4 server, the second server just get copy of first's
current state (that is, copy user db and mail spool). In case of
something wrong with 1st server I'll just put its IP on second one and
will go on.



Use Heartbeat and DRBD for replication - all mail is synched between the 
servers.


If first crashes, heartbeat runs "second" as new server for the users.


As dovecot on "second" is only started if "first" is down, there are no 
issues about inconsistencies.



best regards,

Anton


Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Timo Sirainen
On 11.1.2010, at 16.06, Alexander Chekalin wrote:

> Doing this using imapsync won't work. It is slow (hours vs minutes with 
> rsync) so I can't run it every 5 minutes, and, moreover, it crashes on some 
> messages, so can not rely on it in production.

With v2.0 dsync would be great for this..



Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Alexander Chekalin
I see the only option I have is to use filesystem sync and not rsync. 
Frankly I'd rather use rsync and not play with GEOM (I'm on FreeBSD) on 
servers right now.


The problem as I've said is not sync itself but rather Dovecot's way of 
treating files. You can test it yourself: go to your our cur/ dir, and 
copy any message to new/ dir, and then login to the mailbox with IMAP 
client. As soon as these messages are identical I'd expect Dovecot to 
remove one of it but Dovecot simple rename second message file so you'll 
see two identical messages in your INBOX in mail client.


That's what is strange for me. I can fight it on IMAP level (compare 
messages and find duplicates) but this way won't look nice.


Your,
  Alexander

11.01.2010 16:25, Anton Dollmaier пишет:

Hi,


The idea was to have two identical (well, nearly identical) servers with
the same software and data on them, and while the first do its job as
SMTP and POP3/IMAP4 server, the second server just get copy of first's
current state (that is, copy user db and mail spool). In case of
something wrong with 1st server I'll just put its IP on second one and
will go on.



Use Heartbeat and DRBD for replication - all mail is synched between the
servers.

If first crashes, heartbeat runs "second" as new server for the users.


As dovecot on "second" is only started if "first" is down, there are no
issues about inconsistencies.


best regards,

Anton




Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Alexander Chekalin
In fact I just try to understand if Dovecot's behaviour  is right and my 
expectations are wrong, or vise versa. I mean when server see two 
identical messages (files) both in cur and in new dirs it can compare 
these files not only by name and rename if these names are the same, but 
maybe check content of the messages.



11.01.2010 16:11, Tom Hendrikx пишет:

Hi,

This is a general backup issue (files changing during backup run) and
nothing Dovecot specific. You should look into something that gives you
a consistent view of the data, f.i. LVM snapshots (when you're running
linux).

Regards,
Tom

Alexander Chekalin wrote:

Yes, I'm trying to make some backup solution.

The idea was to have two identical (well, nearly identical) servers with
the same software and data on them, and while the first do its job as
SMTP and POP3/IMAP4 server, the second server just get copy of first's
current state (that is, copy user db and mail spool). In case of
something wrong with 1st server I'll just put its IP on second one and
will go on.

And the problem is that rsynced mailboxes sometimes have duplicates that
may confuse users. It happens when box changes between rsyncs by means
of Dovecot's ordinary operations (when msg file move from new/ to cur/
on 1st server and after rsync to 2nd this may produce two files with
same filename in new/ and cur/, and Dovecot for some reason renames one
of it).

Doing this using imapsync won't work. It is slow (hours vs minutes with
rsync) so I can't run it every 5 minutes, and, moreover, it crashes on
some messages, so can not rely on it in production.

Yours,
   Alexander

11.01.2010 15:07, Charles Marcus wrote:

On 2010-01-11, Alexander Chekalin (acheka...@lazurit.com) wrote:

I'm not sure if this is intended behaviour. It is quite easy to see
such situation when doing periodical rsync (SMTP put message to new/
dir, then rsync copy it to second server, then message on the first
server move to cur/, and second rsync results in two files on second
server).

It there any workaround?


I would only use rsync for migrating to a new box, or for backups only...

It soundslike you're using the wrong tool for the job - maybe you should
be using something like imapsync?

Or, please describe what you are trying to accomplish?








Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Timo Sirainen
On 11.1.2010, at 16.41, Alexander Chekalin wrote:

> In fact I just try to understand if Dovecot's behaviour  is right and my 
> expectations are wrong, or vise versa. I mean when server see two identical 
> messages (files) both in cur and in new dirs it can compare these files not 
> only by name and rename if these names are the same, but maybe check content 
> of the messages.

Feel free to write such code :) There is already a bit of checking to drop hard 
linked duplicates.

Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Alexander Chekalin

I'd love to use it (it's going to be magic solution for me).

But no I haven't looked at v2 yet. Is dsync is ready to use now or this 
is just an alpha/beta concept code?


11.01.2010 16:34, Timo Sirainen пишет:

On 11.1.2010, at 16.06, Alexander Chekalin wrote:


Doing this using imapsync won't work. It is slow (hours vs minutes with rsync) 
so I can't run it every 5 minutes, and, moreover, it crashes on some messages, 
so can not rely on it in production.


With v2.0 dsync would be great for this..





Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Mario Antonio

On 1/11/2010 9:34 AM, Timo Sirainen wrote:

On 11.1.2010, at 16.06, Alexander Chekalin wrote:

   

Doing this using imapsync won't work. It is slow (hours vs minutes with rsync) 
so I can't run it every 5 minutes, and, moreover, it crashes on some messages, 
so can not rely on it in production.
 

With v2.0 dsync would be great for this..



   


How could dsync beat rsync?
With just one rsync command you can replicate the whole mail store (a 
root folder)
Can you do the same with Dsync? or Do you have to write a script that 
feeds Domains/Users ...?


M.A.


Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Alexander Chekalin
No of course it won't. But dsync seems to be a solution that won't deal 
with storage level so it will resolve conflicts easily.


Personally I prefer rsync :)


How could dsync beat rsync?
With just one rsync command you can replicate the whole mail store (a
root folder)
Can you do the same with Dsync? or Do you have to write a script that
feeds Domains/Users ...?


Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Alexander Chekalin

Timo,

I'd really love to but I'm really not sure in my code skills to patch 
such a sw as Dovecot.


11.01.2010 16:42, Timo Sirainen пишет:

On 11.1.2010, at 16.41, Alexander Chekalin wrote:


In fact I just try to understand if Dovecot's behaviour  is right and my 
expectations are wrong, or vise versa. I mean when server see two identical 
messages (files) both in cur and in new dirs it can compare these files not 
only by name and rename if these names are the same, but maybe check content of 
the messages.


Feel free to write such code :) There is already a bit of checking to drop hard 
linked duplicates.




Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Timo Sirainen
On 11.1.2010, at 16.46, Mario Antonio wrote:

>> With v2.0 dsync would be great for this.. 
> 
> How could dsync beat rsync?
> With just one rsync command you can replicate the whole mail store (a root 
> folder)
> Can you do the same with Dsync? or Do you have to write a script that feeds 
> Domains/Users ...?

If there are no changes, dsync needs to do a lot less disk IO, since it just 
needs to open index files.

Currently you'd have to write a script to iterate through all users, but I 
don't see it as a huge issue. Scripting it shouldn't be too difficult, and 
writing code to dsync to directly support it would probably require less than 
100 lines.



Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Timo Sirainen
v2.0 is still in beta. I should release second beta sometimes soon, but I'm a 
bit too busy / internetless currently. I'm anyway using the latest hg for my 
own mails, so it's not completely broken, but I wouldn't necessarily recomment 
it for larger installations..

On 11.1.2010, at 16.45, Alexander Chekalin wrote:

> I'd love to use it (it's going to be magic solution for me).
> 
> But no I haven't looked at v2 yet. Is dsync is ready to use now or this is 
> just an alpha/beta concept code?
> 
> 11.01.2010 16:34, Timo Sirainen пишет:
>> On 11.1.2010, at 16.06, Alexander Chekalin wrote:
>> 
>>> Doing this using imapsync won't work. It is slow (hours vs minutes with 
>>> rsync) so I can't run it every 5 minutes, and, moreover, it crashes on some 
>>> messages, so can not rely on it in production.
>> 
>> With v2.0 dsync would be great for this..
>> 
> 



Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Alexander Chekalin
So I'd better wait for dsync? Or I can get it (without iterate code) now 
somehow?


11.01.2010 16:54, Timo Sirainen пишет:

On 11.1.2010, at 16.46, Mario Antonio wrote:


With v2.0 dsync would be great for this..


How could dsync beat rsync?
With just one rsync command you can replicate the whole mail store (a root 
folder)
Can you do the same with Dsync? or Do you have to write a script that feeds 
Domains/Users ...?


If there are no changes, dsync needs to do a lot less disk IO, since it just 
needs to open index files.

Currently you'd have to write a script to iterate through all users, but I 
don't see it as a huge issue. Scripting it shouldn't be too difficult, and 
writing code to dsync to directly support it would probably require less than 
100 lines.





Re: [Dovecot] Same filenames on different servers?

2010-01-11 Thread Steffen Kaiser

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Mon, 11 Jan 2010, Alexander Chekalin wrote:


Yes, I'm trying to make some backup solution.

The idea was to have two identical (well, nearly identical) servers with the 
same software and data on them, and while the first do its job as SMTP and 
POP3/IMAP4 server, the second server just get copy of first's current state 
(that is, copy user db and mail spool). In case of something wrong with 1st 
server I'll just put its IP on second one and will go on.


So, where does the duplicate name comes from?
This paragraphe sounds as no user accesses the secondary server by
default.

And the problem is that rsynced mailboxes sometimes have duplicates that may 
confuse users. It happens when box changes between rsyncs by means of 
Dovecot's ordinary operations (when msg file move from new/ to cur/ on 1st 
server and after rsync to 2nd this may produce two files with same filename 
in new/ and cur/


When Dovecot on the second server is not running - well, I guess that's
true as long as nobody logs in - ,  you can do a

rsync --delete -razH primaryServer secondaryServer

so the secondary server has a complete copy of the Maildir of the primary
server (well, if you have separated INDEXes or CONTROL from there,
another rsync is required).

If you omit the "--delete", you should have plenty of duplicate messages
in cur/, because any change of keywords or status will change the
filename, too. Also, any deleted message would be still there.
So I still wonder, where your duplicates come from.

Your user won't complain that a message is back "NEW", once the
secondary took over, will they?

I make "rsync backups" as well, but restore them as "new" folders, e.g.
.Archive.Sub.Folder becomes .RESTORE.Archive.Sub.Folder, in order to
avoid the problem you describe.


and Dovecot for some reason renames one of it).


Because Maildir is designed that way that no duplicate filename stem
(part before colon) must exist. So any server may handle this situation
on its own.

Regards,

- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)

iQEVAwUBS0tAg7+Vh58GPL/cAQIYhgf+OpvlwRZS1JcNXnCeBY7tsNunWk6zIHQD
cU1I5LS8it/zLLBt2ORYkm0+u7rRxMYcigEgNsHB1m71f2BeYthlczPzYSm+A17b
OmPwb9oZ6ZCJxk8jXzF6GZ39PgT6UoPHqiN0oo6RH2Xso6FYrp0/KibU96K9+uO0
3dXBbl10TdxCfPYvLgO46ounaBVBW3D/xDzKIUeW4DTWApnPuB/gjXs68lYKoZrb
F/2pGQAwDGF1uMyOq1dY4Mefe05uzgA4TR/IBzYHMtBhG+YLpKqxg/sGFTTMjTPS
DfMtHc0fFbyiIpJOZ7YwwRpq2hNd4tXm7Yq3PmG7eU+guxQboeBkJw==
=I4Da
-END PGP SIGNATURE-


Re: [Dovecot] Moving

2010-01-11 Thread Spyros Tsiolis
Ditto,

Especially from a Finn :-)
I've worked with scandinavians (Finns, Norwegians, Swedes) in the past.
Swedes and Finns in particular are interesting people, the way they
think and so on. 
Brilliant people too.. With quite an attitude towards life, work etc.
Norwegians are party animals :-)

But Finns are quite straight-forward. They don't beat around the bush.
They will express their opinion and that's what I like most.
They will not try to beautify things. They will speak their mind.
Check Linus for example :-)

s.


--- On Mon, 11/1/10, Stewart Dean  wrote:

> From: Stewart Dean 
> Subject: Re: [Dovecot] Moving
> To: "Dovecot Mailing List" 
> Date: Monday, 11 January, 2010, 15:53
> Now that you're back in your native
> land. .
> If and only if you're interested, I'D be interested in
> hearing what you thought of America: the things/customs that
> you thought were just plain wrong or stupid, the
> things/customs you liked, things that made you think, things
> that make you feel relieved to be "back home"
> I'm always curious about how others see my screwy country
> and its inhabitants...
> 
> Timo Sirainen wrote:
> > On 2.1.2010, at 23.18, Timo Sirainen wrote:
> > 
> >   
> >> I'm moving back to Finland tomorrow. It's probably
> going to take a week or so until things settle down and I'm
> again back to coding.
> >>     
> > 
> > And now I'm without internet at home, hopefully my
> mobile 3g connection opens in a few days.. And in any case
> I'll get cable modem by Saturday.
> >   
> 
> --  Once upon a time, the Internet was a friendly,
> neighbors-helping-neighbors small town, and no one locked
> their doors. Now it's like an apartment in Bed-Stuy: you
> need three heavy duty pick-proof locks, one of those braces
> that goes from the lock to the floor, and bars on the
> windows  Stewart Dean, Unix System Admin, Bard
> College, New York 12504 sd...@bard.edu
> voice: 845-758-7475, fax: 845-758-7035
> 






Re: [Dovecot] Moving

2010-01-11 Thread /dev/rob0
On Mon, Jan 11, 2010 at 09:02:25AM -0500, Stewart Dean wrote:
> My apologies for posting this to the list; I meant to send it
> Timo only
> 
> >Now that you're back in your native land. .
> >If and only if you're interested, I'D be interested in hearing
> >what you thought of America

Nonetheless, it would be interesting to see his reply, maybe as a
blog entry link or something. :)
-- 
Offlist mail to this address is discarded unless
"/dev/rob0" or "not-spam" is in Subject: header


Re: [Dovecot] Thinderbird+delete+move to Trash folder

2010-01-11 Thread Lex Brugman
(as a reply to your mail)

I'm not subscribed to the mailing list, but I just read your thread
regarding this plugin.

It seems to me that the Shift-Delete function you are referring to 
in Thunderbird just bypasses the built-in move-to-trash-on-delete 
function, but on the server-side is identical to any other regular 
delete action (flag the message as deleted, followed by an expunge 
later on, probably after closing the mail client) and is thus copied 
to the trash folder by my plugin.

I can't think of anything to distinguish this behavior from a normal 
delete action by any other mail client and using Shift-Delete in 
Thunderbird (server-side), if you know one, please let me know and I 
will try to implement it.

Greetings,
Lex Brugman



[Dovecot] IDLE timing issue - dovecot or fetchmail issue?

2010-01-11 Thread Matt Doran

Hi guys,

Thanks for the great product.  We've used dovecot for ages as our 
internal mail server and it works great!


I've recently started using fetchmail 6.3.9 (with IDLE enabled) to 
download mail from our ISP (Pair networks).   The ISP is running Dovecot 
1.1.16.  I am unable to get the info about the dovecot config at this time.


The IDLE support in fetchmail allows us to deliver mail near 
instantaneously without the need to poll (which is what we did 
previously using POP3).  However I've noticed an issue where if 2 mails 
are delivered in quick succession fetchmail will only download the first 
email, and the second will not download.   If I then send in another 
test email this triggers the download of 2 emails (the original that 
wasn't downloaded and the test email).


Now I'm wondering whether the issue lies with Dovecot (e.g. a timing 
issue), or is it fetchmail that isn't implementing the IDLE/download 
properly.


I've attached the output of a fetchmail session showing this problem in 
action (I've added some annotations to this file starting with >).  
The sequence of events are:


   * Start fetchmail with IDLE enabled
   * Send 2 emails in quick succession.
   * Dovecot notifies of the new message
   * Fetchmail downloads the message
   * Fetchmail initiates a new IDLE
   * Then nothing more is delivered. :(
   * I then send another email, which triggers the 2 to download.


I don't know enough about IMAP to understand whether the problem lies 
with Dovecot or Fetchmail.   Hopefully an IMAP expert will be able to 
see from the attached IMAP session.


Regards,

--
Matt Doran
PaperCut Software International Pty. Ltd.
http://www.papercut.com/

Phone:   +61 3 9809 5194

fetchmail: 6.3.9-rc2 querying mail..com (protocol IMAP) at Tue 12 Jan 2010 
13:17:38 EST: poll started
Trying to connect to 216.92.193.84/143...connected.
fetchmail: IMAP< * OK Dovecot ready.
fetchmail: IMAP> A0001 CAPABILITY
fetchmail: IMAP< * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES 
MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS 
LIST-EXTENDED I18NLEVEL=1 QUOTA STARTTLS AUTH=PLAIN AUTH=LOGIN
fetchmail: IMAP< A0001 OK Capability completed.
fetchmail: will idle after poll
fetchmail: IMAP> A0002 STARTTLS
fetchmail: IMAP< A0002 OK Begin TLS negotiation now.



fetchmail: IMAP> A0003 CAPABILITY
fetchmail: IMAP< * CAPABILITY IMAP4rev1 SASL-IR SORT THREAD=REFERENCES 
MULTIAPPEND UNSELECT LITERAL+ IDLE CHILDREN NAMESPACE LOGIN-REFERRALS UIDPLUS 
LIST-EXTENDED I18NLEVEL=1 QUOTA AUTH=PLAIN AUTH=LOGIN
fetchmail: IMAP< A0003 OK Capability completed.
fetchmail: will idle after poll
fetchmail: mail..com: upgrade to TLS succeeded.
fetchmail: IMAP> A0004 LOGIN "matt" *
fetchmail: IMAP< A0004 OK Logged in.
fetchmail: IMAP> A0005 SELECT "INBOX"
fetchmail: IMAP< * FLAGS (\Answered \Flagged \Deleted \Seen \Draft Junk NonJunk)
fetchmail: IMAP< * OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft 
Junk NonJunk \*)] Flags permitted.
fetchmail: IMAP< * 0 EXISTS
fetchmail: IMAP< * 0 RECENT
fetchmail: IMAP< * OK [UIDVALIDITY 1227629703] UIDs valid
fetchmail: IMAP< * OK [UIDNEXT 76875] Predicted next UID
fetchmail: IMAP< A0005 OK [READ-WRITE] Select completed.
fetchmail: IMAP> A0006 IDLE
fetchmail: IMAP< + idling
fetchmail: IMAP< * 1 EXISTS
fetchmail: IMAP> DONE
fetchmail: IMAP< * 1 RECENT
fetchmail: IMAP< A0006 OK Idle completed.
fetchmail: IMAP> A0007 SEARCH UNSEEN NOT DELETED
fetchmail: IMAP< * SEARCH 1
fetchmail: IMAP< A0007 OK Search completed (0.000 secs).
1 message for matt at mail..com.
fetchmail: IMAP> A0008 FETCH 1 RFC822.SIZE
fetchmail: IMAP< * 1 FETCH (RFC822.SIZE 11068)
fetchmail: IMAP< A0008 OK Fetch completed.
fetchmail: IMAP> A0009 FETCH 1 RFC822.HEADER
fetchmail: IMAP< * 1 FETCH (RFC822.HEADER {1651}
reading message m...@.com:1 of 1 (1651 header octets)
Trying to connect to 127.0.0.1/25...connected.
fetchmail: SMTP< 220 smaug.X.com ESMTP Exim 4.69 Tue, 12 Jan 2010 13:17:56 
+1100
fetchmail: SMTP> EHLO smaug.X.com
fetchmail: SMTP< 250-smaug.X.com Hello matt at localhost [127.0.0.1]
fetchmail: SMTP< 250-SIZE 52428800
fetchmail: SMTP< 250-PIPELINING
fetchmail: SMTP< 250 HELP
fetchmail: SMTP> MAIL FROM: SIZE=11068
fetchmail: SMTP< 250 OK
fetchmail: SMTP> RCPT TO:
fetchmail: SMTP< 250 Accepted
fetchmail: SMTP> DATA
fetchmail: SMTP< 354 Enter message, ending with "." on a line by itself
#
fetchmail: IMAP< )
fetchmail: IMAP< A0009 OK Fetch completed.
fetchmail: IMAP> A0010 FETCH 1 BODY.PEEK[TEXT]
fetchmail: IMAP< * 1 FETCH (BODY[TEXT] {9417}
 (9417 body 
octets)**.*.*.*.*.*.*.*.**.**
fetchmail: IMAP< )
fetchmail: IMAP< A0010 OK Fetch completed.
fetchmail: SMTP>. (EOM)
fetchmail: SMTP< 250 OK id=1NUWKS-0004rr-5f
 flushed
fetchmail: IMAP> A0011 STORE 1 +FLAGS (\Seen \Deleted)
fetchmail: IMAP< * 1 FETCH (FLAGS (\Deleted \Seen \Recent)

Re: [Dovecot] Sieve > Pigeonhole > external storage with LDAP or other data source available to dovecot

2010-01-11 Thread Martin F. Foster

Le 09-Jan-10 20:29, Stephan Bosch a écrit :


I thought this would be an excellent opportunity to test the new
Pigeonhole plugin support and also to do something interesting with the
namespace functionality of the variables extension. That is why I gave
this a short look, which promptly resulted in a preliminary implementation.

If you want to play around with it, you can download it from:

http://hg.rename-it.nl/pigeonhole-sieve-extdata/

It will compile and run with both Pigeonhole for Dovecot v1.2 and
Pigeonhole for Dovecot v2.0, but only with the tip Mercurial revisions
(since only those have plugin support).

Thanks Stephan,

I have the extdata plugin compiled, and am now trying to make a global 
sieve script to test it.  I'm running into problems when using sievec to 
compile the script - I'm not getting the plugin's variables that are 
provided in dovecot.conf's plugin {}.  I added a few sieve_sys_warning 
messages to track the calls to sieve_setting_get()



/usr/local/bin/sievec -d -P sieve_extdata 
/usr/local/etc/dovecot/sieve/before.sv
Warning: sieve: sieve_setting_get: req: 'sieve_max_script_size' res: 
'(null)'

Warning: sieve: sieve_setting_get: req: 'sieve_max_actions' res: '(null)'
Warning: sieve: sieve_setting_get: req: 'sieve_max_redirects' res: '(null)'
Warning: sieve: sieve_setting_get: req: 'sieve_subaddress_sep' res: '(null)'
Warning: sieve: sieve_setting_get: req: 'recipient_delimiter' res: '(null)'
Warning: sieve: sieve_setting_get: req: 'sieve_plugin_dir' res: '(null)'
Warning: sieve: sieve_setting_get: req: 'sieve_plugins' res: '(null)'
Warning: sieve: sieve_setting_get: req: 'sieve_extdata_dict_uri' res: 
'(null)'
Warning: sieve: extdata: no dict uri specified, extension is 
unconfigured (sieve_extdata_dict_uri is not set).


* Required extensions:

  0: vacation (9)
  1: variables (17)
  2: vnd.dovecot.extdata (29)

* Main program (block: 1):

: EXTENSIONS [3]:
0001:   vacation
0002:   variables
0003: SCOPE [0] (end: 0008)
0008:   vnd.dovecot.extdata
0009: VACATION
000a:   (source line: 3)
000d:   subject: VAR ${extdata.vacation_subject}
0023:   reason: VAR ${extdata.vacation_message}
0038:   handle: STR[77] 
"${extdata.vacation_message}${extdata.vacation_subject}"

0088: [End of code]


I'm new to dovecot's internals, it looks like it just needs some 
environment variables provided, but I'm puzzled as to how this is to be 
done.
I've traced it through sievec.c -> sieve_tool_sieve_env -> 
sieve_tool_get_setting -> getenv() call.


More info:
1. I've traced the process, there's no attempt to open or stat any 
dovecot.conf
2. using tip dovecot-1.2, dovecot-1.2-sieve, pigeonhole-sieve-extdata.  
I pulled+updated & rebuilt and confirmed the above behaviour just prior 
to sending this message.
3. The test scripts run because the test framework uses the test_config 
mechanism to provide sieve_extdata_dict_uri.


Any hints on how to get the dovecot.conf data to sievec?

Thanks,

-Martin Foster


Re: [Dovecot] How to configure dovecot to listen on multiple separate port numbers

2010-01-11 Thread Rick Thomas

I sent this a while ago, but got no answers.  Maybe it got lost?

Thanks!

Rick

Rick Thomas wrote:


Is there any way to tell dovecot to listen for imap/imaps requests on 
all interfaces on multiple separate ports?


For example, can I do this:


   protocol imap {
 listen = *:10143
 listen = *:143
 ssl_listen = *:10993
 ssl_listen = *:993
 ...
   }


Thanks!

Rick