[Dovecot] ulimit -n in start-script

2013-03-20 Thread Peer Heinlein


Hi!

Even on midrange-systems it's necessary to set "ulimit -n" to a higher
value then the system default of 1024.

I'd prefer having this already prepared:

In /etc/defaults/dovecot we should add:

# Set amount of "open files" / ulimit -n
ULIMIT_OPEN_FILES=16884


In /etc/init.d/dovecot we should add:

# Set amount of open files / ulimit -n
[ -n "$ULIMIT_OPEN_FILES" ] && ulimit -n $ULIMIT_OPEN_FILES



Peer


-- 
Heinlein Support GmbH
Schwedter Str. 8/9b, 10119 Berlin

http://www.heinlein-support.de

Tel: 030 / 405051-42
Fax: 030 / 405051-19

Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht
Berlin-Charlottenburg,
Geschäftsführer: Peer Heinlein -- Sitz: Berlin


Re: [Dovecot] Mongo backend for userdb and passdb

2013-03-20 Thread Damien Churchill
On 28 February 2013 14:47, Damien Churchill  wrote:
> On 28 February 2013 14:40, Timo Sirainen  wrote:
>> On 28.2.2013, at 15.13, Damien Churchill  wrote:
>>
>>> On 28 February 2013 14:01, Timo Sirainen  wrote:
 On 28.2.2013, at 12.28, Damien Churchill  wrote:

> I was wondering if any work had been made (out of tree) or has been
> planned for a mongo driver? If not is it something that would be of
> any interest for being included?

 Have you noticed the memcached and redis backends for lib-dict, and the 
 passdb/userdb dict? So you'd only need to implement dict-mongodb.c for 
 Dovecot v2.2. Feel free to start developing. :) v2.2 also has its own 
 lib-http if that's needed.

>>>
>>> I hadn't no! That makes things far easier :) Do you have any
>>> preference on which driver to use? I was thinking of selecting
>>> libmongo-client[0] as its made its way into repositories unlike the
>>> official mongo C driver.
>>>
>>> [0] https://github.com/algernon/libmongo-client
>>
>> Any external library actually makes things more difficult, because they can 
>> easily only be loaded by the dict server, which means every lookup have to 
>> be proxied through it (similar problem with dict-sql). Although in v2.2 
>> there's some new code for how to load SSL library dynamically only when 
>> needed, and the same could be done for your dict-mongodb at least in theory..
>>
>
> Okay I'll have a look at doing it that way. Is the ssl code in
> lib-ssl-iostream or somewhere else?

Hi,

I've been messing about with this and I think a similar configuration
format to the sql dict driver would be handy, although I imagine the
same could also be achieved with just lots of uri arguments. Mongo
isn't really a key/value store so you'd want to be able to specify
fields within the document to query upon/fetch.

I'm still getting to grips with the architecture of things so not
entirely sure what the best course of action would be here. If using
the map style config would be desirable then creating some shared
parser that sql and mongodb can use would be good.


Re: [Dovecot] v2.2 status update

2013-03-20 Thread Thomas Leuxner
* Timo Sirainen  2013.03.19 18:45:

>  * dsync can sync ACLs

+1

doveadm -o plugin/quota= backup -u t...@leuxner.net 
mdbox:/home/backups/tlx/mdbox

Works great now. Thanks.


signature.asc
Description: Digital signature


Re: [Dovecot] v2.2 status update

2013-03-20 Thread Timo Sirainen
On Wed, 2013-03-20 at 11:31 +0100, Thomas Leuxner wrote:
> * Timo Sirainen  2013.03.19 18:45:
> 
> >  * dsync can sync ACLs
> 
> +1
> 
> doveadm -o plugin/quota= backup -u t...@leuxner.net 
> mdbox:/home/backups/tlx/mdbox
> 
> Works great now. Thanks.

I don't think you need the -o plugin/quota= here. dsync should ignore
quota limits.




Re: [Dovecot] Mongo backend for userdb and passdb

2013-03-20 Thread Timo Sirainen
On Wed, 2013-03-20 at 10:29 +, Damien Churchill wrote:

> I've been messing about with this and I think a similar configuration
> format to the sql dict driver would be handy, although I imagine the
> same could also be achieved with just lots of uri arguments. Mongo
> isn't really a key/value store so you'd want to be able to specify
> fields within the document to query upon/fetch.
> 
> I'm still getting to grips with the architecture of things so not
> entirely sure what the best course of action would be here. If using
> the map style config would be desirable then creating some shared
> parser that sql and mongodb can use would be good.

I've been planning on having one generic dict sql-like configuration for
all dict backends, so you could map different dict paths to different
backends. So the idea is good, but probably quite a lot of work.




Re: [Dovecot] Mongo backend for userdb and passdb

2013-03-20 Thread Damien Churchill
On 20 March 2013 10:39, Timo Sirainen  wrote:
> On Wed, 2013-03-20 at 10:29 +, Damien Churchill wrote:
>
>> I've been messing about with this and I think a similar configuration
>> format to the sql dict driver would be handy, although I imagine the
>> same could also be achieved with just lots of uri arguments. Mongo
>> isn't really a key/value store so you'd want to be able to specify
>> fields within the document to query upon/fetch.
>>
>> I'm still getting to grips with the architecture of things so not
>> entirely sure what the best course of action would be here. If using
>> the map style config would be desirable then creating some shared
>> parser that sql and mongodb can use would be good.
>
> I've been planning on having one generic dict sql-like configuration for
> all dict backends, so you could map different dict paths to different
> backends. So the idea is good, but probably quite a lot of work.
>

Would it not be just some bastardised version of dict-sql-settings?


Re: [Dovecot] Mongo backend for userdb and passdb

2013-03-20 Thread Timo Sirainen
On Wed, 2013-03-20 at 10:40 +, Damien Churchill wrote:
> On 20 March 2013 10:39, Timo Sirainen  wrote:
> > On Wed, 2013-03-20 at 10:29 +, Damien Churchill wrote:
> >
> >> I've been messing about with this and I think a similar configuration
> >> format to the sql dict driver would be handy, although I imagine the
> >> same could also be achieved with just lots of uri arguments. Mongo
> >> isn't really a key/value store so you'd want to be able to specify
> >> fields within the document to query upon/fetch.
> >>
> >> I'm still getting to grips with the architecture of things so not
> >> entirely sure what the best course of action would be here. If using
> >> the map style config would be desirable then creating some shared
> >> parser that sql and mongodb can use would be good.
> >
> > I've been planning on having one generic dict sql-like configuration for
> > all dict backends, so you could map different dict paths to different
> > backends. So the idea is good, but probably quite a lot of work.
> >
> 
> Would it not be just some bastardised version of dict-sql-settings?

I guess you could do that for now. The grand plans of how to put
everything nicely together can wait. :)




Re: [Dovecot] Mongo backend for userdb and passdb

2013-03-20 Thread Damien Churchill
On 20 March 2013 10:54, Timo Sirainen  wrote:
> On Wed, 2013-03-20 at 10:40 +, Damien Churchill wrote:
>> On 20 March 2013 10:39, Timo Sirainen  wrote:
>> > On Wed, 2013-03-20 at 10:29 +, Damien Churchill wrote:
>> >
>> >> I've been messing about with this and I think a similar configuration
>> >> format to the sql dict driver would be handy, although I imagine the
>> >> same could also be achieved with just lots of uri arguments. Mongo
>> >> isn't really a key/value store so you'd want to be able to specify
>> >> fields within the document to query upon/fetch.
>> >>
>> >> I'm still getting to grips with the architecture of things so not
>> >> entirely sure what the best course of action would be here. If using
>> >> the map style config would be desirable then creating some shared
>> >> parser that sql and mongodb can use would be good.
>> >
>> > I've been planning on having one generic dict sql-like configuration for
>> > all dict backends, so you could map different dict paths to different
>> > backends. So the idea is good, but probably quite a lot of work.
>> >
>>
>> Would it not be just some bastardised version of dict-sql-settings?
>
> I guess you could do that for now. The grand plans of how to put
> everything nicely together can wait. :)
>

For now I think I can get away with just tacking on uri arguments.
Seems silly duplicating effort, although if you'd like me to give it a
shot I'm happy to do so!


Re: [Dovecot] ulimit -n in start-script

2013-03-20 Thread Patrick Westenberg

Peer Heinlein schrieb:


Even on midrange-systems it's necessary to set "ulimit -n" to a higher
value then the system default of 1024.


Could this lead to this problem?

 Error: 
file_dotlock_create(/var/mail/example.com/john.doe/Maildir/.Sent/dovecot-uidlist) 
failed: No space left on device


Patrick


[Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread dormitionsk...@hotmail.com
I'd like to use Dovecot as our IMAP server when our users are within our LAN, 
but I'd also like to give them the ability to access their emails via POP3 when 
they are outside the LAN.  I know most POP3 clients will give their users the 
option of not deleting the messages from the server after they are downloaded, 
but is there any way to restrict them from being able to do so at the server 
level?

In other words, I want to disallow the server from accepting the DELE command 
from POP3 clients.

Is that possible?

We have some accounts that multiple users need simultaneous access to.  I don't 
want a user to decide to set up a POP3 account on his own on his iPad or 
something, and inadvertently blow the Inbox away for everybody else.

We have a satellite connection, so our upload speeds are real slow.  I think 
POP3 would give a lot better user experience than IMAP when they are outside 
the LAN.

Any help or advice will be greatly appreciated.

Peter, hieromonk


Dormition Skete
 Monastery Website:  http://www.DormitionSkete.org
 Convent Website:  http://www.HolyApostlesConvent.org
 




Re: [Dovecot] v2.2 status update

2013-03-20 Thread Thomas Leuxner
* Timo Sirainen  2013.03.20 11:37:

> I don't think you need the -o plugin/quota= here. dsync should ignore
> quota limits.

Just tried without and it adds the backup to the quota, forcing you to run 
recalc afterwards.


signature.asc
Description: Digital signature


Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread Timo Sirainen
On Wed, 2013-03-20 at 06:39 -0600, dormitionsk...@hotmail.com wrote:
> I'd like to use Dovecot as our IMAP server when our users are within our LAN, 
> but I'd also like to give them the ability to access their emails via POP3 
> when they are outside the LAN.  I know most POP3 clients will give their 
> users the option of not deleting the messages from the server after they are 
> downloaded, but is there any way to restrict them from being able to do so at 
> the server level?
> 
> In other words, I want to disallow the server from accepting the DELE command 
> from POP3 clients.
> 
> Is that possible?

You could create a (global) ACL to not allow user to delete own mails.
But some clients will probably keep redownloading the same mails over
and over again then.




Re: [Dovecot] v2.2 status update

2013-03-20 Thread Timo Sirainen
On Wed, 2013-03-20 at 13:40 +0100, Thomas Leuxner wrote:
> * Timo Sirainen  2013.03.20 11:37:
> 
> > I don't think you need the -o plugin/quota= here. dsync should ignore
> > quota limits.
> 
> Just tried without and it adds the backup to the quota, forcing you to run 
> recalc afterwards.

Oh, right, that it does. Difficult to fix it, since it should do that
one some quota backends/configs, but not others.




Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread Robert Schetterer
Am 20.03.2013 13:39, schrieb dormitionsk...@hotmail.com:
> I'd like to use Dovecot as our IMAP server when our users are within our LAN, 
> but I'd also like to give them the ability to access their emails via POP3 
> when they are outside the LAN.  I know most POP3 clients will give their 
> users the option of not deleting the messages from the server after they are 
> downloaded, but is there any way to restrict them from being able to do so at 
> the server level?
> 
> In other words, I want to disallow the server from accepting the DELE command 
> from POP3 clients.
> 
> Is that possible?
> 
> We have some accounts that multiple users need simultaneous access to.  I 
> don't want a user to decide to set up a POP3 account on his own on his iPad 
> or something, and inadvertently blow the Inbox away for everybody else.
> 
> We have a satellite connection, so our upload speeds are real slow.  I think 
> POP3 would give a lot better user experience than IMAP when they are outside 
> the LAN.
> 
> Any help or advice will be greatly appreciated.
> 
> Peter, hieromonk
> 
> 
> Dormition Skete
>  Monastery Website:  http://www.DormitionSkete.org
>  Convent Website:  http://www.HolyApostlesConvent.org
>  
> 
> 
> 

dont think this is possible, but you may redirect mails to subfolder (
filter for big mails ) with i.e. sieve and exclude the subfolder from
pop3 sight
i blogged some example with virtual plugin, sorry german and not exactly
what you asked for, its for auto sort spam mail , but perhaps it gives
you an idea how solve your problem

for the whole situation , why not simple allow only imap , and perhaps
use folder acl etc , downloading only subjects first  or some special
folders etc to save bandwith should be possible with most mobile clients

http://sys4.de/de/blog/2013/02/11/dovecot-virtual-setup-mit-globaler-sieve-spamfilter-regel-fur-pop3-nutzer/


Best Regards
MfG Robert Schetterer

-- 
[*] sys4 AG

http://sys4.de, +49 (89) 30 90 46 64
Franziskanerstraße 15, 81669 München

Sitz der Gesellschaft: München, Amtsgericht München: HRB 199263
Vorstand: Patrick Ben Koetter, Axel von der Ohe, Marc Schiffbauer
Aufsichtsratsvorsitzender: Joerg Heidrich


Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread dormitionsk...@hotmail.com
On Mar 20, 2013, at 6:43 AM, Timo Sirainen wrote:

> On Wed, 2013-03-20 at 06:39 -0600, dormitionsk...@hotmail.com wrote:
>> I'd like to use Dovecot as our IMAP server when our users are within our 
>> LAN, but I'd also like to give them the ability to access their emails via 
>> POP3 when they are outside the LAN.  I know most POP3 clients will give 
>> their users the option of not deleting the messages from the server after 
>> they are downloaded, but is there any way to restrict them from being able 
>> to do so at the server level?
>> 
>> In other words, I want to disallow the server from accepting the DELE 
>> command from POP3 clients.
>> 
>> Is that possible?
> 
> You could create a (global) ACL to not allow user to delete own mails.
> But some clients will probably keep redownloading the same mails over
> and over again then.
> 

Thank you for the speedy reply!

Is there any chance you might consider implementing this as an option sometime? 
 I assume the POP3 delivery code is separate from the IMAP code.  You wouldn't 
necessarily need to return an error code to the email client.  Most clients 
probably wouldn't know how to interpret it anyway.  Just quietly ignore the 
DELE command.  

Or would that leave us in the same position, where some clients may keep 
redownloading the same messages?

Also, how would I create a global ACL like you said, so I could test how our 
clients would react?  Everybody here uses Macs, iPads or iPhones. We would not 
necessarily have to support a wide variety of clients.

We're using sendmail.  I assume this is done in sendmail, not Dovecot?  Or 
should I go to the sendmail group for that, if I can't find anything on the net 
about it with Google?




Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread Thomas Leuxner
* dormitionsk...@hotmail.com  2013.03.20 14:17:

> Everybody here uses Macs, iPads or iPhones. We would not necessarily have to 
> support a wide variety of clients.

Their Mail Clients natively support IMAP, so not sure why you would want to go 
with POP3 in this scenario.


signature.asc
Description: Digital signature


Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread dormitionsk...@hotmail.com
> for the whole situation , why not simple allow only imap , and perhaps
> use folder acl etc , downloading only subjects first  or some special
> folders etc to save bandwith should be possible with most mobile clients

This would be the best, but this has to be done on the clients, right?  I don't 
see this as an option on either my MacBook Pro, or iPad.

I'll give your other suggestion some thought, too, though.

Thank you.  I really appreciate it.





Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread dormitionsk...@hotmail.com

On Mar 20, 2013, at 7:22 AM, Thomas Leuxner wrote:

> * dormitionsk...@hotmail.com  2013.03.20 14:17:
> 
>> Everybody here uses Macs, iPads or iPhones. We would not necessarily have to 
>> support a wide variety of clients.
> 
> Their Mail Clients natively support IMAP, so not sure why you would want to 
> go with POP3 in this scenario.


Well, like I said, we have real slow upload speeds.  I think POP3 would give a 
better user experience.




[Dovecot] Override quota settings with LDAP

2013-03-20 Thread Hanno Hirschberger

Hi all,

my current Dovecot setup is fetching both the imap quota limit and the 
mail location settings from LDAP entries.


user_attrs = [...] UDBmailQuota=quota_rule=*:bytes=%$, mailLocation=mail

That is because we have 3 users who wants to fetch their mail from 
/var/mail/. All the other users have maildir with maildir quota.


The LDAP entry for /var/mail user looks like this:

mailLocation: mbox:/var/empty:INBOX=/var/mail/:INDEX=MEMORY

Works fine with one exception: the mail quota for /var/mail users. The 
dovecot log gets spammed with:


Mar 20 13:37:04 lmtp(2494, username): Warning: quota: Namespace '' is 
not Maildir, skipping for Maildir++ quota


Mar 20 13:37:04 lmtp(2494, username): Error: opendir(/var/empty/.imap) 
failed: No such file or directory


... which is only logical, because there's no maildir for that user. I 
want to get rid of these error messages and like to ask you if there's a 
way to override the "quota = maildir:User quota" setting in my Dovecot 
configuration for the 3 /var/mail users. For example with an extra LDAP 
field?


Sadly I don't really know how to realize this. Or is there any other / 
better way?


You can look at my doveconf -n output here: http://pastebin.com/mJZ2CXbg

Best regards,

Hanno


Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread Thomas Leuxner
* dormitionsk...@hotmail.com  2013.03.20 14:35:

> > Their Mail Clients natively support IMAP, so not sure why you would want to 
> > go with POP3 in this scenario.
> 
> 
> Well, like I said, we have real slow upload speeds.  I think POP3 would give 
> a better user experience.

The clients mentioned will cache the messages locally. They will download 
headers first while they will retrieve the rest in the background. iOS Devices 
will even apply thresholds on larger messages downloading them partly and 
completing the rest upon request.

Regards
Thomas


signature.asc
Description: Digital signature


Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread dormitionsk...@hotmail.com

On Mar 20, 2013, at 7:51 AM, Thomas Leuxner wrote:

> * dormitionsk...@hotmail.com  2013.03.20 14:35:
> 
>>> Their Mail Clients natively support IMAP, so not sure why you would want to 
>>> go with POP3 in this scenario.
>> 
>> 
>> Well, like I said, we have real slow upload speeds.  I think POP3 would give 
>> a better user experience.
> 
> The clients mentioned will cache the messages locally. They will download 
> headers first while they will retrieve the rest in the background. iOS 
> Devices will even apply thresholds on larger messages downloading them partly 
> and completing the rest upon request.
> 
> Regards
> Thomas


Really?  Interesting.

Thank you.

My experience with IMAP over the internet with a couple of servers outside our 
monastery (while I was in it, and we have considerably better download speeds 
than upload) has always been that IMAP has always been incredibly slow.  So, 
I've always just allowed users to connect to the IMAP server via webmail.  It's 
slow, but usable.  

I guess it's time to open a port in our firewall and do some testing with a 
couple of clients from outside.  Maybe they'll work better than I've always 
assumed.  

I appreciate the input, everybody.

Thank you.

fp




Re: [Dovecot] dovecot: auth-worker: order of authentication types

2013-03-20 Thread David Obando
I found out myself how to control the order:
http://wiki2.dovecot.org/Authentication/MultipleDatabases.

still asking how to set up dovecot authentication so
*users that authenticate with only their username (i.e. system users)
always and only use PAM authentication
*users that authenticate with their e-mail-address always and only use
SQL authentication

thanks,
david

David Obando schrieb am 19.03.2013 17:43:
> Hi all,
>
> I'm setting a mailserver using dovecot version: 2.1.7. On the server I
> have a couple of system users using PAM authentication and a lot of
> virtual users using SQL authentication.
>
> When a virtual user (e.g. da...@virtdomain.de) logs in dovecot tries to
> authenticate the user via PAM and after failing it uses SQL:
>
> Mar 19 11:39:42 orange dovecot: auth-worker(7815):
> pam(da...@virtdomain.de,): pam_authenticate() failed:
> Authentication failure (password mismatch?)
> Mar 19 11:39:42 orange dovecot: auth: passwd(da...@virtdomain.de, address>,): unknown user
> Mar 19 11:39:42 orange dovecot: imap-login: Login:
> user=, method=PLAIN, rip=<...>, lip=<...>,
> mpid=7816, TLS
>
>
> Could I set up dovecot authentication so
> *users that authenticate with only their username (i.e. system users)
> always and only use PAM authentication
> *users that authenticate with their e-mail-address always and only use
> SQL authentication
> ???
>
>
> Thanks,
> david
>


-- 
The day microsoft makes something that doesn't suck is the day they start 
making vacuum cleaners.
gpg --keyserver pgp.mit.edu --recv-keys 1920BD87
Key fingerprint = 3326 32CE 888B DFF1 DED3  B8D2 105F 29CB 1920 BD87



Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread Timo Sirainen
On Wed, 2013-03-20 at 08:15 -0600, dormitionsk...@hotmail.com wrote:

> My experience with IMAP over the internet with a couple of servers outside 
> our monastery (while I was in it, and we have considerably better download 
> speeds than upload) has always been that IMAP has always been incredibly 
> slow.  So, I've always just allowed users to connect to the IMAP server via 
> webmail.  It's slow, but usable.  

Another idea: Get some cheap server from outside, use dsync replication
to keep it synced with your internal one, and set up DNS so that users
get directed to the fastest server. http://wiki2.dovecot.org/Replication




Re: [Dovecot] %{session} does not work with deliver_log_format

2013-03-20 Thread Timo Sirainen
On 25.2.2013, at 23.34, Daniel Parthey 
 wrote:

>> LMTP has a completely different session ID currently, which gets reset for 
>> each mail delivery and is written to the Received: header that it writes.
>> It doesn't traverse through proxies, because each delivery gets a different 
>> ID anyway.
>> 
>> So .. Why is it that you want this? For matching a log line with a Received:
>> header? I guess that could be done, but the name should probably be different
>> from %{session} so it won't get mixed up with what IMAP/POP3 uses it for.
> 
> I simply run an LMTP director/proxy to prevent NFS locking issues
> and in error cases I want to investigate where the mail has gone
> (through the director lmtp to the mailbox lmtp). I thought this
> is what "session IDs" were intended for.

The SMTP server should log the delivery ID that the backend generates, and you 
should be able to grep for it, right?

> Obviously, the generated ID is a different one for director and mailbox,
> looking at the Received: lines of a single message:
> 
> Received: from mail01.example.org ([10.129.3.193])
>  by mail01.example.org (Dovecot) with LMTP id vdSeD+CrK1HXZQAAiWCYmA
>  ; Mon, 25 Feb 2013 19:25:02 +0100
> Received: from mx01.example.org ([127.0.0.1])
>  by mail01.example.org (Dovecot) with LMTP id fu7aIn6sK1EMaQAAiWCYmA
>  ; Mon, 25 Feb 2013 19:25:02 +0100
> 
> What would you suggest how to track an LMTP delivery through a
> director proxy? Should one use the MessageID to correlate the
> lmtp log entries in dovecot-director.log and dovecot.log?

I was first thinking about having LMTP proxy log the delivery ID, until I 
noticed that LMTP proxy doesn't log anything about delivered mails currently. 
I'm not really sure if that would be of any actual help?..



Re: [Dovecot] Imaptest: Fatal: opendir(/usr/local/lib/dovecot) failed: No such file or directory

2013-03-20 Thread Timo Sirainen
On 28.2.2013, at 16.36, Steffen Kaiser  wrote:

>>> When I build imaptest with an installed v2.2 instance, 
>>> libssl_iostream_openssl.so is loaded from /usr/local/lib/dovecot .
>> 
>> Don't usee SSL connections, so it won't load it? :)
> 
> OK, I needed two tries to understand :-)
> 
> imaptest does not use SSL itself, its connections are clear text, but the 
> dovecot library is loading the library nonetheless.

Fixed: http://hg.dovecot.org/imaptest/rev/06c24f17871b



Re: [Dovecot] Exposing masteruser info to cllients via lmtp-proxy connections

2013-03-20 Thread Timo Sirainen
On 4.3.2013, at 0.54, Alexandr Sabitov  
wrote:

> Please somebody suggest me how to remove the "*masteruser" appendix from the 
> dovecot director database while using masteruser authentication.

Not sure about how to fix that, but maybe you can get rid of the *masteruser 
completely? Instead of using that, just return "master=masteruser" field. 
http://wiki2.dovecot.org/PasswordDatabase/ExtraFields/Proxy#Master_password



Re: [Dovecot] Stability of extraction of attachment

2013-03-20 Thread Timo Sirainen
On 4.3.2013, at 12.36, Angel L. Mateo  wrote:

> Hello,
> 
>   We are migrating our dovecot servers from 2.1.9 to 2.1.15 (or 2.2 if 
> there is a stable version soon) and maildir format to mdbox.
> 
>   Looking for mdbox options I have found options:
> 
> * mail_attachment_dir
> * mail_attachement_min_size
> * mail_attachment_fs
> * mail_attachment_hash
> 
>   but this options are described with the message:
> 
> # WARNING: This feature hasn't been tested much yet. Use at your own risk.
> 
>   What is the state of these options? Could I use it in a production 
> environment?

I just forgot to remove that warning. Removed now in v2.2 (not in v2.1, because 
people complain if I do unnecessary changes to example-config).

> In case of yes, what is the best deduplicating option? Let it to the FS? Or 
> configuring with "sis posix" or "sis-queue posix"?


If FS supports it then let it do it. If it doesn't, sis is easier than 
sis-queue since it doesn't need a cronjob. Also I'm not sure if sis-queue makes 
the performance better or not (the idea being that it delays the slowness until 
night when it's more quiet).



Re: [Dovecot] Maildir or Mdbox and expunge messages.

2013-03-20 Thread Timo Sirainen
On 5.3.2013, at 11.55, Evgeny Basov  wrote:

> I tested dovecot's work with expunge messages on Mdbox over strace (see
> at tail of message). As I can see  dovecot process opens old storage m.*
> file, reads it content, opens new temporary file, writes in this one
> content and rename this new one to m.(*+1).

You're talking about doveadm purge, right? Not expunge.

> How fast this algorithm works on system with about 1 users and 5Tb
> data? I will use mdbox_rotate_interval for delayed expunge but I think
> that simple delete file in Maildir must be faster than expunge from Mdbox.

Yes, Maildir/sdbox is faster when freeing up disk space for mails. Read and 
save operations should be faster in mdbox though. And if the purge is run at a 
time when there is less disk IO, it shouldn't be that bad.



Re: [Dovecot] Lot of dovecot process writes

2013-03-20 Thread Timo Sirainen
On 6.3.2013, at 14.44, Angel L. Mateo  wrote:

>>> While monitoring my servers' behaviour (ubuntu 12.04 with dovecot
>>> 2.1.9, with about 7 users) I have found that lots of disk usage is
>>> done by dovecot process (the parent process). Since lmtp, imap and pop3
>>> connections are handle by their own process, what could be the reason of
>>> this?
> 
>   In any case, I don't understand why dovecot parent process has these 
> huge amount of IO, since, I guess, IO should be done by user's processes 
> (lmtp, imap or pop), not dovecot parent.

Right.

>   My only hypothesis is related with log messages, but then IO should be 
> done by rsyslog process, not dovecot, shouldn't it?

Master process doesn't even log messages, log process does that.

There is no reason why dovecot master process would be doing any disk IO. Maybe 
whatever you're looking at is counting the child processes' disk IO as well?



Re: [Dovecot] Core dump in 2.2.rc2 with FETCH 1 BODY.PEEK[ALL]

2013-03-20 Thread Timo Sirainen
On 7.3.2013, at 10.30, Steffen Kaiser  wrote:

> 2 FETCH 1 BODY.PEEK[ALL]
> 
> dumps core, bt full is:

Thanks, fixed: http://hg.dovecot.org/dovecot-2.2/rev/ab434891f2af



Re: [Dovecot] [dovecot-2.1.15] mdbox corruption, doveadm force-resync can't repair it (throws segfault)

2013-03-20 Thread Timo Sirainen
On 7.3.2013, at 14.12, Marcin Mirosław  wrote:

> Here is backtrace from doveadm force-resync:
> 
> #0  rebuild_mailbox_multi (trans=0x428b58d090, view=,
> rebuild_ctx=0x428b5a0690, ctx=0x428b57a9a0, mbox=) at
> mdbox-storage-rebuild.c:433
> 433 map_uid = rec->map_uid;

Yeah, I fixed this immediately after 2.1.15: 
http://hg.dovecot.org/dovecot-2.1/rev/2def25f07ca6

I guess it's soon time for 2.1.16.



Re: [Dovecot] ACL to make mailboxes populated by master account Read Only for regular users.

2013-03-20 Thread Timo Sirainen
On 7.3.2013, at 19.10, Alex Cherniak  wrote:

> We have a solution using Dovecot as a secondary mail archive. All mailboxes
> are populated/groomed by master account and the actual users have only read
> access.
> This is achieved by a simple ACL approach.
> dovecot.conf has
> protocol imap { mail_plugins = acl quota imap_quota zlib }
> plugin { acl = vfile:/etc/dovecot/acls:cache_secs=300 }
> 
> /etc/dovecot/acls/.DEFAULT file is trivial:
> user=master lrwstipekxa
> owner lr
> 
> It used to work with Dovecot 2.0.4 for years, but after upgrade to 2.0.18
> users now have full access to folders created by master account and can
> delete, add and move mails.
> 
> Should it behave this way? How can I "secure" mailboxes again? Any help
> is appreciated.

I don't remember how it used to work, but it was never intended to work the way 
you use it. It probably didn't even fully work the way you thought it did. The 
.DEFAULT name is also misleading. Dovecot unfortunately still doesn't support 
"default ACLs".



Re: [Dovecot] dovecot: imap-login: Aborted login (auth failed, 1 attempts in 2 secs): user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, TLS, session=<1pBG/03XogB/AAAB>

2013-03-20 Thread Timo Sirainen
On 8.3.2013, at 8.08, pvsuja  wrote:

> Through wireshark, I found the username and password is going in plain text
> only to the server.
> How will I enable starttls in ImapcProxy before any communication starts?

imapc_ssl = starttls

See also other related settings in http://wiki2.dovecot.org/Migration/Dsync

I guess imapc should have its own wiki page some day.



Re: [Dovecot] Logon with Client Certificate and OTP fallback

2013-03-20 Thread Timo Sirainen
On 10.3.2013, at 12.28, dovecot.pk...@dfgh.net wrote:

> For 10 years we are using a very simple POP3-server where
> I replaced the authentication routines with my own functions
> and these function are doing the following:
> 
> 1) if the connection was made without SSL refuse to connect
> 2) if the client was using a client certificate extract the username
> from the certificate. Since we cannot stop Thunderbird from
> sending a username/passowrd-combination we compare the
> username from the certificate with the username Thunderbird has
> sent. If the usernames matches we allow access and ignore
> the password.
> 3) if the client did not sent a client certificate we calculate the
> current OneTimePassword of the users OTP-token and compare
> that with the password Thunderbird has sent. If the passwords matches
> we allow access. If a OTP-password was validated it can be used
> for 24 hours so our OTP-users must use their tokens only once a day.
> 
> Now we would like to switch from POP3 to IMAP, so here are my
> questions:
> 
> - can Dovecot be CONFIGURED to do the above. I compiled it yesterday
> and SSL client authentication works as expected. OTP seems to be
> supported via PAM and I can write a PAM-modul for our OTP-tokens,
> so OTP would be possible too. But how do I tell Dovecot to do
> OTP-auth as a fallback for ClientCert-auth.

Create a passdb that succeeds if user has a valid SSL client cert. 
http://wiki2.dovecot.org/Variables has %k which is "valid" if client has it 
set. There are several ways you can do this .. for example with sqlite do a 
SELECT that checks for %k. Another possibility is a checkpassword script.

The secondary passdb would then be the OTP.

> - I already looked into the sourcecode of Dovecot. Seems like all the
> authentication routines were built as pluggable modules. Is there any
> documentation out there on how how to built my own auth-module.
> Integrating the OTP-auth directly into Dovecot would be a lot
> easier (for me) than creating a PAM-module, so I would prefer that.
> If there was interest from other people I would add some configuration
> options to Dovecot (for example the location of the OTP-token list).
> Otherwise I would just hardcode everything into the source.

See how the auth process already can build an ldap plugin. For outside sources 
you can build auth plugins the same way as any other plugins. 
http://dovecot.org/patches/ has many such example plugins. Or see how 
Pigeonhole does it with autotools.



Re: [Dovecot] 2.2rc2 core dump

2013-03-20 Thread Timo Sirainen
On 11.3.2013, at 16.00, Heiko Schlichting  wrote:

> using dovecot 2.2rc2 I got core dumps during IMAP subscription change if
> the CONTROL directory (specified in mail_location) does not exists.
> 
> userdb_mail: 
> mbox:~/Test:INBOX=~/Test/heiko:INDEX=~/.imap/index:CONTROL=~/.imap/control
> 
> If ~/.imap/control does not exists, dovecot crashes. See below for log msg,
> full backtrace and configuration.

I can't reproduce this with latest hg, so I think it's fixed?



Re: [Dovecot] dsync migration questions

2013-03-20 Thread Timo Sirainen
On 14.3.2013, at 21.07, Michael Smith (DF)  wrote:

> dsync -D -v -R -u ana...@domain.com backup mbox:/mnt/mail/mail_spool/.migrate/
..
> dsync(anakin): Error: Trying to open a non-listed mailbox with 
> guid=814b6332541c42516949a72406a4
> dsync(anakin): Error: msg iteration failed: Couldn't open mailbox 
> 814b6332541c42516949a72406a4
> dsync(anakin): Error: Trying to open a non-listed mailbox with 
> guid=814b6332541c42516949a72406a4
> 
> Nothing was migrated.  In some other combinations, trying to reproduce them 
> again, it does migrate the old mail, but first destroys the existing mail in 
> the new mailbox.

Use doveadm sync (= dsync mirror) instead of backup.

> Our goal is to cut mail delivery over to the new dovecot system (which will 
> result in existing emails before migration), and then migrate the old mail 
> *while* maintaining message UIDs.  This is the easiest way to ensure no 
> "lost" email with the migration.
> 
> What are we doing wrong, and how do we achieve our goals?

Looks like a dsync bug. v2.2 has much better dsync with clearer errors.



Re: [Dovecot] v2.2 dsync

2013-03-20 Thread Timo Sirainen
On 14.3.2013, at 12.05, Walter Steiner  wrote:

 #0  0x004578cc in dsync_ibc_send_mail_request (ibc=0x4a9f20, 
 request=0x5441c0) at dsync-ibc.c:38
 38  return ibc->v.is_send_queue_full(ibc) ?

If it crashes there, is_send_queue_full must be NULL or some other invalid 
pointer, but..

>> is_send_queue_full = 0x45c855 , 

It's not. So gdb is probably showing wrong place for the crash (the alternative 
would be some kind of a compiler bug).

> is there a chance that the crash I have reported two weeks ago can be
> fixed?  Or any thoughts about what triggers it / what I better try to
> avoid / I do wrong?  Any help is appreciated!

Try compiling Dovecot without any optimization flags (e.g.: CFLAGS=-g 
./configure)

Or if you're using Sun CC, try with GCC.

With those hopefully you'll get a crash in a different location that can be 
fixed?

(Anyway, dsync v2.2 + imapc is something I haven't tested much yet. But I think 
it should work at least in theory..)



Re: [Dovecot] shared folders and "subscriptions = yes"

2013-03-20 Thread Timo Sirainen
On 15.3.2013, at 19.29, Lars Uhlmann  wrote:

> To have all IMAP-Users automatically updated their shared folder
> structure I use "subscriptions = yes".
> This works with the side effect, that all IMAP-Users can see _all_
> folders in every namespace even if they do not have "lookup" access.
> This is of course not wanted.
> 
> Is it possible to have dovecot check the ACL file in the root of a
> namespace before it parses the subscrptions file?


I guess it could be checking ACLs for subscriptions when they're coming from a 
public namespace with subscriptions=yes. See if you can implement it. :)



Re: [Dovecot] Zlib plugin: Compress emails for one folder only

2013-03-20 Thread Timo Sirainen
On 16.3.2013, at 14.43, Andre Rodier  wrote:

> Hello everyone,
> 
> Is it possible to configure the zlib plugin to compress the emails in one 
> folder only?
> 
> I would like to compress the emails when they are stored in my 'Archives' 
> folders and sub folders.

Nope. With hardcoding it would be a simple one line of code addition.

Some day in future there will be namespace-specific settings. Then you could 
create Archive namespace and enable zlib compression only for that namespace.



Re: [Dovecot] lda: duplicate prefix?

2013-03-20 Thread Timo Sirainen
On 4.3.2013, at 8.50, Larry Rosenman  wrote:

> I've just started using Dovecot, and can't seem to get the LDA to work.
> 
> I get the  following error:
> Mar  4 00:47:19 thebighonker dovecot: lda(ler): Error: user ler:
> Initialization failed: namespace configuration error: Duplicate namespace
> prefix: ""

Something's broken. It's complaining about duplicate namespace { prefix= } but 
your config has only one such namespace. My guess is that it's related to the 
snarf plugin. Does it work without it? Also you could see if LMTP works instead 
of LDA.



Re: [Dovecot] lda: duplicate prefix?

2013-03-20 Thread Larry Rosenman
I really need the snarf plugin to work, also, I don't think LMTP will let
me redirect to files using the Exim Filters.

What can you tell me to help debug this?




On Wed, Mar 20, 2013 at 1:00 PM, Timo Sirainen  wrote:

> On 4.3.2013, at 8.50, Larry Rosenman  wrote:
>
> > I've just started using Dovecot, and can't seem to get the LDA to work.
> >
> > I get the  following error:
> > Mar  4 00:47:19 thebighonker dovecot: lda(ler): Error: user ler:
> > Initialization failed: namespace configuration error: Duplicate namespace
> > prefix: ""
>
> Something's broken. It's complaining about duplicate namespace { prefix= }
> but your config has only one such namespace. My guess is that it's related
> to the snarf plugin. Does it work without it? Also you could see if LMTP
> works instead of LDA.
>
>


-- 
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
US Mail: 430 Valona Loop, Round Rock, TX 78681-3893


Re: [Dovecot] Override quota settings with LDAP

2013-03-20 Thread Timo Sirainen
On 20.3.2013, at 15.25, Hanno Hirschberger  
wrote:

> Mar 20 13:37:04 lmtp(2494, username): Warning: quota: Namespace '' is not 
> Maildir, skipping for Maildir++ quota
> 
> Mar 20 13:37:04 lmtp(2494, username): Error: opendir(/var/empty/.imap) 
> failed: No such file or directory
> 
> ... which is only logical, because there's no maildir for that user. I want 
> to get rid of these error messages and like to ask you if there's a way to 
> override the "quota = maildir:User quota" setting in my Dovecot configuration 
> for the 3 /var/mail users. For example with an extra LDAP field?
> 
> Sadly I don't really know how to realize this. Or is there any other / better 
> way?

Yes, you can override either mail_plugins setting or (probably better) the 
"quota" setting. If the LDAP value doesn't exist the default is used, if it's 
empty it overrides the default with an empty setting.



Re: [Dovecot] dovecot: auth-worker: order of authentication types

2013-03-20 Thread Timo Sirainen
On 20.3.2013, at 16.42, David Obando  wrote:

> still asking how to set up dovecot authentication so
> *users that authenticate with only their username (i.e. system users)
> always and only use PAM authentication
> *users that authenticate with their e-mail-address always and only use
> SQL authentication

You can't. Just make it do the SQL auth first and system auth second.



Re: [Dovecot] lda: duplicate prefix?

2013-03-20 Thread Timo Sirainen
Test first if it's because of the snarf plugin? I'm not sure that it is.

On 20.3.2013, at 20.02, Larry Rosenman  wrote:

> I really need the snarf plugin to work, also, I don't think LMTP will let
> me redirect to files using the Exim Filters.
> 
> What can you tell me to help debug this?
> 
> 
> 
> 
> On Wed, Mar 20, 2013 at 1:00 PM, Timo Sirainen  wrote:
> 
>> On 4.3.2013, at 8.50, Larry Rosenman  wrote:
>> 
>>> I've just started using Dovecot, and can't seem to get the LDA to work.
>>> 
>>> I get the  following error:
>>> Mar  4 00:47:19 thebighonker dovecot: lda(ler): Error: user ler:
>>> Initialization failed: namespace configuration error: Duplicate namespace
>>> prefix: ""
>> 
>> Something's broken. It's complaining about duplicate namespace { prefix= }
>> but your config has only one such namespace. My guess is that it's related
>> to the snarf plugin. Does it work without it? Also you could see if LMTP
>> works instead of LDA.
>> 
>> 
> 
> 
> -- 
> Larry Rosenman http://www.lerctr.org/~ler
> Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
> US Mail: 430 Valona Loop, Round Rock, TX 78681-3893



Re: [Dovecot] lda: duplicate prefix?

2013-03-20 Thread Larry Rosenman
The issue is this is my production box, and I've gotten around this by NOT
using the LDA, and just having Exim writing the mbox files.

Is there any easy way to test just the LDA?  Or trace this?



On Wed, Mar 20, 2013 at 1:06 PM, Timo Sirainen  wrote:

> Test first if it's because of the snarf plugin? I'm not sure that it is.
>
> On 20.3.2013, at 20.02, Larry Rosenman  wrote:
>
> > I really need the snarf plugin to work, also, I don't think LMTP will let
> > me redirect to files using the Exim Filters.
> >
> > What can you tell me to help debug this?
> >
> >
> >
> >
> > On Wed, Mar 20, 2013 at 1:00 PM, Timo Sirainen  wrote:
> >
> >> On 4.3.2013, at 8.50, Larry Rosenman  wrote:
> >>
> >>> I've just started using Dovecot, and can't seem to get the LDA to work.
> >>>
> >>> I get the  following error:
> >>> Mar  4 00:47:19 thebighonker dovecot: lda(ler): Error: user ler:
> >>> Initialization failed: namespace configuration error: Duplicate
> namespace
> >>> prefix: ""
> >>
> >> Something's broken. It's complaining about duplicate namespace {
> prefix= }
> >> but your config has only one such namespace. My guess is that it's
> related
> >> to the snarf plugin. Does it work without it? Also you could see if LMTP
> >> works instead of LDA.
> >>
> >>
> >
> >
> > --
> > Larry Rosenman http://www.lerctr.org/~ler
> > Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
> > US Mail: 430 Valona Loop, Round Rock, TX 78681-3893
>
>


-- 
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
US Mail: 430 Valona Loop, Round Rock, TX 78681-3893


Re: [Dovecot] v2.2 dsync

2013-03-20 Thread Timo Sirainen
On 20.3.2013, at 19.51, Timo Sirainen  wrote:

> On 14.3.2013, at 12.05, Walter Steiner  wrote:
> 
> #0  0x004578cc in dsync_ibc_send_mail_request (ibc=0x4a9f20, 
> request=0x5441c0) at dsync-ibc.c:38
> 38  return ibc->v.is_send_queue_full(ibc) ?
> 
> If it crashes there, is_send_queue_full must be NULL or some other invalid 
> pointer, but..

Oh, the function is correct but the line number is wrong. This fixes the crash: 
http://hg.dovecot.org/dovecot-2.2/rev/19ce7403114f

But I see there are other problems .. I'll continue debugging them.

Re: [Dovecot] 2.2rc2 core dump

2013-03-20 Thread Heiko Schlichting
Timo Sirainen wrote:
> On 11.3.2013, at 16.00, Heiko Schlichting  wrote:
> 
> > using dovecot 2.2rc2 I got core dumps during IMAP subscription change if
> > the CONTROL directory (specified in mail_location) does not exists.
> > 
> > userdb_mail: 
> > mbox:~/Test:INBOX=~/Test/heiko:INDEX=~/.imap/index:CONTROL=~/.imap/control
> > 
> > If ~/.imap/control does not exists, dovecot crashes. See below for log msg,
> > full backtrace and configuration.
> 
> I can't reproduce this with latest hg, so I think it's fixed?

Latest hg is not so easy as you commit every few minutes.

Testing with one hour old changeset 16065 ab434891f2af failed during
compilation:

gcc -DHAVE_CONFIG_H -I. -I../..  -I../../src/lib 
-DMODULE_DIR=\""/home/dovecot/server/lib/dovecot"\"   -std=gnu99 -g -O2 -Wall 
-W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith 
-Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime 
-Wstrict-aliasing=2-MT fs-test.o -MD -MP -MF .deps/fs-test.Tpo -c -o 
fs-test.o fs-test.c
fs-test.c:7:26: error: iostream-ssl.h: No such file or directory
fs-test.c:12: error: variable 'ssl_set' has initializer but incomplete type
fs-test.c:13: error: unknown field 'ca_dir' specified in initializer
fs-test.c:14: warning: excess elements in struct initializer
fs-test.c:14: warning: (near initialization for 'ssl_set')
make[3]: *** [fs-test.o] Error 1

So I reverted changeset 16040 70dd78cd89ab and run into the next problem:

make[4]: Entering directory 
`/home/dovecot/src/dovecot/src/replication/replicator'
make[4]: *** No rule to make target `doveadm-connection.c', needed by 
`doveadm-connection.o'.  Stop.

Maybe I should wait until tomorrow and check when your are finished with
your currect coding activities.

Heiko

Heiko SchlichtingFreie Universität Berlin
heiko.schlicht...@fu-berlin.de   Zentraleinrichtung für Datenverarbeitung
Telefon +49 30 838-54327 Fabeckstraße 32
Telefax +49 30 838454327 14195 Berlin


Re: [Dovecot] 2.2rc2 core dump

2013-03-20 Thread Timo Sirainen
On 20.3.2013, at 20.26, Heiko Schlichting  wrote:

> Testing with one hour old changeset 16065 ab434891f2af failed during
> compilation:
> 
> gcc -DHAVE_CONFIG_H -I. -I../..  -I../../src/lib 
> -DMODULE_DIR=\""/home/dovecot/server/lib/dovecot"\"   -std=gnu99 -g -O2 -Wall 
> -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith 
> -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime 
> -Wstrict-aliasing=2-MT fs-test.o -MD -MP -MF .deps/fs-test.Tpo -c -o 
> fs-test.o fs-test.c
> fs-test.c:7:26: error: iostream-ssl.h: No such file or directory

The Makefile is out of date. You need to run autogen.sh and configure again. Or 
use configure --enable-maintainer-mode so you don't have to remember to do that.



Re: [Dovecot] lda: duplicate prefix?

2013-03-20 Thread Larry Rosenman
Also, I *CAN* give SSH access to the box if you need/want it.



On Wed, Mar 20, 2013 at 1:18 PM, Larry Rosenman  wrote:

> The issue is this is my production box, and I've gotten around this by NOT
> using the LDA, and just having Exim writing the mbox files.
>
> Is there any easy way to test just the LDA?  Or trace this?
>
>
>
> On Wed, Mar 20, 2013 at 1:06 PM, Timo Sirainen  wrote:
>
>> Test first if it's because of the snarf plugin? I'm not sure that it is.
>>
>> On 20.3.2013, at 20.02, Larry Rosenman  wrote:
>>
>> > I really need the snarf plugin to work, also, I don't think LMTP will
>> let
>> > me redirect to files using the Exim Filters.
>> >
>> > What can you tell me to help debug this?
>> >
>> >
>> >
>> >
>> > On Wed, Mar 20, 2013 at 1:00 PM, Timo Sirainen  wrote:
>> >
>> >> On 4.3.2013, at 8.50, Larry Rosenman  wrote:
>> >>
>> >>> I've just started using Dovecot, and can't seem to get the LDA to
>> work.
>> >>>
>> >>> I get the  following error:
>> >>> Mar  4 00:47:19 thebighonker dovecot: lda(ler): Error: user ler:
>> >>> Initialization failed: namespace configuration error: Duplicate
>> namespace
>> >>> prefix: ""
>> >>
>> >> Something's broken. It's complaining about duplicate namespace {
>> prefix= }
>> >> but your config has only one such namespace. My guess is that it's
>> related
>> >> to the snarf plugin. Does it work without it? Also you could see if
>> LMTP
>> >> works instead of LDA.
>> >>
>> >>
>> >
>> >
>> > --
>> > Larry Rosenman http://www.lerctr.org/~ler
>> > Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
>> > US Mail: 430 Valona Loop, Round Rock, TX 78681-3893
>>
>>
>
>
> --
> Larry Rosenman http://www.lerctr.org/~ler
> Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
> US Mail: 430 Valona Loop, Round Rock, TX 78681-3893
>



-- 
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
US Mail: 430 Valona Loop, Round Rock, TX 78681-3893


Re: [Dovecot] 2.2rc2 core dump

2013-03-20 Thread Heiko Schlichting
> On 20.3.2013, at 20.26, Heiko Schlichting  wrote:
> 
> > Testing with one hour old changeset 16065 ab434891f2af failed during
> > compilation:
> > 
> > gcc -DHAVE_CONFIG_H -I. -I../..  -I../../src/lib 
> > -DMODULE_DIR=\""/home/dovecot/server/lib/dovecot"\"   -std=gnu99 -g -O2 
> > -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith 
> > -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime 
> > -Wstrict-aliasing=2-MT fs-test.o -MD -MP -MF .deps/fs-test.Tpo -c -o 
> > fs-test.o fs-test.c
> > fs-test.c:7:26: error: iostream-ssl.h: No such file or directory
> 
> The Makefile is out of date. You need to run autogen.sh and configure again. 
> Or use configure --enable-maintainer-mode so you don't have to remember to do 
> that.

Yes, sorry.

But it still crashes if I subscribe and the CONTROL=... directory does not 
exists:

Mar 20 19:38:58 13:island dovecot: imap(heiko): Error: Raw backtrace: 
/home/dovecot/server/lib/dovecot/libdovecot.so.0(+0x6131a) [0x7f011db8d31a] -> 
/home/dovecot/server/lib/dovecot/libdovecot.so.0(+0x61366) [0x7f011db8d366] -> 
/home/dovecot/server/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f011db4e1df] -> 
/home/dovecot/server/lib/dovecot/libdovecot-storage.so.0(mailbox_list_try_mkdir_root+0x573)
 [0x7f011de68fc3] -> 
/home/dovecot/server/lib/dovecot/libdovecot-storage.so.0(mailbox_list_mkdir_root+0x12)
 [0x7f011de69012] -> 
/home/dovecot/server/lib/dovecot/libdovecot-storage.so.0(subsfile_set_subscribed+0x346)
 [0x7f011de7b486] -> 
/home/dovecot/server/lib/dovecot/libdovecot-storage.so.0(mailbox_list_set_subscribed+0x1b)
 [0x7f011de6633b] -> 
/home/dovecot/server/lib/dovecot/libdovecot-storage.so.0(index_storage_set_subscribed+0x48)
 [0x7f011de8a9f8] -> dovecot/imap [heiko 130.133.5.5 
SUBSCRIBE](cmd_subscribe_full+0xd8) [0x412a18] -> dovecot/imap [heiko 
130.133.5.5 SUBSCRIBE](command_exec+0x3d) [0x41609d] -> dovecot/imap [heiko 
130.133.5.5 SUBSCRIBE]() [0x4151f0] -> dovecot/imap [heiko 130.133.5.5 
SUBSCRIBE]() [0x4152dd] -> dovecot/imap [heiko 130.133.5.5 
SUBSCRIBE](client_handle_input+0x11d) [0x41555d] -> dovecot/imap [heiko 
130.133.5.5 SUBSCRIBE](client_input+0x6f) [0x4158df] -> 
/home/dovecot/server/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x36) 
[0x7f011db9c076] -> 
/home/dovecot/server/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xaf) 
[0x7f011db9d0ef] -> 
/home/dovecot/server/lib/dovecot/libdovecot.so.0(io_loop_run+0x28) 
[0x7f011db9c018] -> 
/home/dovecot/server/lib/dovecot/libdovecot.so.0(master_service_run+0x13) 
[0x7f011db52ea3] -> dovecot/imap [heiko 130.133.5.5 SUBSCRIBE](main+0x2a7) 
[0x41eb57] -> /lib/libc.so.6(__libc_start_main+0xfd) [0x7f011d7e8c8d] -> 
dovecot/imap [heiko 130.133.5.5 SUBSCRIBE]() [0x40b5c9]

After creating the CONTROL=... directory manually with mkdir it works
without problems.

Heiko

Heiko SchlichtingFreie Universität Berlin
heiko.schlicht...@fu-berlin.de   Zentraleinrichtung für Datenverarbeitung
Telefon +49 30 838-54327 Fabeckstraße 32
Telefax +49 30 838454327 14195 Berlin


Re: [Dovecot] 2.2rc2 core dump

2013-03-20 Thread Timo Sirainen
On 20.3.2013, at 20.42, Heiko Schlichting  wrote:

>> On 20.3.2013, at 20.26, Heiko Schlichting  wrote:
>> 
>>> Testing with one hour old changeset 16065 ab434891f2af failed during
>>> compilation:
>>> 
>>> gcc -DHAVE_CONFIG_H -I. -I../..  -I../../src/lib 
>>> -DMODULE_DIR=\""/home/dovecot/server/lib/dovecot"\"   -std=gnu99 -g -O2 
>>> -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith 
>>> -Wchar-subscripts -Wformat=2 -Wbad-function-cast -fno-builtin-strftime 
>>> -Wstrict-aliasing=2-MT fs-test.o -MD -MP -MF .deps/fs-test.Tpo -c -o 
>>> fs-test.o fs-test.c
>>> fs-test.c:7:26: error: iostream-ssl.h: No such file or directory
>> 
>> The Makefile is out of date. You need to run autogen.sh and configure again. 
>> Or use configure --enable-maintainer-mode so you don't have to remember to 
>> do that.
> 
> Yes, sorry.
> 
> But it still crashes if I subscribe and the CONTROL=... directory does not 
> exists:

Not sure why I couldn't reproduce it earlier, but I could now. These fix it:

http://hg.dovecot.org/dovecot-2.2/rev/f39c649057ea
http://hg.dovecot.org/dovecot-2.2/rev/9a913c803608



Re: [Dovecot] lda: duplicate prefix?

2013-03-20 Thread Timo Sirainen
Looks like I can reproduce this with v2.1.15, but it works with v2.2.
Probably too much trouble to debug&fix it for v2.1. So I suggest v2.2.
(I'll release v2.2.rc3 probably today.)

On Wed, 2013-03-20 at 13:41 -0500, Larry Rosenman wrote:
> Also, I *CAN* give SSH access to the box if you need/want it.
> 
> 
> 
> On Wed, Mar 20, 2013 at 1:18 PM, Larry Rosenman  wrote:
> 
> > The issue is this is my production box, and I've gotten around this by NOT
> > using the LDA, and just having Exim writing the mbox files.
> >
> > Is there any easy way to test just the LDA?  Or trace this?
> >
> >
> >
> > On Wed, Mar 20, 2013 at 1:06 PM, Timo Sirainen  wrote:
> >
> >> Test first if it's because of the snarf plugin? I'm not sure that it is.
> >>
> >> On 20.3.2013, at 20.02, Larry Rosenman  wrote:
> >>
> >> > I really need the snarf plugin to work, also, I don't think LMTP will
> >> let
> >> > me redirect to files using the Exim Filters.
> >> >
> >> > What can you tell me to help debug this?
> >> >
> >> >
> >> >
> >> >
> >> > On Wed, Mar 20, 2013 at 1:00 PM, Timo Sirainen  wrote:
> >> >
> >> >> On 4.3.2013, at 8.50, Larry Rosenman  wrote:
> >> >>
> >> >>> I've just started using Dovecot, and can't seem to get the LDA to
> >> work.
> >> >>>
> >> >>> I get the  following error:
> >> >>> Mar  4 00:47:19 thebighonker dovecot: lda(ler): Error: user ler:
> >> >>> Initialization failed: namespace configuration error: Duplicate
> >> namespace
> >> >>> prefix: ""
> >> >>
> >> >> Something's broken. It's complaining about duplicate namespace {
> >> prefix= }
> >> >> but your config has only one such namespace. My guess is that it's
> >> related
> >> >> to the snarf plugin. Does it work without it? Also you could see if
> >> LMTP
> >> >> works instead of LDA.
> >> >>
> >> >>
> >> >
> >> >
> >> > --
> >> > Larry Rosenman http://www.lerctr.org/~ler
> >> > Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
> >> > US Mail: 430 Valona Loop, Round Rock, TX 78681-3893
> >>
> >>
> >
> >
> > --
> > Larry Rosenman http://www.lerctr.org/~ler
> > Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
> > US Mail: 430 Valona Loop, Round Rock, TX 78681-3893
> >
> 
> 
> 




Re: [Dovecot] lda: duplicate prefix?

2013-03-20 Thread Larry Rosenman
Ok.  I'll wait for 2.2 to hit the FreeBSD ports tree.

Thanks!


On Wed, Mar 20, 2013 at 2:34 PM, Timo Sirainen  wrote:

> Looks like I can reproduce this with v2.1.15, but it works with v2.2.
> Probably too much trouble to debug&fix it for v2.1. So I suggest v2.2.
> (I'll release v2.2.rc3 probably today.)
>
> On Wed, 2013-03-20 at 13:41 -0500, Larry Rosenman wrote:
> > Also, I *CAN* give SSH access to the box if you need/want it.
> >
> >
> >
> > On Wed, Mar 20, 2013 at 1:18 PM, Larry Rosenman 
> wrote:
> >
> > > The issue is this is my production box, and I've gotten around this by
> NOT
> > > using the LDA, and just having Exim writing the mbox files.
> > >
> > > Is there any easy way to test just the LDA?  Or trace this?
> > >
> > >
> > >
> > > On Wed, Mar 20, 2013 at 1:06 PM, Timo Sirainen  wrote:
> > >
> > >> Test first if it's because of the snarf plugin? I'm not sure that it
> is.
> > >>
> > >> On 20.3.2013, at 20.02, Larry Rosenman  wrote:
> > >>
> > >> > I really need the snarf plugin to work, also, I don't think LMTP
> will
> > >> let
> > >> > me redirect to files using the Exim Filters.
> > >> >
> > >> > What can you tell me to help debug this?
> > >> >
> > >> >
> > >> >
> > >> >
> > >> > On Wed, Mar 20, 2013 at 1:00 PM, Timo Sirainen  wrote:
> > >> >
> > >> >> On 4.3.2013, at 8.50, Larry Rosenman  wrote:
> > >> >>
> > >> >>> I've just started using Dovecot, and can't seem to get the LDA to
> > >> work.
> > >> >>>
> > >> >>> I get the  following error:
> > >> >>> Mar  4 00:47:19 thebighonker dovecot: lda(ler): Error: user ler:
> > >> >>> Initialization failed: namespace configuration error: Duplicate
> > >> namespace
> > >> >>> prefix: ""
> > >> >>
> > >> >> Something's broken. It's complaining about duplicate namespace {
> > >> prefix= }
> > >> >> but your config has only one such namespace. My guess is that it's
> > >> related
> > >> >> to the snarf plugin. Does it work without it? Also you could see if
> > >> LMTP
> > >> >> works instead of LDA.
> > >> >>
> > >> >>
> > >> >
> > >> >
> > >> > --
> > >> > Larry Rosenman http://www.lerctr.org/~ler
> > >> > Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
> > >> > US Mail: 430 Valona Loop, Round Rock, TX 78681-3893
> > >>
> > >>
> > >
> > >
> > > --
> > > Larry Rosenman http://www.lerctr.org/~ler
> > > Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
> > > US Mail: 430 Valona Loop, Round Rock, TX 78681-3893
> > >
> >
> >
> >
>
>
>


-- 
Larry Rosenman http://www.lerctr.org/~ler
Phone: +1 214-642-9640 (c) E-Mail: larry...@gmail.com
US Mail: 430 Valona Loop, Round Rock, TX 78681-3893


[Dovecot] v2.2.rc3 released

2013-03-20 Thread Timo Sirainen
http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc3.tar.gz
http://dovecot.org/releases/2.2/rc/dovecot-2.2.rc3.tar.gz.sig

As mentioned in http://dovecot.org/list/dovecot/2013-March/089044.html
there are some new rather large features. Also various mostly rather
small bugfixes.

+ dsync: Support syncing ACLs (and Sieve scripts with Pigeonhole)
+ ldap: Support subqueries and value pointers, see
  http://wiki2.dovecot.org/AuthDatabase/LDAP/Userdb
+ postmaster_address setting: Expand %d to recipient's domain
- Fixed a crash when decoding quoted-printable content.
- dsync: Various bugfixes




Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread Robin

On 3/20/2013 6:35 AM, dormitionsk...@hotmail.com wrote:


Well, like I said, we have real slow upload speeds.  I think POP3 would give a 
better user experience.


About the only connectivity situation where POP3 might make for a better 
"user experience" is one of intermittent bursty sort that's prone to 
reliability issues.


IMAP provides for header-only enumations as well as partial body fetches 
on demand, as opposed to "all or nothing" POP3 access.  With a suitable 
modern caching client, it will not re-download emails already viewed. 
I've never used any of the devices you mentioned, so I can't speak to 
how their mail clients are implemented.



We're using sendmail.  I assume this is done in sendmail, not Dovecot?


No, sendmail is a Mail Transport Agent (MTA), which is akin to the 
Postal Service.  All it does is convey emails from one endpoint to 
another as reliably as possible.  What is done with the mail once it's 
at that endpoint is left to the "consumer" of the mail, in this case, 
the Mail User Agent (MUA).  It can be automatically processed/filed like 
via procmail or LMTP, or managed via the client through POP3 or IMAP4.


Your main concern sounds like performance from users who connect from 
outside of your enterprise network, which may happen even when your 
mobile devices are on site, due to the way they obtain their 
connectivity?  Timo's replication idea is sensible to address that problem.


Good luck!
=R=


Re: [Dovecot] 2.2rc2 core dump

2013-03-20 Thread Heiko Schlichting
> > But it still crashes if I subscribe and the CONTROL=... directory does not 
> > exists:
> 
> Not sure why I couldn't reproduce it earlier, but I could now. These fix it:
> 
> http://hg.dovecot.org/dovecot-2.2/rev/f39c649057ea
> http://hg.dovecot.org/dovecot-2.2/rev/9a913c803608

Thanks. I can confirm that it is fixed in v2.2.rc3.

Heiko

Heiko SchlichtingFreie Universität Berlin
heiko.schlicht...@fu-berlin.de   Zentraleinrichtung für Datenverarbeitung
Telefon +49 30 838-54327 Fabeckstraße 32
Telefax +49 30 838454327 14195 Berlin


Re: [Dovecot] Disallow POP3 from deleting messages

2013-03-20 Thread dormitionsk...@hotmail.com

On Mar 20, 2013, at 8:59 AM, Timo Sirainen wrote:

> On Wed, 2013-03-20 at 08:15 -0600, dormitionsk...@hotmail.com wrote:
> 
>> My experience with IMAP over the internet with a couple of servers outside 
>> our monastery (while I was in it, and we have considerably better download 
>> speeds than upload) has always been that IMAP has always been incredibly 
>> slow.  So, I've always just allowed users to connect to the IMAP server via 
>> webmail.  It's slow, but usable.  
> 
> Another idea: Get some cheap server from outside, use dsync replication
> to keep it synced with your internal one, and set up DNS so that users
> get directed to the fastest server. http://wiki2.dovecot.org/Replication
> 
> 

I LIKE this idea, but I have a few questions about it to see if it would be 
appropriate for our situation.  There are a few other things to consider that I 
didn't mention before because they did not seem relevant earlier.

First off, I'd just like to say that we have a web server set up at a location 
outside of our monastery that hosts all of our websites.  I'm currently in the 
process of building new servers to replace both it and our current email 
server.  So, assuming this is both plausible for our situation, and within my 
capabilities, I should be able to work on this at my leisure, and get the 
initial sync of our emails done while on the same LAN.  

So, the additional info and questions are the following:

1.)  Our download speeds are decent enough, but in addition to having poor 
upload speeds, we also have very strict limits on how much we are able to 
download.  And we use almost every bit of it every day.  We cannot get more, 
either.  We have unlimited downloads for four hours at night, however.  

2.)  We have very large message archives.  We basically have 95% of the emails 
we've received for the past 16 years.  So, the sync *must* only update items 
that have been changed.  Is this how it it would work?

3.)  We are currently using uw-imap with mbox.  If we switch to Dovecot, using 
Maildir format, will the sync only update the new messages and the header files 
for any folders that have been changed?

4.)  I thought I read somewhere in Dovecot's documentation last night that it 
has a 50 mb limit on folders.  It can't write anything larger than that.  Does 
this sound familiar?  (Now I can't find it!)  If so, is that for mbox?  We 
currently have some mbox folders whose files are significantly larger than 
that.  If we convert to Maildir format, where the individual messages are in 
their own files, could a folder contain messages totaling more than 50 MB using 
Dovecot?

4a. -- Oops.  I just noticed this: "NOTE2: sdbox/mdbox mailbox formats are 
recommended for replication. Maildir still has some issues (although probably 
not noticeable in normal use)."  Should I consider this a show-stopper for 
syncing like this?

5.)  In the http://wiki2.dovecot.org/Replication page, would this be 
continuously synced each time a user sends, receives, deletes, or moves 
messages, etc.?  Or would it be periodically synced?  

6.)  Also, that page does not make it clear if one server is like the "master" 
and the other the "slave".  Do I do the same changes to both servers?


If, given the above additional information, it would not be an appropriate 
solution for us, this suggestion about syncing the two servers gave me another 
idea.  

I was thinking, "Well, I wonder if I could just sync the Inboxes?  We don't 
really need the folders synced.  In the highly unlikely event a person would 
ever need something from one of his folders, he could always just log into the 
(slow) monastery server through web mail and get it that way."

(When we are on the road, we are generally working real hard, and we don't 
answer any more emails or do any other computer work than we absolutely have 
to.)

So, that led me to the idea to simply set up some message rules in procmail in 
our (slow) monastery server to copy any incoming messages to the server offsite 
in addition to delivering them locally.  For the most part, that would be 
sufficient for us -- and considerably easier.  

The only downsides to this are that when we reply to messages, they would not 
be marked as having been replied to, and we wouldn't have copies of our replies 
on our main server.

The not being marked as replied to is not a big deal.  I know we could manually 
copy any sent messages from one server to the other when we returned to the 
monastery, if we really wanted to, but does anyone know of a better way to do 
it?



On Mar 20, 2013, at 3:11 PM, Robin wrote:

> Your main concern sounds like performance from users who connect from outside 
> of your enterprise network, which may happen even when your mobile devices 
> are on site, due to the way they obtain their connectivity? 

We are located deep in the Colorado Rocky Mountains.  There are only a few 
places a person can stand in our monastery and get cell phone reception, so I 

Re: [Dovecot] ulimit -n in start-script

2013-03-20 Thread Ben Morrow
At  1PM +0100 on 20/03/13 you (Patrick Westenberg) wrote:
> Peer Heinlein schrieb:
> 
> > Even on midrange-systems it's necessary to set "ulimit -n" to a higher
> > value then the system default of 1024.
> 
> Could this lead to this problem?
> 
>   Error: 
> file_dotlock_create(/var/mail/example.com/john.doe/Maildir/.Sent/dovecot-uidlist)
>  
> failed: No space left on device

Not on most systems. Reaching a ulimit -n limit usually causes open(2)
to fail with EMFILE (Too many open files) rather than ENOSPC (No space
left on device). ENOSPC is only supposed to be returned if the
filesystem has either run out of space altogether, or has run out of
inodes. (Incidentally, going over quota on a filesystem also has its own
errno, EDQUOT (Quota exceeded).)

However, check your system documentation, because some systems do
strange things.

Ben