Re: [Dovecot] Any client out there taking advantage of Dovecot's virtual mailboxes?

[Steffen Kaiser]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Mon, 17 Mar 2014, Aleve Sicofante wrote:


2014-03-17 21:14 GMT+01:00 Michael M Slusarz :


Quoting Aleve Sicofante :



 OK. Subscribed and voted, but the bug should point to "where to start"
in


Dovecot's documentation.



Ok, but... where would that be? I don't see a 'Where to start' to point
to...

And, well, if subscribed and voted, you could easily add that yourself,
no? ;)




This isn't going to happen in thunderbird, outside of someone writing code
for thunderbird to login to the dovecot server (via SSH with an admin/root
password), find the dovecot config files on the server (which will vary
based on each server), edit the dovecot config non-interactively, and then
be be able to restart the dovecot server to make the changes stick (which,
again, will vary based on each server).  I would guess there is about a
none percent chance of that occurring.


 You can read what he says in this very thread. I'm not a google+ user

either. He just says Dovecot's virtual mailboxes are intended for admins
only, not for clients. It doesn't sound logical, but that's what he says.



This is exactly what I said previously in this thread.  And it is a 100%
accurate statement.

The ONLY way this can be implemented client-side is if there are some sort
of standardized IMAP commands that the client can use to alter the
mailboxes.  There isn't.

In general, IMAP 4 doesn't allow a command to work on multiple mailboxes
at a single time (outside of MULTISEARCH... but that's one reason why
MULTISEARCH is experimental and really hasn't provoked much interest).
 That's why virtual mailboxes don't conceptually work very well as a
server-level entity and instead make much more sense as a client-level
feature.

michael



I don't know who designed the dovecot virtual mailboxes, but they make VERY
LITTLE sense as admin only. On the other hand, virtual mailboxes on the


Somebody paid for them or convinced Timo by other means, so they make 
sense in some environment. At least one springs into my mind easily: 
POP3-users on IMAP boxes.
Also, they make very sense - as Michael pointed out - to merge a 
hierarchie of mailboxes in order to allow _each_ IMAP client access them, 
e.g. search through. Otherwise the client had to do it.



server but managed by the client, make A LOT of sense. IMAP is expandable.
I don't see a reason why Dovecot can't make extensions to the protocol to
allow that. That's exactly what Google made to their IMAP servers and it
works wonderfully.

As a matter of fact, I guess that's what Dovecot could use: an IMAP
extension that manages labels/virtual folders/search folders, right from
the client.


There had been a thread talking about exactly that: Server-side virtual 
mailboxes that select messages based on keywords (labels / tags), which is 
possible with the KEYWORD search command. However, you would need some 
process (cron job, plugin, post login scripting) that sets up the config 
when a new keyword is created by the client.


- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBUyf6/3D1/YhP6VMHAQIQywf/ZPJcUoarCENhapI8PzO2ztJNG5rvvXyD
dYf5bS3BiiL5P9RlQVjeRG5jTlfM4UslhN2sRH8G0zcFEj3HIRgVT9CIUQ2KWGAO
QJf7Ffy7q/zhM/fq/dzoZBC+3TmTblEOvyGkv8PrWSOjSvD7Am2+6pHebSe0dzzr
oimNVkcWEgV2aiuo1oPS90G0v2xQFbDgH6xx0Ac0gD8q8l84+8BPaah/4yBUHjky
wJv+whBict/xiQCxe5tIqGng54dMwaRMVQdz5szq5ZI7RLwIl7HAc963VSNBRHMj
8KU5UYTwslHNcmeAz9QqJPCr2/UwSq0mvlnE66z3cAdQpFYS0wARcg==
=PFXy
-END PGP SIGNATURE-

Re: [Dovecot] versioning of mailbox index files

[Steffen Kaiser]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Tue, 18 Mar 2014, morrison wrote:


I am wondering if dovecot assigns version information in mailbox index files so 
that by which version of dovecot the index files are created can be determined.

Our existing mail service used dovecot 2.2.4 with lots of active mail users. 
When upgraded to 2.2.10, imap processes aborted all the time due to the 
corrupted index files (the problem was fixed in dovecot 2.2.5). After 
investigation, I found that this annoying problem could be avoid by deleting 
index files before opening a mailbox. Now the problem is how I could know if 
the index files are created by a version newer than 2.2.4.


I think not, but what about deleting all index files, that are older than 
the day you've installed the new Dovecot version?


- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.11 (GNU/Linux)

iQEVAwUBUyf7Y3D1/YhP6VMHAQL3LggAkNcRa2frK5XOSHYTffH26s8s1+FR6Jx0
68FmVZvO/e3R0O7GUcaencfOhFVlTQBWMvtg5URnb2PjngZEPeqbH+gtZ3cDrEDC
MSKuzTn9Ph7X9xQYhhbHp3x/lBRXyJAi5YHeCDPAcfUjYqobMUWMr27HZftIaDyH
RcDCKambOuQ/XbyvmAkPWq8CKTLZDwL41IN2tPvfdfGhYfuAcl8MrWfgxL1OT/Po
9Eb18rnHB+97Z1atolqfUfu4ni6yqQY+TIvNeem2R1OjUBDkfU9IhTJ87lv2cmLP
hOeJU9+FPwlKEj1/Gv+n1wE9JUltuaA3BDxXknlTsZ4/o4txpL0zlA==
=liX7
-END PGP SIGNATURE-

Re: [Dovecot] When does the replication run normally?

[Daniel Thielemann]

Hey Vijay,

no I had no repsonese, so thank you very much for your reply. Iam still 
fighting with this problem.

I used the command to check my replication, but it confuses me a bit:

---
date
Tue Mar 18 13:43:09 CET 2014

doveadm replicator status '*'
usernamepriority fast sync full sync failed
j...@domain.net none 04:05:23  04:05:23  -
j...@domain.net none 04:05:23  04:05:23  -
---

Could u explain me pls what these times mean? Is that the sheduled time of the 
next run or the time of the last run?


Thanks in advance

Daniel



> Gesendet: Dienstag, 04. März 2014 um 17:59 Uhr
> Von: "Vijay Rajah" 
> An: dovecot@dovecot.org
> Betreff: Re: [Dovecot] When does the replication run normally?
>
> Daniel,
> 
> Not sure if you had any response.
> 
> There are 2 types of replication. (I'm assuming you have setup some sort 
> of replication using dsync and are using 2.2+ version of dovecot)
> 
> 1. Fast replication -- Only syncs new mails
> 2. Full replication. -- Does a FULL sync, and validates the currently 
> replicated mails.
> 
> The fast replication occurs whenever a mail arrives for a user.
> 
> The full replication occurs based on "replication_full_sync_interval" 
> setting in your config. The default for "replication_full_sync_interval" 
> is 24 Hrs. (2.2rc2+)
> 
> to check the status of replication use
> 
> doveadm replicator status '*'  -- This will give replication stats for 
> all the users. (do not do this if you have a lot of users :-) ).
> 
> 
> -Thanks
> Vijay
> 
> PS: I'm not an expert on Dovecot. This is based on my personal experience.
> 
> 
> On 28/02/14 2:25 PM, Daniel Thielemann wrote:
> > Hi,
> >
> > I got my manual dsync finally working and can replicate mails by initiate 
> > it from comandline (doveadm sync -u m...@domain.dom -d),
> > but it does not run by itself (per dovecot replication). When does dovecot 
> > invoke the replication normally?
> >
> > Thanks in advance
> >
> > Daniel
>

[Dovecot] Sieve vacation attach original message

[azurIt]

Hi,

is it, somehow, possible to attach the original message to the vacation 
autoreply? Thank you.

azur

[Dovecot] NFS not responding generates authantication crash

[bart]

I am facing dovecot authentication problems caused by unresponding NFS
server. If there is even short break in communication with NFS server
keeping maildirs, the dovecot generates the avalanche of processes
(dovecot/imap and dovecot/pop3). The real number of connections was about 50
and after the problems occurs it rises to 1000. After about 3 hours the
limit of connections is filled up:

 dovecot: master: Warning: service(auth): client_limit (1000) reached,
client connections are being dropped

and next:

imap-login: Warning: Auth process not responding, delayed sending greeting
pop3-login: Warning: Error sending handshake to auth server: Broken pipe
imap-login: Warning: Error sending handshake to auth server: Broken pipe


When the mail storage was local there was no such problem. After moving to
NFS storage the problem arised when trying to make backup with dump (we
switched to rsync then) or now if NFS is not responding for a while. 

My dovecot conf for NFS is in accordane with: http://wiki2.dovecot.org/NFS

mmap_disable = yes
dotlock_use_excl = no # only needed with NFSv2, NFSv3+ supports O_EXCL and
it's faster
mail_fsync = always
mail_nfs_storage = no
mail_nfs_index = no

NFS shares are connected with no special parameters.

Can something be done on dovecot configuration to prevent from generating
those dovecot connections processes?
Or is it the problem with NFS configuration?



--
View this message in context: 
http://dovecot.2317879.n4.nabble.com/NFS-not-responding-generates-authantication-crash-tp47155.html
Sent from the Dovecot mailing list archive at Nabble.com.

[Dovecot] Problem with trying to use dsync with ldap userdb

[Frédéric Goudal]

Hello,

I'm trying to use dsync on a dovecot 2.2.12
I'm using an ldap database  as a user database with the following configuration 
: 

auth_bind = yes
ldap_version = 3
auth_bind_userdn = uid=%u,ou=People,dc=ipb,dc=fr
user_attrs = uidNumber=uid,gidNumber=gid

But I keet having the following errors : 

2014-03-14 17:53:37 doveadm(XXX): Debug: user XXX: Auth PASS lookup returned 
temporary failure: reason=Configured passdbs don't support crentials lookups
2014-03-14 17:53:37 doveadm(XXX): Debug: auth input: reason=Configured passdbs 
don't support crentials lookups
2014-03-14 17:53:37 doveadm(XXX): Error: sync: 
/usr/local/var/run/dovecot/auth-userdb: Configured passdbs don't support 
crentials lookups (to see if user is proxied, because doveadm_port is set)

I have been hunting through the doc for the last hours and I don't find what to 
change.
I found something about adding 
set INSECURE_SETUID=1
export INSECUURE_SETUID
before checkpassword-reply launch, but it does not change anything...

 Btw my two server have use the users uid from the ldap, but don't allow user 
login on the servers where only admin can log in.

Does somebody has an idea where to dig ?

f.g.

[Dovecot] Imap user via proxy with starttls - how to rawlogs on proxy ?

[askforstatus]

Hello,

Is there any way to log user imap dialog with starttls when going via
dovecot acting as imap proxy ?
My intention is to log each and every user command similar to rawlogs
feature.
As per my current imap proxy config pre-login working like a charm but
post-login is not possible due as i think the nature of proxy feature.

Any idea ?

Regards




--
View this message in context: 
http://dovecot.2317879.n4.nabble.com/Imap-user-via-proxy-with-starttls-how-to-rawlogs-on-proxy-tp47180.html
Sent from the Dovecot mailing list archive at Nabble.com.

[Dovecot] dovecot for centos ?

[Spyros Tsiolis]

Hello all,

I was wondering which version is better for Centos v6.x.

CentOS v6.5 comes with dovecot v2.0.9 as default.
Should I go ahead with this or go for the latest ?
(v2.2.10 / v2.211 / v2.2.12, btw what's the diferrence
between the three ?)

s.



  

Re: [Dovecot] Sieve vacation attach original message

[Joseph Tam]

"azurIt"  writes:


is it, somehow, possible to attach the original message to the vacation
autoreply?


Hmm.  Allowing a sender control over both the recipient (via spoofing),
and the content seems like perfect recipe to turn your mail server into
a spam relay cannon.  If you do do this, you should hedge this by only
allowing it from known trusted senders (e.g. local network).

Joseph Tam 

Re: [Dovecot] Sieve vacation attach original message

[Stephan Bosch]

On 3/14/2014 7:48 AM, azurIt wrote:
> Hi,
>
> is it, somehow, possible to attach the original message to the vacation 
> autoreply? Thank you.

Not currently. The exttracttext extension could be used for that
(http://tools.ietf.org/html/rfc5703), but it is not supported at the
moment. Also, this would be limited by the maximum variable size.

Regards,

Stephan.

Re: [Dovecot] Sieve escape user input

[Stephan Bosch]

On 3/17/2014 9:09 PM, azurIt wrote:
> Hi,
>
> i'm having problems with escaping user input in sieve scripts. I'm using 
> 'variables' extension and i can't find out how to escape character '$' - i 
> tried '\$' and '$$' but nothing helps. Any ideas? Thanks.

Two options:

http://tools.ietf.org/html/rfc5229#section-3.1
http://tools.ietf.org/html/rfc5228#section-2.4.2.4

Both are arguably a bit ugly.

Regards,

Stephan.

Re: [Dovecot] Using a Sieve script to handle delivery to public mailboxes

[Stephan Bosch]

On 3/15/2014 2:57 PM, Alessandro Menti wrote:
> Hello everyone,
> I'm setting up a Postfix+Dovecot stack with virtual domains and public
> mailboxes.

[...]

> I encountered a problem with this setup: when I send a message to the
> "off...@mydomain.com" account, the Postfix logs say it is correctly
> delivered via Dovecot, but the Sieve script says it can not find the
> folder "Public/.office". As a consequence, Dovecot creates a new
> Maildir in /var/mail/mydomain.com/office and delivers the mail there
> instead of saving it in the correct directory
> (/var/mail/mydomain.com/public/.office).
>
> Is there something I set incorrectly in my configuration? What is
> causing Dovecot not to recognize the correct mailbox during delivery?
> Is there a way to list all mailboxes seen by dovecot-lda itself? K
> Logout completed.

I must say I haven't tried using Sieve with public folders so far.
However, I cannot quite imagine why this wouldn't work. Can you
successfully append messages to the public folder through IMAP?

Regards,

Stephan.

Re: [Dovecot] Sieve vacation attach original message

[azurIt]

> Od: Stephan Bosch 
> Komu: azurIt , 
> Dátum: 19.03.2014 01:45
> Predmet: Re: [Dovecot] Sieve vacation attach original message
>
>On 3/14/2014 7:48 AM, azurIt wrote:
>> Hi,
>>
>> is it, somehow, possible to attach the original message to the vacation 
>> autoreply? Thank you.
>
>Not currently. The exttracttext extension could be used for that
>(http://tools.ietf.org/html/rfc5703), but it is not supported at the
>moment. Also, this would be limited by the maximum variable size.


I tried a different solution but come accross a bug (or a feature?). I used a 
':mime' option to 'vacation' command to create a multi-part vacation message 
which will include the original message. Unfortunately i didn't find a way how 
to include all headers but there should be a solution for including the body of 
the original message - using a 'body' extension. So i tried to save body into 
variable with this:

if body :matches "*" {
set "OriginalBody" "${1}";
}

The 'if' is True but nothing is saved into the variable. Any hints?

azur

Re: [Dovecot] Sieve vacation attach original message

[azurIt]

> Od: Stephan Bosch 
> Komu: azurIt , 
> Dátum: 19.03.2014 01:45
> Predmet: Re: [Dovecot] Sieve vacation attach original message
>
>On 3/14/2014 7:48 AM, azurIt wrote:
>> Hi,
>>
>> is it, somehow, possible to attach the original message to the vacation 
>> autoreply? Thank you.
>
>Not currently. The exttracttext extension could be used for that
>(http://tools.ietf.org/html/rfc5703), but it is not supported at the
>moment. Also, this would be limited by the maximum variable size.


Will this extension be included in Dovecot? If yes, approximately when (month? 
year? 10 years?). Thank you.

azur

[Dovecot] Dovecot crashes on large search result sets in virtual folders when using fts-solr

[Steffen Templin]

Hi Devs,

I experience reproducible crashes when searching in a virtual folder with
fts-solr activated. The crashes occur only, if the folder contains a large
number of mails and the result set of the search is also large. If the result
set is small, no crash occurs. This happens on Debian Wheezy with versions 2.1.7
and 2.2.9.

My goal was it to setup the possibility for cross-folder fulltext search.
Therefore dovecot was setup with fts-solr, which seems to work fine in most
cases. A virtual folder "test" in a namespace "virtual" was created and
configured to return all mails from all mailboxes in the default namespace (with
empty prefix). It was configured like this:

/etc/dovecot/virtual/test/dovecot-virtual:
*
 all

It's also reproducible with:
INBOX
  all

The test user only has the standard mail folders (Sent, Drafts, Trash) beside
the INBOX and of course the folder "virtual.test". INBOX contains about 10.000
mails, the other folders are empty. "virtual.test" correctly referrs to all
mails of the INBOX. Searching within the INBOX returns the desired results
without any problems. Performing the same search within "virtual.test" fails and
dovecot crashes. However, if the result set is small, no crash occurs. My test
mails are imported from the ubuntu mailing list. Therefore the term "ubuntu"
produces a large result set. See attachments for further details, they all refer
to the same crash, reproduced with version 2.2.9 (from the Debian Backports
repository):
 - config.txt:  dovecot -n
 - gdb_backtrace.txt:   The gdb backtrace of the attached core dump
 - log.txt: A logfile extract from the crash
 - protocol_output.txt: The telnet session that caused the crash

Don't hesitate to ask for further details.

Thanks and best regards,
Steffen

* OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE 
AUTH=PLAIN] Dovecot ready.
. login stef...@dovecot.devel.open-xchange.com secret
. OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE IDLE SORT 
SORT=DISPLAY THREAD=REFERENCES THREAD=REFS THREAD=ORDEREDSUBJECT MULTIAPPEND 
URL-PARTIAL CATENATE UNSELECT CHILDREN NAMESPACE UIDPLUS LIST-EXTENDED 
I18NLEVEL=1 CONDSTORE QRESYNC ESEARCH ESORT SEARCHRES WITHIN CONTEXT=SEARCH 
LIST-STATUS SPECIAL-USE BINARY MOVE SEARCH=FUZZY] Logged in
. select virtual.test
* FLAGS (\Answered \Flagged \Deleted \Seen \Draft $cl_0)
* OK [PERMANENTFLAGS (\Answered \Flagged \Deleted \Seen \Draft $cl_0 \*)] Flags 
permitted.
* 10004 EXISTS
* 0 RECENT
* OK [UNSEEN 3] First unseen.
* OK [UIDVALIDITY 1395144608] UIDs valid
* OK [UIDNEXT 30025] Predicted next UID
* OK [NOMODSEQ] No permanent modsequences
. OK [READ-WRITE] Select completed (0.025 secs).
. search text steffen
* SEARCH 1 2 3 4 5 6 7 9
. OK Search completed (0.008 secs).
. search text ubuntu
closed

Mar 18 16:50:40 imap(stef...@dovecot.devel.open-xchange.com): Panic: file 
fts-search.c: line 79 (level_scores_add_vuids): assertion failed: 
(array_count(&vuids_arr) == array_count(&br->scores))
Mar 18 16:50:40 imap(stef...@dovecot.devel.open-xchange.com): Error: Raw 
backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x68adf) [0xb75c5adf] -> 
/usr/lib/dovecot/libdovecot.so.0(+0x68b61) [0xb75c5b61] -> 
/usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb75786f9] -> 
/usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x9aca) [0xb73c2aca] -> 
/usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_search_lookup+0xce) 
[0xb73c2b9e] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xba19) 
[0xb73c4a19] -> 
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_init+0x5f) [0xb76aea7f] 
-> dovecot/imap(imap_search_start+0x74) [0xb778e304] -> 
dovecot/imap(cmd_search+0xfe) [0xb778147e] -> dovecot/imap(command_exec+0x3a) 
[0xb7787cca] -> dovecot/imap(+0x16b36) [0xb7786b36] -> dovecot/imap(+0x16c79) 
[0xb7786c79] -> dovecot/imap(client_handle_input+0x11d) [0xb7786ead] -> 
dovecot/imap(client_input+0x81) [0xb77872b1] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x44) [0xb75d86a4] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xee) [0xb75d972e] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb75d8138] -> 
/usr/lib/dovecot/libdovecot.so.0(master_service_run+0x2e) [0xb757e4ae] -> 
dovecot/imap(main+0x2f8) [0xb7779d08] -> 
/lib/i386-linux-gnu/i686/cmov/libc.so.6(__libc_start_main+0xe6) [0xb7408e46] -> 
dovecot/imap(+0x9eb9) [0xb7779eb9]
Mar 18 16:50:40 imap(stef...@dovecot.devel.open-xchange.com): Fatal: master: 
service(imap): child 8142 killed with signal 6 (core dumped)
GNU gdb (GDB) 7.4.1-debian
Copyright (C) 2012 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later 
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law.  Type "show copying"
and "show warranty" for details.
This GDB was configured as "i486-linux-gnu".
For bug reporting instructions, please see:
...
Reading symbo