[Dovecot] dovecot-lda segfaults
Hi to all. Since version 2.0.3 (now I am running 2.0.5) I have experienced segfaults on mail delivery, either with dovecot-lda and lmtp. At least I succeded in having a core dump, here is the backtrace: #0 0x7f1cca350160 in maildir_sync_set_new_msgs_count () from /usr/lib/dovecot/libdovecot-storage.so.0 #1 0x7f1cca34df0a in maildir_transaction_save_commit_pre () from /usr/lib/dovecot/libdovecot-storage.so.0 #2 0x7f1cca3491c3 in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #3 0x7f1cca382ef7 in mail_index_transaction_commit_full () from /usr/lib/dovecot/libdovecot-storage.so.0 #4 0x7f1cca348e4b in index_transaction_commit () from /usr/lib/dovecot/libdovecot-storage.so.0 #5 0x7f1cc88e in ?? () from /usr/lib/dovecot/modules/lib20_zlib_plugin.so #6 0x7f1cc8edaa31 in ?? () from /usr/lib/dovecot/modules/lib10_quota_plugin.so #7 0x7f1cca3281bd in mailbox_transaction_commit_get_changes () from /usr/lib/dovecot/libdovecot-storage.so.0 #8 0x7f1cca3281fe in mailbox_transaction_commit () from /usr/lib/dovecot/libdovecot-storage.so.0 #9 0x7f1cc8461fd7 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 #10 0x7f1cc8459597 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 #11 0x7f1cc845992b in sieve_result_execute () from /usr/lib/dovecot/libdovecot-sieve.so.0 #12 0x7f1cc846973d in sieve_execute () from /usr/lib/dovecot/libdovecot-sieve.so.0 #13 0x7f1cc869f83e in ?? () from /usr/lib/dovecot/modules/lib90_sieve_plugin.so #14 0x7f1cca0f4084 in mail_deliver () from /usr/lib/dovecot/libdovecot-lda.so.0 #15 0x00402cf0 in main () I have tried to disable quota and zlib, but I suppose it is not related to those plugins. What else can I try??? Andre
[Dovecot] "doveadm mailbox create" oddities
Hi to all! I’m trying to understand the usage of "doveadm mailbox create”. If I do, as root: # doveadm mailbox create -u __public__ sys/test doveadm(__public__): Error: Can't create mailbox sys/test: Permission denied but if I do: # doveadm mailbox create -u __public__ test every thing is OK. “sys" is a shared maildir folder, that is visible in the client as "#Public/sys”. __public__ is the user that owns Public folders, here is the complete details: userdb: __public__ uid : 10002 gid : 8 home : /var/mail/domainname/__public__ mail : maildir:~/maildir:INBOX=~/maildir/INBOX:LAYOUT=fs:INDEX=~/indexes/ Do I have to add root with proper permissions to ACL? TIA Andre
Re: [Dovecot] dovecot-lda segfaults
Il giorno 07/ott/2010, alle ore 09.06, Andre ha scritto: > Hi to all. > Since version 2.0.3 (now I am running 2.0.5) I have experienced segfaults on > mail delivery, either with dovecot-lda and lmtp. > > At least I succeded in having a core dump, here is the backtrace: > > #0 0x7f1cca350160 in maildir_sync_set_new_msgs_count () from > /usr/lib/dovecot/libdovecot-storage.so.0 > #1 0x7f1cca34df0a in maildir_transaction_save_commit_pre () from > /usr/lib/dovecot/libdovecot-storage.so.0 > #2 0x7f1cca3491c3 in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 > #3 0x7f1cca382ef7 in mail_index_transaction_commit_full () from > /usr/lib/dovecot/libdovecot-storage.so.0 > #4 0x7f1cca348e4b in index_transaction_commit () from > /usr/lib/dovecot/libdovecot-storage.so.0 > #5 0x7f1cc88e in ?? () from > /usr/lib/dovecot/modules/lib20_zlib_plugin.so > #6 0x7f1cc8edaa31 in ?? () from > /usr/lib/dovecot/modules/lib10_quota_plugin.so > #7 0x7f1cca3281bd in mailbox_transaction_commit_get_changes () from > /usr/lib/dovecot/libdovecot-storage.so.0 > #8 0x7f1cca3281fe in mailbox_transaction_commit () from > /usr/lib/dovecot/libdovecot-storage.so.0 > #9 0x7f1cc8461fd7 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 > #10 0x7f1cc8459597 in ?? () from /usr/lib/dovecot/libdovecot-sieve.so.0 > #11 0x7f1cc845992b in sieve_result_execute () from > /usr/lib/dovecot/libdovecot-sieve.so.0 > #12 0x7f1cc846973d in sieve_execute () from > /usr/lib/dovecot/libdovecot-sieve.so.0 > #13 0x7f1cc869f83e in ?? () from > /usr/lib/dovecot/modules/lib90_sieve_plugin.so > #14 0x7f1cca0f4084 in mail_deliver () from > /usr/lib/dovecot/libdovecot-lda.so.0 > #15 0x00402cf0 in main () > > I have tried to disable quota and zlib, but I suppose it is not related to > those plugins. > What else can I try??? > Andre > I’m so sorry I have not seen the previous thread "[Dovecot] 2.0.5: deliver crashing”. I’ll try that patch too and report to the list. Should it work even for lmtp (that is my favourite delivery method, for its scalability)? Andre
[Dovecot] Segfault in libdovecot-sieve
Hello, I've been getting these messages in dmesg: [1663649.206652] lmtp[4961]: segfault at 18 ip 7fb5b6aab1f0 sp7fff7e3b5468 error 4 in libdovecot-sieve.so.0.0.0[7fb5b6a6d000 +66000] Dovecot's version is 2.0.3. Is this known? What other kind of information could be useful to help find this issue? Thanks,Andre
Re: [Dovecot] Segfault in libdovecot-sieve
Em 21/10/2010, Stephan Bosch <step...@rename-it.nl> escreveu: > Output from: dovecot -n # 2.0.3 (02a9cf90ad02): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-25-server x86_64 Ubuntu 10.04.1 LTS auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz01234567890...@= auth_worker_max_count = 10 disable_plaintext_auth = no listen = lmtp1.f1.k8.com.br, lmtp1.prv.f1.k8.com.br login_greeting = K8 IMAP/POP3 server mail_debug = yes mail_gid = dovemail mail_plugins = $mail_plugins quota mail_uid = dovemail managesieve_sieve_capability = fileinto reject envelope vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include imapflags notify mmap_disable = yes passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } plugin { autocreate = SPAM autosubscribe = SPAM quota = dict:User quota::file:/var/lib/imap/user/%2.256RHn/%n/dovecot-quota quota_rule = *:storage=1GB sieve = /var/lib/imap/sieve/%2.256RHn/%n/phpscript.script sieve_dir = /var/lib/imap/sieve/%2.256RHn/%n sieve_extensions = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation sieve_max_script_size = 512KB sieve_quota_max_scripts = 2 } protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { process_limit = 1 process_min_avail = 1 } service imap-login { inet_listener imap { address = lmtp1.f1.k8.com.br, box5.f1.k8.com.br port = 143 } } service imap { process_limit = 1024 process_min_avail = 10 } service lmtp { inet_listener { address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br port = 2003 } process_limit = 256 process_min_avail = 10 } service managesieve-login { inet_listener sieve { address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br port = 4190 } inet_listener sieve_deprecated { address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br port = 2000 } } service managesieve { process_limit = 20 process_min_avail = 10 } service pop3-login { inet_listener pop3 { address = lmtp1.f1.k8.com.br, box5.f1.k8.com.br port = 110 } } service pop3 { process_limit = 256 process_min_avail = 10 } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_idle_notify_interval = 120 s imap_max_line_length = 65536 mail_max_userip_connections = 50 mail_plugins = $mail_plugins quota imap_quota autocreate } protocol lmtp { mail_plugins = $mail_plugins sieve quota autocreate } protocol sieve { mail_plugins = $mail_plugins sieve managesieve_implementation_string = K8 ManageSieve managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 managesieve_sieve_capability = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation } protocol pop3 { mail_plugins = $mail_plugins quota autocreate } > What version/revision of Pigeonhole you installed. I'm using recompiled debian packages from http://xi.rename-it.nl/debian/ which already come with pigeonhole. The last changelog entry is from 2010-08-14. > 2) Gdb backtrace: > > http://www.dovecot.org/bugreport.html > > Try to obtain core dumps when it is hard to reproduce. > > 3) Examples of scripts and messages that cause the problem (assuming it > is reproducible). I'll work on these. The server is hosting a few thousand accounts, so it's hard to identify specific scripts. Thanks,Andre
Re: [Dovecot] Segfault in libdovecot-sieve
Sigh. The webmail broke the configuration output. Here's it again. # 2.0.3 (02a9cf90ad02): /etc/dovecot/dovecot.conf # OS: Linux 2.6.32-25-server x86_64 Ubuntu 10.04.1 LTS auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz01234567890...@= auth_worker_max_count = 10 disable_plaintext_auth = no listen = lmtp1.f1.k8.com.br, lmtp1.prv.f1.k8.com.br login_greeting = K8 IMAP/POP3 server mail_debug = yes mail_gid = dovemail mail_plugins = $mail_plugins quota mail_uid = dovemail managesieve_sieve_capability = fileinto reject envelope vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include imapflags notify mmap_disable = yes passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } plugin { autocreate = SPAM autosubscribe = SPAM quota = dict:User quota::file:/var/lib/imap/user/%2.256RHn/% n/dovecot-quota quota_rule = *:storage=1GB sieve = /var/lib/imap/sieve/%2.256RHn/%n/phpscript.script sieve_dir = /var/lib/imap/sieve/%2.256RHn/%n sieve_extensions = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation sieve_max_script_size = 512KB sieve_quota_max_scripts = 2 } protocols = imap pop3 lmtp sieve service auth-worker { user = $default_internal_user } service auth { process_limit = 1 process_min_avail = 1 } service imap-login { inet_listener imap { address = lmtp1.f1.k8.com.br, box5.f1.k8.com.br port = 143 } } service imap { process_limit = 1024 process_min_avail = 10 } service lmtp { inet_listener { address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br port = 2003 } process_limit = 256 process_min_avail = 10 } service managesieve-login { inet_listener sieve { address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br port = 4190 } inet_listener sieve_deprecated { address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br port = 2000 } } service managesieve { process_limit = 20 process_min_avail = 10 } service pop3-login { inet_listener pop3 { address = lmtp1.f1.k8.com.br, box5.f1.k8.com.br port = 110 } } service pop3 { process_limit = 256 process_min_avail = 10 } ssl = no userdb { driver = prefetch } userdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } verbose_proctitle = yes protocol imap { imap_idle_notify_interval = 120 s imap_max_line_length = 65536 mail_max_userip_connections = 50 mail_plugins = $mail_plugins quota imap_quota autocreate } protocol lmtp { mail_plugins = $mail_plugins sieve quota autocreate } protocol sieve { mail_plugins = $mail_plugins sieve managesieve_implementation_string = K8 ManageSieve managesieve_logout_format = bytes=%i/%o managesieve_max_line_length = 65536 managesieve_sieve_capability = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation } protocol pop3 { mail_plugins = $mail_plugins quota autocreate }
Re: [Dovecot] Segfault in libdovecot-sieve
This shows up in the mail error when the sieve error happens. It seems the sieve error is a side-effect of something else: Oct 21 17:58:11 box6 dovecot: lmtp(10424, catia.comercial=industriacarvalho.com...@lmtp1.prv.f1.k8.com.br): Error: lstat((null)) failed: Bad address Oct 21 17:58:11 box6 dovecot: lmtp(10424, catia.comercial=industriacarvalho.com...@lmtp1.prv.f1.k8.com.br): Error: file_dotlock_create((null)) failed: Bad address Oct 21 17:58:11 box6 dovecot: lmtp(10424, catia.comercial=industriacarvalho.com...@lmtp1.prv.f1.k8.com.br): Error: open((null)) failed: Bad address Oct 21 18:05:25 box6 dovecot: master: Error: service(lmtp): child 10424 killed with signal 11 (core dumps disabled) Best regards, Andre On Thu, 2010-10-21 at 14:13 -0400, Andre wrote: > Sigh. The webmail broke the configuration output. Here's it again. > > # 2.0.3 (02a9cf90ad02): /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-25-server x86_64 Ubuntu 10.04.1 LTS > auth_master_user_separator = * > auth_mechanisms = plain login > auth_username_chars = > abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz01234567890...@= > auth_worker_max_count = 10 > disable_plaintext_auth = no > listen = lmtp1.f1.k8.com.br, lmtp1.prv.f1.k8.com.br > login_greeting = K8 IMAP/POP3 server > mail_debug = yes > mail_gid = dovemail > mail_plugins = $mail_plugins quota > mail_uid = dovemail > managesieve_sieve_capability = fileinto reject envelope vacation > subaddress comparator-i;ascii-numeric relational regex imap4flags copy > include imapflags notify > mmap_disable = yes > passdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > passdb { > args = /etc/dovecot/dovecot-sql-master.conf.ext > driver = sql > master = yes > pass = yes > } > plugin { > autocreate = SPAM > autosubscribe = SPAM > quota = dict:User quota::file:/var/lib/imap/user/%2.256RHn/% > n/dovecot-quota > quota_rule = *:storage=1GB > sieve = /var/lib/imap/sieve/%2.256RHn/%n/phpscript.script > sieve_dir = /var/lib/imap/sieve/%2.256RHn/%n > sieve_extensions = comparator-i;ascii-numeric copy envelope fileinto > imapflags include notify regex reject relational subaddress vacation > sieve_max_script_size = 512KB > sieve_quota_max_scripts = 2 > } > protocols = imap pop3 lmtp sieve > service auth-worker { > user = $default_internal_user > } > service auth { > process_limit = 1 > process_min_avail = 1 > } > service imap-login { > inet_listener imap { > address = lmtp1.f1.k8.com.br, box5.f1.k8.com.br > port = 143 > } > } > service imap { > process_limit = 1024 > process_min_avail = 10 > } > service lmtp { > inet_listener { > address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br > port = 2003 > } > process_limit = 256 > process_min_avail = 10 > } > service managesieve-login { > inet_listener sieve { > address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br > port = 4190 > } > inet_listener sieve_deprecated { > address = lmtp1.prv.f1.k8.com.br, box5.prv.f1.k8.com.br > port = 2000 > } > } > service managesieve { > process_limit = 20 > process_min_avail = 10 > } > service pop3-login { > inet_listener pop3 { > address = lmtp1.f1.k8.com.br, box5.f1.k8.com.br > port = 110 > } > } > service pop3 { > process_limit = 256 > process_min_avail = 10 > } > ssl = no > userdb { > driver = prefetch > } > userdb { > args = /etc/dovecot/dovecot-sql.conf.ext > driver = sql > } > verbose_proctitle = yes > protocol imap { > imap_idle_notify_interval = 120 s > imap_max_line_length = 65536 > mail_max_userip_connections = 50 > mail_plugins = $mail_plugins quota imap_quota autocreate > } > protocol lmtp { > mail_plugins = $mail_plugins sieve quota autocreate > } > protocol sieve { > mail_plugins = $mail_plugins sieve > managesieve_implementation_string = K8 ManageSieve > managesieve_logout_format = bytes=%i/%o > managesieve_max_line_length = 65536 > managesieve_sieve_capability = comparator-i;ascii-numeric copy > envelope fileinto imapflags include notify regex reject relational > subaddress vacation > } > protocol pop3 { > mail_plugins = $mail_plugins quota autocreate > } > >
Re: [Dovecot] Segfault in libdovecot-sieve
On Thu, 2010-10-21 at 22:13 +0100, Timo Sirainen wrote: > This reminds me of a problem with missing home directory. That crash is fixed > in v2.0.6, but you should have a home directory set so that reject/vacation > messages won't be duplicated. http://wiki2.dovecot.org/VirtualUsers/Home Given my mail directory is in the format mdbox:/var/spool/imap/$hash/$username is it safe to set the home directory to, say, /var/spool/imap/$hash/$username/home ? I assume it is, since the mailboxes are in the 'mailboxes' directory and thus the conflicts mentioned in the wiki can't happen, right? Best, Andre
Re: [Dovecot] Segfault in libdovecot-sieve
On Thu, 2010-10-21 at 23:01 +0100, Timo Sirainen wrote: > So you're using dbox? Yeah, you can set home like that then. Although with > dbox because of the mailboxes/ directory it's actually not bad to set home = > mail dir. Yeah, I'm using mdbox. I'll set home = mail dir then and upgrade to 2.0.6 to see if the problem goes away. Thanks Andre
Re: [Dovecot] anti-spam+anti-malware suggestions
Il giorno 20/ott/2010, alle ore 18.20, Jose Luis Faria ha scritto: > Hello people, > > I am using now qmail in cluster with LDAP + Interscan Messaging Security > Suite from Trendmicro. > > I need to develop a new solution with: > - postfix > - dovecot > - anti-spam > - anti-malware. > > I am thankful any help or suggestion for anti-spam and anti-malware. > > Thanks in advance! > > — +1 for ASSP. I’ve installed it three months ago, left it in learning mode for two weeks, then set it up, then after a month refined configuration. 99.97% spam blocked here! Regards A.
[Dovecot] Error that I don't understand
I’ve noticed lines like this in error log: IMAP(usern...@cubeholding.com): Error: read(mail, uid=58284) failed: Is a directory I’ve looked at sources and found this message in src/lib-storage/index/index-mail.c, function static int index_mail_stream_check_failure(struct index_mail *mail) but I don’t understand where it come from, I understand it is something about indexes, anyone can explain me more, please? Dovecot 1.2.12 TIA Andrea
Re: [Dovecot] Error that I don't understand
On 29/giu/2010, at 15.57, Steffen Kaiser wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Tue, 29 Jun 2010, Andre wrote: > >> IMAP(usern...@cubeholding.com): Error: read(mail, uid=58284) failed: Is a >> directory >> >> I’ve looked at sources and found this message in >> src/lib-storage/index/index-mail.c, function static int >> index_mail_stream_check_failure(struct index_mail *mail) but I don’t >> understand where it come from, I understand it is something about indexes, >> anyone can explain me more, please? > > Turn on mail_debug and check the output regarding the login of the session, > there are entries telling you the home directory and mailbox locations and > mailbox formats. > > I bet that you have configured a mailbox location, e.g. for the INBOX, that > ought to be a file, but is in fact a directory. > > Regards, This is the output of authtest: # /usr/lib/dovecot/authtest andre userdb: andre uid : 1001 user : an...@cubeholding.com home : /var/mail/cubeholding.com/andre extra fields: username=andre domain=cubeholding.com mail=maildir:~/maildir/:LAYOUT=fs:INDEX=~/indexes/ This is the relevant part of dovecot -a: namespace: type: private separator: / prefix: location: alias_for: inbox: yes hidden: no list: yes subscriptions: yes It does not seem to me that the problem is the one you pointed out, even if I think you pointed in the right direction Andre
Re: [Dovecot] Error that I don't understand
On 29/giu/2010, at 15.57, Steffen Kaiser wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Tue, 29 Jun 2010, Andre wrote: > >> IMAP(usern...@cubeholding.com): Error: read(mail, uid=58284) failed: Is a >> directory >> >> I’ve looked at sources and found this message in >> src/lib-storage/index/index-mail.c, function static int >> index_mail_stream_check_failure(struct index_mail *mail) but I don’t >> understand where it come from, I understand it is something about indexes, >> anyone can explain me more, please? > > Turn on mail_debug and check the output regarding the login of the session, > there are entries telling you the home directory and mailbox locations and > mailbox formats. > > I bet that you have configured a mailbox location, e.g. for the INBOX, that > ought to be a file, but is in fact a directory. > > Regards, > Found the problem: in one maildir there was a directory, that was threated like a message, that is what “Is a directory”. Regards Andrea
[Dovecot] Some doubts about quota
Hi to all, we are using quota to collect statistics about usage of mailboxes (thanks to the one who implemented :noenforcing) and we are using “maildir” backend, but we are thinking to migrate to *dbox (as soon as “per-user \Seen flag” would be implemented) and we should need a faster way to collect statistics, so I’ve tried to use Postgresql as a backend. I’ve follwed literally instructions from wiki2 (and part from wiki), but quota is not automatically updated as soon as a messages is delivered to user or deleted from mailbox, we need to perform a “doveadm quota recalc -A” to have it updated. Is it the normal behavior of quota plugin or do I missed something? TIA Andrea Mistrali a...@am.cx
Re: [Dovecot] Some doubts about quota
Il giorno 03/set/2010, alle ore 10.37, Andre ha scritto: > Hi to all, > we are using quota to collect statistics about usage of mailboxes (thanks to > the one who implemented :noenforcing) and we are using “maildir” backend, but > we are thinking to migrate to *dbox (as soon as “per-user \Seen flag” would > be implemented) and we should need a faster way to collect statistics, so > I’ve tried to use Postgresql as a backend. I’ve follwed literally > instructions from wiki2 (and part from wiki), but quota is not automatically > updated as soon as a messages is delivered to user or deleted from mailbox, > we need to perform a “doveadm quota recalc -A” to have it updated. Is it the > normal behavior of quota plugin or do I missed something? > > TIA > Andrea Mistrali > a...@am.cx Solved! I’ve had disabled quota plugin in LDA & LMTP. Now it works, sorry to have bothered you all and wasted your bandwidth Andrea Mistrali a...@am.cx
Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line
Il giorno 03/set/2010, alle ore 16.44, Timo Sirainen ha scritto: > On Thu, 2010-09-02 at 19:21 +0200, Luca Palazzo wrote: >> Hi All, >> we are experiencing another strange problem after upgrading to 2.0.1 >> from 1.2. >> >> Many people's client aree-retrieving mail from server due to some >> problem with dovecot-uidlist file. >> Looking at log file seem that all file content is sometime duplicated >> and appended to the and of same file. >> It look as another process was accesing and trying to modify uidlist table. > > I've heard of some dovecot-uidlist problems, but haven't really figured > out anything that could be wrong.. I guess there's no way you can > reproduce this? Does happen to same user more than once? How many users > is "many"? Does this happen only/mainly to some specific mailboxes > (INBOX, Trash)? Does this happen to more than one same user's mailbox at > the same time? Does this happen to different users around the same time? > I have the same problem, since migration to 2.0. Mainly it happens on INBOX (well, I’ve only seen this happen on INBOX), but I did not found a way to reproduce it. It happened to the same user more than once. I have 15 users. Only one mailbox a time, well, as I said before it happens only on INBOX and yes, more than one user per time. >> Our setup has a load balance (dovecot director) and three backend >> server. All of them use 2.0.1. > > How did you do it before v2.0? > I have no load balance, no director. > The maildir code hasn't changed much since v1.2. Hmm. Except that > maildir filenames are now tried to be preserved when copying, so copying > messages elsewhere and back does sound like it could cause this > (although there is code to prevent it).. > TIA Andrea Mistrali
Re: [Dovecot] Problems setting up dovecot 2.0.1 with kerberos auth
Il giorno 05/set/2010, alle ore 19.02, Dirk Heinrichs ha scritto: > Hi, > > I'm trying to setup dovecot 2.0.1 on a debian squeeze test box. I want > to integrate it into an already working kerberos5 setup, but I don't get > it to work. > > I've added created host/ smtp/ and imap/ service principals with random > key for the test machine and added them to its keytab. As I see below the principals are for oldbox.altum.de (is this the FQDN of the server?) > > I can also obtain user credentials using kinit, but when I try to telnet > to port 143, I only get the following: > > # kinit heini > Password for he...@altum.de: > # klist > Ticket cache: FILE:/tmp/krb5cc_0 > Default principal: he...@altum.de > > Valid starting ExpiresService principal > 09/05/10 18:56:30 09/06/10 04:56:30 krbtgt/altum...@altum.de >renew until 09/06/10 18:56:27 > # telnet localhost 143 > Trying 127.0.0.1... > Connected to localhost (127.0.0.1). > Escape character is '^]'. > * OK [CAPABILITY IMAP4rev1 LITERAL+ SASL-IR LOGIN-REFERRALS ID ENABLE > AUTH=GSSAPI] Dovecot ready. > a authenticate GSSAPI > a NO [UNAVAILABLE] Temporary authentication failure. > ^] > telnet> Connection closed. > > This is in the logs: > > Sep 5 18:56:47 oldbox dovecot: auth: Debug: Loading modules from > directory: /usr/lib/dovecot/modules/auth > Sep 5 18:56:47 oldbox dovecot: auth: Debug: auth client connected > (pid=27684) > Sep 5 18:56:58 oldbox dovecot: auth: Debug: client in: > AUTH#0111#011GSSAPI#011service=imap#011secured#011lip=127.0.0.1#011rip=127.0.0.1#011lport=143#011rport=33753 > Sep 5 18:56:58 oldbox dovecot: auth: Debug: gssapi(?,127.0.0.1): > Obtaining credentials for i...@rohan > Sep 5 18:56:58 oldbox dovecot: auth: gssapi(?,127.0.0.1): While > acquiring service credentials: Unspecified GSS failure. Minor code may > provide more information > Sep 5 18:56:58 oldbox dovecot: auth: gssapi(?,127.0.0.1): While > acquiring service credentials: Permission denied > Sep 5 18:57:00 oldbox dovecot: auth: Debug: client out: FAIL#0111#011temp > Sep 5 18:57:05 oldbox dovecot: imap-login: Disconnected (auth failed, 1 > attempts): method=GSSAPI, rip=127.0.0.1, lip=127.0.0.1, mpid=0, secured > > My configuration: > > # doveconf -n > # 2.0.1 (a05834588ffb): /etc/dovecot/dovecot.conf > # OS: Linux 2.6.32-5-486 i586 Debian squeeze/sid > auth_debug = yes > auth_gssapi_hostname = rohan ^ Line above should be “auth_gssapi_hostname = oldbox.altum.de" > auth_krb5_keytab = /etc/krb5.keytab > auth_mechanisms = gssapi > auth_verbose = yes > disable_plaintext_auth = no > listen = * > mail_location = maildir:~/mail > managesieve_notify_capability = mailto > managesieve_sieve_capability = comparator-i;octet > comparator-i;ascii-casemap fileinto reject envelope encoded-character > vacation subaddress comparator-i;ascii-numeric relational regex > imap4flags copy include variables body enotify environment mailbox date > plugin { > sieve = ~/.dovecot.sieve > sieve_dir = ~/sieve > } > protocols = imap > ssl = no > ssl_cert = ssl_key = userdb { > args = uid=vmail gid=vmail home=/var/vmail/%u > driver = static > } > > And here's the content of the kerberos keytab: > > # ktutil > ktutil: rkt /etc/krb5.keytab > ktutil: l > slot KVNO Principal > > - > 13host/oldbox.altum...@altum.de > 23host/oldbox.altum...@altum.de > 33host/oldbox.altum...@altum.de > 43host/oldbox.altum...@altum.de > 53imap/oldbox.altum...@altum.de > 63imap/oldbox.altum...@altum.de > 73imap/oldbox.altum...@altum.de > 83imap/oldbox.altum...@altum.de > 93smtp/oldbox.altum...@altum.de > 103smtp/oldbox.altum...@altum.de > 113smtp/oldbox.altum...@altum.de > 123smtp/oldbox.altum...@altum.de > > > I also don't see any connection attempt in the KDC's log file. > > Any idea what could be wrong? > Read between the lines :) It is sufficient that you create principal “imap/fullyqualifieddomainname” for IMAP auth. host/ principal is necessary if you want to telnet/ssh to the host using KRB auth, smtp/ is necessary if you want to send mails authenticating via KRB, but your SMTP server should support it. It is VERY VERY important that you use the FQDN (the one you obtain doing a reverse resolution - host -t ptr IP.of.the.server) of the imap server, unless you use a buggy client (read Apple Mail.app) in which case it should be necessary to create a principal for "imap/alias.of.server" and you MUST add auth_gssapi_hostname = “$ALL” to your configuration. A.
Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line
Il giorno 06/set/2010, alle ore 11.11, Luca Palazzo ha scritto: > Hi Timo, > I tried the patch and duplicate uid are always there. > > Look at this: > Sep 6 10:51:30 10.97.1.33 dovecot: lmtp(29909, xxx...@unict.it): save: > box=INBOX, uid=133197, msgid=<20100906104944.Q92185@>, size=7414, from= > Sep 6 10:51:30 10.97.1.33 dovecot: lmtp(29909, xxx...@unict.it): > T8gcJIyphEzVdAAA27qniQ: msgid=<20100906104944.q92...@pongo.fi.infn.it>: saved > mail to INBOX > Sep 6 10:51:31 10.97.1.33 dovecot: imap(xxx...@unict.it): Warning: > /virtual1/unict.it/g/xx//Maildir/dovecot-uidlist: Duplicate file entry at > line 883: 1277948239.M332097P873 > 3.mailcl-mbox1,S=7903,W=8024:2,S (uid 132318 -> 133198) > Sep 6 10:51:31 10.97.1.33 dovecot: imap(xxx...@unict.it): Warning: > /virtual1/unict.it/g/xx//Maildir/dovecot-uidlist: Duplicate file entry at > line 884: 1277952980.M167558P112 > 43.mailcl-mbox1,S=11228,W=11393:2,S (uid 132319 -> 133199) > Sep 6 10:51:31 10.97.1.33 dovecot: imap(xxx...@unict.it): Warning: > /virtual1/unict.it/g/xx//Maildir/dovecot-uidlist: Duplicate file entry at > line 885: 1277966013.M655255P280 > 93.mailcl-mbox1,S=23709,W=24249:2,S (uid 132320 -> 133200) > Sep 6 10:51:31 10.97.1.33 dovecot: imap(xxx...@unict.it): Warning: > /virtual1/unict.it/g/xx//Maildir/dovecot-uidlist: Duplicate file entry at > line 886: 1277969233.M852614P116 > 56.mailcl-mbox1,S=4496,W=4604:2,S (uid 132321 -> 133201) > Sep 6 10:51:31 10.97.1.33 dovecot: imap(xxx...@unict.it): Warning: > /virtual1/unict.it/g/xx//Maildir/dovecot-uidlist: Duplicate file entry at > line 887: 1277970140.M285747P169 > 43.mailcl-mbox1,S=7601,W=7845:2,RS (uid 132322 -> 133202) > > It seems that LMTP process duplicate UID or something related to it. But, > duplicate occurs sometime during LMTP delivery and sometime after LMTP > delivery with IMAP or POP3. > > I hope this helps. > > Luca Instead for me seems to have fixed the problem (2.0.1) Andre
[Dovecot] Problems with zlib
Sometimes I see lines like these in my log: 20100906 11:34:32 imap(usern...@domain.com): Panic: file istream-zlib.c: line 173 (i_stream_zlib_read): assertion failed: (zstream->high_pos == 0) 20100906 11:34:32 imap(usern...@domain.com): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0 [0x7f328d2244a2] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f328d22450a] -> /usr/lib/dovecot/libdovecot.so.0(i_error+0) [0x7f328d2248b3] -> /usr/lib/dovecot/modules/lib20_zlib_plugin.so [0x7f328be444fc] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read+0x6b) [0x7f328d22a10b] -> /usr/lib/dovecot/libdovecot.so.0(i_stream_read_data+0x4d) [0x7f328d22a3fd] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f328d21476e] -> /usr/lib/dovecot/libdovecot.so.0 [0x7f328d214cbe] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x29) [0x7f328d2148c9] -> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_body+0x23) [0x7f328d214a43] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x7f328d4cb72f] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x7f328d4cb84a] -> /usr/lib/dovecot/libdovecot-storage.so.0(index_mail_get_special+0x3dc) [0x7f328d4cc99c] -> /usr/lib/dovecot/libdovecot-storage.so.0 [0x7f328d4dd86d] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID] [0x41256a] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID](imap_fetch_more+0x16c) [0x412b0c] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID](cmd_fetch+0x3fa) [0x40acea] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID] [0x41031c] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID] [0x4103cd] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID](client_handle_input+0x45) [0x410545] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID](client_input+0x62) [0x410f72] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xcb) [0x7f328d22f3ab] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x18) [0x7f328d22e4c8] -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f328d21dd63] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID](main+0x281) [0x419201] -> /lib/libc.so.6(__libc_start_main+0xe6) [0x7f328caa81a6] -> dovecot/imap [usern...@domain.com 192.168.4.253 UID] [0x408bd9] Here is the backtrace: [New process 11474] #0 0x7f328cabbed5 in raise () from /lib/libc.so.6 (gdb) bt #0 0x7f328cabbed5 in raise () from /lib/libc.so.6 #1 0x7f328cabd3f3 in abort () from /lib/libc.so.6 #2 0x7f328d2244b5 in ?? () from /usr/lib/dovecot/libdovecot.so.0 #3 0x7f328d22450a in ?? () from /usr/lib/dovecot/libdovecot.so.0 #4 0x7f328d2248b3 in i_panic () from /usr/lib/dovecot/libdovecot.so.0 #5 0x7f328be444fc in ?? () from /usr/lib/dovecot/modules/lib20_zlib_plugin.so #6 0x7f328d22a10b in i_stream_read () from /usr/lib/dovecot/libdovecot.so.0 #7 0x7f328d22a3fd in i_stream_read_data () from /usr/lib/dovecot/libdovecot.so.0 #8 0x7f328d21476e in ?? () from /usr/lib/dovecot/libdovecot.so.0 #9 0x7f328d214cbe in ?? () from /usr/lib/dovecot/libdovecot.so.0 #10 0x7f328d2148c9 in message_parser_parse_next_block () from /usr/lib/dovecot/libdovecot.so.0 #11 0x7f328d214a43 in message_parser_parse_body () from /usr/lib/dovecot/libdovecot.so.0 #12 0x7f328d4cb72f in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #13 0x7f328d4cb84a in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #14 0x7f328d4cc99c in index_mail_get_special () from /usr/lib/dovecot/libdovecot-storage.so.0 #15 0x7f328d4dd86d in ?? () from /usr/lib/dovecot/libdovecot-storage.so.0 #16 0x0041256a in ?? () #17 0x00412b0c in imap_fetch_more () #18 0x0040acea in cmd_fetch () #19 0x0041031c in ?? () #20 0x004103cd in ?? () #21 0x00410545 in client_handle_input () #22 0x00410f72 in client_input () #23 0x7f328d22f3ab in io_loop_handler_run () from /usr/lib/dovecot/libdovecot.so.0 #24 0x7f328d22e4c8 in io_loop_run () from /usr/lib/dovecot/libdovecot.so.0 #25 0x7f328d21dd63 in master_service_run () from /usr/lib/dovecot/libdovecot.so.0 #26 0x00419201 in main () here is the relevant plugin section: plugin { zlib_save = gz zlib_save_level = 6 } What can I do to investigate deeper? TIA Andre
Re: [Dovecot] Problems setting up dovecot 2.0.1 with kerberos auth
Il giorno 06/set/2010, alle ore 21.44, Dirk Heinrichs ha scritto: > Am 06.09.2010 21:30, schrieb Dirk Heinrichs: >> Am 06.09.2010 20:09, schrieb Dirk Heinrichs: >> >>> Looks like "$ALL" was the way to go, since at least I get the imap/ >>> ticket now. However, login still fails: >> >> I also get the tickets with auth_gssapi_hostname = oldbox.altum.de, but >> doesn't make a difference. > > But changing permissions of the kerberos keytab did. After chmod 644 > /etc/krb5.keytab login succeeded. > > Bye... > > Dirk > When I saw the message “Permission denied” in a previous mail I immediately thought of permissions of krb5.keytab. Rememeber that, about what concerns security, it could be not good to chmod 644 keytab. Instead you can create another keytab containing principals for imap service, put it in dovecot directory (for example), give it correct permissions and ownership and change “auth_krb5_keytab” value to point to the new keytab file. Bye Andre
Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line
_size=14641, ...}) = 0 > fstat64(17, {st_mode=S_IFREG|0644, st_size=14641, ...}) = 0 > pread64(17, ""..., 4096, 14641) = 0 > stat64("/virtual1/unict.it/a/account//Maildir/dovecot-uidlist", > {st_mode=S_IFREG|0644, st_size=14641, ...}) = 0 > _llseek(17, 0, [0], SEEK_SET) = 0 > fstat64(17, {st_mode=S_IFREG|0644, st_size=14641, ...}) = 0 > fstat64(17, {st_mode=S_IFREG|0644, st_size=14641, ...}) = 0 > pread64(17, ""..., 4096, 14641) = 0 > This morning I have again the problem with duplicate uidlist. Unfortunately. Andre
[Dovecot] Light "bug" in authtest, sockets path
Hi to all! I’ve changed position to client auth socket to enable postfix authentication. The socket is now created in /var/spool/postfix/private/auth. authtest do not catch up the change. Reading source I’ve seen that path to auth sockets is written explicitly in function authtest_passdb in util/authtest.c to: if (auth_socket_path == NULL) auth_socket_path = PKG_RUNDIR"/auth-client”; I know I can launch authtest specifing path to socket, but I think it would be better if authtest would parse dovecot.conf and find out where sockets are. I’ve tried to code it by myself, but I’ve had no time to go deep in the code. Is it possible to have this “feature” added??? TIA Andrea
[Dovecot] S=xxx missing in new messages
Hi to all! I’m setting up dovecot 1.2.8 on my system to substitute an older IMAP server and I’m testing all features of Dovecot. Yesterday I was testing support for zlib, for compressed messages, to set up a new namespace for old mails and I read that it is safe to compress only mails that have the field “S=XXX” in their name (XXX being the original size of message) and to leave uncompressed the ones that don’t have S=XXX in their name. Testing and searching I discovered that only new mail, mail that used to arrive in mailbox via SMTP have S=XXX, mail copied from another mailbox loose S=XXX. Later I’ve found that this not work anymore, even directly delivered mail messages do not have S=XXX anymore. I use dovecot-lda as delivery program and postfix as SMTP server, but I’ve not touched postfix configuration since one month ago. What can it be? How can I have S=XXX again in my messages file name? TIA Andrea
[Dovecot] CRAM-MD5 in Python
Hi to all! I’m writing a python module (python+sqlalchemy) to manage user and domain configuration on my system (I hope to get a CLI tool, a Web app and even a native Mac app, via PyObjc, from my lib). I’m implementing password crypto, but I have some problem in generating CRAM-MD5 password, dovecot style. I’ve found an old discussion on this mailing list and a piece of Perl that works, but I need to implement it in Python; I’ve even read code (hmac-md5.c), but before start hard coding (hard from my POV at least, since I’ve never worked with crypto algorithms in a deep way), is there anyone that have had solved the problem or has any idea on how to approach it? TIA Andre
Dovecot on Debian Stretch with AppArmor
Hello all, I am using dovecot on Debian stretch, with AppArmor, and I have this audit log: Mar 16 11:25:10 mail kernel: audit: type=1400 audit(1521199510.705:580): apparmor="DENIED" operation="file_mmap" info="Failed name lookup - disconnected path" error=-13 profile="/usr/lib/dovecot/auth" name="var/cache/nscd/hosts" pid=26797 comm="auth" requested_mask="r" denied_mask="r" fsuid=0 ouid=0 With 'name="var/cache/nscd/hosts"', is there any missing '/' at the beginning of the path, somewhere? The version is: 1:2.2.27-3+deb9u2 Thanks for your advices, André Rodier. -- https://github.com/progmaticltd/homebox
Re: Accentuated email addresses stored in LDAP
On 19/03/2018 07:23, Steffen Kaiser wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 19 Mar 2018, André Rodier wrote: I had to use base64 encoding to store email addresses, because they are rejected otherwise, with an error message of illegal characters. I also you are using the stock "mail" attribute in LDAP as: olcAttributeTypes: ( 0.9.2342.19200300.100.1.3 NAME ( 'mail' 'rfc822Mailbox' ) DESC 'RFC1274: RFC822 Mailbox' EQUALITY caseIgnoreIA5Match SUBSTR caseIgnoreIA5SubstringsMatch SYNTAX 1.3.6.1.4.1.1466.115.121.1.26{256} ) http://www.oid-info.com/get/1.3.6.1.4.1.1466.115.121.1.26 https://en.wikipedia.org/wiki/IA5STRING IA5 :- 7bit noticed that some of the fields, like 'dn' and 'cn' where automatically encoded in base64 when stored when including accentuated chars. you mean when you use ldapsearch or similiar tool to export data? LDIF traditionally encode all data in 7bit ASCII, which is noted by the double "::" after the LDAP attribute name. The data in LDAP is UTF8 and binary connections need not encode it either. - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1 iQEVAwUBWq9lWMQnQQNheMxiAQL3ywgAtbWsT1U+PQgdK0D3StI9c44r8KgEG7dr AXhIvFPowuD3U0KH0ZJ8VHc+/WN0DMqCONvuaUyueaGY8bgqx+cNw8z01zMC9hTF xfs8x1lQsgikacyyjo3o9WehOJzgnlGvt33LLwjsI62WOLFE8PXnkZFXpkAWI1f4 yTWoTFOxPnAA90CDBS4aBHdBaFI0TwbiGP5oIyjGCvI1aHJSTy5lNKfwUkvTdI+L tH4Z0JDkB3YBnRVIL6ST5W7p0VvBAQo+ia+UXpsZ4b1t3/xYCKtNV0ls9jIoqVzg dEFeyUoKQe8k5N8k6/vVVElzwtW6fxzQUJQXj01u03udqVMmTqXhrw== =8rp9 -END PGP SIGNATURE- Hello Steffen, Thank you for your answer. In fact, I am using the otherMailBox attribute, from the standard OpenLDAP distribution, which is also IA5String. - Is there any way in Dovecot to encode the fields in base 64, to send queries? as the query is "eq", this would be enough, I think. - Or is the LDAP server is supposed to store attributes as UTF8, and in this case, how to configure it that way? Thanks! # RFC1274: Cosine and Internet X.500 schema: # 9.3.18. Other Mailbox # # The Other Mailbox attribute type specifies values for electronic # mailbox types other than X.400 and rfc822. # #otherMailbox ATTRIBUTE #WITH ATTRIBUTE-SYNTAX #SEQUENCE { #mailboxType PrintableString, -- e.g. Telemail #mailbox IA5String -- e.g. X378:Joe #} #::= {pilotAttributeType 22} # attributetype ( 0.9.2342.19200300.100.1.22 NAME 'otherMailbox' SYNTAX 1.3.6.1.4.1.1466.115.121.1.39 ) -- https://github.com/progmaticltd/homebox
Re: Accentuated email addresses stored in LDAP
On 20/03/2018 08:00, Steffen Kaiser wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Mon, 19 Mar 2018, Andre Rodier wrote: In fact, I am using the otherMailBox attribute, from the standard OpenLDAP distribution, which is also IA5String. - Is there any way in Dovecot to encode the fields in base 64, to send queries? as the query is "eq", this would be enough, I think. Check out: https://wiki2.dovecot.org/Variables?highlight=(base64) However, I never used this modifier and Aki pointed out, that UTF8 usernames are not (100%) supported, yet. - Or is the LDAP server is supposed to store attributes as UTF8, and in this case, how to configure it that way? To achieve this, you must/can extend the schema with your own attribute that uses: https://www.ldap.com/understanding-ldap-schema "Directory String "The directory string syntax is basically a catch-all syntax for UTF-8 strings. It allows values with this syntax to have any combination of one or more UTF-8 characters (empty directory string values are not allowed, although some directory servers ignore this constraint). "The directory string syntax is defined in RFC 4517 section 3.3.6, and has an OID of "1.3.6.1.4.1.1466.115.121.1.15"." Otherwise, you could _misuse_ an exiting attribute of this type unused in your directory otherwise. - -- Steffen Kaiser -BEGIN PGP SIGNATURE- Version: GnuPG v1 iQEVAwUBWrC/hcQnQQNheMxiAQLV+wf+P/gzADRyNSIQtILNKoN7eHEVPNGt9iVd TzHl5rka9XB89eUE2lsGjlURH3PIVqDKjtTEAl27CYiBr9OI66u+PvhE1o2lvY7R YBG1Z/R3n8FWF58HpxwJGBbY4iiPQKSvvRM43/Q2mYnEveyIBvNZawNo0okTNMOM bMSmpUhxGKsqmAeEoUQHOKrujAK0qfucZDI7nuSGjJeej7L2HXm3sEEKTEuYmUDQ E2ox5fAyIMURA+NINzdmk7chXu30DfWuHNY8jwezM3SEds5xlAy4x6qD6EZ4f7qP KnYEfxnYyISDqcXSy9AL20srIzn2OXiTA3/TiVOKFXpHrrst8kVCeg== =+Me+ -END PGP SIGNATURE- Thank you, Steffen, this is a great link. I am probably going to keep this attribute, and use base64, for now. Kind regards, Andre -- https://github.com/progmaticltd/homebox
Re: v2.2.35 released
On 19/03/2018 13:23, Aki Tuomi wrote: https://dovecot.org/releases/2.2/dovecot-2.2.35.tar.gz https://dovecot.org/releases/2.2/dovecot-2.2.35.tar.gz.sig - charset_alias: compile fails with Solaris Studio, reported by John Woods. - Fix local name handling in v2.2.34 SNI code, bug found by cPanel. - imapc: Don't try to add mails to index if they already exist there. - imapc: If email is modified in istream_opened hook, mail size isn't updated. - lib-dcrypt: When reading encrypted data, more data would not be read if buffer was not consumed causing panic or hang. - notify: When notify plugin is used and transaction commit fails in dsync, crash occurs. - sdbox: When delivering to a mailbox that is over quota, temp files are not cleaned up when saving or copying fails. Thank you, Aki, This is great to know Dovecot is so active, and to have updates on this mailing list as well. -- https://github.com/progmaticltd/homebox
Questions around mailcrypt and LDAP
Hello, all. I read carefully the messages about mailcrypt on the mailing list, especially this response from Aki: It's best suited for securing external storage such as NFS or object storage. There are possibilities to encrypt the key using user's password, but this takes careful planning. The keys can also come from userdb , e.g. LDAP. I am able to extend the LDAP schema of my OpenLDAP server to store a key into LDAP attribute for each user. In this case, would it be enough for Dovecot to encrypt the messages when they arrive ? Maybe I misunderstand the documentation. Even when using user keys protected by a password, the Dovecot LMTP process should be able to encrypt the emails with user’s public key, without a password, no ? Ideally, I would like to store user's emails encrypted, so each users cannot access other user's emails. I don't need folder sharing. Thanks for your advice. Kind regards, André Rodier
Re: Questions around mailcrypt and LDAP
Dear dovecot developers. When using mailcrypt plugin, how can store the encryption key in LDAP, please ? There is an example with SQL in the doc, but no LDAP. Thanks, André On Thu, 2022-11-10 at 19:39 +, Andre Rodier wrote: > Hello, all. > > I read carefully the messages about mailcrypt on the mailing list, > especially this response from Aki: > > > It's best suited for securing external storage such as NFS or > > object storage. > > There are possibilities to encrypt the key using user's password, > > but this > > takes careful planning. The keys can also come from userdb , e.g. > > LDAP. > > I am able to extend the LDAP schema of my OpenLDAP server to store a > key > into LDAP attribute for each user. > > In this case, would it be enough for Dovecot to encrypt the messages > when they arrive ? > > Maybe I misunderstand the documentation. Even when using user keys > protected by a password, the Dovecot LMTP process should be able to > encrypt the emails with user’s public key, without a password, no ? > > Ideally, I would like to store user's emails encrypted, so each users > cannot access other user's emails. I don't need folder sharing. > > Thanks for your advice. > > Kind regards, > André Rodier >
Self hosting solution for Christmas
Hello everyone, Here my present for Christmas: a new version of HomeBox, the self hosted email solution. Feel free to drop comments, create issues, update the docs, etc. I released this quickly before going on vacation, so you may find some issues. However, this is mostly stable, and the code is easy to modify. Also, you can now add and remove components individually, with an Ansible playbook. https://github.com/progmaticltd/homebox System installation and features - Custom Debian installer generation with full disk encryption and fully automatic installation. - Unlock the system upon boot by entering the passphrase through SSH. - Install packages only from Debian stable (Bullseye). - Automatic letsencrypt certificates generation using Lego and DNS challenge. - Automatic security updates (optional). - Centralised authentication with an LDAP users database, SSL certificate, password policies, PAM integration. - AppArmor activated with a profile for all daemons. - XKCD Random passwords generated and saved into pass (or on file system). - Can be used at home, on a dedicated or virtual server hosted online. - Flexible IP address support: IPv4 only, IPv6 only, and IPv4+IPv4 or IPv4+IPv6. - Embedded DNS server, with CAA, DNSSEC and SSHFP (SSH fingerprint) support. - Grade A https sites, HSTS implemented by default. - Automatic configuration of OpenPGP Web Key Directory. - Automatic firewall rules for inbound, outbound and forwarding traffic, using nftables. - Restricted outbound web sites access to the minimum. - Automatic update of DNS keys, DNS servers and glue records on Gandi. Emails - Postfix configuration and installation, with LDAP lookups, internationalised email aliases, fully SSL compliant. - Generate DKIM keys, SPF and DMARC DNS records. The DKIM keys are generated every year. - Automatic copy of sent emails into the sent folder. - Automatic creation of the postmaster account and special email addresses using RFC 2142 specifications. - Dovecot configuration, IMAPS, POP3S, Quotas, ManageSieve. - Simple spam and ham learning by moving emails in and out the Junk folder - Sieve and vacation scripts. - Virtual folders for server search: unread messages, conversations view, all messages, flagged and messages labelled as "important". - Email addresses with recipient delimiter included, e.g. john.doe+li...@dbcooper.com. - Optional master user creation, e.g. for families with children or moderated communities. - Server side full text search inside emails, attached documents and files and compressed archives, with better results than GMail. - SOGo webmail with sieve filters management, password change form, Calendar and Address book management, GUI to import other account emails. - Powerful and light antispam system with rspamd and optional access to the web interface. - Antivirus for inbound and outbound emails with clamav (optional). - Automatic configuration for Thunderbird and Outlook using published XML and other clients with special DNS records (RFC 6186). Calendar and Address book - Install and configure a CalDAV / CardDAV server, with automatic discovery (RFC 6186). - Groupware functionality in a web interface, with SOGo. - Recurring events, email alerts, shared address books and calendars. - Mobile devices compatibility: Android, Apple iOS, BlackBerry 10 and Windows mobile through Microsoft ActiveSync. Other optional features - Incremental backups, encrypted, on multiple destination (SFTP, S3, Samba share or USB drive), with email and Jabber reporting. - Jabber server, using ejabberd, with LDAP authentication, direct or offline file transfer and optional server to server communication. - Static web site skeleton configuration, with https certificates and A+ security grade by default. Development - YAML files validation on each commit, using travis-ci. - End to end integration tests for the majority of components. - Playbooks to facilitate the installation or removal of development packages. - Global debug flag to activate the debug mode of all components. - Fully open source Ansible scripts licensed under GPLv3. Merry Christmas, André
Re: Message searching in Dovecot
On Wed, 2023-04-19 at 16:34 -0500, John Gateley via dovecot wrote: > Hello, > For mobile clients (gmail on Android), I need a server side searching > solution. > A few months ago, I tried getting Solr to work with Dovecot, but failed. > The instructions here https://doc.dovecot.org/configuration_manual/fts/solr/ > are quite out of date, they reference > Debian 8 and 9 (current version 11), and Solr 7.7 (current version 9.2) > My Solr experience is pretty much zero. > Questions/Requests: > * Is there a different tool than Solr I should be using for this? > * Does anyone have a recent version of Solr and Debian working? > * If you do, would you be willing to help me? > * I cannot afford much, this is a home mailserver for my wife and I, but I > could pay a small consulting fee. > I use ansible to deploy the server, I'd be willing to contribute the > playbooks somewhere for documentation, or help > with the docs. > Thanks! > John > ___ > dovecot mailing list -- dovecot@dovecot.org > To unsubscribe send an email to dovecot-le...@dovecot.org Hello, John, I successfully use Xapian, by the way included in Debian standard packages. If you need real code example, see here: https://github.com/progmaticltd/homebox/tree/main/roles/dovecot The project is a set of Ansible scripts to deploy a mail server from scratch, on Debian. Kind regards, André ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-le...@dovecot.org
Indexer opening emails in write mode ?
Hi, I have dovecot indexer working inside AppArmor, and I am confused by some error messages: > name="/home/users/andre/mails/maildir/.Sent/cur/1682251668.M110083P109814.pigment,S=1743,W=1776:2,S" > pid=111784 > comm="indexer-worker" requested_mask="wd" denied_mask="wd" fsuid=1001 > ouid=1001 Why the indexer would open email files in write mode, please ? Thanks for your advice ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-le...@dovecot.org
Patch SERVICE_FIRST_STATUS_TIMEOUT
Hi list, we had a lot of trouble with our Dovecot Replicating-Cluster installation authenticating against LDAP Service. We ran in a timeout and what happened was that we got more and more search requests running against on our ldap server. And on the dovecot site the process got killed after a couple of seconds. So we ran into a race condition and our LDAP Server was under heavy load. We got a log entry like this: "Initial status notification not received in 30 seconds, killing the process" So we had to apply the attached patch to our Source based Dovecot Cluster. Could you please make a configurable Parameter for our Patched value? That would be great to get this parameter Configurable. Thanks Andre Helwig -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-0 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin --- src/master/service.h.orig 2014-11-07 16:32:24.330468149 +0100 +++ src/master/service.h 2014-11-07 16:32:36.418710001 +0100 @@ -6,7 +6,7 @@ /* If a service process doesn't send its first status notification in this many seconds, kill the process */ -#define SERVICE_FIRST_STATUS_TIMEOUT_SECS 30 +#define SERVICE_FIRST_STATUS_TIMEOUT_SECS 120 #define SERVICE_STARTUP_FAILURE_THROTTLE_MIN_SECS 2 #define SERVICE_STARTUP_FAILURE_THROTTLE_MAX_SECS 60 signature.asc Description: OpenPGP digital signature
Re: Patch SERVICE_FIRST_STATUS_TIMEOUT
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 03/16/2015 10:30 PM, Timo Sirainen wrote: > On 16 Mar 2015, at 22:36, Timo Sirainen wrote: >> >>> So we had to apply the attached patch to our Source based >>> Dovecot Cluster. >>> >>> Could you please make a configurable Parameter for our Patched >>> value? >>> >>> That would be great to get this parameter Configurable. >> >> That's the wrong solution though. A process initialization is >> supposed to take less than a second always. If something like >> LDAP initialization is taking minutes, this waiting should be >> done after the process initialization has finished. >> >> I thought the LDAP initialization code was asynchronous though, >> unless you're using sasl_bind=yes or tls=yes? > > http://hg.dovecot.org/dovecot-2.2/rev/0a17875f0ece should help with > this. I did a bunch of other cleanup commits also, which are more > or less required to avoid invalid errors from rapidly recreating > auth processes that just die immediately. > Wow that was a fast response also with patching. We will test this asap. Thanks a lot Timo. Cheers, Andre Helwig - -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-0 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin -BEGIN PGP SIGNATURE- Version: GnuPG v1 iQEcBAEBAgAGBQJVB/RpAAoJEAoTNwRDnEhRM5MH+QFq+RY95LpZr9qoVmQ+ABnb BH46N5nJxcKc2zRjATfotmEwpxjeVLEH0YrziTkvkTHUd4ehMrqBalxbGVpe/Y1T fjVB4iddM3uHrqzpUSweiS8D4l3Rh6xUL1m36pHtajPKfO6V+bauM0APpogFEXHc GNuUNLCh8IYAEezHTOiMhDSCob4Gx/cr5XOTqRMw/w093nkp1gyfoUUCCj6ZwMVy rgTgBmjebZlx2Kf70G6Q5fa2QXKhDwpWThPqlSrsiC6it10rPAKMjTC/mJ9O2/8/ 9jRGeFYqKVzMCUvPlnD568kXxsLTsXOZRkUDspgQmrJ06Y4VuXCz5KqEfDW/KsI= =Zk4U -END PGP SIGNATURE-
Re: Dovecot current number of connections being used.
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 doveadm who should help On 03/17/2015 05:13 PM, Jaime Ventura wrote: > Hey, Is there an easy way to get how many connections are being > handled at a moment? > > I wanted to have that number over the time and see: - Trends on > usage during the day - how close is it from reaching the maximum > number of connections. - ... > > I'm searching for a solution without recurring to something like > netstat | grep imap | wc -l. > > Thanks, Jaime > - -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-0 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin -BEGIN PGP SIGNATURE- Version: GnuPG v1 iQEcBAEBAgAGBQJVCFOnAAoJEAoTNwRDnEhRJhIIAIHCCVaJmYO/qIfWjdDNb4EB qDuh+ssiMucMzMZFM7wsvYEYc3P0ERb3F8nMdUgyhJWDWU/RJTVniTRrXUkpdPDb 7ozDDaiXAQ3vZ747+RTtoOW7UgSZ08hdUJeQdIEU74Hy2Mf7tWvsqFdpj3qfkXAL piPHnHzl4HFZkuQisrqMyhUJXfICbJHMsH+FtDrpERI4WbVRd0tWtnRgH805Bsf+ 7GVj7kT67jM0rkdp3yD/6fcCt1n8nAdlK5TnjQOrbXHwOMmdV55EsQusgqlou44/ 6H4ZsokrJolFCmA9ayle6bR8qN5YfMzVtGvmkvpc1mUfSi9ANt6vZLfT5A5t9vc= =IZu3 -END PGP SIGNATURE-
Replication: "cross-updates" of mail meta-data
Hello I have a two-server dovecot setup using replication. Each server runs two dovecot instances, one for director and another for the backend. Initially I set up a single server, got it all working, then rsync'd the data and index partitions to the new one and started the clusters (I used rsync as a way to speed-up dovecot's initial replication). Both servers listen on a virtual IP addresses load-balanced by IPVS as well as their own IP addresses. When I started dovecot in the second server, users started reporting that some of their messages were missing. I noticed that while the mail data seemed to be up to date in server1, it wasn't in server2; however, the indexes were being updated in server2 but not in server1. For example, "doveadm quota get -u some-user" would report the wrong value in server1 and the right value in server2, while a "du" would show that only server1 actually had the most up-to-date data. At the moment I had to take down server2, because as soon as dovecot is running in it, users start reporting missing messages again. To solve that problem, a "doveadm force-resync" in server1 isn't enough. I either rsync the index files from server2 or remove the indexes in server1 before the force-resync, which then works. Has anyone ever saw anything similar to this? Any help would be much appreciated. I'm running Ubuntu 14.04 with dovecot 2.2.15 with the configurations below: === Backend instance === # dovecot -n # 2.2.15: /etc/dovecot/dovecot.conf # OS: Linux 3.16.0-37-generic x86_64 Ubuntu 14.04.2 LTS auth_master_user_separator = * auth_mechanisms = plain login auth_username_chars = abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890.-_@= auth_worker_max_count = 10 disable_plaintext_auth = no doveadm_password = secret doveadm_port = 12345 listen = server1.mydomain.com mail_fsync = never mail_gid = dovemail mail_plugins = " notify replication quota" mail_uid = dovemail managesieve_sieve_capability = fileinto reject envelope vacation subaddress comparator-i;ascii-numeric relational regex copy include vacation-seconds imapflags notify namespace { inbox = yes location = mailbox SPAM { auto = subscribe } prefix = separator = / type = private } passdb { args = /etc/dovecot/dovecot-sql.conf.ext driver = sql } passdb { args = /etc/dovecot/dovecot-sql-master.conf.ext driver = sql master = yes pass = yes } plugin { mail_replica = tcp:192.168.0.2:12345 # server2's replication IP quota = dict:User quota::file:/var/lib/imap/user/%2.256RHn/%n/dovecot-quota quota_rule = *:storage=1GB sieve = /var/lib/imap/sieve/%2.256RHn/%n/dovecot.sieve sieve_dir = /var/lib/imap/sieve/%2.256RHn/%n sieve_extensions = comparator-i;ascii-numeric copy envelope fileinto imapflags include notify regex reject relational subaddress vacation-seconds sieve_max_redirects = 20 sieve_max_script_size = 512KB sieve_quota_max_scripts = 2 sieve_vacation_min_period = 1 sieve_vacation_send_from_recipient = yes } protocols = imap pop3 lmtp sieve replication_dsync_parameters = -f -d -N -l 30 -U service aggregator { fifo_listener replication-notify-fifo { group = dovemail mode = 0666 user = dovemail } unix_listener replication-notify { group = dovemail mode = 0666 user = dovemail } } service auth-worker { user = $default_internal_user } service auth { client_limit = 10240 process_limit = 1 process_min_avail = 1 } service doveadm { inet_listener { address = 192.168.0.1 port = 12345 } vsz_limit = 1 G } service imap { process_limit = 8192 process_min_avail = 10 } service lmtp { inet_listener { address = lmtpcluster.internal.mydomain.com, server1.internal.mydomain.com port = 1124 } process_limit = 512 process_min_avail = 10 } service managesieve-login { inet_listener sieve { address = lmtpcluster.internal.mydomain.com, server1.internal.mydomain.com port = 4190 } } service managesieve { process_limit = 20 process_min_avail = 10 } service pop3 { process_limit = 512 process_min_avail = 10 } service replicator { process_min_avail = 1 unix_listener replicator-doveadm { group = dovemail mode = 0666 user = dovemail } } ssl_cert = signature.asc Description: OpenPGP digital signature
Re: mailbox deletion is not replicated correctly
On 04/17/2015 12:07 PM, Dennis Kuhn wrote: > On 16.04.2015 20:32, Timo Sirainen wrote: >> On 16 Apr 2015, at 19:22, Dennis Kuhn wrote: >>> i can't delete several folders at once. I have a folder structure like >>> folder1/folder2/folder3 (we use slash as hierarchy separator). When i >>> delete folder1 server1 executes the command correctly >>> >>> >>> Apr 16 13:44:28 server1 dovecot: imap(d.k...@heinlein-support.de): >>> Mailbox deleted: INBOX/Trash/folder1/folder2/folder3 >>> Apr 16 13:44:28 server1 dovecot: imap(d.k...@heinlein-support.de): >>> Mailbox deleted: INBOX/Trash/folder1/folder2 >>> Apr 16 13:44:28 server1 dovecot: imap(d.k...@heinlein-support.de): >>> Mailbox deleted: INBOX/Trash/folder1 >>> >>> >>> but the replica server2 reverses the order: >>> >>> Apr 16 13:44:29 server2 dovecot: >>> dsync-server(d.k...@heinlein-support.de): Mailbox deleted: >>> INBOX/Trash/folder1 >>> Apr 16 13:44:29 server2 dovecot: >>> dsync-server(d.k...@heinlein-support.de): Mailbox deleted: >>> INBOX/Trash/folder1/folder2 >>> Apr 16 13:44:29 server2 dovecot: >>> dsync-server(d.k...@heinlein-support.de): Mailbox deleted: >>> INBOX/Trash/folder1/folder2/folder3 >>> >>> >>> This creates the folder INBOX/Trash/folder1/folder2 on server2 again >>> which replicates back to server1. >> With what Dovecot version? What mailbox format? >> > The mailbox format is mdbox. Server1 is 2.2.15, server2 2.2.16. Hi Timo, is there any update on this issue? cheers Andre
Re: mailbox deletion is not replicated correctly
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 07/14/2015 10:35 AM, Andre Helwig wrote: > On 04/17/2015 12:07 PM, Dennis Kuhn wrote: >> On 16.04.2015 20:32, Timo Sirainen wrote: >>> On 16 Apr 2015, at 19:22, Dennis Kuhn >>> wrote: >>>> i can't delete several folders at once. I have a folder >>>> structure like folder1/folder2/folder3 (we use slash as >>>> hierarchy separator). When i delete folder1 server1 executes >>>> the command correctly >>>> >>>> >>>> Apr 16 13:44:28 server1 dovecot: >>>> imap(d.k...@heinlein-support.de): Mailbox deleted: >>>> INBOX/Trash/folder1/folder2/folder3 Apr 16 13:44:28 server1 >>>> dovecot: imap(d.k...@heinlein-support.de): Mailbox deleted: >>>> INBOX/Trash/folder1/folder2 Apr 16 13:44:28 server1 dovecot: >>>> imap(d.k...@heinlein-support.de): Mailbox deleted: >>>> INBOX/Trash/folder1 >>>> >>>> >>>> but the replica server2 reverses the order: >>>> >>>> Apr 16 13:44:29 server2 dovecot: >>>> dsync-server(d.k...@heinlein-support.de): Mailbox deleted: >>>> INBOX/Trash/folder1 Apr 16 13:44:29 server2 dovecot: >>>> dsync-server(d.k...@heinlein-support.de): Mailbox deleted: >>>> INBOX/Trash/folder1/folder2 Apr 16 13:44:29 server2 dovecot: >>>> dsync-server(d.k...@heinlein-support.de): Mailbox deleted: >>>> INBOX/Trash/folder1/folder2/folder3 >>>> >>>> >>>> This creates the folder INBOX/Trash/folder1/folder2 on >>>> server2 again which replicates back to server1. >>> With what Dovecot version? What mailbox format? >>> >> The mailbox format is mdbox. Server1 is 2.2.15, server2 2.2.16. > Hi Timo, is there any update on this issue? > > cheers Andre > Just want to bring it to your attention again. - -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-0 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) iQEcBAEBAgAGBQJV3v34AAoJEAoTNwRDnEhRx+0H/01YT39mvkgwgDGAUQzVtaKJ 0lZZJzkMwua6qOBRWGsiK8jH5PYvOWdRjbRxVE5y1H8n8/CLNCJ3nkpvuDu/vMf3 8A4i/DqHy+Dvof+3AagECGLnqdvCi9zcqTgE3Vu9dJyEUzK7A1y1sxLB8CN6GBo2 LBXsrHUWi+eBLDkQdR94LaA6Ssa8TMnSr6ZcpbRmx+bR54uzJ6jwUcmO6db2osqC ESl42Vov0Yps0tp0h7sz+qRmSnIDpAatJys/qjKvZmr+WawC4g5vGcT7Bv33WevC JHt10YOOcftIGZE2zZGo9UyCOHjmnWiluk3toIOdBr4FAVNZhrQj8pplol8m+jU= =ZiRI -END PGP SIGNATURE-
ldap paging
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi List, in ldapsearch you are able to use paging in case of limited results on ldap server side with "-E pr=1/noprompt" Is there any way to get the same effect for the iterate query? Thanks Andre -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) iQEcBAEBAgAGBQJWWHvwAAoJEAoTNwRDnEhRVmMH/0+vGRx7urQ49bHbzc4asD7r XlbwS7whkDKrJpflK39PLPw5BJoptKhwLNOueotFv9Pq8EYQBkN/gX69BzxeoFk8 DZpiP/ogYQIG1lUijes4UkbttVpnviy9/mLBKjIfIkvGDu0q3zwuq5876q6t2Qxx kJkpLSizxAfnGLeD03txVPAc8wGzxhxkyEdosQ+ARriYI1Ce+dfK28z6hSAEXMA+ 4JZEvIsy6P+xepFCFYILFWeRO2YBzqHtgtjKu8KCiyBdUPG0Nii4z2YmN2AoCj7m rQ8l4CeTDw+lk0pMy26kCsmh+PK2/OXCUGjxgYJOR3mxn2HNSIfUXFVWs4ri464= =qWS+ -END PGP SIGNATURE-
Missing Documentation
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Hi, could someone apply the folowing line to the wiki page at http://wiki2.dovecot.org/Tools/Doveadm/Sync Because it is write protected. - -R Reverse backup direction, so mails in location2 are backed up to default mail location. - -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-0 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) iQEcBAEBAgAGBQJWlN6oAAoJEAoTNwRDnEhRfyAH/RZmdQO4jevf8d6Y/CjW/Lkc H7Ny1tB4W+dZnY/Lap+VY4RER/QWfgVgPDrWm0FG1r73FBpPqxafVlMeh2TM9Daf ARSlBQltDl4GvUu3w+ANByUm/eHe3+3+/HavgJApCpJwaxDfgGBpJoEkTsNQSs6d t2NZYY1k/MJV+5Vk7YWatUnHNdK3H6DPz03e+GLQkh+Np0HScy95ispU1c6rirH0 ROb/4X/HPL2Isut3KHcgJ+f5SkHDueNCgM9kq/O72wq8c1GxAIn/Mwk0wQhdVsw/ VoCrsw/IcJ3k6cTeys8rYmpmBMu4LaNfMHoRXTB0X98KmpLHS99WwJ1fXI2Oegw= =flsG -END PGP SIGNATURE-
Re: segfaults with Dovecot 2.2.21
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 01/21/2016 11:05 PM, Peer Heinlein wrote: > > > Jan 21 22:39:20 mailimap01 dovecot: imap(p24062p6): Error: Raw > backtrace: /usr/lib/dovecot/libdovecot.so.0(+0x838cf) > [0x7fbe4e92b8cf] -> /usr/lib/dovecot/libdovecot.so.0(+0x8392e) > [0x7fbe4e92b92e] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) > [0x7fbe4e8d4aae] -> dovecot/imap [p24062p6 87.140.193.6 > NOOP](client_continue_pending_input+0x132) [0x7fbe4f1125e2] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x5b) > [0x7fbe4e93eb0b] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd7) > > [0x7fbe4e93fee7] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x25) > [0x7fbe4e93ebb5] -> > /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7fbe4e93ed58] > -> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) > [0x7fbe4e8da4b3] -> dovecot/imap [p24062p6 87.140.193.6 > NOOP](main+0x2d8) [0x7fbe4f105eb8] -> > /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xfd) > [0x7fbe4e53bead] -> dovecot/imap [p24062p6 87.140.193.6 > NOOP](+0xf03d) [0x7fbe4f10603d] What i found a line above that backtrace was imap(p24062p6): Panic: file imap-client.c: line 852 (client_check_command_hangs): assertion failed: (!have_wait_unfinished || unfinished_count > 0) Maybe that help find the reason of the backtrace? Cheers Andre - -- Heinlein Support GmbH Schwedter Str. 8/9b, 10119 Berlin http://www.heinlein-support.de Tel: 030 / 405051-0 Fax: 030 / 405051-19 Zwangsangaben lt. §35a GmbHG: HRB 93818 B / Amtsgericht Berlin-Charlottenburg, Geschäftsführer: Peer Heinlein -- Sitz: Berlin -BEGIN PGP SIGNATURE- Version: GnuPG v2.0.22 (GNU/Linux) iQEcBAEBAgAGBQJWogYzAAoJEAoTNwRDnEhReyYH/AxXou9eRIUVQn+QT9FMFPXj 17tJn588TiMZOExAGiRbTM0MAfsMdcfHmnzVxCk4APrlUuD2oFBlybIwT1AAjKTP 8qfDiA1wC3eTQgLnbPrJ4idxx0XG4rl6J7upQJKqZl9L0ZK+IdCjzFlHjoWM7Onz IeXDd1qWbukLFBTJCAdcG7V4H3o1XBRkE7h/pGLJkYhXQNKO8Uqo5jwciYHbe4k1 SHAsr5EGqgsO8ueJ7X9xnhGp1DDXAgPPRn4paEZIk/vN3PAudl6FXp0myJ4/4H+c oGD6Q8c/95fRL4o8z291X7EmM2PRGyXY0Tm4Jwh3p92n9Tq6A/KS8CdZ7Ant/aM= =134a -END PGP SIGNATURE-
Email hosting provider
Hello, Sorry if I am off topic a little. I am looking for an email host provider that supports dovecot, sieve and manage sieve. Ideally with the roundcube webmail and managesieve plugin Better if it is in Europe or switzerland. I don't mind paying a little. Thanks, André.
[Dovecot] Errors starting Dovecot
Hi, I'm new to Dovecot. I'm trying to start Dovecot(2.0.9) but I'm getting an error. I think the error is because I'm doing a tutorial for an old version of Devcot(1.x.x). What I get is the following: [code] [root@mailserver dovecot]# service dovecot start Starting Dovecot Imap: doveconf: Warning: NOTE: You can get a new clean config file with: doveconf -n > dovecot-new.conf doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:1: protocols=imaps is no longer necessary, remove it doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:1: protocols=pop3s is no longer necessary, remove it doveconf: Warning: Obsolete setting in /etc/dovecot/dovecot.conf:5: ssl_cert_file has been replaced by ssl_cert =
[Dovecot] What does this /var/log/maillog message means?
Hi, I'm, trying to configure Devcot(2.0.9). Here is my dovecot.conf: [code] protocols = imap pop3 lmtp log_timestamp = "%Y-%m-%d %H:%M:%S " mail_location = maildir:/home/vmail/%d/%n/Maildir ssl_cert = /etc/pki/dovecot/certs/dovecot.pem ssl_key = /etc/pki/dovecot/private/dovecot.pem namespace { type = private separator = . prefix = INBOX. inbox = yes } protocol lda { log_path = /home/vmail/dovecot-deliver.log auth_socket_path = /var/run/dovecot/auth-master postmaster_address = postmas...@mailserver.com } service auth { user = root } passdb { driver = sql args = /etc/dovecot/dovecot-sql.conf } userdb { driver = static args = uid=5000 gid=5000 home=/home/vmail/%d/%n allow_all_users=yes } [/code] I can start the service correctly: [code] [root@mailserver dovecot]# service dovecot start Starting Dovecot Imap: [ OK ] [/code] But when I go to "/var/log/maillog" I get this: [code] Feb 3 14:37:59 www dovecot: master: Warning: Killed with signal 15 (by pid=16757 uid=0 code=kill) Feb 3 14:38:03 www dovecot: master: Dovecot v2.0.9 starting up (core dumps disabled) [/code] What does this mean? I'm doing something that is not correct? Best Regards,
[Dovecot] per user sieve after filters
Hello, Thanks for dovecot, as it's still the best mail server. I'd like to use per users sieve_after scripts. Can I put in my dovecot config file, something like that: sieve_after = %h/Mails/Sieve/After/ It would be very useful for me, as I'd like to add vacation script to be executed from this place. Kind regards, André.
Re: [Dovecot] per user sieve after filters
On 04/05/12 08:02, Stephan Bosch wrote: On 4/9/2012 6:26 PM, Andre Rodier wrote: Hello, Thanks for dovecot, as it's still the best mail server. I'd like to use per users sieve_after scripts. Can I put in my dovecot config file, something like that: sieve_after = %h/Mails/Sieve/After/ It would be very useful for me, as I'd like to add vacation script to be executed from this place. I've tested this recently and it works for the above example. Additionally, I've extended multiscript support with the possibility to specify multiple sieve_before and sieve_after scripts: http://hg.rename-it.nl/dovecot-2.1-pigeonhole/rev/b2ff597c2279 So, you can now (once released) have a configuration like: sieve_after = %h/Mails/Sieve/After sieve_after2 = /usr/lib/dovecot/sieve-after.d And I changed the implementation to accept ~/ substitutions, so it is now also possible to do the following: sieve_after = ~/Mails/Sieve/After Turns out more people need/use a solution similar to yours and that is the reason I made it more flexible. Regards, Stephan. Thank you Stephan. I have started a small vacation plugin for roundcube, that uses this feature. (https://github.com/arodier/Roundcube-Plugins) By using sieve filters that way, I can create complex filters with templates, that does not interfering with "normal" sieve filter scripts. Kind regards, André
[Dovecot] IMAP --> Creating Folders --> trailing slash
Hello List, i use Dovecot 1.0.7 for pop and imap on Suse Linux 10.1. I need a little help in understanding something. If i want to create a folder with outlook express or thunderbird which can also create subfolders, then i have to create these folders with a trailing slash. folders created with trailing slash are in filesystem created als real folders, "normal" folders are created as file. Is it possible to change this behavior? I want to create a folders just by typing a name without trailing slash. It should be possible to store messages in this folder or create subfolders. Is there any workaround to achieve this goal? Thank you Andre
[Dovecot] procmail/formail --> Maildir
Hello List, i switched mailformat from mbox to maildir. Now i have a little problem with procmail/formail and headermanipulation of mails. Here an example: 0 * ^From.*gmx.de | (formail -t -I"procmail: gmx.de") >> /var/spool/mail/xx So, i can add some different headerlines for later evaluation and the result is attached to inbox. Now i have the problem that i don't know name of targetfile, cause it is unique for every mail if maildir is used. I did not found a Option or other workaround to solve this case. I know, it is not a dovecot problem but i hope somebody can give a hint. Could it be a possibility to leave all unchanged? Mails could be transported to /var/spool/mail/xx and picked up by dovecot if in dovecot.conf the convert-plugin ist always activated? Thanks Andre
Re: [Dovecot] procmail/formail --> Maildir
Hello, thanks. I will test it in a few days. This week just holidays ;) Sure, its just a modified example. Reason is to mark mails later graphical in a webmailer using some procmail/formail technics. I think, if i activate the dovecot convert plugin nothig of my procmail must be changed. (just only the bugs ;) ) Mails will be deliverd in mbox format to /var/spool/mail/x On Userlogin dovecot is picking up Mails and deliver them to maildir-inbox. Don't know if this is a very Feasible way, not really clean... http://wiki.dovecot.org/Plugins/Convert?highlight=%28convert_mail%29 Thanks André - Original Message - From: "Karsten Bräckelmann" <[EMAIL PROTECTED]> To: Sent: Monday, December 03, 2007 12:46 PM Subject: Re: [Dovecot] procmail/formail --> Maildir On Mon, 2007-12-03 at 11:02 +0100, Andre Huebner wrote: i switched mailformat from mbox to maildir. Now i have a little problem with procmail/formail and headermanipulation of mails. Here an example: 0 * ^From.*gmx.de | (formail -t -I"procmail: gmx.de") >> /var/spool/mail/xx I would never do it that way anyway. You are bluntly appending the mail to the raw spool (or mbox file) without any locking. Instead, make procmail deliver the mail properly, figuring out the correct locking method. So, i can add some different headerlines for later evaluation and the result is attached to inbox. ^ Now i have the problem that i don't know name of targetfile, cause it is unique for every mail if maildir is used. ^^^ You made that example up, instead of copy-n-paste'ing real life procmail receipts, right? Isn't the default system spool still an mbox file, even when using Maildir? Anyway, again -- let procmail figure out how to properly deliver the mail. For Maildir storage, just use the directory name, including the trailing slash. See 'man procmailrc'. Example below. I did not found a Option or other workaround to solve this case. I know, it is not a dovecot problem but i hope somebody can give a hint. Could it be a possibility to leave all unchanged? Mails could be transported to /var/spool/mail/xx and picked up by dovecot if in dovecot.conf the convert-plugin ist always activated? No. At the very least you need to tell procmail you are using Maildir instead if mbox for any delivery receipt. Note: Example untested. # Set the Maildir prefix, and have the Inbox in there, too. MAILDIR=$HOME/Maildir/ DEFAULT=$MAILDIR # Filter through formail, appending some custom header. :0 fw * ^From.*gmx.de | formail -I "X-procmail: gmx.de" # Keep mailing list traffic out of my Inbox. Let procmail care about # proper locking. :0 : * ^List-Id: .+ .mailing-lists.dovecot/ # Someone loves me. :) Whatever survived till this point will get # delivered to the $DEFAULT Maildir. Now, some words about that obscure tagging with formail. :) Since you are using procmail with gmx.de (which does offer POP3 only for free) I assume you are harvesting your mail using fetchmail. Also, I assume the above example isn't actually what you use. It feels rather useless to add a custom header for that. Your receipt above will match on any From: header with a gmx.de substring, too. Which includes the real name. Besides, you can directly evaluate that header anyway... I guess you actually mean to tag all mail fetched from the gmx.de POP3 account. In that case, have a look at the fetchmail "tracepolls" option. It will add info like "polling $server account $user" to the procmail generated Received: header. You can directly filter on that header using procmail, instead of a custom added one. If this is your use case, the tracepolls option is the only accurate method anyway. Short of using dedicated local users. ;) HTH guenther -- char *t="[EMAIL PROTECTED]"; main(){ char h,m=h=*t++,*x=t+2*h,c,i,l=*x,s=0; for (i=0;ic<<=1: (c=*++x); c&128 && (s+=h); if (!(h>>=1)||!t[s+h]){ putchar(t[s]);h=m;s=0; }}} -- No virus found in this incoming message. Checked by AVG Free Edition. Version: 7.5.503 / Virus Database: 269.16.12/1163 - Release Date: 01.12.2007 12:05
[Dovecot] Imap - Loging
Hello List, i'm looking for a way to increase log-level for imap-processes. Pop3 Server writes all necessary infos about mails-transfered/deleted etc. Imap-Log writes just times and ip's of Userlogins. Is there a way to increase the imap-output? The Conf-Parameters i found did not really fit my requirements. Best result would be a collected log of transfering/deleting mails for one imap-session. Ist there a way to achieve this? Thank you Andre
Re: [Dovecot] Imap - Loging
hmm... in my special case a user misses a lot of mails. i do not believe in dovecot problem (1.0.10) There were some other connects with same ip... For more information a counting of really transfered mails would be nice. only flagged mails are not very interesting. Mails should be counted if they are moved to an other folder or are really deleted and all is synchronized. I think it would be ok that mails are counted twice in case of deleting after moving. operation is operation :) In my special case i only can say to my user that between time x und time y something happend. hmm, yes, thats all at this time ;) Andre - Original Message - From: "Timo Sirainen" <[EMAIL PROTECTED]> To: "Andre Hübner" <[EMAIL PROTECTED]> Cc: Sent: Friday, January 11, 2008 1:01 PM Subject: Re: [Dovecot] Imap - Loging
[Dovecot] Multiple SSL certificates with dovecot.
Hello all, By advance, I hope you'll excuse my probably not perfect English, which is not my mother tongue. I have always appreciated dovecot for this simplicity to setup and lightweight, but today, after many installations, I cannot find how to setup dovecot for my configuration. - I use only IMAPS to retrieve the mails. - I manage two domain names - I use CA-Cert certificates So,the question is : how to setup dovecot to select the appropriate certificate, according to the domain name I use when I retrieve mails using the IMAPS protocol ? Thanks. Andre Rodier.
Re: [Dovecot] Multiple SSL certificates with dovecot.
Hello all, Thanks a lot for your answers, I was not sure it was possible, anyway, Thanks Steffen, to have take the time to detail to me the IMAP protocol, and Daniel for your advices about CSR and vhost task force, I'll try them later. André Rodier.
Re: [Dovecot] Antispam plugin custom behavior?
On Wed, 2008-06-11 at 10:25 -0500, Kyle Wheeler wrote: > Hello, > > I currently have a setup on my system with what I call "magic folders" > to enable spam filter training. Here's how it works: > > 1. If you have a false-negative, put the spam into the Spam.Report > folder > 2. If you have a false-positive (which has all kinds of ugly > spamassassin protective markup in it), put the message into the > Spam.NotSpam folder > > Currently what happens is that a cron job comes along every five > minutes and processes the messages in those folders. In the case of > the NotSpam folder, it strips the message of the spamassassin markup, > retrains the bayesian net, and redelivers the message (e.g. via > deliver). In the case of the Report folder, the message is used to > train the bayesian net (among other things) and then deleted. > > I'd love to be able to trigger these actions when the mail is moved, > rather than have a cron job inspecting the mailboxes. > > I looked into the antispam plugin > (http://johannes.sipsolutions.net/Projects/dovecot-antispam), which > seems nice but doesn't appear sufficiently generic for my needs. What > would really work is if I could get it set up such that putting a > message into either of those directories is turned into piping the > message to a script of my choosing (a different one for each folder). > > Does anyone know a good way of getting my own custom behavior in here, > or is my cronjob setup probably the best way? > > ~Kyle Hello Kyle, As a temporary solution, and if your linux box as iNotify support, I suggest you use incron. incron is an "inotify cron" system. It works like the regular cron but is driven by filesystem events instead of time events. Andre Rodier r e d 2 - Service Driven Development 34-35 Eastcastle Street, London W1W 8DW www.red2.co.uk | [EMAIL PROTECTED] (+44) 0870 471 8492 direct (+44) 0751 124 4961 mobile
[Dovecot] litte problems upgrade from 1.0.x to 1.1.1
Hi List, last time i did a lot of packaging and installing different versions of dovecot 1.0.x (rc not included ;) )and all was fine. Now a have a little problem. In this case it was an update from 1.0.13 to 1.1.1 Sometime it happens that 1 user out of x (more than 100) got this standardmessage for ~1 or ~2 thousend times in his mailbox (mbox) for example: From MAILER_DAEMON Mon Sep 18 16:16:14 2006 Date: Mon, 18 Sep 2006 16:16:14 +0200 From: Mail System Internal Data <[EMAIL PROTECTED]> Subject: DON'T DELETE THIS MESSAGE -- FOLDER INTERNAL DATA Message-ID: [EMAIL PROTECTED] X-IMAP: 1158588973 001177 Status: RO This text is part of the internal format of your mail folder, and is not a real message. It is created automatically by the mail system software. If deleted, important folder data will be lost, and it will be re-created with the data reset to initial values. I can follow this in maillog: Jul 1 16:01:04 myhostname dovecot: POP3(username): Disconnected: Logged out top=0/0, retr=1177/21638, del=1177/1177, size=454 The Mails came from nowhere from one moment to other. But it seems that it was not first pop-login after dovecot update. Update time was 14:57 Uhr. Pop-Login which "created" this mails was 3rd after update. It is not a big problem, seems to happens one only time but i want to know the backgrounds. Do you need further data? My 1.1.1 /etc/dovecot.conf looks like this: protocols = imap imaps pop3 pop3s ssl_disable = no ssl_cert_file = "/etc/*.hostname.com.crt" ssl_key_file = "/etc/*.hostname.com.key" ssl_ca_file = "/etc/*.hostname.com.bundle.crt" disable_plaintext_auth = no syslog_facility = mail login_user = dovecot login_process_per_connection = no login_processes_count = 1 login_greeting = hostname.com mailserver ready. login_log_format_elements = user=<%u> method=%m rip=%r lip=%l %c login_log_format = %$: %s max_mail_processes = 100 verbose_proctitle = yes auth_verbose = yes mail_location = mbox:~/mail:INBOX=/var/spool/mail/%u #default_mail_env = mbox:~/mail:INBOX=/var/spool/mail/%u mail_cache_min_mail_count = 30 mmap_disable=no mail_debug=no lock_method = flock mbox_read_locks = dotlock mbox_write_locks = dotlock fcntl mbox_dirty_syncs = yes mbox_very_dirty_syncs = yes mbox_lazy_writes = no ## ## IMAP specific settings ## protocol imap { login_executable = /usr/libexec/dovecot/imap-login imap_client_workarounds = outlook-idle netscape-eoh tb-extra-mailbox-sep delay-newmail mail_plugins = mail_log } ## ## POP3 specific settings ## protocol pop3 { ssl_disable = no login_executable = /usr/libexec/dovecot/pop3-login mail_executable = /usr/libexec/dovecot/pop3 pop3_no_flag_updates = no pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = oe-ns-eoh outlook-no-nuls } ## ## Authentication processes auth default { mechanisms = plain passdb shadow { } userdb passwd { } user = root } ## ## Plugins ## plugin { } Thanks Andre
Re: [Dovecot] litte problems upgrade from 1.0.x to 1.1.1
Hi, These are created by the University of Washington's implementation of an IMAP server. Notice the date is nearly 2 years ago. At some point, it seems your site was running imap-uw. -- Fred nope, i dont think so. i created completly new mailbox and mailed to it from extern. after deleting this mail using pop3-client same text was left in mbox but with current date. it must be dovecot related. we use dovecot from 1.0rc7 to 1.0.15 and never a case like this occured. also this machine had a lot of updates. now, by updating from 1.0.x (most 13) to 1.1.1 some users have this problem of retrieving ~1000 - ~2000 Mails with this internal message. The messages are from one to other moment in mbox, there is no delivering by postfix etc. this is completely new to me. Hmm If users asking i say it is a one time incident, but i do not really know... Thanks Andre
Re: [Dovecot] litte problems upgrade from 1.0.x to 1.1.1
Hi, It's not UW-IMAP (the server). It's PINE or Alpine (the client). Those are usually found in on-disk mbox files that have been created by PINE/Alpine. The message is ignored by PINE/Alpine (obviously), but when you switch to a different mailer, it doesn't know to ignore it (and shouldn't be expected to). AFAIK, the only solution is to delete the messages. i do not think it is client related. (never heared of this clients) Seems to be a normal dovecot internal message (timo?) But dovecot should not deliver this message as real mail, regardless of which client is used. Furthermore we face this issue only by updating to 1.1.1, all earlier versions did not show this behavior. Andre
Re: [Dovecot] litte problems upgrade from 1.0.x to 1.1.1
ttings ## protocol pop3 { ssl_disable = no login_executable = /usr/libexec/dovecot/pop3-login mail_executable = /usr/libexec/dovecot/pop3 pop3_no_flag_updates = no pop3_uidl_format = %08Xu%08Xv pop3_client_workarounds = oe-ns-eoh outlook-no-nuls } System is suse 10.1 Thank you Andre
Re: [Dovecot] litte problems upgrade from 1.0.x to 1.1.1
cot: IMAP(thisuser): Raw backtrace: imap [0x80c2cf0] -> imap [0x80c2d4a] -> imap [0x80c265c] -> imap(message_parser_parse_body+0) [0x80bbfa0] -> imap(index_mail_cache_parse_continue+0x22) [0x8087172] -> imap [0x8070441] -> imap(mbox_save_continue+0x2d) [0x80704dd] -> imap(mail_storage_co py+0xe4) [0x8091684] -> /usr/lib/dovecot/imap/lib20_mail_log_plugin.so [0xb7f65d1a] -> imap(cmd_copy+0x1d2) [0x805a1c2] -> imap [0x805edfc] -> imap [0x805eea5 ] -> imap [0x805f655] -> imap(client_input+0x5e) [0x805f86e] -> imap(io_loop_handler_run+0x100) [0x80ca590] -> imap(io_loop_run+0x28) [0x80c9738] -> imap(main +0x46b) [0x806736b] -> /lib/libc.so.6(__libc_start_main+0xdc) [0xb7e4f87c] -> imap [0x8059211] Jul 14 16:08:31 servername dovecot: child 7162 (imap) killed with signal 6 lock_method = flock See if it makes any difference to change this to fcntl. changed to fcntl, no difference. How do you deliver new mails to the mbox? mails that arrive will be deliverd by procmail, relevant line in /etc/postfix/main.cf is: mailbox_command = /usr/bin/procmail :) mbox_lazy_writes = no Why? This makes performance worse. hmm, may be a kind of historical relict by my forerunner, now it is changed. thanks. System is suse 10.1 What filesystem? we use xfs hmm, what can i do now? i wonder why no coredump is created to be more helpful for debugging. i did follow the bugreport.html Hope there is some further help, dovecot is a great software which we want to use further on. Thank you Andre
Re: [Dovecot] litte problems upgrade from 1.0.x to 1.1.1
=0x80f9548) at client.c:724 cmd = output = (struct ostream *) 0x80fa904 bytes = 22 __PRETTY_FUNCTION__ = "client_input" #16 0x080ca590 in nearest_power (num=6) at lib.c:13 n = __PRETTY_FUNCTION__ = "nearest_power" #17 0x080c9738 in timeout_reset_timeval (timeout=0x2, tv_now=0x80fa960) at ioloop.c:153 __PRETTY_FUNCTION__ = "timeout_reset_timeval" #18 0x0806736b in main (argc=Cannot access memory at address 0x6697 ) at main.c:244 No locals. ## i see you did a lot of patches, hope this helps :) Thank you Andre
Re: [Dovecot] litte problems upgrade from 1.0.x to 1.1.1
Servus, Jul 16 08:45:55 servername dovecot: Panic: IMAP(user): file message-parser.c: line 770 (message_parser_parse_next_block): assertion failed: (ctx->input->eof || ctx->input->closed || ctx->input->stream_errno != 0 || ctx->broken) Line 770. #6 0x080bbfa0 in message_parser_parse_header (ctx=0xbfaf4920, hdr_size=0xbfaf4920, callback=0, context=0x19) at message-parser.c:798 Line 798. This backtrace is from a different crash I suppose? Nope, all data in this mail today at 11:59 am are the same crash - core-dump was created exactly at this time --> Jul 16 08:45:55 servername dovecot: child 26263 (imap) killed with signal 6 - user in mailog which produced the error and location of coredump ist correct. i do not know why this output of different lines, but its the same crash. Thank you Andre
[Dovecot] 1.1.x problems
Hi, since upgrading to 1.1.x i still have this bugs "Next message unexpectedly lost " I read this Maillist some months ago and i believe that im not the only one... The Panics and crashes in 1.1.1 are gone by upgrading to 1.1.2 but these "Next message unexpectedly lost " bugs are really annoying if users can't download complete mails. is there something new to this issue. all recommend changes did not help. The only thing i could do is downgrade to 1.0.15 and all works fine. i can not keep the 1.1.x versions in my repo untill this case is solved. :( Thanks Andre
Re: [Dovecot] 1.1.x problems
Hi, On 8/13/2008 3:22 PM, Andre Hübner wrote: since upgrading to 1.1.x i still have this bugs "Next message unexpectedly lost " I read this Maillist some months ago and i believe that im not the only one... The Panics and crashes in 1.1.1 are gone by upgrading to 1.1.2 but these "Next message unexpectedly lost " bugs are really annoying if users can't download complete mails. is there something new to this issue. all recommend changes did not help. The only thing i could do is downgrade to 1.0.15 and all works fine. i can not keep the 1.1.x versions in my repo untill this case is solved. :( Output of dovecot -n might help... ok, i did this some times already and was in contact with timo. may be there are some news in this case. i looked in the archives for similiar problems and saw that some users have this problem with 1.1.x and did not get answers f.i. http://dovecot.org/list/dovecot/2008-August/thread.html 2 guys with this problem, but no solution this is dovecot -n # 1.1.2: /etc/dovecot.conf protocols: imap imaps pop3 pop3s ssl_ca_file: /path/path/*.domainname.com.bundle.crt ssl_cert_file: /path/path/*.domainname.com.crt ssl_key_file: /path/path/*.domainname.com.key disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/libexec/dovecot/imap-login login_executable(imap): /usr/libexec/dovecot/imap-login login_executable(pop3): /usr/libexec/dovecot/pop3-login login_greeting: domainname.com mailserver ready. login_process_per_connection: no login_processes_count: 1 max_mail_processes: 100 verbose_proctitle: yes mail_location: mbox:~/mail:INBOX=/var/spool/mail/%u mail_cache_min_mail_count: 30 lock_method: flock mbox_read_locks: dotlock mbox_very_dirty_syncs: yes mail_executable(default): /usr/libexec/dovecot/imap mail_executable(imap): /usr/libexec/dovecot/imap mail_executable(pop3): /usr/libexec/dovecot/pop3 mail_plugins(default): mail_log mail_plugins(imap): mail_log mail_plugins(pop3): mail_plugin_dir(default): /usr/lib/dovecot/imap mail_plugin_dir(imap): /usr/lib/dovecot/imap mail_plugin_dir(pop3): /usr/lib/dovecot/pop3 imap_client_workarounds(default): outlook-idle netscape-eoh tb-extra-mailbox-sep delay-newmail imap_client_workarounds(imap): outlook-idle netscape-eoh tb-extra-mailbox-sep delay-newmail imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): oe-ns-eoh outlook-no-nuls auth default: verbose: yes passdb: driver: shadow userdb: driver: passwd lock_method was already changed to fcntl but no change :( this is my configure-line, i do the packaging on my own: ./configure \ --prefix=/usr \ --sysconfdir=/etc \ --localstatedir=/var \ --mandir=/usr/share/man \ --with-ssl=openssl \ --with-storages=mbox,maildir,raw \ --with-pam \ --with-passwd compiled with no errors/no packagingerrors with gcc 4.1.2 version 1.0.x works without any problems, conf is almost the same, just changes required by 1.1.x Thanks you Andre
[Dovecot] disbale to responded to an unrequested SSL Certificate
Hi dovecot-list, just a easy question today ;) Customer did on Server a PCI-Test to test security to fit worldpay requirements. They found a critical risk at pop3s. (and some other things) This is the Textmesage: Family: Remote Shell Access Critical 993/tcp 11875 Description: The remote host responded to an unrequested SSL Certificate. The remote SSL server should have sent back an Error message. This may indicate that the server is vulnerable to a remote flaw in the way that it handles unrequested certificates. You should manually inspect the SSL Server's configuration Background is that we use a wildcard-cert which is installed on ervery machine and fits to servername. So you have to use the accredited Hostname/Servername to make clean ssl connection pop3s/imaps without warnings etc. Problem should be that server sends no error when requested with other hostname. This is significant part from dovecot.conf protocols = imap imaps pop3 pop3s ssl_disable = no ssl_cert_file = "/path/to/*.myhost.com.crt" ssl_key_file = "/path/to/*.myhost.com.key" ssl_ca_file = "/path/to/*.myhost.com.bundle.crt" Is there a Config-Option to send error when ssl-connect ist not established to in cert accredited Hostname/Servername ? Did not found something like this or did not really understand function of the options. I do not know backgrounds to this issue. Cant decide if it would be a security risk or disproportionated wishes of securityexperts but i want to satisfy this costumer. How to handle thos? Thank you Andre
Re: [Dovecot] disbale to responded to an unrequested SSL Certificate
Hi List, Hi dovecot-list, just a easy question today ;) Customer did on Server a PCI-Test to test security to fit worldpay requirements. They found a critical risk at pop3s. (and some other things) This is the Textmesage: Family: Remote Shell Access Critical 993/tcp 11875 Description: The remote host responded to an unrequested SSL Certificate. The remote SSL server should have sent back an Error message. This may indicate that the server is vulnerable to a remote flaw in the way that it handles unrequested certificates. You should manually inspect the SSL Server's configuration Background is that we use a wildcard-cert which is installed on ervery machine and fits to servername. So you have to use the accredited Hostname/Servername to make clean ssl connection pop3s/imaps without warnings etc. Problem should be that server sends no error when requested with other hostname. This is significant part from dovecot.conf protocols = imap imaps pop3 pop3s ssl_disable = no ssl_cert_file = "/path/to/*.myhost.com.crt" ssl_key_file = "/path/to/*.myhost.com.key" ssl_ca_file = "/path/to/*.myhost.com.bundle.crt" Is there a Config-Option to send error when ssl-connect ist not established to in cert accredited Hostname/Servername ? Did not found something like this or did not really understand function of the options. I do not know backgrounds to this issue. Cant decide if it would be a security risk or disproportionated wishes of securityexperts but i want to satisfy this costumer. How to handle thos? Thank you Andre could be the solution to set ssl_listen to hostname where dovecot is running? pretty easy... O.o my tests were successful but would like to obtain other opinions.. Thanks Andre
[Dovecot] How to configure POP3 access in Dovecot?
Hi, I'am new to Dovecot and Postfix... I have made a Postfix installation as "Internet with Smarthost". I'am using a domain in Godaddy, I have point "A (Host) Record" to my IP and the "MX Record" is also pointing to my IP. I have tested sending e-mail from my gmail.com account to my server, the server receive e-mails from gmail.comto my /home/andre/mbox successfully, the server is also sending mails by SMTP successfully. Now I need to configure POP3, I have been searching but I don't know what to do... I only need to receive e-mails in my windows machines in Outlook Express. I have test telnet in my localhost with "telnet mydomain.com 110" It appears: Trying 127.0.0.1 Connected to localhost +OK Dovecot ready Then I try to auth by telnet with: user [EMAIL PROTECTED] +OK pass mypass -ERR Authentication failed. I know that my password it's ok. When I try to "telnet mydomain.com 110" on other computer with another IP on Internet I get blank screen. My question: What can I do to, or what can I read to configure POP3 successfully? Best Regards, Andre.
[Dovecot] Can't login in Dovecot, clues needed.
Hi, I'am using Ubuntu Server, and I can't get Dovecot working. Please give me a clue if you can. Ok, my gide to configuration was https://help.ubuntu.com/community/Dovecot I tryed to "telnet mydomain.com 110", but the authentication fails, give this error: -ERR Authentication failed. Besides this, I can't "telnet mydomain.com 110" outside my localhost My mail.log tells this: Oct 5 19:25:29 mydomain dovecot: Killed with signal 15 Oct 5 19:25:29 mydomain dovecot: Dovecot v1.0.10 starting up Oct 5 19:29:33 mydomain dovecot: pop3-login: Disconnected: Inactivity: user=<[EMAIL PROTECTED]>, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured What's wrong in here? Best regards, Andre.
[Dovecot] Panic 1.1.4
_data_stack_cur_id = 3 ret = remove_io = handled_commands = false #22 0x0805f87e in client_input (client=0x80fa548) at client.c:725 cmd = output = (struct ostream *) 0x80fb904 bytes = 23 __PRETTY_FUNCTION__ = "client_input" #23 0x080cb590 in io_loop_handler_run (ioloop=0x80f99b0) at ioloop-epoll.c:203 ctx = event = (const struct epoll_event *) 0x80f9ae8 list = (struct io_list *) 0x80fa5b8 ---Type to continue, or q to quit--- io = (struct io_file *) 0x80fb960 tv = {tv_sec = 1799, tv_usec = 999127} t_id = 2 msecs = ret = 1 i = 0 j = 0 call = #24 0x080ca6a8 in io_loop_run (ioloop=0x80f99b0) at ioloop.c:320 No locals. #25 0x080673bc in main (argc=Cannot access memory at address 0x23a0 ) at main.c:293 No locals. Thanks Andre
Re: [Dovecot] Panic 1.1.4
ON__ = "client_command_input" #23 0x08061769 in client_command_input (cmd=0x81289c8) at client.c:629 client = (struct client *) 0x8127548 command = (struct command *) 0x8127af0 __PRETTY_FUNCTION__ = "client_command_input" #24 0x08061867 in client_handle_next_command (client=0x8127548, remove_io_r=0xbfb063d5) at client.c:670 size = 25 #25 0x080618a3 in client_handle_input (client=0x8127548) at client.c:680 _data_stack_cur_id = 3 ret = 18 remove_io = false handled_commands = false #26 0x08061a31 in client_input (client=0x8127548) at client.c:725 cmd = (struct client_command_context *) 0xb7f62d98 output = (struct ostream *) 0x8128904 bytes = 25 __PRETTY_FUNCTION__ = "client_input" #27 0x080f0801 in io_loop_handler_run (ioloop=0x81269b0) at ioloop-epoll.c:203 ctx = (struct ioloop_handler_context *) 0x8126aa8 events = (struct epoll_event *) 0x8126ae8 event = (const struct epoll_event *) 0x8126ae8 list = (struct io_list *) 0x81275b8 io = (struct io_file *) 0x8128960 tv = {tv_sec = 1799, tv_usec = 999711} events_count = 4 t_id = 2 msecs = 180 ret = 1 i = 0 j = 0 call = true #28 0x080efb18 in io_loop_run (ioloop=0x81269b0) at ioloop.c:320 No locals. #29 0x0806ce89 in main (argc=3, argv=0xbfb06534, envp=0xbfb06544) at main.c:293 No locals. (gdb) p *stream $1 = {v_offset = 2421, stream_errno = 0, mmaped = 0, blocking = 1, closed = 0, seekable = 1, eof = 0, real_stream = 0x813ea98} Hope this helps to find the bug. :) I will do some tests with 1.1.5 Thanks, Andre
Re: [Dovecot] limit logins by time
You mean something like "one login per 5 minutes"? Why do you want it? yes, this is exactly what i want. have a user who seems to go crazy, lots of logins with differnet usernames within seconds. i could limit him by iptables, but this has only effect for short time... There's no existing way to do it, but you could probably do it with http://wiki.dovecot.org/PostLoginScripting . ok, will try it Thanks, Andre
[Dovecot] limit logins by time
Hello, i want to limit the count of pop3 logins for users by time. Whats the correct way to do this? I searched the webpage and conf parameters but did not find a fitting solution. Please give me litte hint. Thanks, Andre
Re: [Dovecot] limit logins by time
They're successful logins? yes, is normal user with correct access but he is going over the top with its logins... Perhaps just make it do a "sleep 30" or something if the previous login was too close. good, idea, should be enough for the moment Thanks, Andre
[Dovecot] Panic 1.1.x
Maßnahmen\n\t\t\t\t\t\t\tB B\n\t\t\t\t\t"... i = 6 size = 30 startpos = 29 colon_pos = 0 parse_size = 29 value_pos = ret = 6 continued = true continues = crlf_newline = false __PRETTY_FUNCTION__ = "message_parse_header_next" #10 0x080b9de5 in read_header (mstream=0x8112318) at istream-header-filter.c:163 hdr = (struct message_header_line *) 0x0 highwater_offset = pos = ret = matched = false hdr_ret = 1 __PRETTY_FUNCTION__ = "read_header" #11 0x080ba4e7 in i_stream_header_filter_read (stream=0x8112318) at istream-header-filter.c:293 mstream = (struct header_filter_istream *) 0x0 ret = pos = __PRETTY_FUNCTION__ = "i_stream_header_filter_read" #12 0x080ba634 in parse_header (mstream=0x8112318) at istream-header-filter.c:335 pos = 159 #13 0x080ba715 in i_stream_header_filter_seek (stream=0x8112318, v_offset=554, mark=false) at istream-header-filter.c:349 mstream = (struct header_filter_istream *) 0x0 ---Type to continue, or q to quit--- #14 0x080c88c9 in i_stream_seek (stream=0x8112340, v_offset=554) at istream.c:155 _stream = (struct istream_private *) 0x8112318 #15 0x080718e3 in mbox_mail_get_physical_size (_mail=0x810cb28, size_r=0xbfa4e908) at mbox-mail.c:255 mail = data = (struct index_mail_data *) 0x810cba4 input = (struct istream *) 0x8112340 hdr_size = {physical_size = 552, virtual_size = 566, lines = 14} old_offset = 554 body_offset = 162775 body_size = next_offset = 10982 #16 0xb7f83aec in mail_log_action (dest_trans=, mail=0x810cb28, event=, data=0x8108930 "Gel&APY-schte Elemente") at mail-log-plugin.c:305 lt = (struct mail_log_transaction_context *) 0x8115e50 msgid = 0x810d510 "<[EMAIL PROTECTED]>" size = str = (string_t *) 0x80f2620 pool = #17 0xb7f83d56 in mail_log_copy (t=0x810b0f8, mail=0x810cb28, flags=0, keywords=0x0, dest_mail=0x0) at mail-log-plugin.c:400 _data_stack_cur_id = 4 name = #18 0x0805a202 in cmd_copy (cmd=0x80fc9d0) at cmd-copy.c:66 client = (struct client *) 0x80fb548 storage = (struct mail_storage *) 0x80fc108 destbox = (struct mailbox *) 0x8108780 t = (struct mailbox_transaction_context *) 0x810b0f8 search_arg = messageset = 0x8100ad0 "10359" mailbox = 0x8100ad8 "Gel&APY-schte Elemente" src_uidset = msg = sync_flags = imap_flags = copy_count = 1 uid_validity = uid1 = uid2 = ret = 1 __PRETTY_FUNCTION__ = "cmd_copy" #19 0x0805e529 in cmd_uid (cmd=0x80fc9d0) at cmd-uid.c:26 command = (struct command *) 0x6 cmd_name = 0x8100ac8 "COPY" #20 0x0805eecc in client_command_input (cmd=0x80fc9d0) at client.c:580 client = (struct client *) 0x80fb548 command = __PRETTY_FUNCTION__ = "client_command_input" #21 0x0805ef75 in client_command_input (cmd=0x80fc9d0) at client.c:629 client = (struct client *) 0x80fb548 command = (struct command *) 0x4c54 __PRETTY_FUNCTION__ = "client_command_input" #22 0x0805f735 in client_handle_input (client=0x80fb548) at client.c:670 _data_stack_cur_id = 3 ret = remove_io = handled_commands = false #23 0x0805f94e in client_input (client=0x80fb548) at client.c:725 cmd = output = (struct ostream *) 0x80fc90c bytes = 46 ---Type to continue, or q to quit--- __PRETTY_FUNCTION__ = "client_input" #24 0x080cc130 in io_loop_handler_run (ioloop=0x80fa9b0) at ioloop-epoll.c:203 ctx = event = (const struct epoll_event *) 0x80faae8 list = (struct io_list *) 0x80fb5b8 io = (struct io_file *) 0x810caa0 tv = {tv_sec = 1799, tv_usec = 11} t_id = 2 msecs = ret = 1 i = 0 j = 0 call = #25 0x080cb248 in io_loop_run (ioloop=0x80fa9b0) at ioloop.c:320 No locals. #26 0x0806748c in main (argc=Cannot access memory at address 0x4c54 ) at main.c:293 No locals. I did some bugreports in last time and also compiled dovecot with some changes in guidance from timo to let the bug be more understandable but so far nothing helped. i like dovecot but if these bugs not get solved i cannot upgrade my maschines to > 1.0.15 :( Thanks, Andre
[Dovecot] Panic 1.1.x
Maßnahmen\n\t\t\t\t\t\t\tB B\n\t\t\t\t\t"... i = 6 size = 30 startpos = 29 colon_pos = 0 parse_size = 29 value_pos = ret = 6 continued = true continues = crlf_newline = false __PRETTY_FUNCTION__ = "message_parse_header_next" #10 0x080b9de5 in read_header (mstream=0x8112318) at istream-header-filter.c:163 hdr = (struct message_header_line *) 0x0 highwater_offset = pos = ret = matched = false hdr_ret = 1 __PRETTY_FUNCTION__ = "read_header" #11 0x080ba4e7 in i_stream_header_filter_read (stream=0x8112318) at istream-header-filter.c:293 mstream = (struct header_filter_istream *) 0x0 ret = pos = __PRETTY_FUNCTION__ = "i_stream_header_filter_read" #12 0x080ba634 in parse_header (mstream=0x8112318) at istream-header-filter.c:335 pos = 159 #13 0x080ba715 in i_stream_header_filter_seek (stream=0x8112318, v_offset=554, mark=false) at istream-header-filter.c:349 mstream = (struct header_filter_istream *) 0x0 ---Type to continue, or q to quit--- #14 0x080c88c9 in i_stream_seek (stream=0x8112340, v_offset=554) at istream.c:155 _stream = (struct istream_private *) 0x8112318 #15 0x080718e3 in mbox_mail_get_physical_size (_mail=0x810cb28, size_r=0xbfa4e908) at mbox-mail.c:255 mail = data = (struct index_mail_data *) 0x810cba4 input = (struct istream *) 0x8112340 hdr_size = {physical_size = 552, virtual_size = 566, lines = 14} old_offset = 554 body_offset = 162775 body_size = next_offset = 10982 #16 0xb7f83aec in mail_log_action (dest_trans=, mail=0x810cb28, event=, data=0x8108930 "Gel&APY-schte Elemente") at mail-log-plugin.c:305 lt = (struct mail_log_transaction_context *) 0x8115e50 msgid = 0x810d510 "<[EMAIL PROTECTED]>" size = str = (string_t *) 0x80f2620 pool = #17 0xb7f83d56 in mail_log_copy (t=0x810b0f8, mail=0x810cb28, flags=0, keywords=0x0, dest_mail=0x0) at mail-log-plugin.c:400 _data_stack_cur_id = 4 name = #18 0x0805a202 in cmd_copy (cmd=0x80fc9d0) at cmd-copy.c:66 client = (struct client *) 0x80fb548 storage = (struct mail_storage *) 0x80fc108 destbox = (struct mailbox *) 0x8108780 t = (struct mailbox_transaction_context *) 0x810b0f8 search_arg = messageset = 0x8100ad0 "10359" mailbox = 0x8100ad8 "Gel&APY-schte Elemente" src_uidset = msg = sync_flags = imap_flags = copy_count = 1 uid_validity = uid1 = uid2 = ret = 1 __PRETTY_FUNCTION__ = "cmd_copy" #19 0x0805e529 in cmd_uid (cmd=0x80fc9d0) at cmd-uid.c:26 command = (struct command *) 0x6 cmd_name = 0x8100ac8 "COPY" #20 0x0805eecc in client_command_input (cmd=0x80fc9d0) at client.c:580 client = (struct client *) 0x80fb548 command = __PRETTY_FUNCTION__ = "client_command_input" #21 0x0805ef75 in client_command_input (cmd=0x80fc9d0) at client.c:629 client = (struct client *) 0x80fb548 command = (struct command *) 0x4c54 __PRETTY_FUNCTION__ = "client_command_input" #22 0x0805f735 in client_handle_input (client=0x80fb548) at client.c:670 _data_stack_cur_id = 3 ret = remove_io = handled_commands = false #23 0x0805f94e in client_input (client=0x80fb548) at client.c:725 cmd = output = (struct ostream *) 0x80fc90c bytes = 46 ---Type to continue, or q to quit--- __PRETTY_FUNCTION__ = "client_input" #24 0x080cc130 in io_loop_handler_run (ioloop=0x80fa9b0) at ioloop-epoll.c:203 ctx = event = (const struct epoll_event *) 0x80faae8 list = (struct io_list *) 0x80fb5b8 io = (struct io_file *) 0x810caa0 tv = {tv_sec = 1799, tv_usec = 11} t_id = 2 msecs = ret = 1 i = 0 j = 0 call = #25 0x080cb248 in io_loop_run (ioloop=0x80fa9b0) at ioloop.c:320 No locals. #26 0x0806748c in main (argc=Cannot access memory at address 0x4c54 ) at main.c:293 No locals. I did some bugreports in last time and also compiled dovecot with some changes in guidance from timo to let the bug be more understandable but so far nothing helped. i like dovecot but if these bugs not get solved i cannot upgrade my maschines to > 1.0.15 :( Thanks, Andre
Re: [Dovecot] [Dovecot-news] I've moved to US
A bit stupid looking picture hihi, yes... ;) - Original Message - From: "Timo Sirainen" To: Cc: Sent: Friday, February 06, 2009 11:58 PM Subject: [Dovecot-news] I've moved to US ___ Dovecot-news mailing list dovecot-n...@dovecot.org http://dovecot.org/cgi-bin/mailman/listinfo/dovecot-news Eingehende eMail ist virenfrei. Von AVG überprüft - www.avg.de Version: 8.0.233 / Virendatenbank: 270.10.18/1937 - Ausgabedatum: 02/05/09 11:34:00
[Dovecot] expire tool - individual user/folder?
Hello, is the expire plugin usable to delete mails with different settings for each individual user? If i view sample config at http://wiki.dovecot.org/Plugins/Expire it looks like expire-data are related to foldernames. Is it possible to let each user "activate" the expire-plugin for different folders with different settings? Thanks, Andre
Re: [Dovecot] expire tool - individual user/folder?
Hello, The plugin yes, but expire-tool not really. It would be possible to have userdb lookups return an overridden expire setting and use it instead of the global one, but that would require writing more code.. i have made 2 testsetups with expire-plugin (mysql,dbd) it seems to work, in table i can find new entry for expire_stamp But how i can make individual settings for different users? adding user/folder in dovecot.conf gets ignored. is the plan to add separat settings directly in the expire-dict? (adding lines in mysql-table?) second question is much more importend. how to debug this if i get seg.faults when running "dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool --test" ? basically connect to mysql/dbd is working. if is expire-timestamp in future i get correct results. problem occurs when a folder is expired and action is required. how can i debug this to find real error? Common debugsettings in dovecot.conf seems not to work. i did compile with --enable-debug but all i got is: # dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool --test Warning: Growing pool 'Expire pool' with: 1024 Segmentation Fault Thanks, Andre
Re: [Dovecot] expire tool - individual user/folder?
Hello, ulimit -c unlimited dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool --test gdb /usr/libexec/dovecot/expire-tool core bt full here is the output. i am not in a hurry, for me it was just testing. But you are surely interested... gdb /usr/libexec/dovecot/expire-tool core GNU gdb 6.4 Copyright 2005 Free Software Foundation, Inc. GDB is free software, covered by the GNU General Public License, and you are welcome to change it and/or distribute copies of it under certain conditions. Type "show copying" to see the conditions. There is absolutely no warranty for GDB. Type "show warranty" for details. This GDB was configured as "i586-suse-linux"...Using host libthread_db library "/lib/libthread_db.so.1". Core was generated by `expire-tool --test'. Program terminated with signal 11, Segmentation fault. warning: Can't read pathname for load map: Eingabe-/Ausgabefehler. Reading symbols from /lib/libc.so.6...done. Loaded symbols for /lib/libc.so.6 Reading symbols from /lib/ld-linux.so.2...done. Loaded symbols for /lib/ld-linux.so.2 #0 0xb7e5eeb3 in strlen () from /lib/libc.so.6 (gdb) bt full #0 0xb7e5eeb3 in strlen () from /lib/libc.so.6 No symbol table info available. #1 0x080ba380 in vstrconcat (str1=0x80bd017 "RESTRICT_SETGID=", args=0xbfd4bd78 "", ret_len=0xbfd4bd5c) at strfuncs.c:165 str = 0x4 temp = 0x80d6330 "RESTRICT_SETGID=", 'Þ' ... bufsize = 512 i = 16 len = 16 __PRETTY_FUNCTION__ = "vstrconcat" #2 0x080babe3 in t_strconcat (str1=0x80bd017 "RESTRICT_SETGID=") at strfuncs.c:265 args = 0xbfd4bd74 "\004" len = 28 #3 0x0804a949 in auth_input (conn=0x80da350) at auth-client.c:142 line = #4 0x080b1a17 in io_loop_handler_run (ioloop=0x80da1a8) at ioloop-epoll.c:209 ctx = event = (const struct epoll_event *) 0x80da580 list = (struct io_list *) 0x80dadb0 io = (struct io_file *) 0x80da520 tv = {tv_sec = 2147483, tv_usec = 0} t_id = 3 msecs = ret = 1 i = 0 call = #5 0x080b0b08 in io_loop_run (ioloop=0x80da1a8) at ioloop.c:336 No locals. #6 0x0804a5e4 in auth_client_put_user_env (conn=0x80da350, user=0x80d6060 "m0127a22") at auth-client.c:229 No locals. #7 0x0804b5c7 in main (argc=Cannot access memory at address 0x0 ) at expire-tool.c:43 _data_stack_cur_id = 2 ioloop = (struct ioloop *) 0x80da1a8 test = (gdb) exit Undefined command: "exit". Try "help". (gdb) quit Thanks, Andre
Re: [Dovecot] expire tool - individual user/folder?
That really shouldn't be happening. What dovecot version is this with? Can you run it with valgrind? its version 1.1.15 valgrind --trace-children=yes dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool --test ==31981== Memcheck, a memory error detector. ==31981== Copyright (C) 2002-2005, and GNU GPL'd, by Julian Seward et al. ==31981== Using LibVEX rev 1575, a library for dynamic binary translation. ==31981== Copyright (C) 2004-2005, and GNU GPL'd, by OpenWorks LLP. ==31981== Using valgrind-3.1.1, a dynamic binary instrumentation framework. ==31981== Copyright (C) 2000-2005, and GNU GPL'd, by Julian Seward et al. ==31981== For more details, rerun with: -v ==31981== ==31981== Memcheck, a memory error detector. ==31981== Copyright (C) 2002-2005, and GNU GPL'd, by Julian Seward et al. ==31981== Using LibVEX rev 1575, a library for dynamic binary translation. ==31981== Copyright (C) 2004-2005, and GNU GPL'd, by OpenWorks LLP. ==31981== Using valgrind-3.1.1, a dynamic binary instrumentation framework. ==31981== Copyright (C) 2000-2005, and GNU GPL'd, by Julian Seward et al. ==31981== For more details, rerun with: -v ==31981== Warning: Growing pool 'Expire pool' with: 1024 ==31981== Invalid read of size 1 ==31981==at 0x4021FB8: strlen (in /usr/lib/valgrind/x86-linux/vgpreload_memcheck.so) ==31981==by 0x80BA37F: vstrconcat (strfuncs.c:165) ==31981==by 0x80BABE2: t_strconcat (strfuncs.c:265) ==31981==by 0x804A948: auth_input (auth-client.c:142) ==31981==by 0x80B1A16: io_loop_handler_run (ioloop-epoll.c:209) ==31981==by 0x80B0B07: io_loop_run (ioloop.c:336) ==31981==by 0x804A5E3: auth_client_put_user_env (auth-client.c:229) ==31981==by 0x804B5C6: main (expire-tool.c:43) ==31981== Address 0x4 is not stack'd, malloc'd or (recently) free'd ==31981== ==31981== Process terminating with default action of signal 11 (SIGSEGV) ==31981== Access not within mapped region at address 0x4 ==31981==at 0x4021FB8: strlen (in /usr/lib/valgrind/x86-linux/vgpreload_memcheck.so) ==31981==by 0x80BA37F: vstrconcat (strfuncs.c:165) ==31981==by 0x80BABE2: t_strconcat (strfuncs.c:265) ==31981==by 0x804A948: auth_input (auth-client.c:142) ==31981==by 0x80B1A16: io_loop_handler_run (ioloop-epoll.c:209) ==31981==by 0x80B0B07: io_loop_run (ioloop.c:336) ==31981==by 0x804A5E3: auth_client_put_user_env (auth-client.c:229) ==31981==by 0x804B5C6: main (expire-tool.c:43) ==31981== ==31981== ERROR SUMMARY: 1 errors from 1 contexts (suppressed: 3 from 1) ==31981== malloc/free: in use at exit: 34,477 bytes in 35 blocks. ==31981== malloc/free: 36 allocs, 1 frees, 34,637 bytes allocated. ==31981== For counts of detected errors, rerun with: -v ==31981== searching for pointers to 35 not-freed blocks. ==31981== checked 93,876 bytes. ==31981== ==31981== LEAK SUMMARY: ==31981==definitely lost: 0 bytes in 0 blocks. ==31981== possibly lost: 0 bytes in 0 blocks. ==31981==still reachable: 34,477 bytes in 35 blocks. ==31981== suppressed: 0 bytes in 0 blocks. ==31981== Reachable blocks (those to which a pointer was found) are not shown. ==31981== To see them, rerun with: --show-reachable=yes Segmentation Fault Andre
Re: [Dovecot] expire tool - individual user/folder?
Does the problem go away if you don't configure Dovecot with --enable-devel-checks? no, its not included in my configure-line. This is it: ./configure \ --prefix=/usr \ --sysconfdir=/etc \ --localstatedir=/var \ --mandir=/usr/share/man \ --with-ssl=openssl \ --with-storages=mbox,maildir,raw \ --with-pam \ --with-passwd \ --with-db \ --enable-debug i just added --enable-debug after having the segfaults whren running the expire-tool to see more lines... sorry for always making problems ;) Andre
Re: [Dovecot] expire tool - individual user/folder?
This is what I meant actually, the name just changed in v1.2. What do you get with the attached patch? patch fixes the problem in both cases. it does not care if --enable-debug is enabled or disabled. in 1.1.16 it works without the patch. Thanks, Andre
Re: [Dovecot] expire tool - individual user/folder?
Hello, The patch shouldn't really have changed anything. in 1.1.16 it works without the patch. And I didn't fix anything in 1.1.16 either. Maybe it was some weird compiling issue or something.. i do not have an explanation, but effect is the same. i repackaged 1.1.15 with and without patch and only the one with the patch works. for 1.1.16 i do not need a patch. gcc is 4.1.2 but its not important for me, just some tests... Andre
Re: [Dovecot] Backup recovery with mdbox
On Tue, 2010-10-05 at 14:13 +0100, Timo Sirainen wrote: > dsync could work, although with some small kludging: > > 1. Put the old backup to e.g. ~/backup > > 2. Rename the mailbox to whatever you want in destination, e.g. mv > ~/backup/mailboxes/foo ~/backup/mailboxes/foo-$date > > 3. Copy the mailbox: dsync -m foo-$date mirror mdbox:~/backup Hello I'm doing the following: * Backups are extracted in /home/andre/backup/{spool,lib} * The user mail_location is mdbox:/var/spool/imap/partition7/11/andre=sneakymustard.com:INDEX=/var/lib/imap/user/11/andre=sneakymustard.com * I tried the following commands: # dsync -R -u andre=sneakymustard.com -m backup_2010-10-01-23 backup "mdbox:/home/andre/backup/spool:INDEX=/home/andre/backup/lib" # dsync -u andre=sneakymustard.com -m backup_2010-10-01-23 -o mail_location="mdbox:/home/andre/backup/spool:INDEX=/home/andre/backup/lib" backup "mdbox:/var/spool/imap/partition7/11/andre=sneakymustard.com:INDEX=/var/lib/imap/user/11/andre=sneakymustard.com The intent is that a folder called "backup_2010-10-01-21" is created in that mailbox, with the contents from /home/andre/backup stored in it, but nothing is created. I believe this is because there's no "backup_2010-10-01-21" folder in the recovered backup. Is there a way around this? Thanks, Andre
Re: [Dovecot] Backup recovery with mdbox
On Wed, 2010-10-06 at 15:26 +0100, Timo Sirainen wrote: > dsync -o > mail_location=mdbox:mdbox:/var/spool/imap/partition7/11/andre=sneakymustard.com:INDEX=/var/lib/imap/user/11/andre=sneakymustard.com:MAILBOXDIR=mailboxes/backup-1234 > -u ..etc.. > > So basically override the default mail_location but only change the > mailboxes/ directory to mailboxes/backup-1234. I think that should work. > Take a backup first. :) That worked, as long as I run a doveadm force-resync -u andre=sneakymustard.com INBOX after dsync, which is totally fine :) Thanks! Andre
[Dovecot] User authentication fields size limit
Hello I'm using authentication via SQL, and I'm storing the full mail_location in the database. This is a long string because we're using multiple partitions and hashing to create this path. It looks like this: # doveadm user andre=sneakymustard.com userdb: andre=sneakymustard.com password : $1$ixW87UeD$fLhORaJS0c5wNFmWqfJdI1 mail : mdbox:/var/spool/imap/partition7/11/andre=sneakymustard.com:INDEX=/var/lib/imap/user/11/andre=sneakymustard.com quota_rule: *:bytes=1024M Depending on the user's email, this string can be even longer. What I've noticed is that it is truncated when it reaches 128 bytes. Could this size limit be increased? Thanks, Andre
Re: [Dovecot] User authentication fields size limit
On Wed, 2010-10-06 at 19:59 +0100, Timo Sirainen wrote: > There's no 128 byte limit in Dovecot as far as I know. You sure it's not > truncated to 128 bytes already on the SQL database? :) If that's not the > case, set auth_debug=yes and show the logs. Is the log from "doveadm user" enough? It's like below. Oct 6 16:11:03 box5 dovecot: auth: Debug: master in: USER#0111#011wellington.epaminondas=sbu.org.br#011service=doveadm Oct 6 16:11:03 box5 dovecot: auth: Debug: prefetch(wellington.epaminondas=sbu.org.br): passdb didn't return userdb entries, trying the next userdb Oct 6 16:11:03 box5 dovecot: auth: Debug: sql(wellington.epaminondas=sbu.org.br): SELECT pass AS password, mail_location AS mail, concat('*:bytes=', quota, 'M') AS quota_rule FROM mail_users WHERE user = 'wellington.epaminondas=sbu.org.br' AND server_id = 1 Oct 6 16:11:03 box5 dovecot: auth: Debug: master out: USER#0111#011wellington.epaminondas=sbu.org.br#011password=$1$gT9MJF7o $mactR0nGXtu8X6G.3mJuF0#011mail=mdbox:/var/spool/imap/partition7/b7/wellington.epaminondas=sbu.org.br:INDEX=/var/lib/imap/user/b7/wellington.epaminondas=sbu.org#011quota_rule=*:bytes=1024M Truncation appears in the "master out" string. Thanks, Andre
Re: [Dovecot] User authentication fields size limit
On Wed, 2010-10-06 at 16:09 -0300, Andre Nathan wrote: > Truncation appears in the "master out" string. Nevermind. Apparently there's an inconsistency in the MySQL cluster and some servers have it truncated. Sorry for the noise. Andre
Re: [Dovecot] Backup recovery with mdbox
On Wed, 2010-10-06 at 12:08 -0300, Andre Nathan wrote: > That worked, as long as I run a > > doveadm force-resync -u andre=sneakymustard.com INBOX > > after dsync, which is totally fine :) Hmm actually it doesn't work after a force-resync. The "backup-$date" mailbox is shown, with all it's sub-mailboxes as intended, but they're all empty. I found out, though, that if I run the dsync command twice the messages appear on the imap client. I get log messages like these on the second run: dsync(andre=sneakymustard.com): Info: SPAM: uidnext changed: 31 != 1 dsync(andre=sneakymustard.com): Info: INBOX: uidnext changed: 314 != 1 Is this what makes it work (it fixes the uids or something like that)? Does the second dsync do something that could cause the message listing to be fixed (apparently something that a force-resync doesn't do...)? I have no problem running the command twice, it's just a bit weird... Thanks, Andre
Re: [Dovecot] Backup recovery with mdbox
On Mon, 2010-10-18 at 18:38 +0100, Timo Sirainen wrote: > Added to hg: > >This example imports all mails from a backup under a backup-20101026 >mailbox: > >doveadm import -u jane@example.org \ >mdbox:/backup/20101026/jane.doe/mdbox backup-20101026 all > >Another example that imports only messages from f...@example.org in > the >backup mdbox's INBOX to jane's INBOX: > >doveadm import -u jane@example.org \ >mdbox:~/mdbox-backup mailbox INBOX from f...@example.org Awesome :) Thanks a lot! Andre
Re: [Dovecot] Segfault in libdovecot-sieve
Hi I've upgraded to 2.0.6 and set the home directory. The segfaults are gone :) Thanks, Andre On Thu, 2010-10-21 at 22:13 +0100, Timo Sirainen wrote: > On 21.10.2010, at 23.14, Andre wrote: > > > This shows up in the mail error when the sieve error happens. It seems > > the sieve error is a side-effect of something else: > > > > Oct 21 17:58:11 box6 dovecot: lmtp(10424, > > catia.comercial=industriacarvalho.com...@lmtp1.prv.f1.k8.com.br): Error: > > lstat((null)) failed: Bad address > > This reminds me of a problem with missing home directory. That crash is fixed > in v2.0.6, but you should have a home directory set so that reject/vacation > messages won't be duplicated. http://wiki2.dovecot.org/VirtualUsers/Home >
[Dovecot] Recommendation for OCFS2 filesystem type
Hello When creating an OCFS2 filesystem, one can specify a "filesystem type" option: -T filesystem-type Specify how the filesystem is going to be used, so that mkfs.ocfs2 can chose optimal filesystem parameters for that use. The supported filesystem types are: mail Appropriate for file systems which will have many meta data updates. Creates a larger journal. datafiles Appropriate for file systems which will host a rela‐ tively small number of very large files. A small journal is selected. Cluster size will be at least 128K. Considering I'm using a separate partition for the dovecot indices, and that I'm using mdbox, would it be more appropriate to use 'datafiles' for the mail location partition and 'mail' just for the indices? Or would 'mail' be appropriate for both even with the larger files created by mdbox? Thanks, Andre
[Dovecot] Corrupted transaction log file
Hello I run dovecot 2.0.6 on a two-machine cluster using OCFS2 as the file system. I have some error messages like these in my log: Oct 25 01:07:50 box5 dovecot: lmtp(8886, suporte=100br@lmtp1.prv.f1.k8.com.br): Error: Corrupted transaction log file /var/lib/imap/user/a3/suporte=100br.com/stor age/dovecot.map.index.log seq 29: Transaction log corrupted unexpectedly at 21536: Invalid size 0 (type=0) (sync_offset=21908) Oct 25 01:07:50 box5 dovecot: lmtp(8886, suporte=100br@lmtp1.prv.f1.k8.com.br): Error: Index /var/lib/imap/user/a3/suporte=100br.com/storage/dovecot.map.index: Lost log for seq=29 offset=21796 Oct 25 01:07:55 box5 dovecot: lmtp(8885, suporte=100br@lmtp1.prv.f1.k8.com.br): Error: Log synchronization error at seq=30,offset=312 for /var/lib/imap/user/a3/su porte=100br.com/storage/dovecot.map.index: Append with UID 5404, but next_uid = 5405 Oct 25 02:37:53 box5 dovecot: lmtp(8885, suporte=hostnet.com...@lmtp1.prv.f1.k8.com.br): Error: Log synchronization error at seq=47,offset=22944 for /var/lib/imap/user/03/suporte=hostnet.com.br/storage/dovecot.map.index: Extension record update for invalid uid=21815 These two accounts happen to be accessed simultaneously by a number of people, but there are similar errors for "normal" accounts too, just not the same amount of logs. Is it not considered safe to do this kind of simultaneous access in a distributed filesystem like OCFS2? Is there a way to fix this error? Would a "doveadm force-resync" do it? Thanks, Andre
Re: [Dovecot] Corrupted transaction log file
On Tue, 2010-10-26 at 22:39 +0200, Timo Sirainen wrote: > Have you set mmap_disable=yes? Yep. > Those errors should fix themselves automatically. Still, it's not very good > if they keep happening. Sooner or later they will cause user visible problems. They're not happening all the time. It showed up two or three times in the logs during the night. Thanks, Andre
Re: [Dovecot] Corrupted transaction log file
On Tue, 2010-10-26 at 23:52 -0200, Andre Nathan wrote: > They're not happening all the time. It showed up two or three times in > the logs during the night. A few errors of this kind appeared in the logs last night. The "Log synchronization error" appears more frequently than "Corrupted transaction log file", but I assume the former is a consequence of the latter. This really seems to be related to the shared accounts. Our load balancer makes no attempt to send the same users to the same server; it just sends connections based on server load. This allows two simultaneous connections to access an account, one on each server. Given a distributed FS, this should be OK, right? At least in theory it's no different than two CPU cores accessing the same account in a single server. Best regards, Andre
Re: [Dovecot] Corrupted transaction log file
On Tue, 2010-10-26 at 23:52 -0200, Andre Nathan wrote: > On Tue, 2010-10-26 at 22:39 +0200, Timo Sirainen wrote: > > Have you set mmap_disable=yes? > > Yep. Just out of curiosity, is this setting really needed, or is it for performance reasons? OCFS2 claims to support mmap: http://www.oracle.com/us/technologies/linux/025995.htm Regards, Andre
Re: [Dovecot] Phantom email message
On Wed, 2010-11-10 at 11:59 -0800, Marc Perkel wrote: > Anyone have any ideas? This happens from time to time for me in Evolution. Moving a message from some folder to the folder displaying the phantom message seems to force it to recalculate and always fixes it here. HTH, Andre
Re: [Dovecot] Indexes.
On Thu, 2010-12-02 at 13:40 +0100, Robert Schetterer wrote: > hm , i have no problems with ocfs2 (1.4.3-1: amd64 ) on drbd ubuntu lucid > using dovecot vers 2 recommended settings for cluster file systems > i have my index files in the maildir dir Robert, are you running an active-active setup with drbd+ocfs2? Have you ever seen errors like these in the logs? http://dovecot.markmail.org/message/u5qhqaguhqlsk2ui Thanks, Andre
Re: [Dovecot] Best Cluster Storage
On Fri, 2011-01-14 at 03:48 +, Jonathan Tripathy wrote: > ocfs2 seems to work quite well with lots of small files (typical of > maildir). I'm guessing that since ocfs2 reboot a system automatically, > it doesn't require any additional fencing? We have a two-node active-active DRBD+OCFS2 Dovecot cluster. We're currently unable to fully use it due to (what I believe is) an OCFS2 bug: http://oss.oracle.com/bugzilla/show_bug.cgi?id=1297 so while DRBD is in a dual-primary setup and the dovecot volumes are mounted read/write on both cluster nodes, I had to remove one of them from the load balancer, and thus only one of them handles connections while the other is sitting there as a failover node. HTH, Andre
[Dovecot] Problems setting up shared/public imap folders
Hello everyone, today I have tried to set up shared and public IMAP folders, but it didn't work. # rpm -qa | grep dovecot dovecot12-backend-mysql-1.2.11-3.3.1.x86_64 dovecot12-backend-sqlite-1.2.11-3.3.1.x86_64 dovecot12-1.2.11-3.3.1.x86_64 dovecot12-backend-pgsql-1.2.11-3.3.1.x86_64 Here is my dovecot.conf [1]. Can anyone explain what is wrong with my configuration? It is not possible to access the shared and public mailboxes. Thunderbird and KMail don't show the shared/public namespace at all. Outlook Express shows these namespaces, but trying to access leads to a "mailbox doesn't exist" error message. Dovecot is not logging any errors. What's wrong? Thanks, Andre [1] # cat /etc/dovecot/dovecot.conf protocols = imap imaps protocol imap { mail_plugins = acl imap_acl } listen = * disable_plaintext_auth = no ssl = no login_greeting = alphatest mailservice ready. mail_location = maildir:~/Maildir namespace private { separator = / prefix = inbox = yes } namespace shared { separator = / prefix = shared/ location = maildir:%%h/Maildir:INDEX=~/Maildir/shared/%%u subscriptions = no } namespace public { separator = / prefix = pub/ location = maildir:/srv/mail/pub subscriptions = no } mail_uid = 1002 mail_gid = 1000 protocol imap { mail_plugin_dir = /usr/lib64/dovecot/modules/imap } protocol pop3 { mail_plugin_dir = /usr/lib64/dovecot/modules/pop3 } protocol managesieve { } protocol lda { mail_plugin_dir = /usr/lib64/dovecot/modules/lda mail_plugins = acl } auth default { mechanisms = plain passdb pam { } userdb passwd { } user = root } dict { } plugin { acl = vfile acl_shared_dict = file:/var/lib/dovecot/shared-mailboxes/%u acl_anyone = allow } -- Andre Tann