solr and dovecot 2.2.36
Hi I have dovecot-2.2.36.4 (director) + 5 nodes dovecot (dovecot-2.2.36.4) What version of Solr do you recommend ? -- Maciej Miłaszewski Starszy Administrator Systemowy IQ PL Sp. z o.o. Biuro Obsługi Klienta: e-mail: b...@iq.pl tel.: +48 58 326 09 90 - 94 fax: +48 58 326 09 99 Dział pomocy: https://www.iq.pl/pomoc Informacja dotycząca przetwarzania danych osobowych: https://www.iq.pl/kontakt IQ PL Sp. z o.o. z siedzibą w Gdańsku (80-298), ul. Geodetów 16, KRS 007725, Sąd rejestrowy: Sąd Rejonowy w Gdańsku VII Wydział KRS, kapitał zakładowy: 140.000 PLN, NIP 5832736211, REGON 192478853
Re: solr and dovecot 2.2.36
* Maciej Milaszewski, 18.08.20 14:00 > I have dovecot-2.2.36.4 (director) + 5 nodes dovecot (dovecot-2.2.36.4) > What version of Solr do you recommend ? Don't know about 2.2.36.4, but for 2.3.11.3 both solr-7.7.3 and solr-8.6.0 appear to work fine. I'm only running a small setup with a handful of users, though, so YMMV. HTH nevertheless, Thomas
Re: solr and dovecot 2.2.36
Hi I tested ver solr-8.6.0 but not found schema for 2.2.x with version 6.6.x works fine On 18.08.2020 14:59, Alessio Cecchi wrote: > > Hi Maciej, > > version 6.6.x works fine, but probably also 7.7.x with schema from > Dovecot 2.3. > > Ciao > > Il 18/08/20 14:00, Maciej Milaszewski ha scritto: >> Hi >> I have dovecot-2.2.36.4 (director) + 5 nodes dovecot (dovecot-2.2.36.4) >> >> What version of Solr do you recommend ? >> > -- > Alessio Cecchi > Postmaster @ http://www.qboxmail.it > https://www.linkedin.com/in/alessice
Sieve scripts replication not working
Hi all! I am a long-time dovecot user/admin on my home server, but only recently tried to configure replication. Everything seems to work except sieve scripts replication. When I upload new one on the server A, it does not replicate to server B, even if it seemingly tries to, according to debug logs. The log antry says: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1 on server A, but nothing like that on server B. Server B logs show that server A is connecting to doveadm service but little else. Any ideas what could be wrong? Please see the logs below. Users and domains have been anonymized. - Upload - $ sieve-connect -s serverA.mydomain.example -p sieve -u user@mydomain.example --notlsverify Sieve/IMAP Password: ReadLine support enabled. > put lists > put autosave - Server A log --- Aug 18 16:05:49 serverA dovecot[60776]: managesieve-login: Login: user=, method=PLAIN, rip=, lip=, mpid=35651, TLS, session= Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Effective uid=113, gid=122, home=/var/vmail/user@mydomain.example Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail:LAYOUT=fs:DIRNAME=.MailDir:UTF-8 Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: fs: root=/var/vmail/user@mydomain.example/mail, index=, indexpvt=, control=, inbox=, alt= Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: Pigeonhole version 0.5.4 () initializing Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Using active Sieve script path: /var/vmail/user@mydomain.example/.sieve Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Using script storage path: /var/vmail/user@mydomain.example/sieve Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Using permissions from /var/vmail/user@mydomain.example/sieve: mode=0700 gid=-1 Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: sync: Synchronization active Aug 18 16:05:54 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Using Sieve script path: /var/vmail/user@mydomain.example/sieve/tmp/lists_1597759554.M792097P35651.serverA.mydomain.example.sieve Aug 18 16:05:54 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file script: Opened script `lists' from `/var/vmail/user@mydomain.example/sieve/tmp/lists_1597759554.M792097P35651.serverA.mydomain.example.sieve' Aug 18 16:05:54 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: replication: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1 Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: auth PASS input: user=user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example)<35652><>: Debug: auth USER input: user@mydomain.example uid=113 gid=122 home=/var/vmail/user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: remote(serverB.mydomain.example): auth PASS input: user=user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: remote(serverB.mydomain.example): auth USER input: user@mydomain.example uid=113 gid=122 home=/var/vmail/user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: remote(serverB.mydomain.example): Effective uid=113, gid=122, home=/var/vmail/user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: remote(serverB.mydomain.example): Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail:LAYOUT
Re: Sieve scripts replication not working
Hi Piotr, On 18.08.20 16:40, Piotr Auksztulewicz wrote: > - doveconf -n --- > # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf > # Pigeonhole version 0.5.4 () > # OS: Linux 4.19.0-8-amd64 x86_64 Debian 10.4 It looks like your dovecot version is a bit outdated. There were numerous fixes in the 2.3 series regarding replication, especially with respect to sieve replication. I would suggest updating to the latest release (2.3.11.3) to see if that already fixes the issues you're experiencing. Cheers, Thore -- Thore Bödecker GPG ID: 0xD622431AF8DB80F3 GPG FP: 0F96 559D 3556 24FC 2226 A864 D622 431A F8DB 80F3 signature.asc Description: PGP signature
Sieve scripts replication not working
Hi all! I am a long-time dovecot user/admin on my home server, but only recently tried to configure replication. Everything seems to work except sieve scripts replication. When I upload new one on the server A, it does not replicate to server B, even if it seemingly tries to, according to debug logs. The log antry says: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1 on server A, but nothing like that on server B. Server B logs show that server A is connecting to doveadm service but little else. Any ideas what could be wrong? Please see the logs below. Users and domains have been anonymized. - Upload - $ sieve-connect -s serverA.mydomain.example -p sieve -u user@mydomain.example --notlsverify Sieve/IMAP Password: ReadLine support enabled. > put lists > put autosave - Server A log --- Aug 18 16:05:49 serverA dovecot[60776]: managesieve-login: Login: user=, method=PLAIN, rip=, lip=, mpid=35651, TLS, session= Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Loading modules from directory: /usr/lib/dovecot/modules Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Module loaded: /usr/lib/dovecot/modules/lib15_notify_plugin.so Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Module loaded: /usr/lib/dovecot/modules/lib20_replication_plugin.so Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Effective uid=113, gid=122, home=/var/vmail/user@mydomain.example Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail:LAYOUT=fs:DIRNAME=.MailDir:UTF-8 Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: fs: root=/var/vmail/user@mydomain.example/mail, index=, indexpvt=, control=, inbox=, alt= Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: Pigeonhole version 0.5.4 () initializing Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: include: sieve_global is not set; it is currently not possible to include `:global' scripts. Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Using active Sieve script path: /var/vmail/user@mydomain.example/.sieve Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Using script storage path: /var/vmail/user@mydomain.example/sieve Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Using permissions from /var/vmail/user@mydomain.example/sieve: mode=0700 gid=-1 Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Relative path to sieve storage in active link: sieve/ Aug 18 16:05:49 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: sync: Synchronization active Aug 18 16:05:54 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file storage: Using Sieve script path: /var/vmail/user@mydomain.example/sieve/tmp/lists_1597759554.M792097P35651.serverA.mydomain.example.sieve Aug 18 16:05:54 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: sieve: file script: Opened script `lists' from `/var/vmail/user@mydomain.example/sieve/tmp/lists_1597759554.M792097P35651.serverA.mydomain.example.sieve' Aug 18 16:05:54 serverA dovecot[60776]: managesieve(user@mydomain.example)<35651>: Debug: replication: Replication requested by 'sieve_storage_sync_transaction_begin', priority=1 Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: auth PASS input: user=user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example)<35652><>: Debug: auth USER input: user@mydomain.example uid=113 gid=122 home=/var/vmail/user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: remote(serverB.mydomain.example): auth PASS input: user=user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: remote(serverB.mydomain.example): auth USER input: user@mydomain.example uid=113 gid=122 home=/var/vmail/user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: remote(serverB.mydomain.example): Effective uid=113, gid=122, home=/var/vmail/user@mydomain.example Aug 18 16:05:55 serverA dovecot[60776]: doveadm(user@mydomain.example): Debug: remote(serverB.mydomain.example): Namespace inbox: type=private, prefix=, sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes location=maildir:~/mail:LAYO
Indexer error after upgrade to 2.3.11.3
Hi, after the upgrade to Dovecot 2.3.11.3, from 2.3.10.1, I see frequently these errors from different users: Aug 18 11:02:35 Panic: indexer-worker(i...@domain.com) session=: file http-client-request.c: line 1232 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) Aug 18 11:02:35 Error: indexer-worker(i...@domain.com) session=: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x2f) [0x7f0ee3c828bf] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x26) [0x7f0ee3c829d6] -> /usr/lib64/dovecot/libdovecot.so.0(+0xeb7ba) [0x7f0ee3c8d7ba] -> /usr/lib64/dovecot/libdovecot.so.0(+0xeb801) [0x7f0ee3c8d801] -> /usr/lib64/dovecot/libdovecot.so.0(+0x42ff1) [0x7f0ee3be4ff1] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_more+0x415) [0x7f0ee3c2ba25] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_connection_output+0x114) [0x7f0ee3c30994] -> /usr/lib64/dovecot/libdovecot.so.0(+0x115470) [0x7f0ee3cb7470] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x55) [0x7f0ee3ca4eb5] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xdc) [0x7f0ee3ca6ebc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5c) [0x7f0ee3ca4fac] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f0ee3ca51f8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x8a955) [0x7f0ee3c2c955] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_request_finish_payload+0x21) [0x7f0ee3c2cbd1] -> /usr/lib64/dovecot/lib21_fts_solr_plugin.so(solr_connection_post_end+0x45) [0x7f0ee1c85d15] -> /usr/lib64/dovecot/lib21_fts_solr_plugin.so(+0x3fa0) [0x7f0ee1c81fa0] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x86cc) [0x7f0ee297f6cc] -> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_backend_update_deinit+0x2c) [0x7f0ee297f74c] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xfd04) [0x7f0ee2986d04] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xff3f) [0x7f0ee2986f3f] -> /usr/lib64/dovecot/lib10_quota_plugin.so(+0xf64b) [0x7f0ee2dc764b] -> /usr/lib64/dovecot/lib01_acl_plugin.so(+0xde43) [0x7f0ee2fdce43] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x54) [0x7f0ee3f91db4] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit+0x16) [0x7f0ee3f91e76] -> dovecot/indexer-worker [i...@domain.com INBOX](+0x291c) [0x557584acb91c] -> dovecot/indexer-worker [i...@domain.com INBOX](+0x2e54) [0x557584acbe54] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x55) [0x7f0ee3ca4eb5] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xdc) [0x7f0ee3ca6ebc] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5c) [0x7f0ee3ca4fac] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f0ee3ca51f8] Aug 18 11:02:35 Error: indexer: Indexer worker disconnected, discarding 1 requests for i...@domain.com Aug 18 11:02:35 Error: imap(i...@domain.com) session=: indexer failed to index mailbox INBOX Aug 18 11:02:35 Fatal: indexer-worker(i...@domain.com) session=: master: service(indexer-worker): child 24604 killed with signal 6 (core dumps disabled - https://dovecot.org/bugreport.html#coredumps) I'm using FTS with Solr 6.6.5. What is it? Thanks -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice
Re: solr and dovecot 2.2.36
Hi Maciej, version 6.6.x works fine, but probably also 7.7.x with schema from Dovecot 2.3. Ciao Il 18/08/20 14:00, Maciej Milaszewski ha scritto: Hi I have dovecot-2.2.36.4 (director) + 5 nodes dovecot (dovecot-2.2.36.4) What version of Solr do you recommend ? -- Alessio Cecchi Postmaster @ http://www.qboxmail.it https://www.linkedin.com/in/alessice
Re: Sieve scripts replication not working
On Tue, Aug 18, 2020 at 04:52:48PM +0200, Thore Bödecker wrote: > On 18.08.20 16:40, Piotr Auksztulewicz wrote: > > - doveconf -n --- > > # 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf > > # Pigeonhole version 0.5.4 () > > # OS: Linux 4.19.0-8-amd64 x86_64 Debian 10.4 > > It looks like your dovecot version is a bit outdated. > There were numerous fixes in the 2.3 series regarding replication, > especially with respect to sieve replication. Thank you for information. I am using dovecot packaged for debian stable release, and I like having updates managed by package system. I will think what to do next - bother with compiling and installing dovecot by myself, trying to install packages from unstable (which may be tricky and may break some dependencies), running in a container with debian unstable bootstrapped, or just living with it. I could even make some cron job to sync scripts, or just run sieve-connect twice. The serverB is just for backup anyway, I do not use it for normal activity. -- Piotr "Malgond" Auksztulewicz firstn...@lastname.net
Re: Sieve scripts replication not working
>Thank you for information. I am using dovecot packaged for debian >stable release, and I like having updates managed by package system. You could use the packages provided by dovecot. See https://repo.dovecot.org for more information. -- Christian Kivalo
INBOX sharing does not work
Hello!
INBOX sharing does not seem to work, although all other mailboxes work.
User b...@example.de has shared a few mailboxes:
# doveadm acl get -u b...@example.de INBOX
ID Global Rights
user=f...@example.delookup read write-seen
# doveadm acl get -u b...@example.de Sent
ID Global Rights
user=f...@example.delookup read write-seen
# doveadm acl get -u b...@example.de Drafts
ID Global Rights
user=f...@example.delookup read write-seen
But user f...@example.de can't see the shared INBOX:
# doveadm mailbox list -u f...@example.de
Trash
Sent
Drafts
Junk
shared
shared/b...@example.de
shared/b...@example.de/Sent
shared/b...@example.de/Drafts
INBOX
A review of the ACL does not explain the behaviour:
# doveadm acl debug -u f...@example.de shared/b...@example.de/INBOX
doveadm(f...@example.de): Info: Mailbox 'INBOX' is in namespace
'shared/b...@example.de/'
doveadm(f...@example.de): Info: Mailbox path:
/srv/mail-storage/mailhome/example.de/bar/Maildir
doveadm(f...@example.de): Info: Per-user private flags in mailbox: \Seen
doveadm(f...@example.de): Info: User f...@example.de has rights: lookup
read write-seen
doveadm(f...@example.de): Info: Mailbox found from dovecot-acl-list
doveadm(f...@example.de): Info: User b...@example.de found from ACL
shared dict
doveadm(f...@example.de): Info: Mailbox shared/b...@example.de/INBOX is
visible in LIST
-- doveconf -n --
# 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.4 ()
# OS: Linux 4.19.0-10-amd64 x86_64 Debian 10.5
# Hostname: XXX..de
auth_master_user_separator = *
auth_verbose = yes
first_valid_gid = 401
first_valid_uid = 401
last_valid_gid = 401
last_valid_uid = 401
mail_gid = vmail
mail_home = /srv/mail-storage/mailhome/%d/%n
mail_location = maildir:~/Maildir
mail_plugins = " acl listescape zlib"
mail_uid = vmail
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope
encoded-character vacation subaddress comparator-i;ascii-numeric
relational regex imap4flags copy include variables body enotify
environment mailbox date index ihave duplicate mime foreverypart extracttext
namespace inbox {
inbox = yes
location =
mailbox Drafts {
auto = subscribe
special_use = \Drafts
}
mailbox Junk {
auto = create
special_use = \Junk
}
mailbox Sent {
auto = subscribe
special_use = \Sent
}
mailbox "Sent Messages" {
auto = no
special_use = \Sent
}
mailbox Trash {
auto = subscribe
special_use = \Trash
}
prefix =
separator = /
type = private
}
namespace shared {
list = children
location =
maildir:/srv/mail-storage/mailhome/%%d/%%n/Maildir:INDEXPVT=~/Maildir/shared/%%d/%%n
prefix = shared/%%u/
separator = /
subscriptions = yes
type = shared
}
passdb {
args = /etc/dovecot/master-users
driver = passwd-file
master = yes
pass = yes
}
passdb {
args = /etc/dovecot/dovecot-ldap.conf.ext
driver = ldap
}
plugin {
acl = vfile
acl_shared_dict = file:/srv/mail-storage/mailhome/shared-mailboxes.db
sieve = file:~/sieve;active=~/.dovecot.sieve
zlib_save = gz
zlib_save_level = 6
}
protocols = " imap lmtp sieve"
service auth {
unix_listener auth-userdb {
mode = 0777
}
}
ssl = required
ssl_cert = I don't think it is relevant, but I don't want to forget to mention that
/srv/mail-storage/ is an NFS share.
It would bee nice if someone has a hint. I hope it isn't a bug.
Regards Torsten
