Re: Verifying LDAP configuration from command line ?

2025-06-06 Thread John Fawcett via dovecot
On 05/06/2025 22:12, BuzzSaw Code via dovecot wrote: But for the life of me I can't find out how to test the configuration file without having to actually update my dovecot configuration to use it. I'm looking for something like the Postfix 'postmap' tool that I can provide my configuration fi

Re: LMTP error reading configuration

2024-10-11 Thread John Fawcett via dovecot
On 07/10/2024 05:08, DaLynX via dovecot wrote: Hello, I am getting the following error on my dovecot LMTP server, upon delivery from my postfix mailserver: Oct 6 03:31:09 m dovecot[36551]: lmtp: Fatal: Error reading configuration: read(/var/run/dovecot/config) failed: read(size=8192) faile

Re: last_login plugin does not update IP

2024-10-11 Thread John Fawcett via dovecot
On 30/09/2024 15:49, Maciej Polewczyński via dovecot wrote: When using the last_login plugin I noticed that the IP address information is not updated. If there is no entry in the sql database for a given user, the first time the login date and time information and the IP address will be saved.

Re: dovecot-2.3.2.1 and dovecot-pigeonhole-0.5.2 bug?

2024-08-12 Thread John Fawcett via dovecot
On 12/08/2024 19:06, skraw--- via dovecot wrote: As I already said, this setup is way too complex to think about an update. The cause of this problem cannot be a problem of the same size. If somebody (probably you or Stephan) already found the cause I could concentrate on backporting a soluti

Re: Userdb empty

2024-08-08 Thread John Fawcett via dovecot
On 05/08/2024 16:02, Cam Ellison via dovecot wrote: I have shifted from a system-based email system to virtual for a website I manage. The MTA is exim4, and user data are in a MySQL database. It will receive email, but with one exception the userdb is empty and emails go out with no usernam

Re: lda not sending email on sieve correctly

2024-08-08 Thread John Fawcett via dovecot
On 08/08/2024 10:15, Eduardo Diaz Rodriguez via dovecot wrote: Hi to all I was using dovecot like 15 years on multiples debian places, and I have the same issue on debian 12 and debian 11. on my configuration I use exim with 2 process to send email, and at the same time use mailscanner to sca

Re: Dovecot refuses to install/run on machine without IPv6

2024-08-06 Thread John Fawcett via dovecot
On 06/08/2024 21:08, Kurt Fitzner via dovecot wrote: Hi, I just tried to install Dovecot (version 2.3.19.1 9b53102964) on a Debian 12 server I'm building.  It failed because Dovecot's default listen address is explicitly "*, ::" and it appears to have no logic to determine if there actually

Re: username_filter settings in passdb

2024-08-05 Thread John Fawcett via dovecot
On 05/08/2024 10:00, zaxwat93--- via dovecot wrote: Thank you for explanation. Unfortunately it is better not to touch this script, so I will wait for the fix ___ dovecot mailing list --dovecot@dovecot.org To unsubscribe send an email todovecot-le...@

Re: username_filter settings in passdb

2024-08-04 Thread John Fawcett via dovecot
Hi in my opinion you found a bug. In the function passdb_preinit(..) in file src/auth/passdb.c the username_filters are copied from set->username_filter to passdb->username_filter. However that code only gets to be executed if this line returns NULL passdb = passdb_find(set->driver, set->arg

Re: Event Export (auth_request_finished)

2024-08-04 Thread John Fawcett via dovecot
On 04/08/2024 13:17, Serhii via dovecot wrote: I am trying to implement logging of all failed authentication attempts to catch bruteforce automatically. Currently, I have the following configuration: ... But for me it doesn't look like what is specified in docs[1]: Field | Description ---

Re: lmtp Fatal: setresgid Operation not permitted

2024-07-29 Thread John Fawcett via dovecot
On 28/07/2024 18:41, Rachel Roch via dovecot wrote: I am getting the following error when Postfix attempts LMTP delivery : "lmtp(REDACTED)<32674><7Jm0BSVopmaifwAAbW4UVQ>: Fatal: setresgid(121(mailbox_user),121(mailbox_user),8(mail)) failed with euid=111(mailbox_user): Operation not permitted

Re: dovecot-lda: timeout for external scripts called by sieve

2024-07-28 Thread John Fawcett via dovecot
On 27/07/2024 21:26, Meinhard Schneider via dovecot wrote: Hello, I have now adjusted the values accordingly: root@lnxmail01:~# doveconf | grep -A 13 ^plugin plugin {   sieve = file:~/sieve;active=~/.dovecot.sieve   sieve_execute_exec_timeout = 60s   sieve_extensions = +vnd.dovecot.filter +sp

Re: Sieve duplicate detection not working as expected

2024-07-26 Thread John Fawcett via dovecot
usernames. Do you think there might be any other workarounds to make the duplicate sieve extension work properly ? Thanks, Rosario Il 19/07/2024 22:37, John Fawcett via dovecot ha scritto: On 18/07/2024 15:37, Rosario Esposito via dovecot wrote: Hi, On a dovecot server (2.3.21) I have

Re: sieve mail date change

2024-07-23 Thread John Fawcett via dovecot
On 22/07/2024 21:03, Marc via dovecot wrote: I am a bit rookie with sieve. Some time ago I created a sieve pipe that would sometimes alter alter the subject and move a message to a different mailbox. Currently this results in that a date changes of this message while I don't see anything in t

Re: Sieve duplicate detection not working as expected

2024-07-19 Thread John Fawcett via dovecot
On 18/07/2024 15:37, Rosario Esposito via dovecot wrote: Hi, On a dovecot server (2.3.21) I have a simple sieve script: require ["duplicate"]; # rule:[duplicate] if duplicate {     discard;     stop; } I use virtual users with mail aliases on a LDAP backend. I have user "resposit" having 2

Re: doveadm: SSL handshake failed - wrong version number

2024-07-19 Thread John Fawcett via dovecot
On 18/07/2024 14:41, Rachel Roch via dovecot wrote: When attempting a doveadm backup, e.g. : doveadm -D backup -Ru user tcp:foo.example.com:12345 Hi Rachel maybe that should be with tcps doveadm -D backup -Ru user tcps:foo.example.com:12345 John __

Re: Invalid/Unmapped Key with Last Login Plugin

2024-07-18 Thread John Fawcett via dovecot
On 17/07/2024 23:35, Adam Miller via dovecot wrote: Yes, I did see that, thank you. If I did want to get this working globally, do you know what the issue is here and how to resolve it? I think it has something to do with my database table but I am not positive what the issue is. Here’s my dat

Re: Invalid/Unmapped Key with Last Login Plugin

2024-07-17 Thread John Fawcett via dovecot
On 17/07/2024 22:59, Adam Miller via dovecot wrote: Yikes, this is my bad! I AM using the LMTP service for delivery. What I meant was that I do not necessarily need to track the logins to the LMTP service. I suppose it wouldn’t hurt to track them though. Any idea why it would be throwing this

Re: Invalid/Unmapped Key with Last Login Plugin

2024-07-17 Thread John Fawcett via dovecot
On 17/07/2024 16:03, dovecot--- via dovecot wrote: Hello all! I have the last login plugin working with the IMAP service however with LMTP, it errors. I do not necessarily need / want the LMTP service and did not explicitly enable it but it is throwing an error in my logs. Jul 17 10:22:14 lmt

Re: Invalid/Unmapped Key with Last Login Plugin

2024-07-17 Thread John Fawcett via dovecot
On 17/07/2024 12:28, Adam Miller via dovecot wrote: OS: Ubuntu 22.04.1 Dovecot: 2.3.16 (7e2e900c1a) Hello all! I have the last login plugin working with the IMAP service however with LMTP, it errors. I do not necessarily need / want the LMTP service and did not explicitly enable it but it is

Re: dictionary with %d variable in sql stops insert and select domain part - dovecot 2.3.17+

2024-07-16 Thread John Fawcett via dovecot
On 16/07/2024 08:53, Mariusz Piasecki via dovecot wrote: Hi, unfortunately no :( In sql query instead of variable %d I get user UPDATE used_domain_quota SET bytes=bytes+4359,messages=messages+1 WHERE domain = 'h.u...@example.com'; and domain can receive emails when over quota. On 15.07.2

Re: doveadm auth lookup fails for system user

2024-07-15 Thread John Fawcett via dovecot
45:44 Debug: auth-master: passdb lookup(qno): Finished passdb lookup (user=qno ) passdb: qno   user  : qno Jul 15 19:45:44 Debug: auth-master: conn unix:/run/dovecot/auth-userdb (pid=2542,uid=0): Disconnected: Connection closed (fd=9) Am 13.07.2024 um 13:01 schrieb John Fawcett via d

Re: doveadm auth lookup fails for system user

2024-07-13 Thread John Fawcett via dovecot
On 12/07/2024 21:47, Christian H. Kuhn via dovecot wrote: Hi all, next step with my auth problem with dovecot. I want to authenticate a system user. The user exists, can log in, can sudo -i etc.pp. SASL with sql passdb and userdb works fine. root@bywater /etc/dovecot/conf.d # doveadm user q

Re: dovecot replication

2024-07-12 Thread John Fawcett via dovecot
On 12/07/2024 21:14, James Cook wrote: On Fri, Jul 12, 2024 at 06:28:13PM GMT, John Fawcett via dovecot wrote: Hi James I want to avoid the -1 parameter because it doesn't do deletes in the target. -l, not -1. Thanks I missed that - so locking can be done within Dovecot

Re: dovecot replication

2024-07-12 Thread John Fawcett via dovecot
On 12/07/2024 17:38, James Cook via dovecot wrote: Replication is in the current dovecot version but will go away in 2.4. The doveadm sync feature is staying. So with some work you can set it up what you are requesting. I used to use replication and now I'm thinking about using sync but hav

Re: dovecot replication

2024-07-12 Thread John Fawcett via dovecot
On 12/07/2024 13:05, Jeff Pang via dovecot wrote: Hello, Does the community version of dovecot have the replication feature? When one dovecot was down, another one could take over the tasks. Thanks. _ Jeff Replication is in t

Re: New Member Introduction

2024-07-10 Thread John Fawcett via dovecot
On 10/07/2024 07:37, Selena Thomas via dovecot wrote: Hi everyone, I am new to this forum and excited to be here. I'm interested in learning more about Dovecot and its features, and I'm eager to participate in the discussions here. Could someone please guide me on how to ask questions here ? W

Re: dovecot-lda: timeout for external scripts called by sieve

2024-07-10 Thread John Fawcett via dovecot
Corrected a typo in the previous message, should have read sieve_filter_exec_timeout and not sieve_pipe_exec_timeout On 10/07/2024 10:41, John Fawcett wrote: On 10/07/2024 09:40, John Fawcett via dovecot wrote: On 09/07/2024 09:02, Meinhard Schneider via dovecot wrote: Hello, I have

Re: dovecot-lda: timeout for external scripts called by sieve

2024-07-10 Thread John Fawcett via dovecot
On 10/07/2024 09:40, John Fawcett via dovecot wrote: On 09/07/2024 09:02, Meinhard Schneider via dovecot wrote: Hello, I have set both the values for "sieve_execute_exec_timeout" and "sieve_extension_exec_timeout" to 60 sec, but according to the log, this does no

Re: dovecot-lda: timeout for external scripts called by sieve

2024-07-10 Thread John Fawcett via dovecot
On 09/07/2024 09:02, Meinhard Schneider via dovecot wrote: Hello, I have a small problem with dovecot-lda. I am using Debian 12 Bookworm: root@lnxmail01:~# dovecot --version 2.3.13 (89f716dc2) Historically grown (probably still from sendmail times, long time ago) I always used procmail for

Re: Pread error over smb3

2024-07-06 Thread John Fawcett via dovecot
Hi Joan not sure what OS you're using, so just a guess: but maybe this is selinux related or something similar. When it's the OS providing the error code to dovecot, it's very unlikely to be anything in dovecot itself. On 06/07/2024 12:51, Joan Moreau via dovecot wrote: No error on the error

Re: dsync will be removed in 2.4 - why?

2024-07-05 Thread John Fawcett via dovecot
On 05/07/2024 11:51, Aki Tuomi via dovecot wrote: On 05/07/2024 12:34 EEST Oliver Krone via dovecot wrote: Hi there, I recently learned that dsync (mail replication) functionality will be removed in the upcoming releases of dovecot. What is the reason and will there be a replacement? How

Re: AW: AW: AW: AW: AW: IMAPSieve plugin will not run rspamd script

2024-07-04 Thread John Fawcett via dovecot
ve_global_extensions = +vnd.dovecot.pipe +vnd.dovecot.environment +vnd.dovecot.debug sieve_pipe_bin_dir = /usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666

Re: One-way synchronization with doveadm/TCP

2024-07-04 Thread John Fawcett via dovecot
On 04/07/2024 09:35, Дилян Палаузов via dovecot wrote: Hello, the replication procedure described at https://doc.dovecot.org/configuration_manual/replication/ suggests to open a server port 12345 on two systems, and then point each system to the other one. This creates bi-directional synchro

Re: AW: AW: AW: AW: AW: AW: IMAPSieve plugin will not run rspamd script

2024-07-03 Thread John Fawcett via dovecot
On 03/07/2024 20:53, postfix_dovecot--- via dovecot wrote: Hi John, again you're hitting the point! I put a "report-spam.sieve fired!" and "report-ham.sieve fired!" debug message in the scripts and monitored with "journalctl -u dovecot -f | grep fired". The APPEND event (move to junk) trigge

login_access_sockets

2024-07-03 Thread John Fawcett via dovecot
Hi I've used Dovecot for a long time but I never stop learning about the depth of features I've never used I just discovered the login_access_sockets setting when reading this page: https://doc.dovecot.org/admin_manual/login_processes/ The compilation using  --with-libwrap configure sett

Re: AW: AW: AW: AW: AW: IMAPSieve plugin will not run rspamd script

2024-07-02 Thread John Fawcett via dovecot
(Resending because of size limit exceeded on previous post) Hi Jens that looks much better, though not yet completely solved. What you're now getting is both rules firing when you move a message to Junk, whereas you only want the first one firing. I guess you will have no rules firing when yo

Re: AW: AW: AW: AW: IMAPSieve plugin will not run rspamd script

2024-07-02 Thread John Fawcett via dovecot
plugin code MOVE and COPY are treated almost the same, so my rule with COPY fire on MOVE too. In your case the event you're getting is APPEND, but none of your rules have that as a cause so won't match even if the mailbox matches. John On 02/07/2024 12:07, John Fawcett via dovecot wrote

Re: AW: AW: AW: AW: IMAPSieve plugin will not run rspamd script

2024-07-02 Thread John Fawcett via dovecot
usr/lib/dovecot/sieve sieve_plugins = sieve_imapsieve sieve_extprograms } protocols = imap lmtp sieve service auth { unix_listener /var/spool/postfix/private/auth { mode = 0666 } } service lmtp { inet_listener lmtp { address = 127.0.0.1 ::1 port = 24 } } ssl_cert = Von:

Re: AW: AW: AW: IMAPSieve plugin will not run rspamd script

2024-07-01 Thread John Fawcett via dovecot
On 01/07/2024 22:09, postfix_dovecot--- via dovecot wrote: Hi John, the prefix is ​​just a sign of my desperation - I tried all sorts of variations yesterday and now forgot to undo it. There’s a very detailed tutorial available (German language) with Debian 10. Just the sieve scrip

Re: Sieve Symlink Error

2024-07-01 Thread John Fawcett via dovecot
On 01/07/2024 03:32, Benjamin Rose via dovecot wrote: On 6/30/24 16:48, John Fawcett via dovecot wrote: On 30/06/2024 07:17, Benjamin Rose via dovecot wrote: Hello, I'm in the process of moving our mail server from RHEL 6 to RHEL 9. We will be moving to: # dovecot --version 2

Re: Sieve Symlink Error

2024-06-30 Thread John Fawcett via dovecot
On 30/06/2024 07:17, Benjamin Rose via dovecot wrote: Hello, I'm in the process of moving our mail server from RHEL 6 to RHEL 9. We will be moving to: # dovecot --version 2.3.16 (7e2e900c1a) My issue is that sieve does not appear to work on the new setup, where it does work on the old one.

Re: AW: IMAPSieve plugin will not run rspamd script

2024-06-30 Thread John Fawcett via dovecot
On 30/06/2024 19:57, postfix_dovecot--- via dovecot wrote: Tried it now in every known combination. Nothing changes. It's my 7th evening about this and I'm starting to despair :( Hi Jens any chance of posting the debugging from that  test in case it gives any clues. John

Re: IMAPSieve plugin will not run rspamd script

2024-06-29 Thread John Fawcett via dovecot
On 29/06/2024 10:08, postfix_dovecot--- via dovecot wrote: Host: VMware Workstation 14.1.8 OS: Debian 12 (Bookworm) Dovecot: 2.3.19.1 Postfix: 3.7.10 Mailclient: Outlook 2016 Hello, I am currently working on a new mail server to replace my Debian 10 mail server. For preparation, I use

Re: Debian Bookworm packages, please !

2024-06-27 Thread John Fawcett via dovecot
On 26/06/2024 20:48, pgnd via dovecot wrote: for anyone interested, for dovecot v2.3.14+ @ Fedora, https://src.fedoraproject.org/rpms/dovecot/blob/rawhide/f/dovecot-2.3.14-opensslv3.patch Until this discussion started I didn't realize that I've been using the unsupported version of op

Re: [Patch] blocklist access control for dovecot pop3/imap and pigeonhole managesieve

2024-06-09 Thread John Fawcett via dovecot
On 09/06/2024 18:39, Aki Tuomi via dovecot wrote: On 09/06/2024 16:50 EEST John Fawcett via dovecot wrote: The files themselves didn't make it through the list server. I'll try with .txt On 09/06/2024 15:42, John Fawcett via dovecot wrote: Hi Just in case this is useful more

Re: [Patch] blocklist access control for dovecot pop3/imap and pigeonhole managesieve

2024-06-09 Thread John Fawcett via dovecot
The files themselves didn't make it through the list server. I'll try with .txt On 09/06/2024 15:42, John Fawcett via dovecot wrote: Hi Just in case this is useful more generally, I'm posting it to the list. While Dovecot has an access control via allow_nets, it is a user

[Patch] blocklist access control for dovecot pop3/imap and pigeonhole managesieve

2024-06-09 Thread John Fawcett via dovecot
Hi Just in case this is useful more generally, I'm posting it to the list. While Dovecot has an access control via allow_nets, it is a user database field that applies only at the authentication stage to deny access for the specific user when there is a connection attempt from an unauthorized

Re: sasl database

2024-06-01 Thread John Fawcett via dovecot
On 01/06/2024 13:22, Jeff P via dovecot wrote: Hello, Is there a guide for using a customized SASL database for dovecot? for example, SQLite. Thanks in advance. ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-

Pigenohole bad commands limits and proposed minor patch

2024-06-01 Thread John Fawcett via dovecot
Hi I was looking into Pigeonhole behaviour in the case of managesieve receiving invalid input either before or after login. I can see that there are hard coded limits after 3 sequential bad commands prior to authentication and 20 after authentication. I was wondering if there is a reason for

Re: Pigeonhole Sieve only runs scripts if in users' home directories, or if Sieve is purposely broken

2024-05-15 Thread John Fawcett via dovecot
On 15/05/2024 18:27, Douglas Morse via dovecot wrote: My apologies, a small inaccuracy: Below where I mention .svbin files being created, I incorrectly described what is occurring. If the `sieve` is set to the default of users’ home directories etc., the file `.dovecot.svbin` is created in the

Re: post-login scripting

2024-01-17 Thread John Fawcett
On 18/01/2024 02:31, Alex wrote: Hi, I'm trying to determine the last login time for my IMAP users. Some systems use mbox while others are Maildir, but not sure that matters. I'd just like to touch a file similar to how it's done in this article, but it doesn't

Re: testing sieve/pigeonhole, auth errors

2024-01-16 Thread John Fawcett
On 15/01/2024 21:13, Joe Acquisto wrote: A small SOHO system, of installed perhaps a year.  Seems to be working and wished to add pigeonhole/sieve. Per Pigeonhole/sieve troubleshooting in the docs, set on mail_debug = yes and this is what I see, upon launching Thunderbird as the client.  Thought

Re: Virtual folder with custom flags

2024-01-15 Thread John Fawcett
On 15/01/2024 03:49, Kirill Korinsky wrote: Greetings, I can't figure out how doesn it possible to create a virtual folder which contains mails which has falgs: \Flagged or any customers flag. For example I do have a test mail: mx2$ doas doveadm fetch -u kir...@korins.ky "mailbox flags" mail

Quota clone plugin - initial population of data

2024-01-15 Thread John Fawcett
Hi while responding on a previous thread, I noticed in the documentation: https://doc.dovecot.org/configuration_manual/quota_clone_plugin/ "For example you might want to access everybody’s quota via Redis ... but you don’t store the Redis database permanently so it could become empty once in

Re: Custom map for quota

2024-01-14 Thread John Fawcett
On 15/01/2024 01:10, m87562...@gmail.com wrote: John Fawcett wrote: On 13/01/2024 14:01, Matt wrote: Hi, I'm trying to setup quota with the following layout CREATE TABLE "domain" (

Re: Custom map for quota

2024-01-14 Thread John Fawcett
On 13/01/2024 14:01, Matt wrote: Hi, I'm trying to setup quota with the following layout CREATE TABLE "domain" ( "id" INTEGER, "name" TEXT, "active" INTEGER DEFAULT 0, PRIMARY KEY("id"), UNIQUE("name") ) CREATE TABLE "address" ( "id" INTEGER, "localpart" TEXT NOT NULL, "domain_id" INTEGER NOT

dovecot@dovecot.org

2024-01-14 Thread John Fawcett
On 09/01/2024 19:00, Markus Doits via dovecot wrote: Am 03.01.24 um 10:14 schrieb Aki Tuomi: namespace {     prefix = _/     separator = /     location = virtual:~/Maildir/virtual:LAYOUT=maildir++:INDEX=~/Maildir/virtual } You should not store virtual folders inside Maildir (assuming this i

Re: Autocreate virtual users' home directory?

2024-01-04 Thread John Fawcett
On 04/01/2024 08:21, Aki Tuomi via dovecot wrote: On 03/01/2024 23:38 EET John Fawcett wrote: Hi I have recently rectified an old configuration error whereby I had virtual users' home and mail directories set to the same value. I used option 3 from "ways to set up home direct

Autocreate virtual users' home directory?

2024-01-03 Thread John Fawcett
Hi I have recently rectified an old configuration error whereby I had virtual users' home and mail directories set to the same value. I used option 3 from "ways to set up home directory" https://doc.dovecot.org/configuration_manual/ home_directories_for_virtual_users/ so I have: home= /var/vmail/do

Re: Solr/Tika patches for dovecot 2.3.21

2024-01-03 Thread John Fawcett
On 03/01/2024 10:16, Aki Tuomi via dovecot wrote: On 09/12/2023 15:02 EET John Fawcett wrote: Hi I've just made updated versions of 3 patches against the latest release 2.3.21 in case they are useful to someone or might get considered for official inclusion.

Re: Certificate of the documentation site (https://doc.dovecot.org/)

2024-01-02 Thread John Fawcett
On 02/01/2024 10:55, gileh13242--- via dovecot wrote: Hey ! Your certificate expired today, I can't access it because of my business proxy :). [No Error] (TLS code: X509_V_ERR_CERT_HAS_EXPIRED) SSL Certificate expired on: Jan 2 06:31:02 2024 GMT Maybe you have the old certificate cached som

Solr/Tika patches for dovecot 2.3.21

2023-12-09 Thread John Fawcett
Hi I've just made updated versions of 3 patches against the latest release 2.3.21 in case they are useful to someone or might get considered for official inclusion. John dovecot-2.3.21-tika-http-auth.patch Allows specification of username and password in the fts_tika setting for basic auth against

Re: Username used by dovecot to access database certificate and key files

2023-12-08 Thread John Fawcett
On 08/12/2023 14:18, Aki Tuomi via dovecot wrote: The group depends on process, usually dovecot uses four different identities: root, dovecot:dovecot, dovenull:dovenull and vmail:vmail (or per-user identity). Any extra groups are removed during execution, but if you want, you can use https:

Username used by dovecot to access database certificate and key files

2023-12-08 Thread John Fawcett
Hi does anyone happen to know the username under which dovecot accesses the certificate and key files when connecting to a mariadb database with ssl? I can't seem to get dovecot to read the files without a "other" readable bit set. I have dovecot users in mysql with the following connect str

Re: source code doesn't compile

2022-01-12 Thread John Fawcett
On 12/01/2022 04:19, Ruben Safir wrote: I downloaded the dovecot source and it doesn't compile. The install script fails in auth because it makes a file and then tries to make a directory over it make[2]: Entering directory '/home/ruben/src/dovecot-2.3.17.1/src/auth' make[3]: Entering directory

Patch: enhancements for solr/tika integration

2022-01-08 Thread John Fawcett
Hi here's a patch with some enhancements that I am applying locally for solr/tika integration. Hopefully this can be considered for inclusion. I've tested up to 2.3.16 and this patch applies against latest version 2.3.17.1. The contents are: 1. Allow username and password in tika configurati

Patch: safeguard against too large value for uid being sent to solr for single mailbox searches

2022-01-08 Thread John Fawcett
Hi I'm reposting a patch for solr integration which I have been applying locally. It applies against 2.3.17.1. Dovecot already has a mechanism when doing solr fts searches on multiple mailboxes that prevents a too large value for maximum rows being sent to solr. #define SOLR_MAX_MULTI_ROWS

Patch: assertion failed in doveadm fts lookup

2022-01-08 Thread John Fawcett
Hi I'm reposting this patch, which I have been applying locally since I originally posted it. Hopefully it can be considered for inclusion in the official release. It was tested on dovecot 2.3.16 but applies against the latest version 2.3.17.1. This is the "assertion failed" that it addresse

Re: banning, was Re: Non-user logins?

2022-01-08 Thread John Fawcett
On 08/01/2022 17:22, Dave McGuire wrote: On 1/8/22 8:57 AM, John Fawcett wrote: yes, blocking on the first wrong password sounds like overkill. But it does depend on user base. For a small mail server with few known users it could be workable.   It may be overkill for your network, but it&#

Re: Non-user logins?

2022-01-08 Thread John Fawcett
On 08/01/2022 14:26, dc...@dvl.werbittewas.de wrote: Am 08.01.22 um 05:27 schrieb Dave McGuire: trying to mess with other peoples' stuff.  I run fail2ban to catch those log entries and block the source IP address for a month on the first failed login.  At any one time I have between 12,000 and

Re: TLS connection closed unexpectedly

2022-01-07 Thread John Fawcett
On 07/01/2022 21:03, Ken Wright wrote: On Fri, 2022-01-07 at 18:50 +0100, John Fawcett wrote: it may or may not be related to the tls issue, but I think you will want to investigate that message about the SQL query syntax error. You are not going to be able to login if the query is giving

Re: TLS connection closed unexpectedly

2022-01-07 Thread John Fawcett
On 07/01/2022 18:31, Ken Wright wrote: On Fri, 2022-01-07 at 10:02 +0100, Christian Kivalo wrote: On January 7, 2022 9:51:20 AM GMT+01:00, Ken Wright wrote: I reinstalled Dovecot this evening, because I haven't been able to receive emails recently.  After configuring and adjusting for the use

Re: GDPR/sender-ip (was: make received-header on submission optional or at least drop the ip in it)

2022-01-07 Thread John Fawcett
On 07/01/2022 14:01, Sam Kuper wrote: You say you cannot see it, but I gave an example below, in my previous email: Secondly, a person sending an email to a mailing list might very well consent for the mailing list's recipients to receive the content, subject, and reply address of that email

Re: Doveadm auth test fails

2022-01-05 Thread John Fawcett
On 06/01/2022 04:20, Ken Wright wrote: On Thu, 2022-01-06 at 03:44 +0100, John Fawcett wrote: On 06/01/2022 01:16, Ken Wright wrote: I've been having trouble logging into my email server (postfix 3.4.13, dovecot 2.3.7.2, postfixadmin 3.3.8).  I decided to try the doveadm auth test, and go

Re: Doveadm auth test fails

2022-01-05 Thread John Fawcett
On 06/01/2022 01:16, Ken Wright wrote: I've been having trouble logging into my email server (postfix 3.4.13, dovecot 2.3.7.2, postfixadmin 3.3.8). I decided to try the doveadm auth test, and got the following result: kwright@grace:~$ sudo doveadm auth test m...@mydomain.com Password: passdb: m

Re: GDPR/sender-ip (was: make received-header on submission optional or at least drop the ip in it)

2022-01-05 Thread John Fawcett
On 05/01/2022 18:36, Sam Kuper wrote: On Wed, Jan 05, 2022 at 06:00:31PM +0100, John Fawcett wrote: my understanding of the GDPR legislation is that it defines what is considered lawful processing. One of those items that makes the processing lawful is consent. Not necessarily. An action that

Re: GDPR/sender-ip

2022-01-05 Thread John Fawcett
On 05/01/2022 18:27, dc...@dvl.werbittewas.de wrote: Am 05.01.22 um 18:00 schrieb John Fawcett: my understanding of the GDPR legislation is that it defines what is considered lawful processing. One of those items that makes the processing lawful is consent. If I send an email to a public

Re: GDPR/sender-ip (was: make received-header on submission optional or at least drop the ip in it)

2022-01-05 Thread John Fawcett
On 05/01/2022 17:44, Marc wrote: Where people are sending email to public mailing lists, there is no presumption of privacy. I think the legislation is like this: the privacy is legislation is always applicable, there are no conditions under which there is 'no presumption of privacy' Marc

Re: GDPR/sender-ip (was: make received-header on submission optional or at least drop the ip in it)

2022-01-05 Thread John Fawcett
On 05/01/2022 14:41, dc...@dvl.werbittewas.de wrote: Am 04.01.22 um 08:39 schrieb Aki Tuomi: We'll take a look at your patch. Can you please point out to some legal information about the Received header's GDPR incompliance, I would be interested to see it. thanks for doing so. the GDPR sa

Re: Error: fts_solr: received invalid uid (John Fawcett)

2022-01-02 Thread John Fawcett
On 03/01/2022 01:18, oliver.kr...@snoog.ch wrote: Hi John, You are right this was not a dovecot solr query. It is really strange everything seems to work with Dovecot 2.3.4. E.g. search and  rebuilding index from scratch using doveadm. As soon as I use version  2.3.13 things are getting wild:

Re: Error: fts_solr: received invalid uid

2022-01-02 Thread John Fawcett
On 02/01/2022 12:13, oliver.kr...@snoog.ch wrote: Here is what solr sends to dovecot, the offending uid in this exmaple is '21' {   "responseHeader":{     "status":0,     "QTime":1,     "params":{   "q":"body:Zeitserver"}},   "response":{"numFound":1,"start":0,"numFoundExact":true,"docs":[  

Re: Error: fts_solr: received invalid uid

2021-12-31 Thread John Fawcett
On 30/12/2021 19:14, oliver.kr...@snoog.ch wrote: I'm using dovecot 2.3.13,  solr 8.x. and roundcube 1.5.1. However when I do a search I get the the Error: fts_solr: received invalid uid, search results are ok. Thanks Presumably one of the uid returned from solr could not be decoded (i.e.

Re: Can dovecot be leveraged to exploit Solr/Log4shell?

2021-12-15 Thread John Fawcett
On 15/12/2021 08:52, Aki Tuomi wrote: The suggested configuration is good, and although we did some checking to ensure that dovecot escapes the search queries and usernames sent to solr, so it is not trivial to send the JNDI expansion strings to be logged by solr, it is still good idea to set

Re: Can dovecot be leveraged to exploit Solr/Log4shell?

2021-12-14 Thread John Fawcett
On 14/12/2021 03:23, Scott wrote: Is this assuming you log at some verbose level ? What if you log at WARN or higher ? For production it seems kind of silly to log search queries anyways. Scott It's a pretty much standard install where most things are at INFO level. Probably could turn it d

Re: Can dovecot be leveraged to exploit Solr/Log4shell?

2021-12-13 Thread John Fawcett
On 13/12/2021 23:43, Joseph Tam wrote: I'm surprised I haven't seen this mentioned yet. An internet red alert went out Friday on a new zero-day exploit. It is an input validation problem where Java's Log4j module can be instructed via a specially crafted string to fetch and execute code from a

Re: Incorrect value sent to solr

2021-04-08 Thread John Fawcett
On 08/04/2021 08:02, Aki Tuomi wrote: > Hi! > Thanks for reminding us, I'll make a ticket about this to avoid forgetting it > again. > > Aki Thanks to you and the team for taking it into consideration! PS is this list the best way to post patch proposals or is it easier for you to get code from

Re: Incorrect value sent to solr

2021-04-07 Thread John Fawcett
On 07/04/2021 13:36, Łukasz Szczepański wrote: > I'm not as familiar with C, but I don't see in solr backed in dovecot > any  clue of subsequent queries for single mailbox lookup (which most > mail client uses). There is a hard limit of 10 rows for multiple > mailbox lookup. This was reported

Re: fts_encoder

2021-02-11 Thread John Fawcett
On 11/02/2021 14:25, Joan Moreau wrote: > > Hello > > Checking further, and putting logs a bit every where in the dovecot > code, the core is sending FIRST the initial document (not decoded) > then SECOND the decoded version > > Thisi is really weird, and the indexer then indexes a lot of binary cr

Re: fts_encoder

2021-02-09 Thread John Fawcett
On 09/02/2021 15:33, Joan Moreau wrote: > > If I place the following code in the plugin > fts_backend_xxx_update_build_more function (lucene, squat and xapian, > as solr refuses to work properly on my setup) > >         { >                 char * s = i_strdup("EMPTY"); >                 if(data !=

Re: fts_encoder

2021-02-09 Thread John Fawcett
On 08/02/2021 23:05, Stuart Henderson wrote: > On 2021/02/08 21:33, Joan Moreau wrote: >> Yes , once again : output of the decoder is fine, I also put log inide the >> dovecot core to >> check whether data is properly transmitted, and result is that it is (i.e. >> dovecot core >> receives the pro

Re: fts_encoder

2021-02-08 Thread John Fawcett
On 08/02/2021 21:35, Joan Moreau wrote: > > Well, in the function xxx_build_more of FTS plugin, the data received > in the original PDF, not the output of pdftotext > > Can you clarify where do you put your log in the solr plugin , so I > can check the situation in the xapian plugin ? > I used the

Re: Getting panic in http-client-request.c: line 1240 during indexing on Ubuntu 20.04

2021-02-08 Thread John Fawcett
On 08/02/2021 18:40, deano-dove...@areyes.com wrote: > > On 2021-02-07 7:32 pm, John Fawcett wrote: > >> On 07/02/2021 20:15, @lbutlr wrote: >>> On 07 Feb 2021, at 02:07, @lbutlr >> <mailto:krem...@kreme.com>> wrote: >>>> On 06 Feb 2021, at

Re: fts_encoder

2021-02-08 Thread John Fawcett
On 08/02/2021 15:22, Joan Moreau wrote: > > Well, thank you for the answer, but the actual issue is that data sent > by the decoder (stipulated in the conf file) is properly collected by > dovecot core, but /not/ sent to the plugin : the plugin receives the > original data. > > This is not linke

Re: fts_encoder

2021-02-07 Thread John Fawcett
On 07/02/2021 18:51, Joan Moreau wrote: > > more info : the function fts_parser_script_more in > plugins/fts/fts-parser.c properly read the output of the script > > still, the data is not sent to the FTS pligins (xapian or any other) > > > > On 2021-02-07 17:37, Joan Moreau wrote: > >> more info :

Re: Getting panic in http-client-request.c: line 1240 during indexing on Ubuntu 20.04

2021-02-07 Thread John Fawcett
On 07/02/2021 20:15, @lbutlr wrote: > On 07 Feb 2021, at 02:07, @lbutlr wrote: >> On 06 Feb 2021, at 11:06, John Fawcett wrote: >>> 19.08.20 >> Is that a malformed ISO date 2019-08-20 or a truncated europeans style >> 19-08-2020? > Either way, I cannot find

Re: Getting panic in http-client-request.c: line 1240 during indexing on Ubuntu 20.04

2021-02-06 Thread John Fawcett
On 05/02/2021 15:04, Dean Carpenter wrote: > > Is there anything I can do here ?  This makes Tika unusable :(  That > really sucks because we have a *lot* of attachments. > > Thanks - > > On 2021-02-03 2:07 pm, Dean Carpenter wrote: > >> Just noticed this in the logs >> >> doveadm(har...@exampl

Re: [BUG REPORT] In some cases dovecot sends (huge) binary data to solr for indexing

2021-01-21 Thread John Fawcett
t; <https://filebin.ca/5oy6yqLSCr3H/rawlog.obfuscated.txt> > > (Both files were processed with perl doveadm-obfuscate.pl > <https://www.dovecot.org/tools/doveadm-obfuscate.pl>; the script > doesn’t replace non-latin characters so they were replaced with ‘R’ > manually) > > Wo

Re: fts_solr: Indexing failed (fails on particular messages/mailboxes by timeout)

2021-01-16 Thread John Fawcett
On 15/01/2021 11:39, Alexey Panov wrote: > I guess I was indeed correct. As message body is the part of mail > index dovecot indeed sends all those binary messages as a part of > message body: > >> doveadm fetch -u test.u...@interpont.com >> "body" mailbox KS2 uid 2

Re: Solr and FTS - assertion failure [proposed patch for upper bound on rows in solr search]

2020-12-31 Thread John Fawcett
On 30/12/2020 16:04, Antonino Esposito wrote: > Hi, > > in the latest weeks i'm working on the Solr integration and > immediately i've faced the assertion failure errors, on 2.0.19, 2.2.9 > and 2.3.11.3 servers in our network. > Reading the thread on debian ML, I realize this issue is related to >

  1   2   3   >