Re: [EXT] Re: ZLIB/ZSTD Compressed MBOX in Maildir++ layout

2021-06-28 Thread Josef 'Jeff' Sipek
see if your storage system can do compression. For example, I have dovecot store all mail uncompressed but have zfs transparently compress everything with lz4. (Maybe one day I'll switch it to zstd.) Jeff. > > Regards. > > On 6/28/21 13:42, Josef 'Jeff' Sipek wrot

Re: ZLIB/ZSTD Compressed MBOX in Maildir++ layout

2021-06-28 Thread Josef 'Jeff' Sipek
l vmail 853M Jun 25 17:25 mBoX-MeSsAgEs.zstd > What am I doing wrong? Hm. It is possible that it just doesn't work. mbox doesn't get a lot of attention these days - its support is more of a migration tool. Out of curiosity, why do you use mbox? In your earlier email you said that

Re: ZLIB/ZSTD Compressed MBOX in Maildir++ layout

2021-06-24 Thread Josef 'Jeff' Sipek
On Thu, Jun 24, 2021 at 10:35:24 +0100, Pedro Ribeiro wrote: > Hello everyone! > > Our archive namespace is kept in MBOX format with Maildir++ layout due to: > > * Need to have the email from all users/folders self contained (our > base namespace uses MDBOX with single instance storage of a

Re: Maildir to Mdbox and folder structure after the conversion

2021-06-10 Thread Josef 'Jeff' Sipek
On Wed, Jun 09, 2021 at 15:36:22 +, Marco Usai wrote: >Il mercoledì 9 giugno 2021, 13:37:51 CEST, Aki Tuomi > ha scritto: > > Maildir and mdbox have different directory structure. You cannot get them to > be identical. > > Aki > Yes I know, but the directory structure of the two paste

Re: Separating Dovecot and Postfix

2021-05-14 Thread Josef 'Jeff' Sipek
On Fri, May 14, 2021 at 12:37:15 +, White, Daniel E. (GSFC-770.0)[NICS] wrote: > I am struggling to update a very old set of mail servers. > Some are supposed to be relays (MTAs by my understanding) while others are > where the mailboxes live (MDA) > > In rebuilding the MDA servers, is postfi

Re: json_parse_number broken by compiler optimization

2021-04-01 Thread Josef 'Jeff' Sipek
On Wed, Mar 31, 2021 at 11:26:14 -0400, Josef 'Jeff' Sipek wrote: > On Wed, Mar 31, 2021 at 09:07:28 +0200, Christian Ehrhardt wrote: > > On Wed, Mar 31, 2021 at 8:46 AM Christian Ehrhardt > > wrote: > > > On Tue, Mar 30, 2021 at 9:21 PM Josef 'Jeff&

Re: json_parse_number broken by compiler optimization

2021-03-31 Thread Josef 'Jeff' Sipek
On Wed, Mar 31, 2021 at 09:07:28 +0200, Christian Ehrhardt wrote: > On Wed, Mar 31, 2021 at 8:46 AM Christian Ehrhardt > wrote: > > On Tue, Mar 30, 2021 at 9:21 PM Josef 'Jeff' Sipek > > wrote: ... > > > The culprit seems to be LTO. If you disable LTO, e

Re: json_parse_number broken by compiler optimization

2021-03-30 Thread Josef 'Jeff' Sipek
On Tue, Mar 30, 2021 at 13:34:54 -0400, Josef 'Jeff' Sipek wrote: > On Tue, Mar 30, 2021 at 17:53:27 +0200, Christian Ehrhardt wrote: > > Hi, > > the recent Ubuntu (re)builds uncovered an issue with dovecot > > 1:2.3.13+dfsg1-1 > > build log: > &g

Re: json_parse_number broken by compiler optimization

2021-03-30 Thread Josef 'Jeff' Sipek
On Tue, Mar 30, 2021 at 17:53:27 +0200, Christian Ehrhardt wrote: > Hi, > the recent Ubuntu (re)builds uncovered an issue with dovecot 1:2.3.13+dfsg1-1 > build log: > https://launchpadlibrarian.net/529849650/buildlog_ubuntu-hirsute-amd64.dovecot_1%3A2.3.13+dfsg1-1build1_BUILDING.txt.gz > A coworke

Re: Authentication segfault with Dovecot 2.3.13

2021-01-06 Thread Josef 'Jeff' Sipek
On Wed, Jan 06, 2021 at 14:07:06 -0500, Josef 'Jeff' Sipek wrote: > Ok, just a quick update. I managed to reproduce it. I'll try to figure out > where things went wrong. Two more questions: (1) Why are you using a UNION in your SQL statement? (2) Does the crash still hap

Re: Authentication segfault with Dovecot 2.3.13

2021-01-06 Thread Josef 'Jeff' Sipek
Ok, just a quick update. I managed to reproduce it. I'll try to figure out where things went wrong. Thanks, Jeff. On Wed, Jan 06, 2021 at 18:22:03 +0100, Harald Leithner wrote: > Hi > > Am 06.01.2021 um 18:08 schrieb Josef 'Jeff' Sipek: > > On Wed, Jan 06,

Re: Authentication segfault with Dovecot 2.3.13

2021-01-06 Thread Josef 'Jeff' Sipek
On Wed, Jan 06, 2021 at 17:13:05 +0100, Harald Leithner wrote: > Hi, > > we have a problem upgrading Dovecot from 2.2 to 2.3.13 on one server it > seems one user triggers a segfault while trying to authenticate. > > The user works fine with 2.2.36.4, our last update try mid-late 2020 was > abor

Re: [EXT] Re: Indexer error after upgrade to 2.3.11.3

2020-09-02 Thread Josef 'Jeff' Sipek
ll' in gdb on the core file)? Jeff. > On Wednesday, 02/09/2020 at 15:34 Josef 'Jeff' Sipek wrote: > > > On Wed, Sep 02, 2020 at 15:07:37 -0400, Scott Q. wrote: > > Sorry to bump up an old thread. > > > > 2.3.11.3 already contains this patch and the err

Re: [EXT] Re: Metric label values truncated when using OpenMetrics endpoint

2020-09-02 Thread Josef 'Jeff' Sipek
On Thu, Aug 27, 2020 at 02:04:20 +, Daan van Gorkum wrote: > Hi Jeff, > > Thanks again for your insights. I understand that a lot of features are > pending and it's totally fine, we're just very eager to use all these > features. I completely forgot that the work to add those fields was done

Re: Indexer error after upgrade to 2.3.11.3

2020-09-02 Thread Josef 'Jeff' Sipek
7;t in the 2.3.11.3 tarball. It isn't even on master. Those two files haven't been touched since January. Jeff. > Anything else we could try ? > > Scott > > On Wednesday, 19/08/2020 at 11:37 Josef 'Jeff' Sipek wrote: > > > On Wed, Aug 19, 2020 at 1

Re: Metric label values truncated when using OpenMetrics endpoint

2020-08-26 Thread Josef 'Jeff' Sipek
On Tue, Aug 25, 2020 at 01:08:06 +, Daan van Gorkum wrote: > Hi Jeff, > > Thanks for your reply! > > Regarding grouping by remote address, I understand and for now I'll keep a > close eye. Maybe it's an option to group by /24 for ipv4 and /64 for IPv6? Hrm, interesting idea. But the answer

Re: unsupported auth mechanism

2020-08-24 Thread Josef 'Jeff' Sipek
On Mon, Aug 24, 2020 at 17:11:04 +0200, absolutely_f...@libero.it wrote: > Hi, > > last friday I upgraded from dovecot-2.3.10.1_2 to dovecot-2.3.11.3 (FreeBSD). > > Since then, I started having some issues with some customers. > > The log I see is like: > > pop3-login: Disconnected (tried to us

Re: Metric label values truncated when using OpenMetrics endpoint

2020-08-24 Thread Josef 'Jeff' Sipek
On Sat, Aug 22, 2020 at 00:31:36 +, Daan van Gorkum wrote: > Hi, > > Recently we upgraded to Dovecot 2.3.11.3 and configured an example metric > like this: > > > metric imap_command { > event_name = imap_command_finished > group_by = cmd_name tagged_reply_state user remote_ip Grouping b

Re: /usr/include/dovecot/str.h

2020-08-20 Thread Josef 'Jeff' Sipek
On Wed, Aug 19, 2020 at 15:59:59 +0200, Marc Roos wrote: > > > > FYI, I am building on alpine 3.10 and 3.11 I am getting this build[1] > error. That's the header file. Where is it getting included from? Is it C++ by any chance? > I think these header files of dovecot are not correct. Or ar

Re: Indexer error after upgrade to 2.3.11.3

2020-08-19 Thread Josef 'Jeff' Sipek
On Wed, Aug 19, 2020 at 17:03:57 +0200, Alessio Cecchi wrote: > Hi, > > after the upgrade to Dovecot 2.3.11.3, from 2.3.10.1, I see frequently > these errors from different users: It looks like this has been around for a while and you just got unlucky and started seeing this now. Here's a quick

Re: Doveadm error since 2.3.11.3 when run as unprivileged user

2020-08-13 Thread Josef 'Jeff' Sipek
On Thu, Aug 13, 2020 at 21:16:42 +0200, Arjen de Korte wrote: > Citeren Timo Sirainen : > > !include_try ssl-keys.conf > > That will only work to include an optional configuration file and > suppress errors if it doesn't exist. I put > > ssl_key = > in a separate configuration file and it fai

Re: To field was not correct indexed by FTS

2020-07-21 Thread Josef 'Jeff' Sipek
Original Message ----- > > On Mon, Jul 20, 2020 at 09:43:12 -0400, Josef 'Jeff' Sipek wrote: > > > On Mon, Jul 20, 2020 at 20:24:13 +0900, TACHIBANA Masashi wrote: > > ... > > > Thanks for the report. I reproduced it locally, but I'm not sure wh

Re: To field was not correct indexed by FTS

2020-07-20 Thread Josef 'Jeff' Sipek
On Mon, Jul 20, 2020 at 09:43:12 -0400, Josef 'Jeff' Sipek wrote: > On Mon, Jul 20, 2020 at 20:24:13 +0900, TACHIBANA Masashi wrote: ... > Thanks for the report. I reproduced it locally, but I'm not sure what is > causing it yet. Alright, it is actually a parsing bug.

Re: To field was not correct indexed by FTS

2020-07-20 Thread Josef 'Jeff' Sipek
On Mon, Jul 20, 2020 at 20:24:13 +0900, TACHIBANA Masashi wrote: > Hi, > > I'm Tachibana. > Additionally, I found below: > > dovecot/src/plugins/fts/fts-build-mail.c: > > 187 i_debug("@ befor address > parse:%s",hdr->full_value); > 188 > 189 addr

Re: How to use dovecot only as POP3 server / prevent it from creating .imap directories?

2020-06-17 Thread Josef 'Jeff' Sipek
On Tue, Jun 09, 2020 at 12:32:18 +0200, Binarus wrote: ... > ./mail/inbox > ./mail/.imap > ./mail/.imap/dovecot-uidvalidity > ./mail/.imap/dovecot.list.index.log > ./mail/.imap/dovecot-uidvalidity.5edce848 > ./mail/.imap/INBOX > ./mail/.imap/INBOX/dovecot.index.log > ./mail/.imap/INBOX/dovecot.inde

Re: Dovecot 2.3.9 fails on FreeBSD

2019-12-04 Thread Josef 'Jeff' Sipek via dovecot
On Wed, Dec 04, 2019 at 18:41:45 +0100, Pascal Christen wrote: > Thanks, build passed on FreeBSD 11.3 It turns out I had a typo in the patch I posted on the mailing list. I corrected the typo and it builds fine on 12.1. Jeff. -#ifdef EAI_ADDRFAIMILY /* Obsoleted by RFC 2553bis-02 */

Re: Dovecot 2.3.9 fails on FreeBSD

2019-12-04 Thread Josef 'Jeff' Sipek via dovecot
On Wed, Dec 04, 2019 at 12:19:35 -0500, Josef 'Jeff' Sipek via dovecot wrote: > On Wed, Dec 04, 2019 at 18:06:58 +0100, Pascal Christen via dovecot wrote: > > Hi > > > > I've just tried to build the latest Dovecot 2.3.9 on FreeBSD 11.3. > > Without succes

Re: Dovecot 2.3.9 fails on FreeBSD

2019-12-04 Thread Josef 'Jeff' Sipek via dovecot
On Wed, Dec 04, 2019 at 18:06:58 +0100, Pascal Christen via dovecot wrote: > Hi > > I've just tried to build the latest Dovecot 2.3.9 on FreeBSD 11.3. > Without success...It fails on the following commit which was introduced > in 2.3.9: > https://github.com/dovecot/core/commit/c85f1bc3ce612c736c9d

Re: rsync sdbox, no new mails?

2019-04-15 Thread Josef 'Jeff' Sipek via dovecot
On Mon, Apr 15, 2019 at 14:45:31 +0200, Jakob Curdes via dovecot wrote: > Hello, I had to restore a mailserver from a backup to replace a system > with problems that is still live. I did a 1:1 restore as far as possible > from a backup, then rsynced the /var/vmail/ directory, where we have all >

Re: FTS delays

2019-04-15 Thread Josef 'Jeff' Sipek via dovecot
ck to you > > > > For the point 4, this is random. FTS backend (xapian, lucene, solr, > > whatever..) returns X, then dovecot core choose to select only Y emails. > > THis is a clear bug. > > > > On 2019-04-05 20:08, Josef 'Jeff' Sipek via dovecot wr

Re: FTS delays

2019-04-05 Thread Josef 'Jeff' Sipek via dovecot
er search usually does not care > about fts plugin (even with fts_enforced) and rely on some internal > search , which si total non-sense You're right, that doesn't seem to make sense. Can you provide a test case? Jeff. > Let me know how can I help on thos 4 points >

Re: FTS delays

2019-04-05 Thread Josef 'Jeff' Sipek via dovecot
s-xapian) Ok, good to know. > 2 - the body/text loop has appeared recently (maybe during the month of > March) Our testing doesn't seem to be able to reproduce this. Can you try to git-bisect this to find which commit broke it? Thanks, Jeff. > > On 2019-04-05 16:36, Josef

Re: FTS delays

2019-04-05 Thread Josef 'Jeff' Sipek via dovecot
On Wed, Apr 03, 2019 at 19:02:52 +0800, Joan Moreau via dovecot wrote: > issue seems in the Git version : Which git revision? Before you updated to the broken revision, which revision/version were you running? Can you try it with 5f6e39c50ec79ba8847b2fdb571a9152c71cd1b6 (the commit just before

Re: v2.3.3 rc1 - Error: sieve: !!BUG!!: Binary compiled from dovecot.sieve is still corrupt

2018-09-27 Thread Josef 'Jeff' Sipek
On Thu, Sep 27, 2018 at 10:42:16 +0100, James wrote: > On 25/09/2018 22:39, Stephan Bosch wrote: > > > Something mightily weird is going on at your end. It doesn't fail here > > (see below). First of all, what is your configuration (output from > > `dovecot -n`)? > > You have dovecot.conf but...

Re: murmurhash3 test failures on big-endian systems

2018-03-28 Thread Josef 'Jeff' Sipek
On Tue, Mar 27, 2018 at 08:46:20 -0400, Josef 'Jeff' Sipek wrote: > On Tue, Mar 27, 2018 at 13:15:31 +0300, Apollon Oikonomopoulos wrote: > > On 13:05 Tue 27 Mar , Apollon Oikonomopoulos wrote: > > > On 11:31 Tue 27 Mar , Apollon Oikonomopoulos wrote: > >

Re: murmurhash3 test failures on big-endian systems

2018-03-27 Thread Josef 'Jeff' Sipek
On Tue, Mar 27, 2018 at 13:15:31 +0300, Apollon Oikonomopoulos wrote: > On 13:05 Tue 27 Mar , Apollon Oikonomopoulos wrote: > > On 11:31 Tue 27 Mar , Apollon Oikonomopoulos wrote: > > It turns out there's a missing byte-inversion when loading the blocks > > which should be addressed in get

Re: murmurhash3 test failures on big-endian systems

2018-03-26 Thread Josef 'Jeff' Sipek
On Mon, Mar 26, 2018 at 15:57:01 +0300, Apollon Oikonomopoulos wrote: ... > I'd be happy to test the patch, thanks! Ok, try the attached patch. (It is a first pass at the issue, so it may not be the final diff that'll end up getting committed. It'd be good to know if it actually fixes the issue

Re: Panic: data stack: Out of memory when allocating bytes

2018-02-22 Thread Josef 'Jeff' Sipek
highlight=(vsz_limit)#Service_limits [2] https://wiki2.dovecot.org/Dictionary > Am 25.01.2018 um 16:24 schrieb Thomas Robers: > > Hi, > > > > Am 24.01.2018 um 23:39 schrieb Josef 'Jeff' Sipek: > > > It looks like the binaries are stripped.  There should be a

Re: Auth SEGV on sparc64, alignment problem?

2018-02-22 Thread Josef 'Jeff' Sipek
On Tue, Feb 20, 2018 at 19:08:27 -0500, Chris Ross wrote: > > Apologies first for using two addresses, but I can’t currently read my > email at distal.com. :-) > > I was previously running dovecot2-2.2.29.1_2 on FreeBSD 11 on sparc64. > Trying to debug a problem I was having with one of m

Re: Panic: data stack: Out of memory when allocating bytes

2018-01-24 Thread Josef 'Jeff' Sipek
On Wed, Jan 24, 2018 at 18:55:47 +0100, Thomas Robers wrote: > Am 23.01.2018 um 20:07 schrieb Josef 'Jeff' Sipek: > > On Tue, Jan 23, 2018 at 14:03:27 -0500, Josef 'Jeff' Sipek wrote: > > > On Tue, Jan 23, 2018 at 18:21:38 +0100, Thomas Robers wrote: ... >

Re: Panic: data stack: Out of memory when allocating bytes

2018-01-23 Thread Josef 'Jeff' Sipek
On Tue, Jan 23, 2018 at 14:03:27 -0500, Josef 'Jeff' Sipek wrote: > On Tue, Jan 23, 2018 at 18:21:38 +0100, Thomas Robers wrote: > > Hello, > > > > I'm using Dovecot 2.3 and sometimes i get this: > > > > --- snip --- > > Jan 23 14:23:13 mai

Re: Panic: data stack: Out of memory when allocating bytes

2018-01-23 Thread Josef 'Jeff' Sipek
On Tue, Jan 23, 2018 at 18:21:38 +0100, Thomas Robers wrote: > Hello, > > I'm using Dovecot 2.3 and sometimes i get this: > > --- snip --- > Jan 23 14:23:13 mail dovecot: imap(b...@tutech.de)<4880>: > Panic: data stack: Out of memory when allocating 134217768 bytes Interesting... imap is trying

Re: Mailsploit problem in responce of BODYSTRUCTURE

2017-12-08 Thread Josef &#x27;Jeff&#x27; Sipek
On Fri, Dec 08, 2017 at 18:47:37 +0900, TACHIBANA Masashi wrote: > Hi, > > I tried to see a mail that have a strange From header in bellow URL: > > https://www.mailsploit.com/index > > Then, I got BODYSTRUCTURE response contain next: > > ((NIL NIL "service" "paypal.com")) > > Are this problem

Re: Building dovecot 2.2.33.2 is broken with uclibc-ng

2017-11-14 Thread Josef &#x27;Jeff&#x27; Sipek
On Tue, Nov 14, 2017 at 05:56:52 +0100, Bernd Kuhls wrote: > Am Mon, 13 Nov 2017 15:40:14 -0500 schrieb Josef 'Jeff' Sipek: > > > What happens if in dovecot's byteorder.h you add this before line 30: > > > > #undef bswap_8 > > #undef bs

Re: Building dovecot 2.2.33.2 is broken with uclibc-ng

2017-11-13 Thread Josef &#x27;Jeff&#x27; Sipek
On Mon, Nov 13, 2017 at 20:07:00 +0100, Bernd Kuhls wrote: > Hi, > > this commit > https://github.com/dovecot/core/commit/c9d76e2baf653fa5504d6849e5c1aae32eff3c53 > > added code which can not be compiled with uclibc-ng 1.0.26 using buildroot: Hrm... ok. It'll be probably faster for you to try a

Re: Sub addressing delimiters

2016-08-30 Thread Josef &#x27;Jeff&#x27; Sipek
On Tue, Aug 30, 2016 at 15:28:19 +0200, Steffen Kaiser wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > On Mon, 29 Aug 2016, Timo Sirainen wrote: > > > For v2.3 (maybe early next year): > > https://git.dovecot.net/dovecot/core/commit/972c9172e9e6a0fc6053efb3d2ee9d354b67727f > > is t

Re: Director/Doveadm: Trying to iterate users, but userdbs don't support it

2016-08-23 Thread Josef &#x27;Jeff&#x27; Sipek
On Wed, Jul 06, 2016 at 16:21:59 +0200, Tom Sommer wrote: > On the director (which is set to proxy doveadm commands): > > # doveadm force-resync -A "*" > Error: User listing returned failure > doveadm: Error: Failed to iterate through some users I'm trying to reproduce this, but I can iterate use