Re: Error: Broken file dovecot-uidlist

2023-02-16 Thread Maciej Milaszewski
Hi I had the same problem fstab: Ip:/vmail /vmail nfs rw,sec=sys,noexec,noatime,tcp,soft,rsize=32768,wsize=32768,intr,nordirplus,nfsvers=3,actimeo=120 /vmail on /vmail type nfs (rw,noexec,noatime,vers=3,rsize=65536,wsize=65536,namlen=255,acregmin=120,acregmax=120,acdirmin=120,acdirmax=120,har

Re: Error: Broken file dovecot-uidlist

2023-02-15 Thread Sohin Vyacheslav
15.02.2023 16:58, Maciej Milaszewski пишет: Can you send me info about mounted options (fstab) and what is your kernel and nfs version in client and your storage Hi Maciej, Client=> fstab: IP-address:/data /data nfs auto,nofail,noatime,intr,tcp,nordirplus,actimeo=18000 0 #

Re: Error: Broken file dovecot-uidlist

2023-02-15 Thread Maciej Milaszewski
ildir/dovecot-uidlist line XX: Invalid data: for some email accounts. For example, dovecot-uidlist line 21197: Invalid data: When I open line 21197 in editor: # vim +21197 dovecot-uidlist 1750207 :1676454069.M698819P4439.mail-b,S=963716,W=976359 and then check this file size # ls -l /data

Re: Error: Broken file dovecot-uidlist

2023-02-15 Thread Aki Tuomi
> On 15/02/2023 13:58 EET Sohin Vyacheslav wrote: > > > 15.02.2023 13:42, Aki Tuomi пишет: > > Every time that happens I've seen it's been zerofilled (due to NFS), and > > not yet filled with actual data. Size might be right, but it just contains > > NULs. > > Thank you, Aki for clarifying

Re: Error: Broken file dovecot-uidlist

2023-02-15 Thread Sohin Vyacheslav
15.02.2023 13:42, Aki Tuomi пишет: Every time that happens I've seen it's been zerofilled (due to NFS), and not yet filled with actual data. Size might be right, but it just contains NULs. Thank you, Aki for clarifying! you mean lines like this: ICAgICAgICAgICAgICAgICAgCiAgICAgICAgICAgICAg

Re: Error: Broken file dovecot-uidlist

2023-02-15 Thread Aki Tuomi
> On 15/02/2023 13:32 EET Sohin Vyacheslav wrote: > > > Hi All, > > In mail.log are exists error messages "Error: Broken file > /data/mail/vhosts/domain.com/u...@domain.com/Maildir/dovecot-uidlist > line XX: Invalid data: for some email accounts. > >

Error: Broken file dovecot-uidlist

2023-02-15 Thread Sohin Vyacheslav
Hi All, In mail.log are exists error messages "Error: Broken file /data/mail/vhosts/domain.com/u...@domain.com/Maildir/dovecot-uidlist line XX: Invalid data: for some email accounts. For example, dovecot-uidlist line 21197: Invalid data: When I open line 21197 in editor: # vim +

Re: dovecot-uidlist invalid data

2020-10-26 Thread Maciej Milaszewski
t 23 15:57:52 dovecot6 dovecot: > lmtp(33973,media4_js,2KEXD2Dhkl+1hAAAe3x6RQ): Error: Broken file > /vmail/me/media4_js/Maildir/dovecot-uidlist line 6875: Invalid data: > > In debian9 - kernel-4.9.0-13 - problem exists > In debian10 - kernel-4.19.0-12 - problem exist > > In debian8

dovecot-uidlist invalid data

2020-10-23 Thread Maciej Milaszewski
): Error: Broken file /vmail/me/media4_js/Maildir/dovecot-uidlist line 6875: Invalid data: In debian9 - kernel-4.9.0-13 - problem exists In debian10 - kernel-4.19.0-12 - problem exist In debian8 - kernel 3.16.0-11-amd64 - problem not exists In debian9 - kernel 3.16.0-11-amd64 - problem not exists

Re: dovecot-uidlist....

2020-02-27 Thread Erik de Waard
On Thu, Feb 27, 2020 at 4:52 AM Chi Min Wang wrote: > Hello Everyone: >Is it possible to direct dovecot to modify dovecot-uidlist > automatically?? I have some user who use ancient MUA(i.e. Openwebmail) > and IMAP/POP3. Since Openwebmail will insert "Status: R" in th

dovecot-uidlist....

2020-02-26 Thread Chi Min Wang
Hello Everyone:   Is it possible to direct dovecot to modify dovecot-uidlist automatically??  I have some user who use ancient MUA(i.e. Openwebmail) and IMAP/POP3. Since Openwebmail will insert "Status: R" in the eml file,the size of the eml file will increase by 10 bytes. If th

Error: Mailbox INBOX: Broken file dovecot-uidlist: Invalid data

2019-10-29 Thread Dirk via dovecot
Hi list, today a user reported messages are disappearing from his INBOX and I discovered a two digit number of mailboxes with broken dovecot-uidlist files. The log says: Oct 29 08:51:34 mail02 dovecot: lmtp(i...@example.com)<5270>: Error: Mailbox INBOX: Broken file /var/vmail/examp

Dovecot Index Corruption and dovecot-uidlist Issues

2019-10-25 Thread Billy Luedtke via dovecot
dovecot: imap(): Error: Fixed index file /mail/j/k//Maildir/dovecot.index: first_recent_uid 6799 -> 6798 Oct 25 01:33:26 dovecot: imap(): Error: Broken file /mail/j/k//Maildir/dovecot-uidlist line 6461: Invalid data: Oct 25 01:33:26 dovecot: imap(): Error: Log synchronization error at seq=89,

Re: Force dovecot-uidlist reset

2019-09-09 Thread Tom Sommer via dovecot
Nevermind, the indexes were not deleted correctly - the method described below works :) --- Tom On 2019-09-09 09:45, Tom Sommer via dovecot wrote: Is there a way to force Dovecot to rebuild dovecot-uidlist from zero? It seems deleting all indexes and dovecot-* files followed by "do

Force dovecot-uidlist reset

2019-09-09 Thread Tom Sommer via dovecot
Is there a way to force Dovecot to rebuild dovecot-uidlist from zero? It seems deleting all indexes and dovecot-* files followed by "doveadm force-resync" is not enough? It just gets the same UIDs? Perhaps from Maildir filenames? But I would like to reset the uid of all mails. Thanks -- Tom

Re: dovecot-uidlist invalid data

2019-08-14 Thread Timo Sirainen via dovecot
On 4 Aug 2019, at 22.57, Király Balázs via dovecot wrote: > > Hi! > > I’m struggling with the following error: > > Aug 4 21:32:00 mx02 dovecot: imap(x...@xxx.tld)<17693>: > Error: Mailbox INBOX: Broken file /home/vmail/xxx.tld/xxx/dovecot-uidlist > line 6246

dovecot-uidlist invalid data

2019-08-04 Thread Király Balázs via dovecot
Hi! I'm struggling with the following error: Aug 4 21:32:00 mx02 dovecot: imap(x...@xxx.tld)<17693>: Error: Mailbox INBOX: Broken file /home/vmail/xxx.tld/xxx/dovecot-uidlist line 6246: Invalid data: Aug 4 21:49:22 mx02 dovecot: imap(x...@xxx.tld)<21879>: Error: Mail

Exclude dovecot-uidlist files from a Maildir backup ?

2019-06-25 Thread David Pottage via dovecot
tored new mails. However, the dovecot-uidlist files change frequently, and are often quite large. The restic backup program detects the file has changed and uploads a new version, but is not smart enough to detect that only a few lines have changed, so it uploads a fresh copy of the entire fi

dovecot-uidlist path

2019-01-02 Thread Christos Chatzaras
When I use this: mail_location = maildir:/home/mail/%d/%n the dovecot-uidlist file is located in: /home/mail/example.com/user/dovecot-uidlist But when I change it to: mail_location = maildir:/home/mail/%d/%n:CONTROL=/var/mail/%d/%n then it's stored in: /var/mail/example.com/user/.

Re: dovecot-uidlist is not up-to-date [EXTERNAL]

2018-03-22 Thread Dmitry Filonov
s index based on dovecot-uidlist. But not the >> dovecot-uidlist based on actual mail data. :( >> >> Fil >> >> >> >> On March 21, 2018 11:58:21 PM EDT, "@lbutlr" >wrote: >> >> On 2018-03-21 (17:15 MDT), Dmitry Filonov > wro

Re: dovecot-uidlist is not up-to-date

2018-03-22 Thread Aki Tuomi
Did you try removing the file? Aki On 22.03.2018 06:32, Dmitry Filonov wrote: > Tried that. It rebuilds index based on dovecot-uidlist. But not the > dovecot-uidlist based on actual mail data. :( > > Fil > > > > On March 21, 2018 11:58:21 PM EDT, "@lbutlr" w

Re: dovecot-uidlist is not up-to-date

2018-03-21 Thread Dmitry Filonov
Tried that. It rebuilds index based on dovecot-uidlist. But not the dovecot-uidlist based on actual mail data. :( Fil On March 21, 2018 11:58:21 PM EDT, "@lbutlr" wrote: >On 2018-03-21 (17:15 MDT), Dmitry Filonov > wrote: >> Now the question is if there's any way

Re: dovecot-uidlist is not up-to-date

2018-03-21 Thread @lbutlr
On 2018-03-21 (17:15 MDT), Dmitry Filonov wrote: > Now the question is if there's any way to tell dovecot to rebuild > dovecot-uidlist files using actual Maildir data. I don't want to remove > dovecot-uidlist files as this triggers the whole mailbox being re-downloaded &

dovecot-uidlist is not up-to-date

2018-03-21 Thread Dmitry Filonov
x27;t match if I check the real messages in my Maildirs. For some account doveadm was reporting number of messages but that account didn't have any messages stored at all. So I looked a bit further and found that doveadm utility reports data form indexes and indexes are built using dovecot-ui

Re: Slow reading of large dovecot-uidlist files

2016-04-12 Thread Steffen Kaiser
al/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 13:07:35.306747 umask(077) = 0177 13:07:35.306772 open("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist", O_RDWR) = 15 13:07:35.306802 lseek(15,

Re: Slow reading of large dovecot-uidlist files

2016-04-12 Thread Bostjan Skufca
On 12 April 2016 at 23:16, Timo Sirainen wrote: > > On 09 Apr 2016, at 21:04, Bostjan Skufca wrote: > > (context: I was optimizing Roundcube mailbox list server response, and in > > that 300-400ms response time, around 170ms is spent on single fgets() call > > which is waiting IMAP repsonse to "S

Re: Slow reading of large dovecot-uidlist files

2016-04-12 Thread Timo Sirainen
uot; command) > > I straced dovecot and of the whole request/response process, around 30ms is > spent for everything else, and overwhelming majority of time (150-170ms) is > spent for reading dovecot-uidlist file for given mailbox. > > I skimmed over src/lib-storage/index/maildir

Re: Slow reading of large dovecot-uidlist files

2016-04-12 Thread Bostjan Skufca
662 fstat(15, {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 13:07:35.306690 close(15) = 0 13:07:35.306716 lstat("/var/mail/virtual/ stage.mail.teon.si/bostjan/.Gmail/dovecot-uidlist.lock", {st_mode=S_IFREG|0600, st_size=13, ...}) = 0 13:07:35.306747 umask(077)

Re: Slow reading of large dovecot-uidlist files

2016-04-12 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 12 Apr 2016, Bostjan Skufca wrote: On 12 April 2016 at 10:23, A.L.E.C wrote: I don't know dovecot's code, but I suppose it uses uidlist file to get mailbox statistics that it returns as EXISTS, RECENT, UNSEEN, UIDNEXT, UIDVALIDITY, etc, wh

Re: Slow reading of large dovecot-uidlist files

2016-04-12 Thread Bostjan Skufca
On 12 April 2016 at 10:23, A.L.E.C wrote: > I don't know dovecot's code, but I suppose it uses uidlist file to get > mailbox statistics that it returns as EXISTS, RECENT, UNSEEN, UIDNEXT, > UIDVALIDITY, etc, which are required by IMAP standard. I don't know, > maybe they could be stored in more o

Re: Slow reading of large dovecot-uidlist files

2016-04-12 Thread A.L.E.C
On 04/10/2016 10:27 AM, Adrian Minta wrote: > It will be nice if the "SELECT MyMailbox" command will be "SELECT > mymailbox LIMIT 100" or something, to get the first files since only the > last messages are shown to the user. SELECTing a mailbox has nothing to do with FETCHing messages, so above d

Re: Slow reading of large dovecot-uidlist files

2016-04-10 Thread Bostjan Skufca
> I straced dovecot and of the whole request/response process, around 30ms >> is >> spent for everything else, and overwhelming majority of time (150-170ms) >> is >> spent for reading dovecot-uidlist file for given mailbox. >> >> I skimmed over src/lib-stor

Re: Slow reading of large dovecot-uidlist files

2016-04-10 Thread Adrian Minta
st/response process, around 30ms is spent for everything else, and overwhelming majority of time (150-170ms) is spent for reading dovecot-uidlist file for given mailbox. I skimmed over src/lib-storage/index/maildir/maildir-uidlist.c and src/src/lib/istream.c, but I am out of ideas on how to optimiz

Slow reading of large dovecot-uidlist files

2016-04-09 Thread Bostjan Skufca
nd 30ms is spent for everything else, and overwhelming majority of time (150-170ms) is spent for reading dovecot-uidlist file for given mailbox. I skimmed over src/lib-storage/index/maildir/maildir-uidlist.c and src/src/lib/istream.c, but I am out of ideas on how to optimize mentioned file reading

Re: bug - over system quota and dovecot-uidlist

2015-09-23 Thread Timo Sirainen
d with courier pop3. I think that dovecot does > not handle dovecot-uidlist file safely so it can withstand such > situations. > rsync and other similar programs always writes to a copy of the file > like dovecot-uidlis.xcb453 and on success unlinks old file and renames > new one.

bug - over system quota and dovecot-uidlist

2015-09-23 Thread krz...@gmail.com
Ever since I've migraded from courier pop3 to dovecot pop3 I'm constantly getting complains from users that went over system quota for short while and then their pop3 client downloads all messages again. I never happened with courier pop3. I think that dovecot does not handle dovecot-ui

Re: Large jumps in dovecot-uidlist

2015-07-07 Thread Mark
On 19/06/2015 18:41, Mark wrote: > On 15/06/2015 18:04, Mark wrote: >> On 15/06/2015 17:46, Felix Zielcke wrote: >>> Am Sonntag, den 14.06.2015, 10:46 +0100 schrieb Mark: Since upgrading to Debian Wheezy >>> ... # 2.2.13: /etc/dovecot/dovecot.conf # OS: Linux 3.2.0-4-kirkwood armv5t

Re: Large jumps in dovecot-uidlist

2015-06-19 Thread Mark
On 15/06/2015 18:04, Mark wrote: > On 15/06/2015 17:46, Felix Zielcke wrote: >> Am Sonntag, den 14.06.2015, 10:46 +0100 schrieb Mark: >>> Since upgrading to Debian Wheezy >> ... >>> # 2.2.13: /etc/dovecot/dovecot.conf >>> # OS: Linux 3.2.0-4-kirkwood armv5tel Debian 7.8 >> >> So it's dovecot from

Re: Large jumps in dovecot-uidlist

2015-06-15 Thread Mark
On 15/06/2015 17:46, Felix Zielcke wrote: > Am Sonntag, den 14.06.2015, 10:46 +0100 schrieb Mark: >> Since upgrading to Debian Wheezy > ... >> # 2.2.13: /etc/dovecot/dovecot.conf >> # OS: Linux 3.2.0-4-kirkwood armv5tel Debian 7.8 > > So it's dovecot from the backports. > Didn't you notice that s

Re: Large jumps in dovecot-uidlist

2015-06-15 Thread Felix Zielcke
Am Sonntag, den 14.06.2015, 10:46 +0100 schrieb Mark: > Since upgrading to Debian Wheezy ... > # 2.2.13: /etc/dovecot/dovecot.conf > # OS: Linux 3.2.0-4-kirkwood armv5tel Debian 7.8 So it's dovecot from the backports. Didn't you notice that since about 2 months there's now jessie out? That has 2.

Large jumps in dovecot-uidlist

2015-06-14 Thread Mark
Since upgrading to Debian Wheezy I have been observing large jumps in the value stored in dovecot-uidlist. The effect of these jumps is to confuse some mail clients (Thunderbird, Opera Mail) causing them not to display messages from a (random?) point in time onwards in the affected folder. I have

Re: [Dovecot] Odd ownership of the dovecot-uidlist file

2014-06-04 Thread Bruce
session= Jun 3 12:56:32 gettas dovecot: Dovecot postlogin.sh running as celia@xxx/celia) userid = 41410 (41410) - uidlist = 7903 Jun 3 12:56:32 gettas dovecot: Dovecot for celia@xxx finished, uidlist now = 7903 < POSTLOGIN.SH ENDS HERE Jun 3 12:56:32 gettas dovecot: pop3(celia@xxx/celia/

Re: [Dovecot] Odd ownership of the dovecot-uidlist file

2014-06-03 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Wed, 4 Jun 2014, Bruce wrote: Please see my responses below, I dislike top posting anyway :-) On 04/06/14 01:35, dovecot-requ...@dovecot.org wrote: Message: 4 Date: Tue, 3 Jun 2014 09:33:48 +0200 (CEST) From: Steffen Kaiser >Jun 3 11:38:51

Re: [Dovecot] Odd ownership of the dovecot-uidlist file

2014-06-03 Thread Peter Chiochetti
Am 2014-06-03 22:52, schrieb Bruce: All I am really looking for is ideas on where to look, Use inotify on the directory? -- peter

Re: [Dovecot] Odd ownership of the dovecot-uidlist file

2014-06-03 Thread Bruce
Hi, Please see my responses below, On 04/06/14 01:35, dovecot-requ...@dovecot.org wrote: Message: 4 Date: Tue, 3 Jun 2014 09:33:48 +0200 (CEST) From: Steffen Kaiser >Jun 3 11:38:51 brio dovecot: Dovecot postlogin.sh running as hamish@X >(/mnt/spool/keepers/h/X/hamish) userid = 7053 (70

Re: [Dovecot] Odd ownership of the dovecot-uidlist file

2014-06-03 Thread Steffen Kaiser
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On Tue, 3 Jun 2014, Bruce wrote: Jun 3 11:38:51 brio dovecot: Dovecot postlogin.sh running as hamish@X (/mnt/spool/keepers/h/X/hamish) userid = 7053 (7053) - uidlist = 26624 Jun 3 11:38:51 brio dovecot: Dovecot for hamish@X finished, uid

Re: [Dovecot] Odd ownership of the dovecot-uidlist file

2014-06-02 Thread Bruce
Hi Robert (and list), See my response below, On 27/05/14 23:05, dovecot-requ...@dovecot.org wrote: Message: 4 Date: Mon, 26 May 2014 19:50:01 -0700 From: Robert L Mathews To: Dovecot Mailing List Subject: Re: [Dovecot] Odd ownership of the dovecot-uidlist file Message-ID: <5383fd59.9

Re: [Dovecot] Odd ownership of the dovecot-uidlist file

2014-05-26 Thread Robert L Mathews
On 5/26/14, 6:06 PM, dclist.h...@hook.net.nz wrote: > It would be great if someone can give us some hints where the problem > maybe as this has us stumped. Have you tried "stat dovecot-uidlist" after it's changed to look at all three times of the file? The "Cha

[Dovecot] Odd ownership of the dovecot-uidlist file

2014-05-26 Thread dclist . hook
ownership and permissions category which people seem to have all the time. But in those cases it always happens, whereas what we are seeing is a random ownership change on the dovecot-uidlist file. Basically what we see is the user is able to login fine for days and then all of a sudden the file has

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-03 Thread Jouko Nikula
>>> However, I would look at the cause of the "insufficient privileges": >>> it is a symptom of something that could lead to other problems. >> >> >> The cause is that I have not given lmtp read access to mail/home dir. >> :-) So this is intentional. > > > That is bizarre -- I can't think of how yo

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-03 Thread Joseph Tam
On Thu, 3 Apr 2014, Jouko Nikula wrote: I now used: mail_location = maildir:~/mail:INDEX=MEMORY:CONTROL=/var/mail/%d/ctrl/%u and for sieve: plugin { sieve = /var/mail/%d/ctrl/%u/dovecot.sieve sieve_dir = /var/mail/%d/ctrl/%u/ } I also have two dovecot instances. One is responsible for ima

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-03 Thread Alessio Cecchi
Il 02/04/2014 12:27, Jouko Nikula ha scritto: Hello all, Is there a way to use LMTP (or LDA) so that maildir index and dovecot-uidlist are not updated? My setup is such that mail delivery sees user's maildir as write only. This setup works well when using postfix for mail delivery, but w

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-03 Thread Jouko Nikula
On Thu, Apr 3, 2014 at 1:36 AM, Joseph Tam wrote: > > Jouko Nikula writes: > >> Is there a way to use LMTP (or LDA) so that maildir index and >> dovecot-uidlist are not updated? >> >> My setup is such that mail delivery sees user's maildir as write onl

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-02 Thread Joseph Tam
Jouko Nikula writes: Is there a way to use LMTP (or LDA) so that maildir index and dovecot-uidlist are not updated? My setup is such that mail delivery sees user's maildir as write only. This setup works well when using postfix for mail delivery, but when I try to switch to dovecot LMT

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-02 Thread Jiri Bourek
If you're trying to do this without reading, you can't read the sieve rules. If you only want to prevent the delivery process from reading Maildir data (messages) and don't mind when it reads dovecot-uidlist, one possible solution may be moving dovecot-uidlist (and others) out

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-02 Thread Jouko Nikula
LDA) so that maildir index and > > dovecot-uidlist are not updated? > > > > My setup is such that mail delivery sees user's maildir as write only. > This > > setup works well when using postfix for mail delivery, but when I try to > > switch to dovecot LMTP the

Re: [Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-02 Thread Tom Hendrikx
On 04/02/2014 12:27 PM, Jouko Nikula wrote: > Hello all, > > Is there a way to use LMTP (or LDA) so that maildir index and > dovecot-uidlist are not updated? > > My setup is such that mail delivery sees user's maildir as write only. This > setup works well when using

[Dovecot] Disable maildir indexing and dovecot-uidlist on LMTP/LDA delivery

2014-04-02 Thread Jouko Nikula
Hello all, Is there a way to use LMTP (or LDA) so that maildir index and dovecot-uidlist are not updated? My setup is such that mail delivery sees user's maildir as write only. This setup works well when using postfix for mail delivery, but when I try to switch to dovecot LMTP the lmtp pr

Re: [Dovecot] Reading dovecot-uidlist by external program (locking)

2013-04-11 Thread Andrzej A. Filip
On 04/11/2013 10:39 PM, Andrzej A. Filip wrote: > How to lock dovecot-uidlist file before reading by an external program? > [perl script] I have been too "sending happy". http://wiki2.dovecot.org/MailboxFormat/Maildir The dovecot-uidlist file doesn't need to be locked for reading.

[Dovecot] Reading dovecot-uidlist by external program (locking)

2013-04-11 Thread Andrzej A. Filip
How to lock dovecot-uidlist file before reading by an external program? [perl script]

Re: [Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients

2013-02-16 Thread Timo Sirainen
On 16.2.2013, at 23.41, Piotr Rotter wrote: > Thank you for your assistant. > > Broken uidlist errors appears more than 10 time less frequently then in the > past and still reduce. > > I have question about director and no plain text auth methods. Now I have > tricky query in director configu

Re: [Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients

2013-02-16 Thread Piotr Rotter
Thank you for your assistant. Broken uidlist errors appears more than 10 time less frequently then in the past and still reduce. I have question about director and no plain text auth methods. Now I have tricky query in director configuration. password_query = SELECT clear AS password, 'Y' as

Re: [Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients

2013-02-16 Thread Timo Sirainen
On Wed, 2013-02-13 at 23:43 +0100, Piotr Rotter wrote: > I configure director temporary in some tricky way because I have to > serve md5 and ntlm authentication method and I do not want reconfigure > pop/imap servers. > > Can you confirm I done all ok becouse I have that issue: > > # doveadm

Re: [Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients

2013-02-13 Thread Piotr Rotter
I apologize for asking a question too fast without checking , I forgot look at logs. Of course missing iterate_query iterate_query = SELECT email AS user FROM postfix_users

Re: [Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients

2013-02-13 Thread Piotr Rotter
I configure director temporary in some tricky way because I have to serve md5 and ntlm authentication method and I do not want reconfigure pop/imap servers. Can you confirm I done all ok becouse I have that issue: # doveadm director map doveadm(root): Error: User listing returned failure dove

Re: [Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients

2013-02-13 Thread Timo Sirainen
On 13.2.2013, at 13.57, Piotr Rotter wrote: > I have issue with dovecot (v. 2.1.13)configuration after implementation > dovecot-lda (I used maildrop earlier). Now i have 9 servers with storage by > NFS v3. My problem is frequently dovecot-uidlist crashing. > > 2013-02-13T13:34:

[Dovecot] dovecot-uidlist crashing and re retriving messages by pop3 clients

2013-02-13 Thread Piotr Rotter
Hello, I have issue with dovecot (v. 2.1.13)configuration after implementation dovecot-lda (I used maildrop earlier). Now i have 9 servers with storage by NFS v3. My problem is frequently dovecot-uidlist crashing. 2013-02-13T13:34:02.447969+01:00 k1 dovecot: imap(u...@domain.com): Error

Re: [Dovecot] More detail re dovecot-uidlist and -uidvalidity files

2012-12-13 Thread Ben Morrow
At 10AM +0200 on 13/12/12 you (Dale Gallagher) wrote: > Regarding the dovecot-uidlist header (first line) - I've tried to search > for and figure out what exactly is meant by the "mailbox global uid" and > once I do, how to manually generate the 128 bit hex variatio

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-03-24 Thread list
0600, l...@airstreamcomm.net wrote: >> >> Jan 25 11:30:11 1295976611 POP3(4eagles): Warning: Created dotlock file's >> timestamp is different than current time (1295976643 vs 1295976607): >> /mail/4/e/4eagles/Maildir/dovecot-uidlist >> >> We added the epoch time t

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-27 Thread Timo Sirainen
On Tue, 2011-01-25 at 12:34 -0600, l...@airstreamcomm.net wrote: > > Jan 25 11:30:11 1295976611 POP3(4eagles): Warning: Created dotlock file's > timestamp is different than current time (1295976643 vs 1295976607): > /mail/4/e/4eagles/Maildir/dovecot-uidlist > > We adde

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-25 Thread list
Created dotlock file's timestamp is different than current time (1295976643 vs 1295976607): /mail/4/e/4eagles/Maildir/dovecot-uidlist We added the epoch time to the log_timestamp setting to compare it to the dotlock error, and as you can see the "Created dotlock" epoch time is 32

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-24 Thread Timo Sirainen
On 25.1.2011, at 1.06, wrote: > Multi-server setup that tries to flush NFS caches: > > dotlock_use_excl = no # only needed with NFSv2, NFSv3+ supports O_EXCL and > it's faster You're probably using NFSv3, right? Then this isn't needed. Also not the "tries" word. It doesn't work perfectly, alth

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-24 Thread list
perceivable drift that shows on our systems clock (which is >> negligible, sub 1 second). > .. >> Created dotlock file's timestamp is different than current time >> (1295900137 vs 1295899898): /mail/username/Maildir/dovecot-uidlist > > I see you have: > >>

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-24 Thread Harlan Stenn
I may have missed something - if this is NFS related, you are running NTP on *all* of your machines (clients and servers) that are involved in this NFS share, right? NFS cares that the time is sync'd on the computers it works with. H

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-24 Thread Timo Sirainen
nd). .. > Created dotlock file's timestamp is different than current time > (1295900137 vs 1295899898): /mail/username/Maildir/dovecot-uidlist I see you have: > dotlock_use_excl: no There was another reason why the above error could happen with that setting. http://hg.dovecot.org/dov

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-24 Thread Harlan Stenn
Michael wrote: > We tested the patch you suggested with no success. We are seeing > timestamps straying into the 100's of seconds of difference, which > does not reflect the perceivable drift that shows on our systems clock > (which is negligible, sub 1 second). Currently we run against two > st

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-24 Thread list
the author of dovecot! > > Michael > > On Thu, 20 Jan 2011 23:18:16 +0200, Timo Sirainen wrote: >> On Thu, 2011-01-20 at 08:32 -0600, l...@airstreamcomm.net wrote: >> >>> Created dotlock file's timestamp is different than current time >>> (1295480202 vs 12954

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-24 Thread list
: > On Thu, 2011-01-20 at 08:32 -0600, l...@airstreamcomm.net wrote: > >> Created dotlock file's timestamp is different than current time >> (1295480202 vs 1295479784): /mail/user/Maildir/dovecot-uidlist > > Hmm. This may be a bug that happens when dotlocking has

Re: [Dovecot] Fwd: Re: Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread Stan Hoeppner
Brandon Davidson put forth on 1/20/2011 11:22 PM: > Stan, > > On 1/20/11 7:45 PM, "Stan Hoeppner" wrote: >> >> What you're supposed to do, and what VMWare recommends, is to run ntpd _only >> in >> the ESX host_ and _not_ in each guest. According to: >> http://kb.vmware.com/selfservice/microsites

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread Stan Hoeppner
Gregory Finch put forth on 1/20/2011 3:27 PM: > You're much better off running one ntp server than two. With just two > servers providing time, if they drift from one another, for whatever > reason, there is no way to tell which one has the correct time. If you > need to ensure the time is correct

Re: [Dovecot] Fwd: Re: Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread Brandon Davidson
Stan, On 1/20/11 7:45 PM, "Stan Hoeppner" wrote: > > What you're supposed to do, and what VMWare recommends, is to run ntpd _only > in > the ESX host_ and _not_ in each guest. According to: > http://kb.vmware.com/selfservice/microsites/search.do?language=en_US&cmd=displ > ayKC&externalId=100642

Re: [Dovecot] Fwd: Re: Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread Stan Hoeppner
other > locking mechanisms in the future. > > Thanks again! > > Michael > > Original Message > Subject: Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load > Date: Thu, 20 Jan 2011 10:57:24 -0600 > From: Stan Hoeppner > To: dovecot@doveco

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread Gregory Finch
On 2011-01-20 8:57 AM, Stan Hoeppner wrote: > l...@airstreamcomm.net put forth on 1/20/2011 8:32 AM: > >> Secondly we thought the issues were due to NTP as the time stamps vary so >> widely, so we rebuilt our NTP servers and found closer stratum 1 source >> clocks to synchronize to hoping it would

[Dovecot] Fwd: Re: Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread list
: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load Date: Thu, 20 Jan 2011 10:57:24 -0600 From: Stan Hoeppner To: dovecot@dovecot.org l...@airstreamcomm.net put forth on 1/20/2011 8:32 AM: > Secondly we thought the issues were due to NTP as the time stamps vary so > widely, so we r

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread Timo Sirainen
On Thu, 2011-01-20 at 08:32 -0600, l...@airstreamcomm.net wrote: > Created dotlock file's timestamp is different than current time > (1295480202 vs 1295479784): /mail/user/Maildir/dovecot-uidlist Hmm. This may be a bug that happens when dotlocking has to wait for a long time for dotl

Re: [Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread Stan Hoeppner
l...@airstreamcomm.net put forth on 1/20/2011 8:32 AM: > Secondly we thought the issues were due to NTP as the time stamps vary so > widely, so we rebuilt our NTP servers and found closer stratum 1 source > clocks to synchronize to hoping it would alleviate the problem but the > dotlock errors ret

[Dovecot] Dotlock dovecot-uidlist errors / NFS / High Load

2011-01-20 Thread list
As of late our four node dovecot 1.2.13 cluster has been experiencing a massive number of these dotlock errors: Created dotlock file's timestamp is different than current time (1295480202 vs 1295479784): /mail/user/Maildir/dovecot-uidlist These dotlock errors correspond with very high

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-07 Thread Timo Sirainen
Yeah, the patches fix the mail delivery stage. These duplicate errors happen during the next imap/pop3 login. So either wait for a while and in the meanwhile maybe check that the same mailbox won't get the error more than once. On Tue, 2010-09-07 at 18:36 +0200, Luca Palazzo wrote: > Timo, > just

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-07 Thread Luca Palazzo
Timo, just put the path in all three servers. I'm yes getting duplicates. May be they are caused by existent files? How may I check if patch is working fine? I'll look at results tomorrow, anyway. Luca On 09/07/2010 05:32 PM, Timo Sirainen wrote: On Tue, 2010-09-07 at 16:24 +0100, Timo Sirain

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-07 Thread Timo Sirainen
On Tue, 2010-09-07 at 16:24 +0100, Timo Sirainen wrote: > On Tue, 2010-09-07 at 15:59 +0100, Timo Sirainen wrote: > > OK, I can reproduce this. It happens only with LMTP, because only then > > it can do a mailbox sync around the time of mail delivery. It probably > > also only happens when LMTP del

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-07 Thread Timo Sirainen
On Tue, 2010-09-07 at 15:59 +0100, Timo Sirainen wrote: > OK, I can reproduce this. It happens only with LMTP, because only then > it can do a mailbox sync around the time of mail delivery. It probably > also only happens when LMTP delivers the same mail to multiple > recipients. > > Now I'll just

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-07 Thread Timo Sirainen
OK, I can reproduce this. It happens only with LMTP, because only then it can do a mailbox sync around the time of mail delivery. It probably also only happens when LMTP delivers the same mail to multiple recipients. Now I'll just need to figure out how to fix this properly.. The maildir uidlist c

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-07 Thread Andre
uplicates. > > I hope this helps, duplicates problem is becoming big. > Can I check or trace something else? > > Luca > > open("/virtual1/unict.it/a/account//Maildir/dovecot-uidlist", > O_RDWR|O_LARGEFILE) = 17 > _llseek(17, 0, [0], SEEK_SET)

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-07 Thread Luca Palazzo
trace something else? Luca open("/virtual1/unict.it/a/account//Maildir/dovecot-uidlist", O_RDWR|O_LARGEFILE) = 17 _llseek(17, 0, [0], SEEK_SET) = 0 fstat64(17, {st_mode=S_IFREG|0644, st_size=8056, ...}) = 0 fstat64(17, {st_mode=S_IFREG|0644, st_size=8056, ...}) = 0 pread64(17,

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-06 Thread Timo Sirainen
On Mon, 2010-09-06 at 11:11 +0200, Luca Palazzo wrote: > Sep 6 10:51:31 10.97.1.33 dovecot: imap(xxx...@unict.it): Warning: > /virtual1/unict.it/g/xx//Maildir/dovecot-uidlist: Duplicate file > entry at line 883: 1277948239.M332097P873 Hmmh. See if http://hg.dovecot.org/doveco

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-06 Thread Andre
4.Q92185@>, size=7414, from= > Sep 6 10:51:30 10.97.1.33 dovecot: lmtp(29909, xxx...@unict.it): > T8gcJIyphEzVdAAA27qniQ: msgid=<20100906104944.q92...@pongo.fi.infn.it>: saved > mail to INBOX > Sep 6 10:51:31 10.97.1.33 dovecot: imap(xxx...@unict.it): Warning: > /virtua

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-06 Thread Luca Palazzo
Timo, please also check this output of lmtp process: stat64("/virtual1/unict.it/d///Maildir/dovecot-uidlist", {st_mode=S_IFREG|0644, st_size=44628, ...}) = 0 _llseek(42, 0, [0], SEEK_SET) = 0 fstat64(42, {st_mode=S_IFREG|0644, st_size=44628, ...}) = 0 fstat64(42

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-06 Thread Luca Palazzo
ict.it): T8gcJIyphEzVdAAA27qniQ: msgid=<20100906104944.q92...@pongo.fi.infn.it>: saved mail to INBOX Sep 6 10:51:31 10.97.1.33 dovecot: imap(xxx...@unict.it): Warning: /virtual1/unict.it/g/xx//Maildir/dovecot-uidlist: Duplicate file entry at line 883: 1277948239.M332097P873 3.mailcl-mbox1,S=790

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-03 Thread Luca Palazzo
etrieving mail from server due to some >> problem with dovecot-uidlist file. >> Looking at log file seem that all file content is sometime duplicated >> and appended to the and of same file. >> It look as another process was accesing and trying to modify uidlist table. > > I&#

Re: [Dovecot] dovecot-uidlist: Duplicate file entry at line

2010-09-03 Thread Andrea Mistrali
Il giorno 03/set/2010, alle ore 16.59, Timo Sirainen ha scritto: > On Fri, 2010-09-03 at 15:57 +0100, Timo Sirainen wrote: >> On Fri, 2010-09-03 at 15:44 +0100, Timo Sirainen wrote: >> >>> The maildir code hasn't changed much since v1.2. Hmm. Except that >>> maildir filenames are now tried to be

  1   2   3   >