[Dovecot] Couldn't init INBOX: BUG: Unknown internal error

2007-08-20 Thread Philipp Schmid

hi,

I'm getting quite a few of these in the logs of our new dovecot mail  
server:


Aug 20 09:50:03 mail2 dovecot: POP3(vwc406): Couldn't init INBOX: BUG:  
Unknown internal error
Aug 20 09:50:03 mail2 dovecot: POP3(vwc406): Mailbox init failed  
top=0/0, retr=0/0, del=0/0, size=0


we migrated from courier and other mailboxes work.

any idea what the cause might be or how I can fix it?


greets philipp


mail1:/home/vwc406# ls -la
total 168
drwx--   14 vmail vmail  4096 Aug 20 01:48 .
drwxrwxrwx 2297 vmail vmail 69632 Aug 20 02:08 ..
drwx--6 vmail vmail  4096 Aug 19 21:09 .Drafts
drwx--6 vmail vmail  4096 Aug 19 21:09 .Junk
drwx--6 vmail vmail  4096 Aug 19 21:09 .Sent
drwx--6 vmail vmail  4096 Aug 19 21:09 .Trash
drwx--   10 vmail vmail  4096 Apr 28  2006 .openwebmail
drwx--5 vmail vmail  4096 Apr 28  2006 .saved-drafts
drwx--5 vmail vmail  4096 Apr 28  2006 .saved-messages
drwx--5 vmail vmail  4096 Apr 28  2006 .sent-mail
drwx--2 vmail vmail  4096 Jun 10 19:01 courierimapkeywords
-rw-r--r--1 vmail vmail47 May 13 15:44 courierimapsubscribed
-rw-r--r--1 vmail vmail   621 Jun 10 19:01 courierimapuiddb
-rw-r--r--1 vmail vmail  1582 Aug  7 15:56 courierpop3dsizelist
drwx--2 vmail vmail  4096 Aug  7 15:56 cur
-rw---1 vmail vmail  1157 Aug 19 23:55 dovecot-uidlist
-rw---1 vmail vmail   396 Aug 19 23:27 dovecot.index
-rw---1 vmail vmail 16384 Aug 19 23:29 dovecot.index.cache
-rw---1 vmail vmail   528 Aug 19 23:27 dovecot.index.log
drwx--2 vmail vmail  4096 Aug  7 15:56 new
-rw-r--r--1 vmail vmail23 Aug 19 23:55 subscriptions
drwx--2 vmail vmail  4096 Aug  7 15:56 tmp


mail1:~# dovecot --version
1.0.3


mail1:~# dovecot -n
# 1.0.3: /etc/dovecot/dovecot.conf
log_timestamp: %Y-%m-%d %H:%M:%S
protocols: imap imaps pop3 pop3s
ssl_ca_file: /infrastructure/certs/gd_intermediate_bundle.crt
ssl_cert_file: /infrastructure/certs/_.netmonic.com.crt
ssl_key_file: /infrastructure/certs/_.netmonic.com.key
disable_plaintext_auth: no
shutdown_clients: no
login_dir: /var/run/dovecot/login
login_executable(default): /usr/lib/dovecot/imap-login
login_executable(imap): /usr/lib/dovecot/imap-login
login_executable(pop3): /usr/lib/dovecot/pop3-login
login_greeting: Ready.
login_processes_count: 10
login_max_processes_count: 256
mail_extra_groups: mail
mail_location: maildir:/home/%h
mmap_disable: yes
mail_executable(default): /usr/lib/dovecot/imap
mail_executable(imap): /usr/lib/dovecot/imap
mail_executable(pop3): /usr/lib/dovecot/pop3
mail_plugin_dir(default): /usr/lib/dovecot/modules/imap
mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap
mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3
imap_client_workarounds(default): delay-newmail outlook-idle netscape- 
eoh

imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh
imap_client_workarounds(pop3): outlook-idle
pop3_uidl_format(default):
pop3_uidl_format(imap):
pop3_uidl_format(pop3): %f
pop3_client_workarounds(default):
pop3_client_workarounds(imap):
pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh
namespace:
  type: private
  prefix: INBOX.
  inbox: yes
auth default:
  mechanisms: plain login digest-md5 cram-md5 ntlm apop
  username_chars:  
[EMAIL PROTECTED]

  username_translation: @#
  passdb:
driver: sql
args: /etc/dovecot/dovecot-sql.conf
  userdb:
driver: prefetch
  userdb:
driver: sql
args: /etc/dovecot/dovecot-sql.conf
  socket:
type: listen
client:
  path: /var/spool/postfix/private/auth
  mode: 432
  user: postfix
  group: postfix
master:
  path: /var/run/dovecot/auth-master
  mode: 384
  user: vmail
  group: vmail




Re: [Dovecot] Dovecot IDLE bandwidth usage

2007-08-20 Thread Ed W

Gerald Villemure wrote:

Timo Sirainen wrote:


TCP keepalives get sent so rarely that they don't keep NATed connections
alive. (Linux's tcp(7) says the first one is sent after 2h of idling)



Its the same for windows systems, 2 hours.


You may find that some GPRS implementations drop idle connections after 
as little as 2 mins also...


You need to test your own GPRS implementation, but they certainly drop 
idle connections after a period (probably 2 mins is unusually short though)


Ed W


Re: [Dovecot] Dovecot fails almost every 20 minutes exactly

2007-08-20 Thread Kyle Wheeler

On Sunday, August 19 at 02:13 PM, quoth Patrick - South Valley Internet:
Now that we're in the production environment, we've noticed that 
every 20 minutes, Dovecot will stop running.


Meaning what? Is the dovecot process still alive? Is the service 
unresponsive? Is it just not allowing logins?


Is the shared NFS store the only thing shared between the two? Is 
there a load-balancer in front of the machines?


I can't see anything out of the ordinary in the log files either.  


What are the last couple entries in the log files when it "stops"? The 
same things every time, or something different every time?


~Kyle
--
If Mr. Einstein doesn't like the natural laws of the universe, let him 
go back to where he came from.

-- Robert Benchley (1889-1945)


pgplX5EPDAq36.pgp
Description: PGP signature


Re: [Dovecot] Dovecot fails almost every 20 minutes exactly

2007-08-20 Thread Patrick - South Valley Internet

The issue had to do with PAM.  I was getting zombie processes.

adding 'args = blocking=yes'  to the passdb pam area fixed the issue.

Thanks for the response.

Patrick





Kyle Wheeler wrote:

On Sunday, August 19 at 02:13 PM, quoth Patrick - South Valley Internet:
Now that we're in the production environment, we've noticed that 
every 20 minutes, Dovecot will stop running.


Meaning what? Is the dovecot process still alive? Is the service 
unresponsive? Is it just not allowing logins?


Is the shared NFS store the only thing shared between the two? Is 
there a load-balancer in front of the machines?


I can't see anything out of the ordinary in the log files either.  


What are the last couple entries in the log files when it "stops"? The 
same things every time, or something different every time?


~Kyle




[Dovecot] UW-IMAP to Dovecot conversion - How to migrate the folders?

2007-08-20 Thread Patrick - South Valley Internet

Hi all,

I've read so much information on this that I'm a little confused as to 
what to follow.  Here's what's going on:


We just migrated away from our AIX machines which were running Postfix 
and UW-IMAP.  We're now running Postfix with Dovecot.  I already 
converted everyone's mbox file to maildir, but now I'm having a little 
troubles with how to exactly populate their IMAP folders.  People are 
saying they cannot see their folders.  These 'folders' they are talking 
about can be found in their /home directory.


I have the following URLs I've been looking at:
http://wiki.dovecot.org/Migration/MailFormat
http://people.redhat.com/rkeech/maildir-migration.txt
http://wiki.dovecot.org/Plugins/Convert
http://www.dovecot.org/list/dovecot/2007-June/023757.html

What would be the suggested method to convert them?  So far I understand 
that I need to somehow populate the /home/USERNAME/Maildir/subscriptions 
file with the items located in /home/USERNAME/.mailboxlist and then I 
don't know what to do from there.  I don't know if I need to incorporate 
a Dovecot plugin, or if there is a script I can run to do this for me.


Since this is a live server, I would prefer to test on a single account 
before I run a plugin that would effect all users globally.


Any help would be very appreciated - thanks in advance!

Patrick




Re: [Dovecot] UW-IMAP to Dovecot conversion - How to migrate the folders?

2007-08-20 Thread Scott Silva
Patrick - South Valley Internet spake the following on 8/20/2007 3:21 PM:
> Hi all,
> 
> I've read so much information on this that I'm a little confused as to
> what to follow.  Here's what's going on:
> 
> We just migrated away from our AIX machines which were running Postfix
> and UW-IMAP.  We're now running Postfix with Dovecot.  I already
> converted everyone's mbox file to maildir, but now I'm having a little
> troubles with how to exactly populate their IMAP folders.  People are
> saying they cannot see their folders.  These 'folders' they are talking
> about can be found in their /home directory.
> 
> I have the following URLs I've been looking at:
> http://wiki.dovecot.org/Migration/MailFormat
> http://people.redhat.com/rkeech/maildir-migration.txt
> http://wiki.dovecot.org/Plugins/Convert
> http://www.dovecot.org/list/dovecot/2007-June/023757.html
> 
> What would be the suggested method to convert them?  So far I understand
> that I need to somehow populate the /home/USERNAME/Maildir/subscriptions
> file with the items located in /home/USERNAME/.mailboxlist and then I
> don't know what to do from there.  I don't know if I need to incorporate
> a Dovecot plugin, or if there is a script I can run to do this for me.
> 
> Since this is a live server, I would prefer to test on a single account
> before I run a plugin that would effect all users globally.
> 
> Any help would be very appreciated - thanks in advance!
> 
> Patrick
> 
> 
> 
Have you tried to edit their subscriptions file?
Or log in with a client to one of the accounts and use its subscribe feature?
With the second method, you could get an idea of what the subscriptions layout
is and use a copy / sed script to fix each one.

-- 

MailScanner is like deodorant...
You hope everybody uses it, and
you notice quickly if they don't



Re: [Dovecot] UW-IMAP to Dovecot conversion - How to migrate the folders?

2007-08-20 Thread Patrick - South Valley Internet

I have, but it didn't do anything that I could tell.

I tried resyncing my IMAP but I didn't see the new folder.

Does it matter that the UW-IMAP folders are in mbox-like format?  It 
appears each "folder" is a single file, similar to mbox format.


Thanks again.

Patrick



Scott Silva wrote:

Patrick - South Valley Internet spake the following on 8/20/2007 3:21 PM:
  

Hi all,

I've read so much information on this that I'm a little confused as to
what to follow.  Here's what's going on:

We just migrated away from our AIX machines which were running Postfix
and UW-IMAP.  We're now running Postfix with Dovecot.  I already
converted everyone's mbox file to maildir, but now I'm having a little
troubles with how to exactly populate their IMAP folders.  People are
saying they cannot see their folders.  These 'folders' they are talking
about can be found in their /home directory.

I have the following URLs I've been looking at:
http://wiki.dovecot.org/Migration/MailFormat
http://people.redhat.com/rkeech/maildir-migration.txt
http://wiki.dovecot.org/Plugins/Convert
http://www.dovecot.org/list/dovecot/2007-June/023757.html

What would be the suggested method to convert them?  So far I understand
that I need to somehow populate the /home/USERNAME/Maildir/subscriptions
file with the items located in /home/USERNAME/.mailboxlist and then I
don't know what to do from there.  I don't know if I need to incorporate
a Dovecot plugin, or if there is a script I can run to do this for me.

Since this is a live server, I would prefer to test on a single account
before I run a plugin that would effect all users globally.

Any help would be very appreciated - thanks in advance!

Patrick





Have you tried to edit their subscriptions file?
Or log in with a client to one of the accounts and use its subscribe feature?
With the second method, you could get an idea of what the subscriptions layout
is and use a copy / sed script to fix each one.

  




Re: [Dovecot] imap memory footprint rather large

2007-08-20 Thread Curtis Maloney

Leroy van Logchem wrote:



I found the file to be ever growing, so when it had grown back to
160Mb in a single day, I decided to employ cron on the mail server:

  11 4 * * * find $HOME/.maildir -type f -name dovecot.index.cache 
-exec rm {} \;


Since my mail is fetched in the background anyway, I am happy to
take the performance hit first thing in the morning.
  


I'm wondering, can this be done safely with connected users?



My guess would be :  Yes.

If dovecot has the file open, the OS won't trash it until there are no more 
links.

If dovecot is about to open the file, I'm sure Timo would use an 
open/create-on-fail pattern, not a test-if-exist/open patter which would lead to 
a race.


Worst case I can see is someone's session suddenly slows down a bit.

--
Curtis Maloney
[EMAIL PROTECTED]



Re: [Dovecot] Sieve Vacation cause deliver to die

2007-08-20 Thread kc

I am running gentoo 2.6.20.

The script is ok, otherwise it cannot be compile. It will generate an error 
log instead.


Regards,
Steve

"Steffen Kaiser" <[EMAIL PROTECTED]> wrote in 
message 
news:[EMAIL PROTECTED]

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1

On Fri, 17 Aug 2007, M1 wrote:


# Sieve Filter
# 由 Ingo (http://www.horde.org/ingo/) 產生 (August 15, 2007, 10:49 am)

require "vacation";

# 假期通知
if allof ( not exists ["list-help", "list-unsubscribe", "list-subscribe",
"list-owner", "list-post", "list-archive", "list-id"], not header
:comparator "i;ascii-casemap" :is "Precedence" "list,bulk" ) {
  vacation :days 7 :addresses "[EMAIL PROTECTED]" :subject "test" "test
vacation";
}


This script works on Dovecot v1.0.3 on Linux.

Did you forced a re-compile of the script already?

Bye,

- -- 
Steffen Kaiser

-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.6 (GNU/Linux)

iQEVAwUBRsWBCy9SORjhbDpvAQKcegf/f6om8HcDzxrqogOduZ0uhf2M311mTqND
PLotOFDFHimERRoAVdf1wMMAvlWfyO/x8ocnhlwb3eR5HLQbvpBp3uftru5Ie8cz
N4jYhFDoEtKXbYd7R23krC7GzcqZbkGyYNrWgeUbaSxrgrkgthamGUhtA6nKoQKN
/c787cQrFtHzmirE6SZSDSylhBzvJ0eezXUPOF9rePAlrvzwVx1ixMt3KP7dreBT
ag2IwnY+3cnquO+DX5ZvOQWJ0TUTx8XYoJsbhTAKXN5heyC7WEKmw+9WIvQLNgqh
hEoSlw+9hwtKm/GxhnXB1F9Zg+h31EAS+/9FQxWUR9mevzL/mr0Xuw==
=Py/G
-END PGP SIGNATURE-  





Re: [Dovecot] UW-IMAP to Dovecot conversion - How to migrate the folders?

2007-08-20 Thread Kyle Wheeler

On Monday, August 20 at 04:07 PM, quoth Patrick - South Valley Internet:

I have, but it didn't do anything that I could tell.

I tried resyncing my IMAP but I didn't see the new folder.

Does it matter that the UW-IMAP folders are in mbox-like format? 
 It appears each "folder" is a single file, similar to mbox 
format.


Yeah, it does matter. Dovecot doesn't allow you to mix-and-match 
different mail storage formats very easily. You may be able to set 
something like that up with the Namespaces support in Dovecot, but the 
easiest thing to do is to convert your mbox files into Maildir.


~Kyle
--
Liberty means responsibility. That is why most men dread it.
-- George Bernard Shaw


pgpzxd5qajxuF.pgp
Description: PGP signature