[vchkpw] temp-problems with vpopmail and finding users
hi i'm new in vpopmail I installed a little system with 4 domains using the great howto by matt. I'm using vpopmail 5.3.29. Sometime the system can't find a user. But the user exists ?!? SQL-Server was up and runninng the hole time. This also happens sometimes while getting mails from the server with eg. fetchmail. Mostly everthing works fine. But sometimes there is and auth error while fetching? Can anyone help me ? regards mandy /var/qmail/log/send/current mail one to [EMAIL PROTECTED] @40003fbc6f9a223ff3b4 starting delivery 1759: msg 1586646 to local [EMAIL PROTECTED] @40003fbc6f9a22400354 status: local 1/10 remote 0/20 @40003fbc6f9a228fa60c delivery 1759: success: vmysql:_sql_error[1]:_Can't_create_database_'vpopmail'._Database_exists/vmys ql:_sql_error[3]:_No_Database_Selected/user_does_not_exist,_but_will_deliver_to_/home/vpopmail/domains/bar.de/catchall//did _0+0+1/ mail two to [EMAIL PROTECTED] @40003fbc86f00c683f24 starting delivery 1772: msg 1586646 to local [EMAIL PROTECTED] @40003fbc86f00c684adc status: local 1/10 remote 0/20 @40003fbc86f00d3e675c delivery 1772: success: did_0+0+1/
[vchkpw] disable_external_relay
Dear List Members, What does "disable_external_relay" do in the ".qmailadmin-limits" file? Can it be used to disable SMTP Relay even if I am using SMTP Authentication instead of POP-Before-SMTP? The install.txt says: *** quote *** You may disable these services: a) POP Access b) IMAP Access c) Roaming Users (External Relaying) d) Webmail Access e) Dialup Access f) Password Changing The syntax of the .qmailadmin-limits file for disabling the above services, respectively, is: disable_pop disable_imap disable_external_relay disable_webmail disable_dialup disable_password_changing *** unquote *** __ Devendra Singh IndiaMART InterMESH Limited (Global Gateway to Indian Market Place) B-1, Sector 8, Noida, UP - 201301, India Voice : +91-120-2543945, 2543946, 2543947 Fax: +91-120-2543943 http://www.indiamart.com http://www.indiangiftsportal.com http://www.indiantravelportal.com __ --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com). Version: 6.0.528 / Virus Database: 324 - Release Date: 16/10/03
Re: [vchkpw] disable_external_relay
No,it works only for pop-before-SMTP. I suggested to use it also for SMTP relay, but it wqas preferred to add a dedicated bit for SMTP relaying. So, you may also disable SMTP relay, but I don't know if you find the disable_smtp line working in the last vpopmail versions. I made the patch for making it work, inside qmailadmin (at that time qmailadmin-limits was handled by qmailadmin), but it was never integrated in qmailadmin. Ciao, Tonino At 24/11/2003 24/11/2003 +0530, you wrote: Dear List Members, What does "disable_external_relay" do in the ".qmailadmin-limits" file? Can it be used to disable SMTP Relay even if I am using SMTP Authentication instead of POP-Before-SMTP? The install.txt says: *** quote *** You may disable these services: a) POP Access b) IMAP Access c) Roaming Users (External Relaying) d) Webmail Access e) Dialup Access f) Password Changing The syntax of the .qmailadmin-limits file for disabling the above services, respectively, is: disable_pop disable_imap disable_external_relay disable_webmail disable_dialup disable_password_changing *** unquote *** __ Devendra Singh IndiaMART InterMESH Limited (Global Gateway to Indian Market Place) B-1, Sector 8, Noida, UP - 201301, India Voice : +91-120-2543945, 2543946, 2543947 Fax: +91-120-2543943 http://www.indiamart.com http://www.indiangiftsportal.com http://www.indiantravelportal.com __ --- Outgoing mail is certified Virus Free. Checked by AVG anti-virus system (http://www.grisoft.com). Version: 6.0.528 / Virus Database: 324 - Release Date: 16/10/03 [EMAIL PROTECTED]Interazioni di Antonio Nati http://www.interazioni.it [EMAIL PROTECTED]
[vchkpw] Problem with manually adding new domains
Hi all, Im running an enviroment with vpopmail on mysql. I've been trying to generate a script which does almost the same thing as vadddomain, but im having a problem... I add the correct lines to assign, virtualdomains and rctphosts, and insert a postmaster account into the vpopmail database, and also I run qmail-newu. But still I get this error when sending an email to the newly created domainname. <[EMAIL PROTECTED]>: Sorry, no mailbox here by that name. (#5.1.1) Does vpopmail need anything else in order to manually setup a domainname ? Hope someone can help. Best regards Morten Skou
Re: [vchkpw] Intermittent pop3 authentication failure
On 20031119 1052, Michael Bowe wrote: > file locking is used in several places throughout vpopmail > > However the only place I have ever heard of it causing problems is inside > the roaming user functions. > > Usually you would need to have a fair number of POP3 logins happening before > you run into locking problems. Perhaps consult your POP3 logs and look to > see if you are recording a high number of POP3 connections. > > The problem is exacerbated when you are using CDB auth backend rather than > MySQL backend. MySQL removes some (but not all) of the file-based operations > for the roaming users code. > > Michael. Hi Michael. Thanks for your reply. I have consulted the logs, and it seems that there are never more than 9 concurrent pop3 connections, as reported by tcpserver. The server is currently handling a small numbers of mailboxes - only a tiny fraction of the intended total. If it's struggling to keep up already, I dread to think how it will handle the rest. The box itself isn't exactly slow. It's a 1.7GHz Celeron, with a gigabyte of RAM, and twin 80Gb ATA100 disks in hardware ATA-RAID mirror config. The disks are both masters on seperate channels. I know this isn't ideal server spec, but the client has a very limited budget at the moment. Even so, I would expect it to be able to cope fairly easily. Can you, or anyone else, make any recommendations on trying to avoid or improve this bottleneck? I have been considering moving the entire ~vpopmail/etc directory onto a memory based filesystem for quicker access, with a backup copy on hard disk. What do you think of that idea? Moving to MySQL isn't ideal, due to my lack of experience with it. Many thanks in advance. Jason Mann
Re: [vchkpw] Problem with manually adding new domains
I think it creates das Mailboxdirs under /home/vpopmail/domains/... regards mandy Morten Skou wrote: Hi all, Im running an enviroment with vpopmail on mysql. I've been trying to generate a script which does almost the same thing as vadddomain, but im having a problem... I add the correct lines to assign, virtualdomains and rctphosts, and insert a postmaster account into the vpopmail database, and also I run qmail-newu. But still I get this error when sending an email to the newly created domainname. <[EMAIL PROTECTED]>: Sorry, no mailbox here by that name. (#5.1.1) Does vpopmail need anything else in order to manually setup a domainname ? Hope someone can help. Best regards Morten Skou
RE: [vchkpw] Problem with manually adding new domains
Yea but I also create those manually, (just forgot to mention that). So everything is there, assign, virtualhost, rctphosts and the directories. Also the .qmail-default is there containing the vdelivery stuff. Maybe I should add that if I use 'vadddomain', everything works perfectly. -Morten -Original Message- From: Mandy [mailto:[EMAIL PROTECTED] Sent: 24. november 2003 14:31 Cc: [EMAIL PROTECTED] Subject: Re: [vchkpw] Problem with manually adding new domains I think it creates das Mailboxdirs under /home/vpopmail/domains/... regards mandy Morten Skou wrote: >Hi all, > >Im running an enviroment with vpopmail on mysql. > >I've been trying to generate a script which does almost the same >thing as vadddomain, but im having a problem... > >I add the correct lines to assign, virtualdomains and rctphosts, >and insert a postmaster account into the vpopmail database, and also >I run qmail-newu. > >But still I get this error when sending an email to the newly created >domainname. > ><[EMAIL PROTECTED]>: >Sorry, no mailbox here by that name. (#5.1.1) > >Does vpopmail need anything else in order to manually setup a domainname >? > >Hope someone can help. > >Best regards >Morten Skou > > > > > > > > >
[vchkpw] Setting up the POP3 Daemon and memory allocation problem
I'm putting together a mail toaster and I've just installed vpopmail-5.3.30. ./configure \ --enable-roaming-users=y \ --enable-logging=p \ --enable-defaultquota=20971520S \ --enable-ip-alias-domains=n \ --enable-passwd=n \ --enable-clear-passwd=y \ --enable-domain-quotas=n \ --enable-mysql=y \ --enable-many-domains=n \ --enable-auth-logging=y \ --enable-mysql-logging=y \ --enable-mysql-limits=n \ --enable-valias=y \ --enable-incdir=/usr/local/mysql/include/mysql \ --enable-libdir=/usr/local/mysql/lib/mysql I get this error when testing the pop3 service: # telnet 127.0.0.1 110 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. +OK <[EMAIL PROTECTED]> user [EMAIL PROTECTED] +OK pass 123123 /home/vpopmail/bin/vchkpw: error while loading shared libraries: libcrypto.so.4: failed to map segment from shared object: Cannot allocate memory -ERR unable to write pipe Connection closed by foreign host. I've read Michael's issue with the allocated memory in the supervise script in: http://www.pipeline.com.au/staff/mbowe/isp/vpopmail-mysql.htm#pop3tips Here's my script: #!/bin/sh exec /usr/local/bin/softlimit -m 300 \ /usr/local/bin/tcpserver \ -H -l experimental.dev \ -v -c 30 -R 0 pop3 \ /var/qmail/bin/qmail-popup experimental.dev \ /home/vpopmail/bin/vchkpw /var/qmail/bin/qmail-pop3d Maildir 2>&1 I've even tried bumping the softlimit to 600 with no success. Any help would be appreciated. ron == Ron Dyck Webbtech www.webbtech.net ==
Re: [vchkpw] qpsmtpd
Henry, I too just started looking into it.. was the idea from this list?? Anyhow, what concerns me is the perl overhead for qpsmtpd, but I'm probably paying for that overhead by using SpamAssassin... There is a link for something that virtualizes a perl processor session to make the thing run like a daemon to avoid startup and memory grabbing issues; I believe the link appears on the develooper listing for qpsmtpd. Why change? I wanted a nice, friendly way to introduce username checking since the two patches "out there" for username checking in qmail-smtpd are conflicting with other patches I run or don't like the mysql backend I'd love to see anyone give a testamonial or some usage data about running qpsmtpd. (Sorry DJB) D. > Hi everyone, > > I just heard about qpsmtpd (http://develooper.com/code/qpsmtpd/) which is > a > qmail-smtpd replacement. It supports plugins that lets you control its > behavior, such as checking RBL lists, integrate SpamAssassin, etc. Yes, > the > current qmail-smtpd can do all that but sometimes that requires patching > the > source and I'm not a fan of having to mess around with source codes. > > Has anyone tried using qpsmtpd on their vpopmail installation? > > -Henry Ho > > > >
RE: [vchkpw] Setting up the POP3 Daemon and memory allocation problem
Why r u using the qmail-pop instead of courier? Most people will do courier-imap which does contain pop server as well and works beautifully with vpopmail. Remo Mattei Network Security Engineer cell 801-209-8554 email [EMAIL PROTECTED] -Original Message- From: Ron Dyck [mailto:[EMAIL PROTECTED] Sent: Monday, November 24, 2003 7:44 AM To: Vpopmail Subject: [vchkpw] Setting up the POP3 Daemon and memory allocation problem I'm putting together a mail toaster and I've just installed vpopmail-5.3.30. ./configure \ --enable-roaming-users=y \ --enable-logging=p \ --enable-defaultquota=20971520S \ --enable-ip-alias-domains=n \ --enable-passwd=n \ --enable-clear-passwd=y \ --enable-domain-quotas=n \ --enable-mysql=y \ --enable-many-domains=n \ --enable-auth-logging=y \ --enable-mysql-logging=y \ --enable-mysql-limits=n \ --enable-valias=y \ --enable-incdir=/usr/local/mysql/include/mysql \ --enable-libdir=/usr/local/mysql/lib/mysql I get this error when testing the pop3 service: # telnet 127.0.0.1 110 Trying 127.0.0.1... Connected to 127.0.0.1. Escape character is '^]'. +OK <[EMAIL PROTECTED]> user [EMAIL PROTECTED] +OK pass 123123 /home/vpopmail/bin/vchkpw: error while loading shared libraries: libcrypto.so.4: failed to map segment from shared object: Cannot allocate memory -ERR unable to write pipe Connection closed by foreign host. I've read Michael's issue with the allocated memory in the supervise script in: http://www.pipeline.com.au/staff/mbowe/isp/vpopmail-mysql.htm#pop3tips Here's my script: #!/bin/sh exec /usr/local/bin/softlimit -m 300 \ /usr/local/bin/tcpserver \ -H -l experimental.dev \ -v -c 30 -R 0 pop3 \ /var/qmail/bin/qmail-popup experimental.dev \ /home/vpopmail/bin/vchkpw /var/qmail/bin/qmail-pop3d Maildir 2>&1 I've even tried bumping the softlimit to 600 with no success. Any help would be appreciated. ron == Ron Dyck Webbtech www.webbtech.net ==
RE: [vchkpw] Setting up the POP3 Daemon and memory allocation problem
Try pushing your softlimit up a lot higher than that, give 2000 a try or take the softlimit off and see if your problem goes away. Shane >-Original Message- >From: Ron Dyck [mailto:[EMAIL PROTECTED] >Sent: Monday, 24 November 2003 10:44 PM >To: Vpopmail >Subject: [vchkpw] Setting up the POP3 Daemon and memory >allocation problem > > >I'm putting together a mail toaster and I've just installed >vpopmail-5.3.30. > >./configure \ >--enable-roaming-users=y \ >--enable-logging=p \ >--enable-defaultquota=20971520S \ >--enable-ip-alias-domains=n \ >--enable-passwd=n \ >--enable-clear-passwd=y \ >--enable-domain-quotas=n \ >--enable-mysql=y \ >--enable-many-domains=n \ >--enable-auth-logging=y \ >--enable-mysql-logging=y \ >--enable-mysql-limits=n \ >--enable-valias=y \ >--enable-incdir=/usr/local/mysql/include/mysql \ >--enable-libdir=/usr/local/mysql/lib/mysql > >I get this error when testing the pop3 service: > ># telnet 127.0.0.1 110 >Trying 127.0.0.1... >Connected to 127.0.0.1. >Escape character is '^]'. >+OK <[EMAIL PROTECTED]> >user [EMAIL PROTECTED] >+OK >pass 123123 >/home/vpopmail/bin/vchkpw: error while loading shared libraries: >libcrypto.so.4: failed to map segment from shared object: >Cannot allocate >memory >-ERR unable to write pipe >Connection closed by foreign host. > >I've read Michael's issue with the allocated memory in the >supervise script >in: >http://www.pipeline.com.au/staff/mbowe/isp/vpop>mail-mysql.htm#pop3tips > >Here's my script: >#!/bin/sh >exec /usr/local/bin/softlimit -m 300 \ >/usr/local/bin/tcpserver \ > -H -l experimental.dev \ > -v -c 30 -R 0 pop3 \ >/var/qmail/bin/qmail-popup experimental.dev \ >/home/vpopmail/bin/vchkpw /var/qmail/bin/qmail-pop3d Maildir 2>&1 > >I've even tried bumping the softlimit to 600 with no success. > >Any help would be appreciated. > >ron > >== >Ron Dyck >Webbtech >www.webbtech.net >== > > > > >
[vchkpw] vpopmail with drbd / intermezzo
Hi List, our current qmail/vpopmail server gets a little unstable due to some raid problems, so i want to setup a 2-node failover cluster with qmail, vpopmail and imap. the plan is to use drbd to mirror /home via tcp/ip to the second node and to use heartbeat to do a failover if the primary fails. the second node runs the same daemons as node-1, so users still have full access to their imap-accounts. s :) does anybody have any experience with this setup, has done it before or has any hints? im also thinking about intermezzo as distributed FS. any eperiences with that? many thanks for your opinions, greets from germany Tom
Re: [vchkpw] Setting up the POP3 Daemon and memory allocation problem
> Try pushing your softlimit up a lot higher than that, give 2000 a try > or take the softlimit off and see if your problem goes away. > > Shane Removing the softlimit seems to have done the trick. Thank-you! ron > > >-Original Message- > >From: Ron Dyck [mailto:[EMAIL PROTECTED] > >Sent: Monday, 24 November 2003 10:44 PM > >To: Vpopmail > >Subject: [vchkpw] Setting up the POP3 Daemon and memory > >allocation problem > > > > > >I'm putting together a mail toaster and I've just installed > >vpopmail-5.3.30. > > > >./configure \ > >--enable-roaming-users=y \ > >--enable-logging=p \ > >--enable-defaultquota=20971520S \ > >--enable-ip-alias-domains=n \ > >--enable-passwd=n \ > >--enable-clear-passwd=y \ > >--enable-domain-quotas=n \ > >--enable-mysql=y \ > >--enable-many-domains=n \ > >--enable-auth-logging=y \ > >--enable-mysql-logging=y \ > >--enable-mysql-limits=n \ > >--enable-valias=y \ > >--enable-incdir=/usr/local/mysql/include/mysql \ > >--enable-libdir=/usr/local/mysql/lib/mysql > > > >I get this error when testing the pop3 service: > > > ># telnet 127.0.0.1 110 > >Trying 127.0.0.1... > >Connected to 127.0.0.1. > >Escape character is '^]'. > >+OK <[EMAIL PROTECTED]> > >user [EMAIL PROTECTED] > >+OK > >pass 123123 > >/home/vpopmail/bin/vchkpw: error while loading shared libraries: > >libcrypto.so.4: failed to map segment from shared object: > >Cannot allocate > >memory > >-ERR unable to write pipe > >Connection closed by foreign host. > > > >I've read Michael's issue with the allocated memory in the > >supervise script > >in: > >http://www.pipeline.com.au/staff/mbowe/isp/vpop>mail-mysql.htm#pop3tips > > > >Here's my script: > >#!/bin/sh > >exec /usr/local/bin/softlimit -m 300 \ > >/usr/local/bin/tcpserver \ > > -H -l experimental.dev \ > > -v -c 30 -R 0 pop3 \ > >/var/qmail/bin/qmail-popup experimental.dev \ > >/home/vpopmail/bin/vchkpw /var/qmail/bin/qmail-pop3d Maildir 2>&1 > > > >I've even tried bumping the softlimit to 600 with no success. > > > >Any help would be appreciated. > > > >ron > > > >== > >Ron Dyck > >Webbtech > >www.webbtech.net > >== > > > > > > > > > > > > > >
Re: [vchkpw] disable_external_relay
On Monday, November 24, 2003, at 03:37 AM, tonix (Antonio Nati) wrote: No,it works only for pop-before-SMTP. I suggested to use it also for SMTP relay, but it wqas preferred to add a dedicated bit for SMTP relaying. Use disable_smtp in the .qmailadmin-limits file to disable SMTP access for the domain. The current version of vpopmail (5.3.30) supports this flag. -- Tom Collins - [EMAIL PROTECTED] QmailAdmin: http://qmailadmin.sf.net/ Vpopmail: http://vpopmail.sf.net/ Info on the Sniffter hand-held Network Tester: http://sniffter.com/
[vchkpw] Re: Setting up the POP3 Daemon and memory allocation problem
Hello Ron, On Monday, November 24, 2003 at 5:11:02 PM you wrote (at least in part): >> Try pushing your softlimit up a lot higher than that, give 2000 a try >> or take the softlimit off and see if your problem goes away. > Removing the softlimit seems to have done the trick. Thank-you! Removing is a BAD idea. Test what's the minimum necessary for './run' to execute and if it seems far to high investigate why it might be that high. Running w/o softlimit screams for a DoS. -- Best regards Peter Palmreuther The difference between stupidity and genius is that genius has limits.
Re: [vchkpw] vpopmail with drbd / intermezzo
Erik Bourget wrote: TuxRelated <[EMAIL PROTECTED]> writes: Hi List, our current qmail/vpopmail server gets a little unstable due to some raid problems, so i want to setup a 2-node failover cluster with qmail, vpopmail and imap. the plan is to use drbd to mirror /home via tcp/ip to the second node and to use heartbeat to do a failover if the primary fails. the second node runs the same daemons as node-1, so users still have full access to their imap-accounts. s :) does anybody have any experience with this setup, has done it before or has any hints? im also thinking about intermezzo as distributed FS. any eperiences with that? many thanks for your opinions, You're over-engineering. DRDB and Intermezzo are not ready for this. Try to imagine recovering from a failure in either of these. I whole heartedly agree. Intermezzo looks and feels like a research FS, which its pretty darn good for. Its not a production FS at this point. I suggest simply having every mail deliver to both locations, and hacking a pop/imap server that deletes from both. Personally, I don't go that far; I just deliver to both and have rsync clean up the second member of the storage pair when a delete happens. This is a little nappy if you're going to try and "cluster" these, as you'll get mail showing up and disappearing based on where the user hits until the rsync finishes. I don't know about anybody else, but I also get nervous cron'ing an rsync which removes files. Consider separating your MXs away from your mail storage boxes. Yes. Double Yes. Really, though, all you need is one stable box. Don't buy scummy IDE drives. You'll have a better time with one really good machine than with two crashy ones, and spend less. If people are paying to access their mailbox, I disagree 100%. 3 or 4 9s of availability isn't that hard to achieve with a well engineered solution. However, be ready to spend the right amount of money. There are several ways to solve this: Shared scsi storage with active/passive failover using something in the realm of Linux-HA or Veritas Cluster Services (opposite ends of the price spectrum. Also opposite ends of the ability to sleep at night spectrum). Simply hang an external scsi storage array (or fibre channel) off of two boxes on its two channels. Then have a cluster service mediating who has access to the boxes. This means one box is always going to waste, something which I'm not real keen on. You can expand this by having two external boxes and criss-crossing, with the ability for each machine to take control of both raid's, and then offer services from each with virtual IPs and fail over in each direction. The other solution is to build a real cluster, with redundant storage and front end machines delivering mail via NFS. Then you can abstract out as many or as few functions to their own clusters, and just access them via virtual IPs. This is the setup I'm migrating towards, piece by piece, for my hosted email platform. Right now I've got four front end smtp/pop/imap servers delivering to an active/passive veritas cluster on mirrored external raid (two external raid boxes mirrored in software by veritas). I'm moving this to a pair of NetApp filer heads, each offering different services and able to take over for each other (I feel this is less wasted hardware). I'm also running a pair of fail-over capable MySQL servers on my NFS servers, though those'll soon be moved off to a different pair of servers with more horsepower. I'm using Linux-HA tools to cluster MySQL, Veritas Foundation Suite and Cluster Server to cluster NFS, and a Foundry load balancer to cluster/balance my front end servers. Its a rather complex setup, but so far I've got 5 9s of availability, which means I get to sleep through the night, every night. Hope that provides some suggestions. Obviously a lot of this can be done on a more modest, or more extravagant, scale as the needs of your platform are very definitely going to be different. You can get external storage really cheap these days using internal IDE and external scsi interfaces (I bought a 1.2TB raw unit for under $7K USD recently). You can build an LVS load balanced cluster with pretty low end hardware that'll keep up with full 100Mbs line speed. Nick Harring Webley Systems
Re: [vchkpw] Re: Setting up the POP3 Daemon and memory allocation problem
> >> Try pushing your softlimit up a lot higher than that, give 2000 a try > >> or take the softlimit off and see if your problem goes away. > > > Removing the softlimit seems to have done the trick. Thank-you! > > Removing is a BAD idea. Test what's the minimum necessary for './run' > to execute and if it seems far to high investigate why it might be > that high. Running w/o softlimit screams for a DoS. > -- > Best regards > Peter Palmreuther I pushed it to 500 and it seems to work fine. Thanks for the tip! ron
Re: [vchkpw] vpopmail with drbd / intermezzo
On Monday, November 24, 2003, at 10:51 AM, Erik Bourget wrote: On another note, what would someone expect the requirements of a box running spamassassin's spamd for 2 million e-mails per day would be? I'm gunning for a few dual Xeon 2.4GHz. All these boxes do is spamd. I found that a dual 1.13GHz box is not adequate for handling a fifth of this load (spamd in addition to my filtering-rules-in-SQL patched maildrop, pop, etc) at three in the morning (spam time). This surprised me. Spamd is /INTENSIVE/. Anyone have tuning tips? Take a look at your memory statistics. Available RAM might be more of an issue than processor speed. Limiting the concurrency might help as well -- only processing 20 emails at a time instead of 50 might result in faster queue processing times. I assume that you're using something more efficient than qmail-scanner for the SpamAssassin connection... -- Tom Collins - [EMAIL PROTECTED] QmailAdmin: http://qmailadmin.sf.net/ Vpopmail: http://vpopmail.sf.net/ Info on the Sniffter hand-held Network Tester: http://sniffter.com/
[vchkpw] Mysql Threads
Hello, I saw, that on the mailserver there are 10 Mysqltreads waiting for requests. Everyone of the use 10MB RAM (standard installation of the rpms) Is this nessesary, our would 2 threads be enought. If yes, where can i change this ? Because 10 Threads --> 10 MB Ram --> 100MB RAM only for mysql ?? regards mandy.
Re: [vchkpw] Mysql Threads
On Monday 24 November 2003 19:57, Mandy wrote: > Hello, > > I saw, that on the mailserver there are 10 Mysqltreads waiting for > requests. Everyone of the use 10MB RAM (standard installation of the > rpms) Is this nessesary, our would 2 threads be enought. If yes, > where can i change this ? > Because 10 Threads --> 10 MB Ram --> 100MB RAM only for mysql ?? threads ? or processes? usually threads share memory, processes don't. so 10 processes with 10mb ram each = 100mb 10 threads with 10mb ram = 10mb but as vpopmail doesn't use threads, this is quite offtopic. -- Mit internetten Grüßen / Best Regards --- Justin Heesemannionium Technologies [EMAIL PROTECTED]www.ionium.org
Re: [vchkpw] vpopmail with drbd / intermezzo
Tom Collins <[EMAIL PROTECTED]> writes: > On Monday, November 24, 2003, at 10:51 AM, Erik Bourget wrote: >> On another note, what would someone expect the requirements of a box >> running spamassassin's spamd for 2 million e-mails per day would be? I'm >> gunning for a few dual Xeon 2.4GHz. All these boxes do is spamd. I found >> that a dual 1.13GHz box is not adequate for handling a fifth of this load >> (spamd in addition to my filtering-rules-in-SQL patched maildrop, pop, etc) >> at three in the morning (spam time). This surprised me. Spamd is >> /INTENSIVE/. Anyone have tuning tips? > > Take a look at your memory statistics. Available RAM might be more of an > issue than processor speed. Nope, 2GB of RAM in this thing, it's not even all used. > Limiting the concurrency might help as well -- only processing 20 emails at > a time instead of 50 might result in faster queue processing times. I have to finish them faster than they come in, though... SA takes about 1.5 seconds when it's slow (big mail), so the concurrency has to be big enough to allow for this given a few per second coming in. > I assume that you're using something more efficient than qmail-scanner for > the SpamAssassin connection... I'm just throwing | spamc in the big .qmail-default. I don't assume there's a more efficient way to do that. I'm not interested in filtering outgoing mail. Are there any good pre-learned Bayesian filters for SA? Thanks, - Erik
Re: [vchkpw] Mysql Threads OT
Sorry for the OT. But maybe you can help me elsewhere ;-) This is an output of top. Maybe this help you (and me). Only the Mailsystem is running . 8:09pm up 5 days, 22:00, 0 users, load average: 0,00, 0,02, 0,00 52 processes: 51 sleeping, 1 running, 0 zombie, 0 stopped CPU states: 0,2% user, 0,4% system, 0,0% nice, 99,4% idle Mem: 514488K av, 474188K used, 40300K free, 0K shrd, 102196K buff Swap: 498004K av, 15948K used, 482056K free 273092K cached PID USER PRI NI SIZE RSS SHARE STAT %CPU %MEM TIME COMMAND 22044 spamd 8 0 19572 16M 3584 S 0,0 3,3 0:05 spamd 1765 mysql 13 5 1 9988 1268 S N 0,0 1,9 0:10 mysqld 1784 mysql 12 5 1 9988 1268 S N 0,0 1,9 0:15 mysqld 1785 mysql 13 5 1 9988 1268 S N 0,0 1,9 0:00 mysqld 1786 mysql 13 5 1 9988 1268 S N 0,0 1,9 0:00 mysqld 1787 mysql 13 5 1 9988 1268 S N 0,0 1,9 0:00 mysqld 1788 mysql 13 5 1 9988 1268 S N 0,0 1,9 0:00 mysqld 1789 mysql 13 5 1 9988 1268 S N 0,0 1,9 0:00 mysqld 1790 mysql 13 5 1 9988 1268 S N 0,0 1,9 1:28 mysqld 1791 mysql 13 5 1 9988 1268 S N 0,0 1,9 0:00 mysqld 1792 mysql 13 5 1 9988 1268 S N 0,0 1,9 0:03 mysqld 9106 www9 0 8924 8924 3780 S 0,0 1,7 0:00 httpd Justin Heesemann wrote: threads ? or processes? I think processes ?! usually threads share memory, processes don't. so 10 processes with 10mb ram each = 100mb 10 threads with 10mb ram = 10mb but as vpopmail doesn't use threads, this is quite offtopic. regards mandy
[vchkpw] vpopmail with mysql documentation
Is there some documentation on how vpopmail works with mysql? I have it set-up succesfully, but I'm curious as to how exactly I can take advantage of the 'valias' table and also the relay table information etc. ron == Ron Dyck Webbtech www.webbtech.net ==
[vchkpw] qmailadmin
When I try and login with qmailadmin, it says invalid username / password.. Are there logfiles or something I can look at to see why this thing is acting like it hates me? :) Thanks, Duane
Re: [vchkpw] vpopmail with drbd / intermezzo
Monday, November 24, 2003, 5:44:49 PM, Nick wrote: NH> I whole heartedly agree. Intermezzo looks and feels like a research FS, NH> which its pretty darn good for. Its not a production FS at this point. ACK - but i hope drbd is better NH> This is a little nappy if you're going to try and "cluster" these, as NH> you'll get mail showing up and disappearing based on where the user hits NH> until the rsync finishes. I don't know about anybody else, but I also NH> get nervous cron'ing an rsync which removes files. NH> Consider separating your MXs away from your mail storage boxes. NH> Yes. Double Yes. is done NH> If people are paying to access their mailbox, I disagree 100%. 3 or 4 9s NH> of availability isn't that hard to achieve with a well engineered NH> solution. However, be ready to spend the right amount of money. hehehe, this is the problem :) NH> There are several ways to solve this: NH> Shared scsi storage with active/passive failover using something in the NH> realm of Linux-HA or Veritas Cluster Services (opposite ends of the NH> price spectrum. Also opposite ends of the ability to sleep at night NH> spectrum). Simply hang an external scsi storage array (or fibre channel) NH> off of two boxes on its two channels. Then have a cluster service NH> mediating who has access to the boxes. This means one box is always NH> going to waste, something which I'm not real keen on. You can expand NH> this by having two external boxes and criss-crossing, with the ability NH> for each machine to take control of both raid's, and then offer services NH> from each with virtual IPs and fail over in each direction. NH> The other solution is to build a real cluster, with redundant storage NH> and front end machines delivering mail via NFS. Then you can abstract NH> out as many or as few functions to their own clusters, and just access NH> them via virtual IPs. NH> This is the setup I'm migrating towards, piece by piece, for my hosted NH> email platform. Right now I've got four front end smtp/pop/imap servers NH> delivering to an active/passive veritas cluster on mirrored external NH> raid (two external raid boxes mirrored in software by veritas). I'm NH> moving this to a pair of NetApp filer heads, each offering different NH> services and able to take over for each other (I feel this is less NH> wasted hardware). I'm also running a pair of fail-over capable MySQL NH> servers on my NFS servers, though those'll soon be moved off to a NH> different pair of servers with more horsepower. I'm using Linux-HA tools NH> to cluster MySQL, Veritas Foundation Suite and Cluster Server to cluster NH> NFS, and a Foundry load balancer to cluster/balance my front end NH> servers. NH> Its a rather complex setup, but so far I've got 5 9s of availability, NH> which means I get to sleep through the night, every night. NH> Hope that provides some suggestions. it does, thank you, but i guess these setups are a little to oversized for me. main problem is that i won't get a "fitting" amount of money to realize these scenarios. wen went really good with this single box for about 3 years, but recently there were some nasty down-times due to these raid problems. besides the os is a 7.x suse and a lot of patches are not aplied (no smtp.auth, but "smtp after imap" instead...), so i thought, if i have to reinstall the system i might do it with a spare server to increase the availability. NH> Obviously a lot of this can be done on a more modest, or more NH> extravagant, scale as the needs of your platform are very definitely NH> going to be different. You can get external storage really cheap these NH> days using internal IDE and external scsi interfaces (I bought a 1.2TB NH> raw unit for under $7K USD recently). Hell :) im talking about 700 account with about 8 Gig of imap dirs... i thought about mirroring to 40 Gig-IDE-drives... that will last for the next decade :) NH> You can build an LVS load balanced NH> cluster with pretty low end hardware that'll keep up with full 100Mbs NH> line speed. thanks for describing how it should be :) bye tom
Re: [vchkpw] vpopmail with drbd / intermezzo
Monday, November 24, 2003, 5:30:05 PM, Erik wrote: EB> You're over-engineering. DRDB and Intermezzo are not ready for this. Try to EB> imagine recovering from a failure in either of these. ok, intermezzo really seems to be not ready for production, but drbd makes a pretty stable impression on me. i have set up two boxes and will test the system tomorrow. EB> I suggest simply having every mail deliver to both locations, how can i accomplish this? the only way would be a some kind of balancer in front of the the qmail boxes, but then again i have another spof. EB> and hacking a pop/imap server that deletes from both. ARG... i guess this exceeds my abilities :) EB> Personally, I don't go that far; I EB> just deliver to both and have rsync clean up the second member of the storage EB> pair when a delete happens. how do you do this double-delivery? EB> Consider separating your MXs away from your mail storage boxes. EB> Really, though, all you need is one stable box. Don't buy scummy IDE drives. EB> You'll have a better time with one really good machine than with two crashy EB> ones, and spend less. im just about to migrate this 500 accs from one crashy box to two of them :) no, i think you just need some sort of redundancy to achieve a certain level of availability. and i thought, this would be a rather "cheap" approach thanks for your opinion greets Tom
Re: [vchkpw] Mysql Threads
They're threads, they share the same memory. So all the MySQL threads are sharing, among them, 10 megs. For an RDBMS, MySQL is quite lightweight. -- Adam Hooper [EMAIL PROTECTED] Mandy wrote: Hello, I saw, that on the mailserver there are 10 Mysqltreads waiting for requests. Everyone of the use 10MB RAM (standard installation of the rpms) Is this nessesary, our would 2 threads be enought. If yes, where can i change this ? Because 10 Threads --> 10 MB Ram --> 100MB RAM only for mysql ?? regards mandy.
Re: [vchkpw] Mysql Threads
I don't quite follow you. Why is it not relational? Note that MySQL's InnoDB table storage supports transactions, row-level locks, and foreign keys. -- Adam Hooper [EMAIL PROTECTED] Erik Bourget wrote: Adam Hooper <[EMAIL PROTECTED]> writes: They're threads, they share the same memory. So all the MySQL threads are sharing, among them, 10 megs. For an RDBMS, MySQL is quite lightweight. Then again, it's not an RDBMS (note the lack of 'relational'). SQL syntax doesn't make an RDB. - Erik
RE: [vchkpw] Mysql Threads
InnoDB and MyISAM (and others) are the storage engines behind Mysql. As far as performance goes, InnoDB is very fast was well. We have been using it on Production servers for over a year now and it works great. Ross Davis DataAnywhere.net 250-470-9192 ChaletsOnline.com is coming soon Don't you deserve a vacation! -Original Message- From: Erik Bourget [mailto:[EMAIL PROTECTED] Sent: Monday, November 24, 2003 4:13 PM To: Adam Hooper Cc: Mandy; VCHKPW Mailinglist Subject: Re: [vchkpw] Mysql Threads Adam Hooper <[EMAIL PROTECTED]> writes: > I don't quite follow you. Why is it not relational? Note that MySQL's > InnoDB table storage supports transactions, row-level locks, and > foreign keys. To be fair, I don't count InnoDB as "mysql". Perhaps I should. Is it production-ready (I assume so)? How is the speed compared to featureless myisam? - Erik
Re: [vchkpw] Mysql Threads
I've never had problems with InnoDB in the past 1-2 years. In one case it's being used for some fairly computationally intense PHP website calculations. Many people have used it in more critical applications, and it's up to the task. Slashdot, for instance, or Yahoo! Finance. It's around the same speed as MyISAM. One thing it's missing is fulltext searching... but you can't win 'em all It's not really all that useful for vpopmail, because all the data's in one table anyway. But using InnoDB wouldn't cause all that much harm. InnoDB is installed and initialized by default on MySQL 4.x. To use it, just ALTER TABLE table_name TYPE=InnoDB (could take a while if it's a big table -- you might want to create a separate InnoDB table and copy a few thousand rows at a time), or when CREATE-ing, CREATE TABLE table_name (blah blah blah) TYPE=InnoDB. -- Adam Hooper [EMAIL PROTECTED] Erik Bourget wrote: Adam Hooper <[EMAIL PROTECTED]> writes: I don't quite follow you. Why is it not relational? Note that MySQL's InnoDB table storage supports transactions, row-level locks, and foreign keys. To be fair, I don't count InnoDB as "mysql". Perhaps I should. Is it production-ready (I assume so)? How is the speed compared to featureless myisam? - Erik
Re: [vchkpw] Mysql Threads
Adam Hooper wrote: I've never had problems with InnoDB in the past 1-2 years. In one case it's being used for some fairly computationally intense PHP website calculations. Many people have used it in more critical applications, and it's up to the task. Slashdot, for instance, or Yahoo! Finance. It's around the same speed as MyISAM. One thing it's missing is fulltext searching... but you can't win 'em all It's not really all that useful for vpopmail, because all the data's in one table anyway. But using InnoDB wouldn't cause all that much harm. InnoDB is installed and initialized by default on MySQL 4.x. To use it, just ALTER TABLE table_name TYPE=InnoDB (could take a while if it's a big table -- you might want to create a separate InnoDB table and copy a few thousand rows at a time), or when CREATE-ing, CREATE TABLE table_name (blah blah blah) TYPE=InnoDB. Last i checked Slashdot was running PostGreSQL.
