Hash Cache using Require

2004-12-03 Thread Bill Whillers
I recently ported a set of old CGI applications for mod_perl. Each script loads a few hashes from flat files (using "open") filled with plain rows of delimited data that rarely changes (~50k each). The hashes are built by iterating thru each file, row by row, assigning values to keys. All the f

Server Load Profile

2005-05-12 Thread Bill Whillers
Hi, I'd really appreciate any ideas or "best practices" you might have before re-inventing with Yet Another Benchmarker/Profiler... We are expecting an unusually high amount of traffic over the next month on one of our Apache/MySQL machines and I'd like to profile this in a simple, "bootstap"

Re: Server Load Profile

2005-05-15 Thread Bill Whillers
appreciated. Bill On Thursday 12 May 2005 16:57, Stas Bekman wrote: > Bill Whillers wrote: > > Hi, > > > > I'd really appreciate any ideas or "best practices" you might have before > > re-inventing with Yet Another Benchmarker/Profiler... > > &g

MLDBM::Sync / BerkeleyDB

2005-07-06 Thread Bill Whillers
Instead of using Apache::Reload to monitor periodically re-cached flat files of session configuration data, I'm considering implementing MLDBM::Sync or BerkeleyDB. The amount of data needing to be loaded during each session is relatively small and variable (10-25k) but typically, these configur

Persistent storage

2005-07-08 Thread Bill Whillers
Are there any peculiarities or recommendations with using either YAML, Storable (or another means) to efficiently store session hashes and bring them back to life safely from rdbms (mysql)? So far, I've avoided using Data::Dumper (and eval) and just used 'split' with stored comma-delimited hash

Re: MLDBM::Sync / BerkeleyDB

2005-07-08 Thread Bill Whillers
orked location is this still at least roughly the case? Thank you ! On Friday 08 July 2005 09:07, Perrin Harkins wrote: > I meant to respond to this one earlier, and your Storable question > reminded me. > > On Wed, 2005-07-06 at 14:01 -0700, Bill Whillers wrote: > > Instead o

MP2 - ("did not send an HTTP header")

2005-07-11 Thread Bill Whillers
Ugh. We have CGI scripts that were ported a while ago to MP 1x and seemed to work fine at that time but now we've set up an MP 2 environment and are seeing "did not send an HTTP header" (everywhere), such as with: print "Location: $url\n\n"; (All CGI code here uses the same common method to pr

Re: MP2 - ("did not send an HTTP header")

2005-07-12 Thread Bill Whillers
ks Kevin - Original Message - From: "Kevin A. McGrail" <[EMAIL PROTECTED]> To: "Bill Whillers" <[EMAIL PROTECTED]> Sent: Tuesday, July 12, 2005 5:37 AM Subject: Re: MP2 - ("did not send an HTTP header") > I've gotten the opinion so far that

Re: MP2 - ("did not send an HTTP header")

2005-07-12 Thread Bill Whillers
) (??). httpd.conf uses: SetHandler perl-script PerlResponseHandler ModPerl::Registry PerlOptions +ParseHeaders Options +ExecCGI Thanks On Tuesday 12 July 2005 11:59, Geoffrey Young wrote: > Bill Whillers wrote: > > Can someone on the list share any information ab

Re: MP2 - ("did not send an HTTP header")

2005-07-12 Thread Bill Whillers
The test machine is running: CGI 3.10 Apache/2.0.54 (Unix) mod_perl/2.0.1 Perl/v5.8.5 On Tuesday 12 July 2005 13:12, Bill Whillers wrote: > Thanks Geoff, > > I'm not suggesting this is a 'bug' at this point however I'd like to find > (or solicit) more info

Re: MP2 - ("did not send an HTTP header")

2005-07-12 Thread Bill Whillers
ECT; but for now, it appears that we're on the right track. Hope this thread can help others. On Tuesday 12 July 2005 13:22, Bill Whillers wrote: > The test machine is running: > > CGI 3.10 > Apache/2.0.54 (Unix) > mod_perl/2.0.1 > Perl/v5.8.5 > > On Tuesday

Apache2::Status Trouble

2005-07-13 Thread Bill Whillers
I'm having trouble getting Apache2::Status to display particular information. (following examples in "practical-mod_perl") The application menus work but "PerlRequire'd Files" and "Compiled Registry Scripts" are showing nothing -- other options appear to work fine. I've been running our scripts

Re: Apache2::Status Trouble (Resolved)

2005-07-13 Thread Bill Whillers
(be sure to run in single-process mode) On Wednesday 13 July 2005 15:47, Bill Whillers wrote: > I'm having trouble getting Apache2::Status to display particular > information. (following examples in "practical-mod_perl") > > The application menus work but "Pe

Large Caches - How Stateful?

2005-08-26 Thread Bill Whillers
Can I improve inefficiencies with using Storable freeze/thaw on 2-6MB hashes assuming that all data in the hashes are necessary (for each session) and changing every-so-often? --> Is it possible to create an apache variable at server start-up that can be referenced read/write by all forked chil

Storable Freeze/thaw - Size Limits - 65535 (?)

2005-09-18 Thread Bill Whillers
When using Storable freeze/thaw to work with basic object (hash) storage within a mysql db (blob column), I can't seem to get any more than 65535 bytes stored. Since 65535 appears to be a "magic" number, I've been digging for where my problem might reside (Storable, Perl, etc). but knowing man

Re: Storable Freeze/thaw - Size Limits - 65535 (?)

2005-09-19 Thread Bill Whillers
imitation: > > http://dev.mysql.com/doc/mysql/en/storage-requirements.html > > If you're using a BLOB column type, you're limited to 2^16 bytes, which is > the barrier you're hitting. Try a MEDIUMBLOB column and see if that > helps. > > --pete > > O

cdb/Storable (Was: Storable Freeze/thaw ....)

2005-09-19 Thread Bill Whillers
ile, so we optimixe for quick access. > > Matthew > > -Original Message- > From: Bill Whillers <[EMAIL PROTECTED]> > Date: Sun, 18 Sep 2005 22:43:09 > To:"mod_perl list" > Subject: Storable Freeze/thaw - Size Limits - 65535 (?) > > When using Storable

Re: cdb/Storable (Was: Storable Freeze/thaw ....)

2005-09-19 Thread Bill Whillers
Thanks Perrin, > Compression (using zlib) tends to speed things up a bit. So at what point (1k, 10k, 100k) might the overhead of a decompress on a frozen chunk make real sense? -- If we compressed every frozen 1k item (requiring decompress everytime), might this only add unnecessary overhead?

Re: Advocacy and Talking Points

2005-09-28 Thread Bill Whillers
I'm an advocate. But this argument can be broken into at least a few areas or more (beyond the "walls" of mod_perl) since scaling applies to human as well as hardware and capital infrastructures. This may be old news and common, but I hear less of performance scaling criticisms than of what so

PERL_CHILD_INIT

2006-03-08 Thread Bill Whillers
Versions: Apache/2.0.54 mod_perl/2.0.1 Where can I verify: PERL_CHILD_INIT=1 PERL_STACKED_HANDLERS=1 Are these callbacks defaulting in mod_perl 2? (Using Apache2::Status, I don't see current values.) How can these be verified without Apache2::Status? Thanks All, Bill

Semaphores

2006-03-18 Thread Bill Whillers
To avoid use of Reload, I'm using semaphores to ensure all processes are up to date with a single large hash that rarely gets updated. Is this a bad idea? I'd appreciate any constructive criticisms: # each session unless(-e "$semaphore/$$"){ # do the caching routine from

Re: Semaphores

2006-03-18 Thread Bill Whillers
Thanks - It'd be great to share this memory, but I'm suspecting start/stop could cause other problems -- i.e. dropping current connections. Also, we'd still need to know when to start/stop the given machine's service. As for touching, instead of using the physical disk, we could use an extra c

PerlSetEnv

2006-05-24 Thread Bill Whillers
Hello all, SetEnv was convenient for site specific configurations. We now use modperl and PerlSetEnv. The problem is when under virtual hosting environments, one site's ENV value (with the same name) (and set under ) inevitably gets used by another site. How is this problem correctly mitigated

Re: Redirects?

2007-01-17 Thread Bill Whillers
Assuming your not re-using session variables, you might want to verify that your package names do not conflict and that your conditions for any redirects are not confused. I remember fighting this in a previous life. B On Wednesday 17 January 2007 08:24, Perrin Harkins wrote: > On Tue, 2007-01

bouncing emails

2007-01-28 Thread Bill Whillers
Hello, Although not exclusively a MP dependant issue, maybe this is the best list to ask since I'm concerned about performance, using perl and clean code. A couple years ago, I built (and now maintain) Yet Another custom job that processes bounced email messages set by our web servers. It parse

Profiling Tools

2007-03-12 Thread Bill Whillers
Hi, I'd like to lightly monitor server load and overall utilization and include decent httpd detail (on linux machines). Basically, I'd like to run a periodic job and log the results. I rolled my own a long time ago, adding complexity over time and using basic server tools. I've experimented

Charts and Graphs

2007-04-12 Thread Bill Whillers
Hello, I'm wondering what people are using for efficiently generating charts and graphs on the fly from within a mod_perl environment. I've been using GD::Graph for a while but I'm hoping to get a bit more feature-deep. I'm not terribly concerned about getting a bit more complicated if it mea

PDF creation tools

2007-09-05 Thread Bill Whillers
Hello, I'm looking for a fast and simple module for creating simple PDF format documents from mostly text data and possibly some small images (i.e. icons, etc.). Lot's of tools available on either CPAN or Source Forge, but it's been a while since I've looked at these and I'm guessing 1 or 2 ha

Re: FYI

2007-10-22 Thread Bill Whillers
Maybe someones working? I'm just getting generic Internal Server Errors when searching on anything like "handler". http://perl.apache.org/search/swish.cgi?query=handler&sbm=&submit=search On Monday 22 October 2007 16:47, Arshavir Grigorian wrote: > Not sure if people already know about this,