Re: [EMAIL PROTECTED] Apache Multi Process Limit

2007-06-09 Thread Joshua Slive
On 6/9/07, Angelo Bourik <[EMAIL PROTECTED]> wrote: The problem is that I am able to get only two of these scripts running at the same time. So it would still take me at least 5 days to get all the results. The rest of the scripts just sit there in the server's backlog. This is definitely due t

Re: [EMAIL PROTECTED] Apache Multi Process Limit

2007-06-09 Thread Vincent Bray
On 09/06/07, Angelo Bourik <[EMAIL PROTECTED]> wrote: Hello all, Hi, If I understood your question correctly, you've written a spider script that runs via apache. That script connects to a remote site, fetches a page by id and parses out the data you need, once per request to your own server (

[EMAIL PROTECTED] Apache Multi Process Limit

2007-06-09 Thread Angelo Bourik
Hello all, I am in a bind with Apache's multi process limit. Let me explain what I am doing. There's this website which has career details of all the football players since the beginning of professional football. They have a simple web form which allows you to look at a player's profile by enteri

Re: [EMAIL PROTECTED] error doc handler ok for 403 but fails on 404

2007-06-09 Thread j k
On 6/9/07, Joshua Slive <[EMAIL PROTECTED]> wrote: On 6/9/07, j k <[EMAIL PROTECTED]> wrote: > The requested URL /nof.html was not found on this server. > > Additionally, a 404 Not Found error was encountered while trying to use an > ErrorDocument to handle the request.

Re: [EMAIL PROTECTED] error doc handler ok for 403 but fails on 404

2007-06-09 Thread Joshua Slive
On 6/9/07, j k <[EMAIL PROTECTED]> wrote: The requested URL /nof.html was not found on this server. Additionally, a 404 Not Found error was encountered while trying to use an ErrorDocument to handle the request. Apache Server at myserver Port 80 and when I look

[EMAIL PROTECTED] error doc handler ok for 403 but fails on 404

2007-06-09 Thread j k
I followed this suggestion in the apache2 htpd.conf to use the default error handlers: # The internationalized error documents require mod_alias, mod_include # and mod_negotiation. To activate them, uncomment the following 30 lines. and it works fine for a 403 i get the expected response: Access

Re: [EMAIL PROTECTED] Auth basic only compares first 8 chars

2007-06-09 Thread Tom Donovan
Mark Constable wrote: Using apache 2.2.4 with mod_auth_basic, mod_dbd and mod_authn_dbd (with apr-util compiled with sqlite3 support) it seems that only the first 8 characters of an incoming password are compared to the crypted version stored in the database! When you use the crypt algorithm, on

RE: [EMAIL PROTECTED] mod_rewrite and mod_jk help

2007-06-09 Thread Allen Pulsifer
> now i change your sample rewrite rule abit to > RewriteRule ^/(.*?)/(.*)$ /user/$2?user=$1 [L] > > When i tried to access http://www.example.com/me/home.jsp. i > got the following error in error_log > > [error] [client 127.0.0.1] File does not exist: /var/www/html/me > > Seems httpd ignore th

Re: [EMAIL PROTECTED] OT: where to discuss general issues concerning spiders?

2007-06-09 Thread lists
Mark H. Wood wrote: > Your chance to tell me where to go :-) > > I'm looking for a good place to discuss non-server-specific issues > relating to spidering. Such as: "I have this great new proposal that > would help us to segregate spider and real-user access in our > statistics" > do you