Re: [PHP] page suck attack

2008-05-21 Thread Michael McGlothlin
robert wrote: Hi Every so often my site is "attacked" in which all URLS on my site are retrieved in the span of minutes. What is this called?? I mean what do I google for? I don't know where to begin. I'm not sure if I am going to implement such at thing but I would like to be able to resear

Re: [PHP] page suck attack

2008-05-21 Thread Aschwin Wesselius
robert wrote: Not that i can tell. Yahoo and google have a signature: googlebot and slurp. both of them also check my site over a span of days. that's all good. The others come from regular isps as far as their IP tells me and the hits are within milliseconds. Hi, Are the URL's legit? Or are

Re: [PHP] page suck attack

2008-05-21 Thread TG
Can you check your logs and look at the user agent for what's making the connections? Could it just be a search engine crawler indexing your pages? You can control access, usually, via a robots.txt exclusion file. If it's someone else mirroring your site for some reason, some programs that d

Re: [PHP] page suck attack

2008-05-21 Thread robert
Not that i can tell. Yahoo and google have a signature: googlebot and slurp. both of them also check my site over a span of days. that's all good. The others come from regular isps as far as their IP tells me and the hits are within milliseconds. On May 21, 2008, at 8:57 AM, Gavin M. Roy w

RE: [PHP] page suck attack

2008-05-21 Thread Warren Vail
Hmmm, sounds like a search engine scan, Google or Yahoo Slurpy? Do a reverse lookup on the requesting IP. I would think the goal would be to get this increased? You can stop it (or control it a bit) by placing a robots.txt file in the root directory, then telling the robot which paths not to fol

Re: [PHP] page suck attack

2008-05-21 Thread Jason Pruim
One thing you might want to check for before blocking it is looking in the logs and checking to see if it is one of the search engines that is grabbing your URL's... Which I would think you actually want :) On May 21, 2008, at 11:54 AM, robert wrote: Hi Every so often my site is "attacked"

Re: [PHP] page suck attack

2008-05-21 Thread Dan Joseph
On Wed, May 21, 2008 at 11:54 AM, robert <[EMAIL PROTECTED]> wrote: > Hi > Every so often my site is "attacked" in which all URLS on my site are > retrieved in the span of minutes. What is this called?? I mean what do I > google for? I don't know where to begin. > > I'm not sure if I am going to i

Re: [PHP] page suck attack

2008-05-21 Thread Gavin M. Roy
Search engines indexing your site? On Wed, May 21, 2008 at 11:54 AM, robert <[EMAIL PROTECTED]> wrote: > Hi > Every so often my site is "attacked" in which all URLS on my site are > retrieved in the span of minutes. What is this called?? I mean what do I > google for? I don't know where to begin.