Re: [PHP] spider

2008-03-23 Thread Børge Holen
On Sunday 23 March 2008 12:12:04 Michelle Konzack wrote: > Am 2008-03-21 19:15:13, schrieb Børge Holen: > > wget is fast and easy though... umm I'm on an direct 100mbit > > connection... wget does it brute > > Sometimes it is too fast for me... :-) > Specialy If I work in Paris on my Dual-STM-4 ne

Re: [PHP] spider

2008-03-23 Thread Michelle Konzack
Am 2008-03-21 13:58:59, schrieb Wolf: > Both are pretty effecitve and give pretty much the same results, > however with the CURL you can pass other things alone (user:pass) > which with wget you can not do. ??? wget http://${USER}:[EMAIL PROTECTED]/ is working and wget --http-user="${US

Re: [PHP] spider

2008-03-23 Thread Michelle Konzack
Am 2008-03-21 14:12:04, schrieb Wolf: > OK, so I stand corrected there... But has anyone seen a PHP port of > wget or is curl the only one of the 2 which does it natively in a > compiled version of php with curl? :) AFAIK, there is no native port. But why do you want one? -- "wget is working p

Re: [PHP] spider

2008-03-23 Thread Michelle Konzack
Am 2008-03-21 19:15:13, schrieb Børge Holen: > wget is fast and easy though... umm I'm on an direct 100mbit connection... > wget does it brute Sometimes it is too fast for me... :-) Specialy If I work in Paris on my Dual-STM-4 network... Then, --limit-rate= is my friend. Thanks, Greetings and

Re: [PHP] spider

2008-03-21 Thread tedd
To get directory permissions, you'd really have to go through either FTP or a terminal connection (telnet, etc). Yes, but that's doing it programmatically, what about this? What if you knew that a directory on a site was set to 0777 -- what damage could you cause? I have seen scripts that cl

Re: [PHP] spider

2008-03-21 Thread TG
ation type link sources. -TG - Original Message - From: Ray Hauge <[EMAIL PROTECTED]> To: tedd <[EMAIL PROTECTED]> Cc: php-general@lists.php.net Date: Fri, 21 Mar 2008 13:45:35 -0500 Subject: Re: [PHP] spider > Have a look at something like this: > > http://simplehtmld

Re: [PHP] spider

2008-03-21 Thread TG
quiring authorization). That's a really basic site security check. I know you know you should use good coding practices and use more intensive site security scanning tools. -TG - Original Message - From: tedd <[EMAIL PROTECTED]> To: php-general@lists.php.net Date: Fri, 21 M

Re: [PHP] spider

2008-03-21 Thread Eric Butera
On Fri, Mar 21, 2008 at 1:52 PM, tedd <[EMAIL PROTECTED]> wrote: > Also, is there a way to spider through a remote web site gathering > directory permissions? I should hope not. > > If not, can one attempt to write a file and record the > failures/successes (0777 directories)? I don't know i

Re: [PHP] spider

2008-03-21 Thread Wolf
> I knew sometime I would have to figure out what CURL is, but now WGET > (WETFTI) as well. I was hoping for something simple that wouldn't > hurt my brain. > > Thanks a lot guys! :-) For hijacking the thread? No Problem! For making your brain hurt? Anytime!! We're just here to help! ;)

Re: [PHP] spider

2008-03-21 Thread Ray Hauge
tedd wrote: Hi gang: How do you spider a remote web site in php? I get the general idea, which is to take the root page, strip out the links and repeat the process on those links. But, what's the code? Does anyone have an example they can share or a direction for me to take? Also, is there

Re: [PHP] spider

2008-03-21 Thread Daniel Brown
On Fri, Mar 21, 2008 at 1:52 PM, tedd <[EMAIL PROTECTED]> wrote: > Hi gang: > > How do you spider a remote web site in php? > > I get the general idea, which is to take the root page, strip out the > links and repeat the process on those links. But, what's the code? I make absolutely no war

Re: [PHP] spider

2008-03-21 Thread tedd
At 1:52 PM -0400 3/21/08, tedd wrote: Hi gang: How do you spider a remote web site in php? You guys are always doing this. I ask a simple question like what's a + b and you guys high-jack the thread and start discussing the quadratic equation. :-) I knew sometime I would have to figure ou

Re: [PHP] spider

2008-03-21 Thread Wolf
"Børge Holen" <[EMAIL PROTECTED]> wrote: > On Friday 21 March 2008 19:12:04 Wolf wrote: > > Daniel Brown <[EMAIL PROTECTED]> wrote: > > > On Fri, Mar 21, 2008 at 1:58 PM, Wolf <[EMAIL PROTECTED]> wrote: > > > > In one word: CURL > > > > > > > > In another word: WGET > > > > > > > >

Re: [PHP] spider

2008-03-21 Thread Børge Holen
On Friday 21 March 2008 19:12:04 Wolf wrote: > Daniel Brown <[EMAIL PROTECTED]> wrote: > > On Fri, Mar 21, 2008 at 1:58 PM, Wolf <[EMAIL PROTECTED]> wrote: > > > In one word: CURL > > > > > > In another word: WGET > > > > > > Both are pretty effecitve and give pretty much the same results,

Re: [PHP] spider

2008-03-21 Thread Børge Holen
On Friday 21 March 2008 18:58:59 Wolf wrote: > tedd <[EMAIL PROTECTED]> wrote: > > Hi gang: > > > > How do you spider a remote web site in php? > > > > I get the general idea, which is to take the root page, strip out the > > links and repeat the process on those links. But, what's the code? >

Re: [PHP] spider

2008-03-21 Thread Wolf
Daniel Brown <[EMAIL PROTECTED]> wrote: > On Fri, Mar 21, 2008 at 1:58 PM, Wolf <[EMAIL PROTECTED]> wrote: > > > > In one word: CURL > > > > In another word: WGET > > > > Both are pretty effecitve and give pretty much the same results, however > > with the CURL you can pass other things

Re: [PHP] spider

2008-03-21 Thread Daniel Brown
On Fri, Mar 21, 2008 at 1:58 PM, Wolf <[EMAIL PROTECTED]> wrote: > > In one word: CURL > > In another word: WGET > > Both are pretty effecitve and give pretty much the same results, however > with the CURL you can pass other things alone (user:pass) which with wget you > can not do. [EMAIL P

Re: [PHP] spider

2008-03-21 Thread Robert Cummings
On Fri, 2008-03-21 at 13:58 -0400, Wolf wrote: > tedd <[EMAIL PROTECTED]> wrote: > > In one word: CURL > > In another word: WGET > > Both are pretty effecitve and give pretty much the same results, however > with the CURL you can pass other things alone (user:pass) which with > wget you c

Re: [PHP] spider

2008-03-21 Thread Wolf
tedd <[EMAIL PROTECTED]> wrote: > Hi gang: > > How do you spider a remote web site in php? > > I get the general idea, which is to take the root page, strip out the > links and repeat the process on those links. But, what's the code? > Does anyone have an example they can share or a dire

[PHP] spider

2008-03-21 Thread tedd
Hi gang: How do you spider a remote web site in php? I get the general idea, which is to take the root page, strip out the links and repeat the process on those links. But, what's the code? Does anyone have an example they can share or a direction for me to take? Also, is there a way to spi

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-30 Thread Jochem Maas
Jay Blanchard wrote: [snip] Pardon my ignorance but can you enlighten me a little more please? Like where can I look for them or how to code? [/snip] Start here http://www.php.net/file_get_contents [snip] As always all members are more than welcome to ask me for graphics I hope to be benevolen

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Chirantan Ghosh
ROTECTED]> Sent: Friday, July 29, 2005 2:37 PM Subject: Re: [PHP] PHP Spider/Crawler for Emails possible? I guess my question at this point is that it sounds like you have control of the system. Why not have it so when they enter their email address, they can check a box saying "Add me

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread tg-php
I guess my question at this point is that it sounds like you have control of the system. Why not have it so when they enter their email address, they can check a box saying "Add me to your mailing list".. and it'll put them directly into the database? Why the need to parse already built webpa

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread eoghan
On 29 Jul 2005, at 19:16, Jay Blanchard wrote: I also noticed that the thread started as a RE:, was this thread hijacked? yeah... was PHP noobie -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Saqib Ali
Why code this yourself, when Google can do it for you. Google provides an API for this. See the book called "Google Hacks" for details. > I was wondering if one could create Spiders/Crawlers in PHP? > I need for the PHP code to email me a list of emails, of domains listed in > that page. -- In P

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Chirantan Ghosh
dn't mean to barter a trade was just trying to be helpful if anyone needed graphic. - Original Message - From: "Jim Moseby" <[EMAIL PROTECTED]> To: Sent: Friday, July 29, 2005 2:14 PM Subject: RE: [PHP] PHP Spider/Crawler for Emails possible? Hi, I was wond

RE: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Jim Moseby
> > [snip] > Of course it is, but I'm afraid you might crawl the web, collect email > addresses, and send spam to the good people, or sell their email > adresses to > someone else who will. > [/snip] > > Why be afraid? That's just paranoid. > > I also noticed that the thread started as a RE:, wa

RE: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Jay Blanchard
[snip] Of course it is, but I'm afraid you might crawl the web, collect email addresses, and send spam to the good people, or sell their email adresses to someone else who will. [/snip] Why be afraid? That's just paranoid. I also noticed that the thread started as a RE:, was this thread hijacked?

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread tg-php
EMAIL PROTECTED]>; Sent: Friday, July 29, 2005 2:05 PM Subject: RE: [PHP] PHP Spider/Crawler for Emails possible? [snip] I was wondering if one could create Spiders/Crawlers in PHP? [/snip] Yes. [snip] I need for the PHP code to email me a list of emails, of domains

RE: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Jay Blanchard
[snip] Pardon my ignorance but can you enlighten me a little more please? Like where can I look for them or how to code? [/snip] Start here http://www.php.net/file_get_contents [snip] As always all members are more than welcome to ask me for graphics I hope to be benevolent that way. [/snip] I

RE: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Jim Moseby
> Hi, > > I was wondering if one could create Spiders/Crawlers in PHP? > I need for the PHP code to email me a list of emails, of > domains listed in > that page. > > Is this possible? Of course it is, but I'm afraid you might crawl the web, collect email addresses, and send spam to the good p

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread John Nichel
Jay Blanchard wrote: [snip] I was wondering if one could create Spiders/Crawlers in PHP? [/snip] Yes. [snip] I need for the PHP code to email me a list of emails, of domains listed in that page. Is this possible? [/snip] Yes. Imagine that. ;) -- John C. Nichel ÜberGeek KegWorks.com 716.8

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Chirantan Ghosh
t;Jay Blanchard" <[EMAIL PROTECTED]> To: "Chirantan Ghosh" <[EMAIL PROTECTED]>; Sent: Friday, July 29, 2005 2:05 PM Subject: RE: [PHP] PHP Spider/Crawler for Emails possible? [snip] I was wondering if one could create Spiders/Crawlers in PHP? [/snip] Yes. [snip] I need for th

RE: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Jay Blanchard
[snip] I was wondering if one could create Spiders/Crawlers in PHP? [/snip] Yes. [snip] I need for the PHP code to email me a list of emails, of domains listed in that page. Is this possible? [/snip] Yes. -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.

Re: [PHP] PHP Spider/Crawler for Emails possible?

2005-07-29 Thread Chirantan Ghosh
Hi, I was wondering if one could create Spiders/Crawlers in PHP? I need for the PHP code to email me a list of emails, of domains listed in that page. Is this possible? Thanks, C -- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php

Re: [PHP]Spider script in PHP.

2001-02-10 Thread Hrishi
On Friday 09 February 2001 21:28, Angerer, Chad wrote: maybe late and all, this pieca code was lying around somewhere in my socks ;) see if ya can use it, hrishi begin code snippet handle; $currpath=$fromdir_class->path; chdir($currpath); $dirs=array();

Re: [PHP]Spider script in PHP.

2001-02-09 Thread Anna
- Original Message - From: "Angerer, Chad" <[EMAIL PROTECTED]> > I am not sure if this is the correct wording. But I am wondering about a > good tutorial about writing a PHP script that will spider a directory > structure and extract the file names and insert them into a database. Also

[PHP]Spider script in PHP.

2001-02-09 Thread Angerer, Chad
I am not sure if this is the correct wording. But I am wondering about a good tutorial about writing a PHP script that will spider a directory structure and extract the file names and insert them into a database. Also this spidering would be done on a directory and its child with mp3 files and I