Hi List,
I am trying to list all files in a remote url for processing into my attempt at a search engine but I cant work out how to list the files found in a given domain name.
The manual has nothing on this, as I can see, and searching the web has drawn a blank.
So I ask the list if there is a way of doing it.
The idea is:
Domain name = domain.com
Then fopen or opendir or something on the domain name to get a list of files found
As far as I know, this can't be done. You have to start fetching a file (usually index.html) and then find all links in there and follow them. That is why the Search Engines are called Spiders or Crawlers. They can't fetch everything. The "crawl" along the "net" that is made up by links.
HTH, Oliver
-- PHP General Mailing List (http://www.php.net/) To unsubscribe, visit: http://www.php.net/unsub.php
