Re: Create an index from a webpage [RANT, DNFTT]

2011-09-09 Thread Duncan Booth
Simon Cropper wrote: > Certainly doable but > considering the shear commonality of this task I don't understand why a > simple script does not already exist - hence my original request for > assistance. I think you may have underestimated the complexity of the task in general. To do it for a

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Chris Angelico
On Fri, Sep 9, 2011 at 1:20 PM, Simon Cropper wrote: > Chris, > > You assessment is correct. Working through the PyPI I am having better luck > with using different terms than the old-term 'sitemap'. > > I have found a link to funnelweb which uses the transmogrify library (yeah, > as if I would ha

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Simon Cropper
On 09/09/11 12:59, Chris Angelico wrote: On Fri, Sep 9, 2011 at 12:43 PM, Simon Cropper wrote: At present I am definitely getting the impression that my assumption that something like this' must out there', is wrong. I have found a XML-Sitemaps Generator at http://www.xml-sitemaps.com, this p

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Chris Angelico
On Fri, Sep 9, 2011 at 12:43 PM, Simon Cropper wrote: > At present I am definitely getting the impression that my assumption that > something like this' must out there', is wrong. > > I have found a XML-Sitemaps Generator at http://www.xml-sitemaps.com, > this page allows you to create the XML fil

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Simon Cropper
On 09/09/11 12:14, Steven D'Aprano wrote: If you do decide to write your own, please consider uploading it to PyPI under a FOSS licence. At present I am definitely getting the impression that my assumption that something like this' must out there', is wrong. I am following people's links and

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Steven D'Aprano
Simon Cropper wrote: > Certainly doable but > considering the shear commonality of this task I don't understand why a > simple script does not already exist Perhaps it isn't as common or as simple as you believe. -- Steven -- http://mail.python.org/mailman/listinfo/python-list

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Steven D'Aprano
Simon Cropper wrote: > 1. Being told to google-it when I explicitly stated in my initial post > that I had been doing this and had not been able to find anything is > just plain rude. It is unconstructive and irritating. Why so you did. Even though I wasn't the one who told you to google it, I'll

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Simon Cropper
On 09/09/11 10:32, Rhodri James wrote: On Fri, 09 Sep 2011 00:40:42 +0100, Simon Cropper Ahem. You should expect a certain amount of ribbing after admitting that your Google-fu is weak. So is mine, but hey. I did not admit anything. I consider my ability to find this quite good actually. Othe

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Rhodri James
On Fri, 09 Sep 2011 00:40:42 +0100, Simon Cropper wrote: On 09/09/11 01:11, Steven D'Aprano wrote: [SNIP] It's no harder to put the search terms into a google URL, which still gets the point across without being a dick about it: > [SNIP] [RANT] OK I was not going to say anything but..

Re: Create an index from a webpage [RANT, DNFTT]

2011-09-08 Thread Simon Cropper
On 09/09/11 01:11, Steven D'Aprano wrote: [SNIP] It's no harder to put the search terms into a google URL, which still gets the point across without being a dick about it: > [SNIP] [RANT] OK I was not going to say anything but... 1. Being told to google-it when I explicitly stated in my initi

Re: Create an index from a webpage

2011-09-08 Thread Steven D'Aprano
Thomas 'PointedEars' Lahn wrote: > [climbs up on the soapbox and begins rant] Please don't use lmgtfy. The joke, such as it is, stopped being funny about three years ago. It's just annoying, and besides, it doesn't even work without Javascript. Kids today ha

Re: Create an index from a webpage

2011-09-08 Thread Thomas 'PointedEars' Lahn
Simon Cropper wrote: > I am after a way of pointing a python routine to my website and have it > create a tree, represented as a hierarchical HTML list in a webpage, of > all the pages in that website (recursive list of internal links to HTML > documents; ignore images, etc.). > > It is essential

Create an index from a webpage

2011-09-08 Thread Simon Cropper
Hi, I am getting dizzy on google. I am after a way of pointing a python routine to my website and have it create a tree, represented as a hierarchical HTML list in a webpage, of all the pages in that website (recursive list of internal links to HTML documents; ignore images, etc.). It is es