> i have no idea what scrapy is
>
http://scrapy.org/
Scrapy is a fast high-level screen scraping and web
crawling framework, used to crawl websites and extract
structured data from their pages. It can be used for
a wide range of purposes, from data mining to monitoring
Now I use EditpadPro and IDLE which appears to be adequate for
beginning level. But PyDev looks fun, I'll try it.
By the way, I realized that the spider sends the scraped data to the
pipelines.py. Now everything is working.
On Nov 21, 11:21 am, DreiJane wrote:
> Sorry,
>
> i have no idea what sc
Sorry,
i have no idea what scrapy is - but i see, that you try to use
idle with pipes or anything like that. That cannot work.
idle doesn't even handle __file__ correctly. Use a full-fledged
python IDE (PyDev under Eclipse leaves very few wishes open) or
test in a python interpreter shell.
Good l
