> i have no idea what scrapy is
>
http://scrapy.org/
Scrapy is a fast high-level screen scraping and web
crawling framework, used to crawl websites and extract
structured data from their pages. It can be used for
a wide range of purposes, from data mining to monitoring
Now I use EditpadPro and IDLE which appears to be adequate for
beginning level. But PyDev looks fun, I'll try it.
By the way, I realized that the spider sends the scraped data to the
pipelines.py. Now everything is working.
On Nov 21, 11:21 am, DreiJane wrote:
> Sorry,
>
> i have no idea what sc
Sorry,
i have no idea what scrapy is - but i see, that you try to use
idle with pipes or anything like that. That cannot work.
idle doesn't even handle __file__ correctly. Use a full-fledged
python IDE (PyDev under Eclipse leaves very few wishes open) or
test in a python interpreter shell.
Good l
Hello,
I have a question about scrapy tutorial and I put 2 questions in the
scrapy group
http://groups.google.com/group/scrapy-users/t/d5afae7d88672e02
http://groups.google.com/group/scrapy-users/t/4d52fa8c589a412a
but there were no answers. Can anyone here help me? The spider works
fine but I c
