Never tried this, but if it's not data you're after, but a search term type
of app, then ip address crawl, and if keyword/metadata, then crawl, and
parse, just as it seems you are doing, for keywords, and url's associated
with them, then eliminate url's without that specified keyword parameter
into
Umesh Sharma wrote:
> Hello,
>
> I am writing a crawler in python, which crawl quora. I can't read the content
> of quora without login. But google/bing crawls quora. One thing i can do is
> use browser automation and login in my account and the go links by link and
> crawl content, but this me
