Re: [go-nuts] Connection Refused while scraping the data

2020-03-07 Thread Jesper Louis Andersen
On Sat, Mar 7, 2020 at 5:35 AM Kurtis Rader wrote: > The web site you are accessing thinks you are executing a DDOS attack or > are otherwise violating their terms of service. This has nothing to do with > the Go language. You need to rate limit your requests of that site. > > To add: Look up th

Re: [go-nuts] Connection Refused while scraping the data

2020-03-07 Thread Amnon Baron Cohen
You might get better results if you at a www to the beginning of the hostname. curl https://www.indeed.co.in/browsejobs/Engineering does download a page whereas curl https://indeed.co.in/browsejobs/Engineering does give a connection refused error. On Saturday, 7 March 2020 04:36:04 UTC, Kurtis

Re: [go-nuts] Connection Refused while scraping the data

2020-03-06 Thread Kurtis Rader
On Fri, Mar 6, 2020 at 8:21 PM Kuldeep Avsar wrote: > I am trying to Scrape the Job Titles one by one from the Indeed.co.in website > > but it through me connection refused problem while I am visiting to the > particular jobs Title > > categories page and trying to take response back from the pa