Re: http://ftp-master.debian.org/new/ not accessible any more

2015-05-23 Thread Jean-Michel Vourgère
Hi Andreas Tille wrote: > I noticed that the ftpnew gatherer for UDD is currently broken. > (...) > Location: https://ftp-master.debian.org/new/ [following] > HTTP request sent, awaiting response... 403 Forbidden There is a related issue with deferred packages: Link "non-NEW uploads are available

Re: http://ftp-master.debian.org/new/ not accessible any more

2015-05-21 Thread Paul Wise
On Thu, May 21, 2015 at 6:26 PM, Andreas Tille wrote: > it it would be nice to have some confirmation that the latest change will be > permanent. I guess you missed my earlier mail so I'm CCing you this time. I expect this is fallout from the recent upgrade of franck to jessie, I'd suggest repo

Re: http://ftp-master.debian.org/new/ not accessible any more

2015-05-21 Thread Andreas Tille
Hi Ansgar, On Thu, May 21, 2015 at 11:59:39AM +0200, Ansgar Burchardt wrote: > > I don't know exactly why this changed (maybe different default in > Apache?), Probably - I just wanted to know if this is an *intentional* change or by accident and will be reverted. > but scraping web pages seems

Re: http://ftp-master.debian.org/new/ not accessible any more

2015-05-21 Thread Ansgar Burchardt
Hi, On 05/21/2015 11:21 AM, Andreas Tille wrote: > I noticed that the ftpnew gatherer for UDD is currently broken. The > reason is that it is usually fetching files via > >wget -q -r -N --level=2 --no-parent --no-directories > http://ftp-master.debian.org/new/ [...] > It seems it is forbidd

Re: http://ftp-master.debian.org/new/ not accessible any more

2015-05-21 Thread Andreas Tille
Hi Bas, On Thu, May 21, 2015 at 11:26:55AM +0200, Sebastiaan Couwenberg wrote: > > It seems it is forbidden to read the web dir directly. Any reason for > > this and if it is intentional what would be the alternative to fetch > > data about packages in new? > > If indexes are forbidden intention

Re: http://ftp-master.debian.org/new/ not accessible any more

2015-05-21 Thread Paul Wise
On Thu, May 21, 2015 at 5:21 PM, Andreas Tille wrote: > It seems it is forbidden to read the web dir directly. Any reason for > this and if it is intentional what would be the alternative to fetch > data about packages in new? I expect this is fallout from the recent upgrade of franck to jessie,

Re: http://ftp-master.debian.org/new/ not accessible any more

2015-05-21 Thread Sebastiaan Couwenberg
> It seems it is forbidden to read the web dir directly. Any reason for > this and if it is intentional what would be the alternative to fetch > data about packages in new? If indexes are forbidden intentionally now, extracting the links from new.html may be reasonable alternative. https://ftp-m

http://ftp-master.debian.org/new/ not accessible any more

2015-05-21 Thread Andreas Tille
Hi, I noticed that the ftpnew gatherer for UDD is currently broken. The reason is that it is usually fetching files via wget -q -r -N --level=2 --no-parent --no-directories http://ftp-master.debian.org/new/ but if you try wget http://ftp-master.debian.org/new/ --2015-05-21 09:19:52-- h