Re: [R-pkg-devel] Scrapping R CRAN website from package

2021-07-19 Thread Gábor Csárdi
On Sat, Jul 17, 2021 at 2:21 AM wrote: > > Maciej: > > There are other packages that query the CRAN site (cranlogs, etc.). So it > seems the queries/fetches are generally allowed. I can only find a couple > relevant mentions in the CRAN policies: [...] For the record, the cranlogs package does

Re: [R-pkg-devel] Scrapping R CRAN website from package

2021-07-19 Thread Maëlle SALMON via R-package-devel
Could pkgsearch http://r-hub.github.io/pkgsearch/ help with what you're doing, as it can queries all versions of CRAN packages? See http://r-hub.github.io/pkgsearch/reference/cran_package_history.html for the docs of the function cran_package_history(). It does not scrape CRAN pages, it uses an

Re: [R-pkg-devel] Scrapping R CRAN website from package

2021-07-16 Thread dbosak01
Maciej: There are other packages that query the CRAN site (cranlogs, etc.). So it seems the queries/fetches are generally allowed. I can only find a couple relevant mentions in the CRAN policies: "Packages which use Internet resources should fail gracefully with an informative message if the r

Re: [R-pkg-devel] Scrapping R CRAN website from package

2021-07-16 Thread Georgi Boshnakov
If you need only DESCRIPTION, you can get it from github/cran - just open the file in any package and see how its web address is formed. There is a small delay between a package appearing on CRAN and it being mirrowed on github/CRAN though. For caching strategies you could check, for example, r