[
https://issues.apache.org/jira/browse/ARROW-17120?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Neal Richardson updated ARROW-17120:
------------------------------------
Component/s: C++
> copy_files() does not take paths to specific files
> --------------------------------------------------
>
> Key: ARROW-17120
> URL: https://issues.apache.org/jira/browse/ARROW-17120
> Project: Apache Arrow
> Issue Type: Improvement
> Components: C++, R
> Reporter: Carl Boettiger
> Priority: Major
>
> `copy_files()` is a pretty handy function for working between local and
> remote interfaces, particularly for any file type arrow doesn't handle (arvo,
> ncdf, h5, etc etc).
> Unfortunately, it seems to work only from directory-to-directory, at least in
> the direction of copying S3 -> local file system. e.g. this reprex:
> {code:java}
> library(arrow)
> local_dir <- tempfile()
> fs::dir_delete(local_dir)
> fs::dir_create(local_dir) # create dir if it doesn't exist
> l3 <- SubTreeFileSystem$create(local_dir)
> l3$ls() #empty
> s3 <- s3_bucket("neon4cast-targets/aquatics", endpoint_override =
> "data.ecoforecast.org", anonymous=TRUE)
> s3$ls() #not empty, good
> copy_files(s3$path("aquatics-targets.csv.gz"),
> l3$path("aquatics-targets.csv.gz"))
> l3$ls() # darn, nothing!
> copy_files(s3$path("aquatics-targets.csv.gz"), l3)
> l3$ls() # darn, nothing!
> copy_files(s3, l3)
> l3$ls() # Finally! only this works
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
