[ https://issues.apache.org/jira/browse/ARROW-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459338#comment-17459338 ]
Carl Boettiger commented on ARROW-15104: ---------------------------------------- Thanks much! sorry for the duplicate and I'll keep an eye on those issues you linked. > write_parquet() / write_csv_arrow() cannot stream a dataset object back to S3 > ----------------------------------------------------------------------------- > > Key: ARROW-15104 > URL: https://issues.apache.org/jira/browse/ARROW-15104 > Project: Apache Arrow > Issue Type: Bug > Components: R > Affects Versions: 6.0.1 > Reporter: Carl Boettiger > Priority: Minor > > It seems we cannot send a dataset (table) object opened with `open_dataset()` > into `write_parquet()` or `write_csv_arrow()`. I realize that the former is > a 'multi-file' representation and the latter two are not, but as both > represent a single table (single schema) it seems like this should still > work. (It also looks like write_csv_arrow() gives us more control over > formatting details than write_dataset() ) -- This message was sent by Atlassian Jira (v8.20.1#820001)