[ 
https://issues.apache.org/jira/browse/ARROW-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459338#comment-17459338
 ] 

Carl Boettiger commented on ARROW-15104:
----------------------------------------

Thanks much! sorry for the duplicate and I'll keep an eye on those issues you 
linked.

> write_parquet() / write_csv_arrow() cannot stream a dataset object back to S3
> -----------------------------------------------------------------------------
>
>                 Key: ARROW-15104
>                 URL: https://issues.apache.org/jira/browse/ARROW-15104
>             Project: Apache Arrow
>          Issue Type: Bug
>          Components: R
>    Affects Versions: 6.0.1
>            Reporter: Carl Boettiger
>            Priority: Minor
>
> It seems we cannot send a dataset (table) object opened with `open_dataset()` 
> into `write_parquet()` or `write_csv_arrow()`.  I realize that the former is 
> a 'multi-file' representation and the latter two are not, but as both 
> represent a single table (single schema) it seems like this should still 
> work.  (It also looks like write_csv_arrow() gives us more control over 
> formatting details than write_dataset() )



--
This message was sent by Atlassian Jira
(v8.20.1#820001)

Reply via email to