[jira] [Created] (ARROW-17120) copy_files() does not take paths to specific files

2022-07-18 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-17120: -- Summary: copy_files() does not take paths to specific files Key: ARROW-17120 URL: https://issues.apache.org/jira/browse/ARROW-17120 Project: Apache Arrow

[jira] [Created] (ARROW-17201) Cannot override environmental variables setting region

2022-07-25 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-17201: -- Summary: Cannot override environmental variables setting region Key: ARROW-17201 URL: https://issues.apache.org/jira/browse/ARROW-17201 Project: Apache Arrow

[jira] [Commented] (ARROW-16680) [R] Weird R error: Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) : ignoring SIGPIPE signal

2022-08-03 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574916#comment-17574916 ] Carl Boettiger commented on ARROW-16680: Hi arrow devs, apologies that this one

[jira] [Commented] (ARROW-16680) [R] Weird R error: Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) : ignoring SIGPIPE signal

2022-08-03 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574968#comment-17574968 ] Carl Boettiger commented on ARROW-16680: Additional note – the behavior seems to

[jira] [Commented] (ARROW-16680) [R] Weird R error: Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) : ignoring SIGPIPE signal

2022-08-03 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574990#comment-17574990 ] Carl Boettiger commented on ARROW-16680: FWIW, the sigpipe error also appears mo

[jira] [Created] (ARROW-17541) [R] Substantial RAM use increase in 9.0.0 release on write_dataset()

2022-08-26 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-17541: -- Summary: [R] Substantial RAM use increase in 9.0.0 release on write_dataset() Key: ARROW-17541 URL: https://issues.apache.org/jira/browse/ARROW-17541 Project: Apa

[jira] [Updated] (ARROW-17541) [R] Substantial RAM use increase in 9.0.0 release on write_dataset()

2022-08-26 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Boettiger updated ARROW-17541: --- Description: Consider the following example of opening a remote dataset (a single 4 GB parq

[jira] [Commented] (ARROW-17541) [R] Substantial RAM use increase in 9.0.0 release on write_dataset()

2022-08-26 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585638#comment-17585638 ] Carl Boettiger commented on ARROW-17541: Thanks Weston for the pointers here!  

[jira] [Commented] (ARROW-17541) [R] Substantial RAM use increase in 9.0.0 release on write_dataset()

2022-08-29 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597497#comment-17597497 ] Carl Boettiger commented on ARROW-17541: Weird.  I'm running on ubuntu linux (ro

[jira] [Created] (ARROW-17597) [R] Why is read_csv_arrow so much slower when using S3 path notation?

2022-09-01 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-17597: -- Summary: [R] Why is read_csv_arrow so much slower when using S3 path notation? Key: ARROW-17597 URL: https://issues.apache.org/jira/browse/ARROW-17597 Project: Ap

[jira] [Commented] (ARROW-17597) [R][C++] Why is read_csv_arrow so much slower when using S3 path notation?

2022-09-06 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600838#comment-17600838 ] Carl Boettiger commented on ARROW-17597:  Just a note, but I think the additiona

[jira] [Created] (ARROW-17905) [R] as_date and similar methods fail with digit seconds

2022-09-30 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-17905: -- Summary: [R] as_date and similar methods fail with digit seconds Key: ARROW-17905 URL: https://issues.apache.org/jira/browse/ARROW-17905 Project: Apache Arrow

[jira] [Commented] (ARROW-17905) [R] as_date and similar methods fail with digit seconds

2022-09-30 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17611796#comment-17611796 ] Carl Boettiger commented on ARROW-17905: Very cool.  I actually tried to do that

[jira] [Commented] (ARROW-15883) [C++] Support for fractional seconds in strptime()

2022-09-30 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17611799#comment-17611799 ] Carl Boettiger commented on ARROW-15883: I agree about the lack of a standard, b

[jira] [Commented] (ARROW-17905) [R] as_date and similar methods fail with digit seconds

2022-09-30 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17611808#comment-17611808 ] Carl Boettiger commented on ARROW-17905: thanks for the pointers! I see that col

[jira] [Created] (ARROW-15151) write_dataset() never increments {i} in partitions part-{i}

2021-12-19 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15151: -- Summary: write_dataset() never increments {i} in partitions part-{i} Key: ARROW-15151 URL: https://issues.apache.org/jira/browse/ARROW-15151 Project: Apache Arro

[jira] [Commented] (ARROW-15151) write_dataset() never increments {i} in partitions part-{i}

2021-12-20 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462733#comment-17462733 ] Carl Boettiger commented on ARROW-15151: > The new dataset writer in 6.0.x has o

[jira] [Commented] (ARROW-13703) [Python][R] Add bindings for new dataset writing options

2021-12-20 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462737#comment-17462737 ] Carl Boettiger commented on ARROW-13703: Does this also include a max_file_size

[jira] [Commented] (ARROW-15088) [R] Support for csv options on open_dataset

2022-01-28 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483901#comment-17483901 ] Carl Boettiger commented on ARROW-15088: Sorry for the confusion.  Here's some r

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-02-08 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489204#comment-17489204 ] Carl Boettiger commented on ARROW-15081: sorry about that, you caught me at a ti

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-02-09 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489644#comment-17489644 ] Carl Boettiger commented on ARROW-15081: should be back up now.  Just a note I n

[jira] [Commented] (ARROW-13703) [Python][R] Add bindings for new dataset writing options

2022-02-09 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489645#comment-17489645 ] Carl Boettiger commented on ARROW-13703: Any update on this? Would be very usefu

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-02-09 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489660#comment-17489660 ] Carl Boettiger commented on ARROW-15081: Just tested with the nightly build,  ‘

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-02-09 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489663#comment-17489663 ] Carl Boettiger commented on ARROW-15081: One more note: even the nightly arrow,

[jira] [Created] (ARROW-15822) arrow_write_csv cannot write difftime objects

2022-03-01 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15822: -- Summary: arrow_write_csv cannot write difftime objects Key: ARROW-15822 URL: https://issues.apache.org/jira/browse/ARROW-15822 Project: Apache Arrow Issu

[jira] [Commented] (ARROW-15822) [R] arrow_write_csv cannot write difftime objects

2022-03-08 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503192#comment-17503192 ] Carl Boettiger commented on ARROW-15822: Just a footnote that this also impacts

[jira] [Created] (ARROW-15875) Include md5sum in S3 method for GetFileInfo()

2022-03-08 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15875: -- Summary: Include md5sum in S3 method for GetFileInfo() Key: ARROW-15875 URL: https://issues.apache.org/jira/browse/ARROW-15875 Project: Apache Arrow Iss

[jira] [Created] (ARROW-15879) passing a schema calls open_dataset to fail on hive-partitioned csv files

2022-03-08 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15879: -- Summary: passing a schema calls open_dataset to fail on hive-partitioned csv files Key: ARROW-15879 URL: https://issues.apache.org/jira/browse/ARROW-15879 Project

[jira] [Commented] (ARROW-15879) [R] passing a schema calls open_dataset to fail on hive-partitioned csv files

2022-03-14 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506256#comment-17506256 ] Carl Boettiger commented on ARROW-15879: Sorry my minimal example was too minima

[jira] [Commented] (ARROW-15875) [R][C++] Include md5sum in S3 method for GetFileInfo()

2022-03-14 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506277#comment-17506277 ] Carl Boettiger commented on ARROW-15875: nice, that would work for me! > [R][C+

[jira] [Created] (ARROW-18006) [R] integer coercion on parition variables

2022-10-12 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-18006: -- Summary: [R] integer coercion on parition variables Key: ARROW-18006 URL: https://issues.apache.org/jira/browse/ARROW-18006 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-18114) [R] unify_schemas=FALSE does not improve open_dataset() read times

2022-10-20 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-18114: -- Summary: [R] unify_schemas=FALSE does not improve open_dataset() read times Key: ARROW-18114 URL: https://issues.apache.org/jira/browse/ARROW-18114 Project: Apach

[jira] [Created] (ARROW-18214) [R] Use ISO 8601 in character representations of datetimes?

2022-11-01 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-18214: -- Summary: [R] Use ISO 8601 in character representations of datetimes? Key: ARROW-18214 URL: https://issues.apache.org/jira/browse/ARROW-18214 Project: Apache Arrow

[jira] [Updated] (ARROW-18214) [R] Use ISO 8601 in character representations of datetimes?

2022-11-01 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Boettiger updated ARROW-18214: --- Description: Arrow needs to represent datetime / timestamp values as character strings, e.g.

[jira] [Commented] (ARROW-18114) [R] unify_schemas=FALSE does not improve open_dataset() read times

2022-11-01 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17627339#comment-17627339 ] Carl Boettiger commented on ARROW-18114: Thanks Weston! Any update here? > [R]

[jira] [Commented] (ARROW-16680) [R] Weird R error: Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) : ignoring SIGPIPE signal

2022-11-08 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630753#comment-17630753 ] Carl Boettiger commented on ARROW-16680: Hi folks, not to nag but this issue is

[jira] [Commented] (ARROW-18114) [R] unify_schemas=FALSE does not improve open_dataset() read times

2022-11-10 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17632000#comment-17632000 ] Carl Boettiger commented on ARROW-18114: Any update on this?  I think we could r

[jira] [Commented] (ARROW-16680) [R] Weird R error: Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) : ignoring SIGPIPE signal

2022-11-11 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17632484#comment-17632484 ] Carl Boettiger commented on ARROW-16680: Wow, thanks Dewey!  That looks like bla

[jira] [Commented] (ARROW-17894) [R] Documentation for json_credentials is misleading

2022-12-10 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645720#comment-17645720 ] Carl Boettiger commented on ARROW-17894: Unfortunately I still get an error when

[jira] [Commented] (ARROW-17894) [R] Documentation for json_credentials is misleading

2022-12-14 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17647674#comment-17647674 ] Carl Boettiger commented on ARROW-17894: I no longer get the error when I use re

[jira] [Commented] (ARROW-18114) [R] unify_schemas=FALSE does not improve open_dataset() read times

2022-12-15 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17648256#comment-17648256 ] Carl Boettiger commented on ARROW-18114: Just an additional comment that this be

[jira] [Created] (ARROW-16144) Write compressed data streams (particularly over S3)

2022-04-07 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-16144: -- Summary: Write compressed data streams (particularly over S3) Key: ARROW-16144 URL: https://issues.apache.org/jira/browse/ARROW-16144 Project: Apache Arrow

[jira] [Commented] (ARROW-16144) [R] Write compressed data streams (particularly over S3)

2022-04-11 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520814#comment-17520814 ] Carl Boettiger commented on ARROW-16144: Hi, sorry, but I believe this is not co

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-05-02 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530874#comment-17530874 ] Carl Boettiger commented on ARROW-15081: Any news on this? I'll keep an eye on

[jira] [Comment Edited] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-05-02 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530962#comment-17530962 ] Carl Boettiger edited comment on ARROW-15081 at 5/2/22 10:29 PM: -

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-05-02 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530962#comment-17530962 ] Carl Boettiger commented on ARROW-15081: Thanks Weston, I'll try that.  Just to

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-05-04 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531751#comment-17531751 ] Carl Boettiger commented on ARROW-15081: Thanks Weston, sounds promising!  Hmm..

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-05-04 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531857#comment-17531857 ] Carl Boettiger commented on ARROW-15081: Thanks, this is super.   Right, I have

[jira] [Commented] (ARROW-15081) [R][C++] Arrow crashes (OOM) on R client with large remote parquet files

2022-05-09 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533976#comment-17533976 ] Carl Boettiger commented on ARROW-15081: Just a note that even with a single par

[jira] [Created] (ARROW-16521) Configure curl timeout policy for remote filesystems

2022-05-10 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-16521: -- Summary: Configure curl timeout policy for remote filesystems Key: ARROW-16521 URL: https://issues.apache.org/jira/browse/ARROW-16521 Project: Apache Arrow

[jira] [Commented] (ARROW-16521) [C++][R] Configure curl timeout policy for S3

2022-05-10 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17534579#comment-17534579 ] Carl Boettiger commented on ARROW-16521: I'm seeing timeouts on s3$ls() for exam

[jira] [Created] (ARROW-16619) read_csv_arrow / open_dataset over https connection?

2022-05-19 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-16619: -- Summary: read_csv_arrow / open_dataset over https connection? Key: ARROW-16619 URL: https://issues.apache.org/jira/browse/ARROW-16619 Project: Apache Arrow

[jira] [Created] (ARROW-16620) open_dataset fails to open single compressed csv

2022-05-19 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-16620: -- Summary: open_dataset fails to open single compressed csv Key: ARROW-16620 URL: https://issues.apache.org/jira/browse/ARROW-16620 Project: Apache Arrow I

[jira] [Commented] (ARROW-16619) [R] read_csv_arrow / open_dataset over https connection?

2022-05-19 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539779#comment-17539779 ] Carl Boettiger commented on ARROW-16619: @David Li I agree these are closely rel

[jira] [Commented] (ARROW-16619) [R] read_csv_arrow / open_dataset over https connection?

2022-05-19 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539789#comment-17539789 ] Carl Boettiger commented on ARROW-16619: thanks, yeah totally.  I'd love to see

[jira] [Commented] (ARROW-16619) [R] Support compression + R connection (URL with .gz file)

2022-05-25 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542229#comment-17542229 ] Carl Boettiger commented on ARROW-16619: sounds good!  Eventually it would still

[jira] [Created] (ARROW-16680) Weird R error: Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) : ignoring SIGPIPE signal

2022-05-27 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-16680: -- Summary: Weird R error: Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) :ignoring SIGPIPE signal Key: ARROW-16680 URL: https://issues.apache.org/jira/brows

[jira] [Commented] (ARROW-16680) [R] Weird R error: Error in fs___FileSystem__GetTargetInfos_FileSelector(self, x) : ignoring SIGPIPE signal

2022-05-31 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17544504#comment-17544504 ] Carl Boettiger commented on ARROW-16680: Hi folks, thanks for testing, I know th

[jira] [Commented] (ARROW-16521) [C++][R][Python] Configure curl timeout policy for S3

2022-06-30 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561193#comment-17561193 ] Carl Boettiger commented on ARROW-16521: I've found that setting CURLOPT_ACCEPTT

[jira] [Created] (ARROW-13761) arrow::filter() crashes (aborts R session)

2021-08-25 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-13761: -- Summary: arrow::filter() crashes (aborts R session) Key: ARROW-13761 URL: https://issues.apache.org/jira/browse/ARROW-13761 Project: Apache Arrow Issue T

[jira] [Commented] (ARROW-13761) arrow::filter() crashes (aborts R session)

2021-08-25 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404782#comment-17404782 ] Carl Boettiger commented on ARROW-13761: I noticed that falling back to arrow 4.

[jira] [Commented] (ARROW-13761) [R] arrow::filter() crashes (aborts R session)

2021-08-26 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405506#comment-17405506 ] Carl Boettiger commented on ARROW-13761: Thanks all for the explanations. I can

[jira] [Commented] (ARROW-13761) [R] arrow::filter() crashes (aborts R session)

2021-08-26 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405566#comment-17405566 ] Carl Boettiger commented on ARROW-13761: Thanks Weston, that's great to hear!  T

[jira] [Created] (ARROW-11582) write_dataset fails unexpectedly

2021-02-09 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-11582: -- Summary: write_dataset fails unexpectedly Key: ARROW-11582 URL: https://issues.apache.org/jira/browse/ARROW-11582 Project: Apache Arrow Issue Type: Bug

[jira] [Commented] (ARROW-11582) [R] write_dataset "format" argument default and validation could be better

2021-02-10 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282593#comment-17282593 ] Carl Boettiger commented on ARROW-11582: Thanks, that makes total sense.  Works

[jira] [Commented] (ARROW-13611) [C++] Scanning datasets does not enforce back pressure

2021-09-30 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423038#comment-17423038 ] Carl Boettiger commented on ARROW-13611: Any news on this?  I believe this bug i

[jira] [Comment Edited] (ARROW-13611) [C++] Scanning datasets does not enforce back pressure

2021-09-30 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423038#comment-17423038 ] Carl Boettiger edited comment on ARROW-13611 at 9/30/21, 10:58 PM: ---

[jira] [Comment Edited] (ARROW-13611) [C++] Scanning datasets does not enforce back pressure

2021-09-30 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423038#comment-17423038 ] Carl Boettiger edited comment on ARROW-13611 at 9/30/21, 10:59 PM: ---

[jira] [Created] (ARROW-14998) Support for HTTPS Filesystem access (from R client)

2021-12-06 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-14998: -- Summary: Support for HTTPS Filesystem access (from R client) Key: ARROW-14998 URL: https://issues.apache.org/jira/browse/ARROW-14998 Project: Apache Arrow

[jira] [Commented] (ARROW-14998) Support for HTTPS Filesystem access (from R client)

2021-12-06 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17454236#comment-17454236 ] Carl Boettiger commented on ARROW-14998: I think so, thanks for sharing the link

[jira] [Created] (ARROW-15060) open_dataset() on csv files lacks support for compressed files

2021-12-10 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15060: -- Summary: open_dataset() on csv files lacks support for compressed files Key: ARROW-15060 URL: https://issues.apache.org/jira/browse/ARROW-15060 Project: Apache Ar

[jira] [Created] (ARROW-15081) Arrow crashes (OOM) on R client with large remote parquet files

2021-12-13 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15081: -- Summary: Arrow crashes (OOM) on R client with large remote parquet files Key: ARROW-15081 URL: https://issues.apache.org/jira/browse/ARROW-15081 Project: Apache A

[jira] [Created] (ARROW-15088) Support for csv options on open_dataset

2021-12-13 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15088: -- Summary: Support for csv options on open_dataset Key: ARROW-15088 URL: https://issues.apache.org/jira/browse/ARROW-15088 Project: Apache Arrow Issue Type

[jira] [Created] (ARROW-15104) write_parquet() / write_csv_arrow() cannot stream a dataset object back to S3

2021-12-14 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15104: -- Summary: write_parquet() / write_csv_arrow() cannot stream a dataset object back to S3 Key: ARROW-15104 URL: https://issues.apache.org/jira/browse/ARROW-15104 Pro

[jira] [Created] (ARROW-15105) unsupported timestamp cast in CSV with tz element

2021-12-14 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15105: -- Summary: unsupported timestamp cast in CSV with tz element Key: ARROW-15105 URL: https://issues.apache.org/jira/browse/ARROW-15105 Project: Apache Arrow

[jira] [Updated] (ARROW-15105) unsupported timestamp cast in CSV with tz element

2021-12-14 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Carl Boettiger updated ARROW-15105: --- Component/s: R Affects Version/s: 6.0.1 > unsupported timestamp cast in CSV with t

[jira] [Commented] (ARROW-15104) write_parquet() / write_csv_arrow() cannot stream a dataset object back to S3

2021-12-14 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459338#comment-17459338 ] Carl Boettiger commented on ARROW-15104: Thanks much! sorry for the duplicate an

[jira] [Created] (ARROW-15124) default TZ parsing woes in CSV reader

2021-12-15 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15124: -- Summary: default TZ parsing woes in CSV reader Key: ARROW-15124 URL: https://issues.apache.org/jira/browse/ARROW-15124 Project: Apache Arrow Issue Type:

[jira] [Commented] (ARROW-15124) [R] default TZ parsing woes in CSV reader

2021-12-15 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460411#comment-17460411 ] Carl Boettiger commented on ARROW-15124: Thanks, I understand the potential ambi

[jira] [Created] (ARROW-15127) More visible documentation of AWS_EC2_METADATA_DISABLED=TRUE

2021-12-15 Thread Carl Boettiger (Jira)
Carl Boettiger created ARROW-15127: -- Summary: More visible documentation of AWS_EC2_METADATA_DISABLED=TRUE Key: ARROW-15127 URL: https://issues.apache.org/jira/browse/ARROW-15127 Project: Apache Arro

[jira] [Commented] (ARROW-14442) [R] Should we warn when converting timestamps with "" as tzone?

2021-12-16 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460878#comment-17460878 ] Carl Boettiger commented on ARROW-14442: FWIW, I also think option 3 is correct.

[jira] [Commented] (ARROW-15124) [R] default TZ parsing woes in CSV reader

2021-12-16 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460895#comment-17460895 ] Carl Boettiger commented on ARROW-15124: Just a correction – this only impacts t

[jira] [Commented] (ARROW-15127) [R] More visible documentation of AWS_EC2_METADATA_DISABLED=TRUE

2021-12-16 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460911#comment-17460911 ] Carl Boettiger commented on ARROW-15127: Also, does this only work (or behave di

[jira] (ARROW-15127) [R] More visible documentation of AWS_EC2_METADATA_DISABLED=TRUE

2021-12-16 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15127 ] Carl Boettiger deleted comment on ARROW-15127: was (Author: cboettig): Also, does this only work (or behave differently) on the dev release (6.0.2)?  Just tried rolling back to the lates

[jira] [Commented] (ARROW-15060) [R] open_dataset() on csv files lacks support for compressed files

2021-12-16 Thread Carl Boettiger (Jira)
[ https://issues.apache.org/jira/browse/ARROW-15060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460947#comment-17460947 ] Carl Boettiger commented on ARROW-15060: My apologies, but it looks like it is r