Carl Boettiger created ARROW-17120:
--
Summary: copy_files() does not take paths to specific files
Key: ARROW-17120
URL: https://issues.apache.org/jira/browse/ARROW-17120
Project: Apache Arrow
Carl Boettiger created ARROW-17201:
--
Summary: Cannot override environmental variables setting region
Key: ARROW-17201
URL: https://issues.apache.org/jira/browse/ARROW-17201
Project: Apache Arrow
[
https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574916#comment-17574916
]
Carl Boettiger commented on ARROW-16680:
Hi arrow devs, apologies that this one
[
https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574968#comment-17574968
]
Carl Boettiger commented on ARROW-16680:
Additional note – the behavior seems to
[
https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17574990#comment-17574990
]
Carl Boettiger commented on ARROW-16680:
FWIW, the sigpipe error also appears mo
Carl Boettiger created ARROW-17541:
--
Summary: [R] Substantial RAM use increase in 9.0.0 release on
write_dataset()
Key: ARROW-17541
URL: https://issues.apache.org/jira/browse/ARROW-17541
Project: Apa
[
https://issues.apache.org/jira/browse/ARROW-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Boettiger updated ARROW-17541:
---
Description:
Consider the following example of opening a remote dataset (a single 4 GB
parq
[
https://issues.apache.org/jira/browse/ARROW-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17585638#comment-17585638
]
Carl Boettiger commented on ARROW-17541:
Thanks Weston for the pointers here!
[
https://issues.apache.org/jira/browse/ARROW-17541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17597497#comment-17597497
]
Carl Boettiger commented on ARROW-17541:
Weird. I'm running on ubuntu linux (ro
Carl Boettiger created ARROW-17597:
--
Summary: [R] Why is read_csv_arrow so much slower when using S3
path notation?
Key: ARROW-17597
URL: https://issues.apache.org/jira/browse/ARROW-17597
Project: Ap
[
https://issues.apache.org/jira/browse/ARROW-17597?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17600838#comment-17600838
]
Carl Boettiger commented on ARROW-17597:
Just a note, but I think the additiona
Carl Boettiger created ARROW-17905:
--
Summary: [R] as_date and similar methods fail with digit seconds
Key: ARROW-17905
URL: https://issues.apache.org/jira/browse/ARROW-17905
Project: Apache Arrow
[
https://issues.apache.org/jira/browse/ARROW-17905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17611796#comment-17611796
]
Carl Boettiger commented on ARROW-17905:
Very cool. I actually tried to do that
[
https://issues.apache.org/jira/browse/ARROW-15883?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17611799#comment-17611799
]
Carl Boettiger commented on ARROW-15883:
I agree about the lack of a standard, b
[
https://issues.apache.org/jira/browse/ARROW-17905?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17611808#comment-17611808
]
Carl Boettiger commented on ARROW-17905:
thanks for the pointers! I see that col
Carl Boettiger created ARROW-15151:
--
Summary: write_dataset() never increments {i} in partitions
part-{i}
Key: ARROW-15151
URL: https://issues.apache.org/jira/browse/ARROW-15151
Project: Apache Arro
[
https://issues.apache.org/jira/browse/ARROW-15151?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462733#comment-17462733
]
Carl Boettiger commented on ARROW-15151:
> The new dataset writer in 6.0.x has o
[
https://issues.apache.org/jira/browse/ARROW-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17462737#comment-17462737
]
Carl Boettiger commented on ARROW-13703:
Does this also include a max_file_size
[
https://issues.apache.org/jira/browse/ARROW-15088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17483901#comment-17483901
]
Carl Boettiger commented on ARROW-15088:
Sorry for the confusion. Here's some r
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489204#comment-17489204
]
Carl Boettiger commented on ARROW-15081:
sorry about that, you caught me at a ti
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489644#comment-17489644
]
Carl Boettiger commented on ARROW-15081:
should be back up now. Just a note I n
[
https://issues.apache.org/jira/browse/ARROW-13703?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489645#comment-17489645
]
Carl Boettiger commented on ARROW-13703:
Any update on this? Would be very usefu
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489660#comment-17489660
]
Carl Boettiger commented on ARROW-15081:
Just tested with the nightly build,
‘
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489663#comment-17489663
]
Carl Boettiger commented on ARROW-15081:
One more note: even the nightly arrow,
Carl Boettiger created ARROW-15822:
--
Summary: arrow_write_csv cannot write difftime objects
Key: ARROW-15822
URL: https://issues.apache.org/jira/browse/ARROW-15822
Project: Apache Arrow
Issu
[
https://issues.apache.org/jira/browse/ARROW-15822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503192#comment-17503192
]
Carl Boettiger commented on ARROW-15822:
Just a footnote that this also impacts
Carl Boettiger created ARROW-15875:
--
Summary: Include md5sum in S3 method for GetFileInfo()
Key: ARROW-15875
URL: https://issues.apache.org/jira/browse/ARROW-15875
Project: Apache Arrow
Iss
Carl Boettiger created ARROW-15879:
--
Summary: passing a schema calls open_dataset to fail on
hive-partitioned csv files
Key: ARROW-15879
URL: https://issues.apache.org/jira/browse/ARROW-15879
Project
[
https://issues.apache.org/jira/browse/ARROW-15879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506256#comment-17506256
]
Carl Boettiger commented on ARROW-15879:
Sorry my minimal example was too minima
[
https://issues.apache.org/jira/browse/ARROW-15875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17506277#comment-17506277
]
Carl Boettiger commented on ARROW-15875:
nice, that would work for me!
> [R][C+
Carl Boettiger created ARROW-18006:
--
Summary: [R] integer coercion on parition variables
Key: ARROW-18006
URL: https://issues.apache.org/jira/browse/ARROW-18006
Project: Apache Arrow
Issue T
Carl Boettiger created ARROW-18114:
--
Summary: [R] unify_schemas=FALSE does not improve open_dataset()
read times
Key: ARROW-18114
URL: https://issues.apache.org/jira/browse/ARROW-18114
Project: Apach
Carl Boettiger created ARROW-18214:
--
Summary: [R] Use ISO 8601 in character representations of
datetimes?
Key: ARROW-18214
URL: https://issues.apache.org/jira/browse/ARROW-18214
Project: Apache Arrow
[
https://issues.apache.org/jira/browse/ARROW-18214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Boettiger updated ARROW-18214:
---
Description:
Arrow needs to represent datetime / timestamp values as character strings, e.g.
[
https://issues.apache.org/jira/browse/ARROW-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17627339#comment-17627339
]
Carl Boettiger commented on ARROW-18114:
Thanks Weston! Any update here?
> [R]
[
https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17630753#comment-17630753
]
Carl Boettiger commented on ARROW-16680:
Hi folks, not to nag but this issue is
[
https://issues.apache.org/jira/browse/ARROW-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17632000#comment-17632000
]
Carl Boettiger commented on ARROW-18114:
Any update on this? I think we could r
[
https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17632484#comment-17632484
]
Carl Boettiger commented on ARROW-16680:
Wow, thanks Dewey! That looks like bla
[
https://issues.apache.org/jira/browse/ARROW-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17645720#comment-17645720
]
Carl Boettiger commented on ARROW-17894:
Unfortunately I still get an error when
[
https://issues.apache.org/jira/browse/ARROW-17894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17647674#comment-17647674
]
Carl Boettiger commented on ARROW-17894:
I no longer get the error when I use re
[
https://issues.apache.org/jira/browse/ARROW-18114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17648256#comment-17648256
]
Carl Boettiger commented on ARROW-18114:
Just an additional comment that this be
Carl Boettiger created ARROW-16144:
--
Summary: Write compressed data streams (particularly over S3)
Key: ARROW-16144
URL: https://issues.apache.org/jira/browse/ARROW-16144
Project: Apache Arrow
[
https://issues.apache.org/jira/browse/ARROW-16144?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17520814#comment-17520814
]
Carl Boettiger commented on ARROW-16144:
Hi, sorry, but I believe this is not co
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530874#comment-17530874
]
Carl Boettiger commented on ARROW-15081:
Any news on this? I'll keep an eye on
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530962#comment-17530962
]
Carl Boettiger edited comment on ARROW-15081 at 5/2/22 10:29 PM:
-
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17530962#comment-17530962
]
Carl Boettiger commented on ARROW-15081:
Thanks Weston, I'll try that. Just to
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531751#comment-17531751
]
Carl Boettiger commented on ARROW-15081:
Thanks Weston, sounds promising! Hmm..
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17531857#comment-17531857
]
Carl Boettiger commented on ARROW-15081:
Thanks, this is super. Right, I have
[
https://issues.apache.org/jira/browse/ARROW-15081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17533976#comment-17533976
]
Carl Boettiger commented on ARROW-15081:
Just a note that even with a single par
Carl Boettiger created ARROW-16521:
--
Summary: Configure curl timeout policy for remote filesystems
Key: ARROW-16521
URL: https://issues.apache.org/jira/browse/ARROW-16521
Project: Apache Arrow
[
https://issues.apache.org/jira/browse/ARROW-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17534579#comment-17534579
]
Carl Boettiger commented on ARROW-16521:
I'm seeing timeouts on s3$ls() for exam
Carl Boettiger created ARROW-16619:
--
Summary: read_csv_arrow / open_dataset over https connection?
Key: ARROW-16619
URL: https://issues.apache.org/jira/browse/ARROW-16619
Project: Apache Arrow
Carl Boettiger created ARROW-16620:
--
Summary: open_dataset fails to open single compressed csv
Key: ARROW-16620
URL: https://issues.apache.org/jira/browse/ARROW-16620
Project: Apache Arrow
I
[
https://issues.apache.org/jira/browse/ARROW-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539779#comment-17539779
]
Carl Boettiger commented on ARROW-16619:
@David Li I agree these are closely rel
[
https://issues.apache.org/jira/browse/ARROW-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17539789#comment-17539789
]
Carl Boettiger commented on ARROW-16619:
thanks, yeah totally. I'd love to see
[
https://issues.apache.org/jira/browse/ARROW-16619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17542229#comment-17542229
]
Carl Boettiger commented on ARROW-16619:
sounds good! Eventually it would still
Carl Boettiger created ARROW-16680:
--
Summary: Weird R error: Error in
fs___FileSystem__GetTargetInfos_FileSelector(self, x) :ignoring SIGPIPE
signal
Key: ARROW-16680
URL: https://issues.apache.org/jira/brows
[
https://issues.apache.org/jira/browse/ARROW-16680?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17544504#comment-17544504
]
Carl Boettiger commented on ARROW-16680:
Hi folks, thanks for testing, I know th
[
https://issues.apache.org/jira/browse/ARROW-16521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17561193#comment-17561193
]
Carl Boettiger commented on ARROW-16521:
I've found that setting CURLOPT_ACCEPTT
Carl Boettiger created ARROW-13761:
--
Summary: arrow::filter() crashes (aborts R session)
Key: ARROW-13761
URL: https://issues.apache.org/jira/browse/ARROW-13761
Project: Apache Arrow
Issue T
[
https://issues.apache.org/jira/browse/ARROW-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17404782#comment-17404782
]
Carl Boettiger commented on ARROW-13761:
I noticed that falling back to arrow 4.
[
https://issues.apache.org/jira/browse/ARROW-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405506#comment-17405506
]
Carl Boettiger commented on ARROW-13761:
Thanks all for the explanations. I can
[
https://issues.apache.org/jira/browse/ARROW-13761?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17405566#comment-17405566
]
Carl Boettiger commented on ARROW-13761:
Thanks Weston, that's great to hear! T
Carl Boettiger created ARROW-11582:
--
Summary: write_dataset fails unexpectedly
Key: ARROW-11582
URL: https://issues.apache.org/jira/browse/ARROW-11582
Project: Apache Arrow
Issue Type: Bug
[
https://issues.apache.org/jira/browse/ARROW-11582?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17282593#comment-17282593
]
Carl Boettiger commented on ARROW-11582:
Thanks, that makes total sense. Works
[
https://issues.apache.org/jira/browse/ARROW-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423038#comment-17423038
]
Carl Boettiger commented on ARROW-13611:
Any news on this? I believe this bug i
[
https://issues.apache.org/jira/browse/ARROW-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423038#comment-17423038
]
Carl Boettiger edited comment on ARROW-13611 at 9/30/21, 10:58 PM:
---
[
https://issues.apache.org/jira/browse/ARROW-13611?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17423038#comment-17423038
]
Carl Boettiger edited comment on ARROW-13611 at 9/30/21, 10:59 PM:
---
Carl Boettiger created ARROW-14998:
--
Summary: Support for HTTPS Filesystem access (from R client)
Key: ARROW-14998
URL: https://issues.apache.org/jira/browse/ARROW-14998
Project: Apache Arrow
[
https://issues.apache.org/jira/browse/ARROW-14998?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17454236#comment-17454236
]
Carl Boettiger commented on ARROW-14998:
I think so, thanks for sharing the link
Carl Boettiger created ARROW-15060:
--
Summary: open_dataset() on csv files lacks support for compressed
files
Key: ARROW-15060
URL: https://issues.apache.org/jira/browse/ARROW-15060
Project: Apache Ar
Carl Boettiger created ARROW-15081:
--
Summary: Arrow crashes (OOM) on R client with large remote parquet
files
Key: ARROW-15081
URL: https://issues.apache.org/jira/browse/ARROW-15081
Project: Apache A
Carl Boettiger created ARROW-15088:
--
Summary: Support for csv options on open_dataset
Key: ARROW-15088
URL: https://issues.apache.org/jira/browse/ARROW-15088
Project: Apache Arrow
Issue Type
Carl Boettiger created ARROW-15104:
--
Summary: write_parquet() / write_csv_arrow() cannot stream a
dataset object back to S3
Key: ARROW-15104
URL: https://issues.apache.org/jira/browse/ARROW-15104
Pro
Carl Boettiger created ARROW-15105:
--
Summary: unsupported timestamp cast in CSV with tz element
Key: ARROW-15105
URL: https://issues.apache.org/jira/browse/ARROW-15105
Project: Apache Arrow
[
https://issues.apache.org/jira/browse/ARROW-15105?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Carl Boettiger updated ARROW-15105:
---
Component/s: R
Affects Version/s: 6.0.1
> unsupported timestamp cast in CSV with t
[
https://issues.apache.org/jira/browse/ARROW-15104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17459338#comment-17459338
]
Carl Boettiger commented on ARROW-15104:
Thanks much! sorry for the duplicate an
Carl Boettiger created ARROW-15124:
--
Summary: default TZ parsing woes in CSV reader
Key: ARROW-15124
URL: https://issues.apache.org/jira/browse/ARROW-15124
Project: Apache Arrow
Issue Type:
[
https://issues.apache.org/jira/browse/ARROW-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460411#comment-17460411
]
Carl Boettiger commented on ARROW-15124:
Thanks, I understand the potential ambi
Carl Boettiger created ARROW-15127:
--
Summary: More visible documentation of
AWS_EC2_METADATA_DISABLED=TRUE
Key: ARROW-15127
URL: https://issues.apache.org/jira/browse/ARROW-15127
Project: Apache Arro
[
https://issues.apache.org/jira/browse/ARROW-14442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460878#comment-17460878
]
Carl Boettiger commented on ARROW-14442:
FWIW, I also think option 3 is correct.
[
https://issues.apache.org/jira/browse/ARROW-15124?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460895#comment-17460895
]
Carl Boettiger commented on ARROW-15124:
Just a correction – this only impacts t
[
https://issues.apache.org/jira/browse/ARROW-15127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460911#comment-17460911
]
Carl Boettiger commented on ARROW-15127:
Also, does this only work (or behave di
[ https://issues.apache.org/jira/browse/ARROW-15127 ]
Carl Boettiger deleted comment on ARROW-15127:
was (Author: cboettig):
Also, does this only work (or behave differently) on the dev release (6.0.2)?
Just tried rolling back to the lates
[
https://issues.apache.org/jira/browse/ARROW-15060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17460947#comment-17460947
]
Carl Boettiger commented on ARROW-15060:
My apologies, but it looks like it is r
85 matches
Mail list logo