Re: [RUST] [DISCUSS] Changing type of array lengths

2018-12-09 Thread paddy horan
Thanks All, I didn't hear any strong opinions against this change so the PR is here: https://github.com/apache/arrow/pull/3142 Thanks, Paddy From: Marco Neumann Sent: Friday, December 7, 2018 12:35 PM To: dev@arrow.apache.org Subject: Re: [RUST] [DISCUSS] Changin

[jira] [Created] (ARROW-3978) [C++] Implement hashing, dictionary-encoding for StructArray

2018-12-09 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3978: --- Summary: [C++] Implement hashing, dictionary-encoding for StructArray Key: ARROW-3978 URL: https://issues.apache.org/jira/browse/ARROW-3978 Project: Apache Arrow

[jira] [Created] (ARROW-3977) [Gandiva] gandiva cpp tests not running in CI

2018-12-09 Thread Pindikura Ravindra (JIRA)
Pindikura Ravindra created ARROW-3977: - Summary: [Gandiva] gandiva cpp tests not running in CI Key: ARROW-3977 URL: https://issues.apache.org/jira/browse/ARROW-3977 Project: Apache Arrow

[jira] [Created] (ARROW-3976) [Ruby] Homebrew donation solicitation on CLI breaking CI builds

2018-12-09 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3976: --- Summary: [Ruby] Homebrew donation solicitation on CLI breaking CI builds Key: ARROW-3976 URL: https://issues.apache.org/jira/browse/ARROW-3976 Project: Apache Arrow

[jira] [Created] (ARROW-3975) Find a better organizational scheme for inter-language integration / protocol tests and integration tests between Apache Arrow and third party projects

2018-12-09 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3975: --- Summary: Find a better organizational scheme for inter-language integration / protocol tests and integration tests between Apache Arrow and third party projects Key: ARROW-3975 URL

Re: Arrow JS 0.4.0 Release

2018-12-09 Thread Wes McKinney
I agree that we should cut a JavaScript release. With the amount of maintenance work on my plate I have to declare bankruptcy on doing any more than I am right now. Can another PMC volunteer to be the RM for the 0.4.0 JavaScript release? Thanks Wes On Tue, Dec 4, 2018 at 10:07 PM Brian Hulette w

[jira] [Created] (ARROW-3974) [C++] Combine field_builders_ and children_ members in array/builder.h

2018-12-09 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3974: --- Summary: [C++] Combine field_builders_ and children_ members in array/builder.h Key: ARROW-3974 URL: https://issues.apache.org/jira/browse/ARROW-3974 Project: Apache Ar

Re: [Go] Npyio / Arrow support

2018-12-09 Thread Wes McKinney
hi Sebastien, Seems reasonable, and the integration between the libraries could be useful (although npyio could be made to depend on the Arrow Go libraries) If there is the desire from the Arrow Go developers to merge in that codebase, it seems perhaps old enough that we might have to do an IP cl

Re: Timeline for Arrow 0.12.0 release

2018-12-09 Thread Wes McKinney
hi Andy, I can see an argument for having some basic native function kernel support in Rust. One of the things that Gandiva has begun is a Protobuf-based serialized representation representation of projection and filter expressions. In the long run I would like to see a more complete relational al

[jira] [Created] (ARROW-3973) [Gandiva][Java] Move the benchmark tests out of unit test scope.

2018-12-09 Thread Praveen Kumar Desabandu (JIRA)
Praveen Kumar Desabandu created ARROW-3973: -- Summary: [Gandiva][Java] Move the benchmark tests out of unit test scope. Key: ARROW-3973 URL: https://issues.apache.org/jira/browse/ARROW-3973 Pr

[jira] [Created] (ARROW-3972) [Gandiva] Update to LLVM 7

2018-12-09 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-3972: -- Summary: [Gandiva] Update to LLVM 7 Key: ARROW-3972 URL: https://issues.apache.org/jira/browse/ARROW-3972 Project: Apache Arrow Issue Type: Improvement

[jira] [Created] (ARROW-3971) [Python] Remove APIs deprecated in 0.11 and prior

2018-12-09 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3971: --- Summary: [Python] Remove APIs deprecated in 0.11 and prior Key: ARROW-3971 URL: https://issues.apache.org/jira/browse/ARROW-3971 Project: Apache Arrow Issue Ty

[jira] [Created] (ARROW-3970) [Gandiva][C++] Remove unnecessary boost dependencies

2018-12-09 Thread Praveen Kumar Desabandu (JIRA)
Praveen Kumar Desabandu created ARROW-3970: -- Summary: [Gandiva][C++] Remove unnecessary boost dependencies Key: ARROW-3970 URL: https://issues.apache.org/jira/browse/ARROW-3970 Project: Apache

[jira] [Created] (ARROW-3969) [Rust] CI build broken because rustfmt not available on nightly toolchain

2018-12-09 Thread Andy Grove (JIRA)
Andy Grove created ARROW-3969: - Summary: [Rust] CI build broken because rustfmt not available on nightly toolchain Key: ARROW-3969 URL: https://issues.apache.org/jira/browse/ARROW-3969 Project: Apache Arr

Re: Thread-safety of buffer allocators in Java

2018-12-09 Thread Jacques Nadeau
Yes, that is true. Allocators, buffers and pretty much everything inbetween is thread safe. Locking around the memory backing a buffer itself needs to be managed in the app. You can review the doc here which talks more about the structure of the allocators: https://github.com/apache/arrow/blob/mas