[jira] [Created] (ARROW-4189) [Rust] Fix broken cargo coverage

Chao Sun created ARROW-4189: --- Summary: [Rust] Fix broken cargo coverage Key: ARROW-4189 URL: https://issues.apache.org/jira/browse/ARROW-4189 Project: Apache Arrow Issue Type: Test Compon

Re: Rust bindings for Gandiva

Agree with Wes, the protobuf based interface should be the language neutral way to build expressions with Gandiva. On Mon, Jan 7, 2019 at 8:30 PM Andy Grove wrote: > This makes sense to me know that I understand a little more about Gandiva. > This also fits well with my proposal to donate DataFu

[jira] [Created] (ARROW-4188) [Rust] There should be a README in the top level rust directory

Andy Grove created ARROW-4188: - Summary: [Rust] There should be a README in the top level rust directory Key: ARROW-4188 URL: https://issues.apache.org/jira/browse/ARROW-4188 Project: Apache Arrow

[jira] [Created] (ARROW-4187) [C++] file-benchmark uses

Benjamin Kietzman created ARROW-4187: Summary: [C++] file-benchmark uses Key: ARROW-4187 URL: https://issues.apache.org/jira/browse/ARROW-4187 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4186) [C++] BitmapWriters clobber the first byte when length=0

Benjamin Kietzman created ARROW-4186: Summary: [C++] BitmapWriters clobber the first byte when length=0 Key: ARROW-4186 URL: https://issues.apache.org/jira/browse/ARROW-4186 Project: Apache Arrow

[jira] [Created] (ARROW-4185) [Rust] Appveyor builds are broken

Andy Grove created ARROW-4185: - Summary: [Rust] Appveyor builds are broken Key: ARROW-4185 URL: https://issues.apache.org/jira/browse/ARROW-4185 Project: Apache Arrow Issue Type: Bug Co

Re: Compiling C++ Arrow Flight

I was finally able to build and run the flight-test-server/flight-test binaries by hacking the arrow/flight/CMakeLists.txt to manually satisfy the dependencies. I think part of my issue was trying to use a separate local grpc installation to satisfy dependencies. I can now work through the test c

[jira] [Created] (ARROW-4184) [Ruby] Add Arrow::RecordBatch#to_table

Kouhei Sutou created ARROW-4184: --- Summary: [Ruby] Add Arrow::RecordBatch#to_table Key: ARROW-4184 URL: https://issues.apache.org/jira/browse/ARROW-4184 Project: Apache Arrow Issue Type: New Fea

[jira] [Created] (ARROW-4183) [Ruby] Add Arrow::Struct as an element of Arrow::StructArray

Kouhei Sutou created ARROW-4183: --- Summary: [Ruby] Add Arrow::Struct as an element of Arrow::StructArray Key: ARROW-4183 URL: https://issues.apache.org/jira/browse/ARROW-4183 Project: Apache Arrow

Re: Debugging Gandiva failures in python CI tests

IMHO we can simpler skip the Gandiva tests on Python 2.7. Regards Antoine. Le 07/01/2019 à 21:12, Ravindra Pindikura a écrit : > Thanks Antoine. > > This works on my test machine. But fails in CI. I’m guessing it’s a python > 2.7 issue. > > https://travis-ci.org/apache/arrow/jobs/47646967

[jira] [Created] (ARROW-4182) [Python][CI] SEGV frequency

Kouhei Sutou created ARROW-4182: --- Summary: [Python][CI] SEGV frequency Key: ARROW-4182 URL: https://issues.apache.org/jira/browse/ARROW-4182 Project: Apache Arrow Issue Type: Bug Comp

Re: Debugging Gandiva failures in python CI tests

Thanks Antoine. This works on my test machine. But fails in CI. I’m guessing it’s a python 2.7 issue. https://travis-ci.org/apache/arrow/jobs/476469678 ImportError while loading conftest '/home/travis/build/apache/arrow/python/pyarrow/test

Re: [Rust] [DISCUSS] Donate DataFusion to Arrow project

Thanks, Ted! I wish I'd been a bit more specific about my ask in the original email... I guess my question (for Wes?) is what is the process to raise this for a vote? Andy. On Sun, Jan 6, 2019 at 2:59 PM Ted Dunning wrote: > Cool! > > > > On Sun, Jan 6, 2019 at 1:52 PM Andy Grove wrote: > >

[jira] [Created] (ARROW-4181) [Python] TestConvertStructTypes.test_from_numpy_large failing

Wes McKinney created ARROW-4181: --- Summary: [Python] TestConvertStructTypes.test_from_numpy_large failing Key: ARROW-4181 URL: https://issues.apache.org/jira/browse/ARROW-4181 Project: Apache Arrow

Re: [Rust] Creating Native Types from Rust Types (e.g. i32 -> ArrowNativeType)

Looks like I need the below in datatypes.rs impl From for Int32Type { fn from(value: i32) -> Self { value.into() } } Adding that to the `make_type` macro seems to have solved my problem. I can now implement things like `count`, `mean`, and a few more types of calculations and aggregations on arra

Re: Compiling C++ Arrow Flight

Did you build gRPC using CMake or autotools (I was using CMake, so things are specialized to that for the moment)? As I said the current state of the toolchain configuration for gRPC was temporary to enable me to develop the initial unit tests and benchmarks. It'll be some time before this is produ

[jira] [Created] (ARROW-4180) [Java] Reduce verbose logging of ArrowBuf creation events?

Wes McKinney created ARROW-4180: --- Summary: [Java] Reduce verbose logging of ArrowBuf creation events? Key: ARROW-4180 URL: https://issues.apache.org/jira/browse/ARROW-4180 Project: Apache Arrow

Re: [Rust] Creating Native Types from Rust Types (e.g. i32 -> ArrowNativeType)

Thanks Andy, I'm aware of that, and have tried it with no success. What I am looking for might be similar to ScalarValue in DataFusion. If I create an array like Int32Array::from(vec![1]), and try to get the first value from this array, I get the primitive 1i32 instead of what I'm looking for. O

[jira] [Created] (ARROW-4179) [Python] Tests crashing on all platforms in CI

Wes McKinney created ARROW-4179: --- Summary: [Python] Tests crashing on all platforms in CI Key: ARROW-4179 URL: https://issues.apache.org/jira/browse/ARROW-4179 Project: Apache Arrow Issue Type:

Re: Timeline for Arrow 0.12.0 release

Cool. I'm going to help with the python issues right after fixing the spark integration tests. On Mon, Jan 7, 2019 at 4:43 PM Wes McKinney wrote: > Great, thank you! > > There are 20 0.12 issues Open or In-Progress, I'm going to tackle a > couple more Python things today and tomorrow, but let's

[jira] [Created] (ARROW-4178) [C++] Fix TSan and UBSan errors

Antoine Pitrou created ARROW-4178: - Summary: [C++] Fix TSan and UBSan errors Key: ARROW-4178 URL: https://issues.apache.org/jira/browse/ARROW-4178 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-4177) [C++] Add ThreadPool and TaskGroup microbenchmarks

Wes McKinney created ARROW-4177: --- Summary: [C++] Add ThreadPool and TaskGroup microbenchmarks Key: ARROW-4177 URL: https://issues.apache.org/jira/browse/ARROW-4177 Project: Apache Arrow Issue T

Re: Timeline for Arrow 0.12.0 release

Great, thank you! There are 20 0.12 issues Open or In-Progress, I'm going to tackle a couple more Python things today and tomorrow, but let's see where we stand by Wednesday or so and decide when to cut the release On Mon, Jan 7, 2019 at 4:38 AM Krisztián Szűcs wrote: > > Hey! > > On Fri, Jan 4,

Re: [Rust] Creating Native Types from Rust Types (e.g. i32 -> ArrowNativeType)

It is possible to create an array of Arrow types from a vec of primitives e.g. Int32Array::from(vec![1, 2, 3]) IIRC. Andy. On Mon, Jan 7, 2019 at 5:09 AM Neville Dipale wrote: > I'm trying to find/create a way of converting primitive rust values in Rust > to their ArrowNativeType counterparts.

Re: Rust bindings for Gandiva

This makes sense to me know that I understand a little more about Gandiva. This also fits well with my proposal to donate DataFusion in the other thread. DataFusion can manage the overall logical query plan in Rust and potentially delegate some subset of expression evaluation to Gandiva via protobu

Re: Rust bindings for Gandiva

Gandiva supports a Protobuf-based interface -- this is how Java interacts with it via JNI. Rust could do the same -- that would probably be easier than wrapping the C++ class structure. It would also help drive new feature requirements in the serialized projection/filter expression trees - Wes On

Re: Debugging Gandiva failures in python CI tests

Hi Ravindra, I've found that it's the same issue as previously in Java. Here is a workaround that works here: https://gist.github.com/pitrou/7eed7b980eec3187d619bc146b75cc4b Regards Antoine. Le 07/01/2019 à 07:16, Ravindra Pindikura a écrit : > I missed mentioning this. The repro requires my

[Rust] Creating Native Types from Rust Types (e.g. i32 -> ArrowNativeType)

I'm trying to find/create a way of converting primitive rust values in Rust to their ArrowNativeType counterparts. I'm trying to implement some array ops which need constant values, so I can be able to multiply say a Int32Type by 3 to get a value. Is there currently a way of doing this that I don'

Re: Timeline for Arrow 0.12.0 release

Hey! On Fri, Jan 4, 2019 at 10:31 PM Wes McKinney wrote: > hi all, > > We should try to cut a release candidate for 0.12 as soon as > practical. Since we're just coming off the holidays, it would be good > to work for a few more business days to close out as many outstanding > patches as possibl

Re: Rust bindings for Gandiva

I'm not sure, that a binding is a good idea. Both Arrow and Parquet already have their own rust implementation, and a interfacing with cpp isn't as easy and straightforward than it is with C. Otherwise We could simply just maintain bindings for all of the cpp libraries, rather than of having a hybr

[jira] [Created] (ARROW-4176) [C++/Python] Human readable arrow schema comparison

Florian Jetter created ARROW-4176: - Summary: [C++/Python] Human readable arrow schema comparison Key: ARROW-4176 URL: https://issues.apache.org/jira/browse/ARROW-4176 Project: Apache Arrow Is