Re: questions about Gandiva

2019-10-31 Thread Yibo Cai
Thanks Wes. Arrow is a very exciting project. I'm from Arm. We are interested in arrow and would like to study and help improving arrow. Yibo On 11/1/19 1:25 AM, Wes McKinney wrote: hi On Thu, Oct 31, 2019 at 12:11 AM Yibo Cai wrote: Hi, Arrow cpp integrates Gandiva to provide low level o

Re: [VOTE] Release Apache Arrow 0.15.1 - RC0

2019-10-31 Thread Bryan Cutler
After changing it to `pip install archery` it will use my base conda env. Then I get an error that `archery integration` is not a valid command: + INTEGRATION_TEST_ARGS= + '[' OFF = ON ']' + LD_LIBRARY_PATH=/tmp/arrow-0.15.1.0tRNC/apache-arrow-0.15.1/cpp/build/release:/tmp/arrow-0.15.1.0tRNC/insta

re: Arrow for low latency IPC

2019-10-31 Thread Samrat Batth
Hi, I am new to Apache Arrow and want to consider it for low latency IPC stream. I want to see if I can use Arrow for low latency IPC via processes written in multiple languages. As far as what I can understand about current version of Arrow, the messages are passed in a batch via IPC, ie the

Re: [VOTE] Release Apache Arrow 0.15.1 - RC0

2019-10-31 Thread Bryan Cutler
I am using a conda env, so that will install the package there. When archery runs the integration tests though, it looks like it uses my system python/pip3, which doesn't have any of the required packages. Not sure if I'm missing something to use the right environment. On Thu, Oct 31, 2019 at 2:17

Re: [CI] Docker-compose refactor and GitHub Actions

2019-10-31 Thread Wes McKinney
hi Krisz -- I just left comments on the PR. This definitely looks like a good step forward. My main comment is that I think there are too many C++/Python tasks to run on an each-commit basis. Ideally many of these would be run nightly. There is also a certain amount of redundancy in rebuilding the

Re: [VOTE] Release Apache Arrow 0.15.1 - RC0

2019-10-31 Thread Wes McKinney
hi Bryan -- I think `pip3 install setuptools` will take care of it On Thu, Oct 31, 2019 at 2:06 PM Bryan Cutler wrote: > > +1 (non-binding), although I could not complete the source verification > script > > On Ubuntu 16.04 I ran > * verification script for binaries, no issues > * verification

[jira] [Created] (ARROW-7041) PythonLibs setting found by CMake uses wrong version of Python on macOS

2019-10-31 Thread Christian Hudon (Jira)
Christian Hudon created ARROW-7041: -- Summary: PythonLibs setting found by CMake uses wrong version of Python on macOS Key: ARROW-7041 URL: https://issues.apache.org/jira/browse/ARROW-7041 Project: Ap

Re: [VOTE] Release Apache Arrow 0.15.1 - RC0

2019-10-31 Thread Bryan Cutler
+1 (non-binding), although I could not complete the source verification script On Ubuntu 16.04 I ran * verification script for binaries, no issues * verification script for source, could not complete: TEST_DEFAULT=0 TEST_SOURCE=1 TEST_PYTHON=1 TEST_INTEGRATION_CPP=1 TEST_INTEGRATION_JAVA=1 ARROW

Re: [VOTE] Release Apache Arrow 0.15.1 - RC0

2019-10-31 Thread Wes McKinney
We have 3 PMC votes, should the vote be closed so that artifacts can begin to be posted? On Thu, Oct 31, 2019 at 8:53 AM Francois Saint-Jacques wrote: > > +1 (non-binding) > > Ubuntu 18.04 > - Source release verified > - Binary release verified > > François > > > On Fri, Oct 25, 2019 at 2:43 PM K

Re: questions about Gandiva

2019-10-31 Thread Ted Gooch
You can also see some of the Gandiva python bindings in the tests in pyarrow: https://github.com/apache/arrow/blob/master/python/pyarrow/tests/test_gandiva.py On Thu, Oct 31, 2019 at 10:26 AM Wes McKinney wrote: > hi > > On Thu, Oct 31, 2019 at 12:11 AM Yibo Cai wrote: > > > > Hi, > > > > Arro

Re: questions about Gandiva

2019-10-31 Thread Wes McKinney
hi On Thu, Oct 31, 2019 at 12:11 AM Yibo Cai wrote: > > Hi, > > Arrow cpp integrates Gandiva to provide low level operations on arrow > buffers. [1][2] > I have some questions, any help is appreciated: > - Arrow cpp already has a compute kernel[3], does it duplicate what Gandiva > provides? I s

[jira] [Created] (ARROW-7040) StringArrayBuilder.AppendRange - Crashes

2019-10-31 Thread Anthony Abate (Jira)
Anthony Abate created ARROW-7040: Summary: StringArrayBuilder.AppendRange - Crashes Key: ARROW-7040 URL: https://issues.apache.org/jira/browse/ARROW-7040 Project: Apache Arrow Issue Type: Bu

Re: [VOTE] Release Apache Arrow 0.15.1 - RC0

2019-10-31 Thread Francois Saint-Jacques
+1 (non-binding) Ubuntu 18.04 - Source release verified - Binary release verified François On Fri, Oct 25, 2019 at 2:43 PM Krisztián Szűcs wrote: > > Hi, > > I would like to propose the following release candidate (RC0) of Apache > Arrow version 0.15.1. This is a patch release consisting of 36

Re: [NIGHTLY] Arrow Build Report for Job nightly-2019-10-31-0

2019-10-31 Thread Krisztián Szűcs
For the no pandas failures here is the ticket containing the fix: https://issues.apache.org/jira/browse/ARROW-7039 The OSX wheel failure is caused by GitHub API read timeout. On Thu, Oct 31, 2019 at 1:01 PM Crossbow wrote: > > > Arrow Build Report for Job nightly-2019-10-31-0 > > All tasks: > h

[jira] [Created] (ARROW-7039) [Python] Typecheck expects pandas to be installed

2019-10-31 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7039: -- Summary: [Python] Typecheck expects pandas to be installed Key: ARROW-7039 URL: https://issues.apache.org/jira/browse/ARROW-7039 Project: Apache Arrow Is

[NIGHTLY] Arrow Build Report for Job nightly-2019-10-31-0

2019-10-31 Thread Crossbow
Arrow Build Report for Job nightly-2019-10-31-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-10-31-0 Failed Tasks: - docker-clang-format: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-10-31-0-circle-docker-clang-format - docke

Re: [VOTE] Release Apache Arrow 0.15.1 - RC0

2019-10-31 Thread Antoine Pitrou
+1 from me. I verified the release on Ubuntu 18.04 (x86-64), CUDA enabled: * binaries verification went fine * source verification went fine except for the Go step (*) (*) Go failure: """ github.com/apache/arrow (download) created GOPATH=/home/antoine/go; see 'go help gopath' package github.co