Re: [JIRA] -ARROW-1780 - JDBC Adapter - resolved.

2018-10-05 Thread Uwe L. Korn
Hello Atul, sorry for the long turnaround time. I finally had the time to spin up the code from Python. I simply did some tests with a table of New York Taxi trip data and Apache Drill. Using the bundled JDBC driver and JayDeBeAPI, the default for accessing JDBC from Python, it took 11 minutes

[jira] [Created] (ARROW-3447) Arrow 0.10 on Python 3.7 install failure on Ubuntu 17.10

2018-10-05 Thread Matthew Seal (JIRA)
Matthew Seal created ARROW-3447: --- Summary: Arrow 0.10 on Python 3.7 install failure on Ubuntu 17.10 Key: ARROW-3447 URL: https://issues.apache.org/jira/browse/ARROW-3447 Project: Apache Arrow I

CUDA context management questions

2018-10-05 Thread Pearu Peterson
Hi, While researching CUDA context management code in arrow, https://github.com/apache/arrow/blob/master/cpp/src/arrow/gpu/cuda_context.cc , I noticed the following: CudaContextImpl has a member own_context_ that seems not being initialized anywhere. The member own_context_ determines whether the

Re: [VOTE] Release Apache Arrow 0.11.0 (RC1)

2018-10-05 Thread Wes McKinney
+1 (binding) * Ran the source release verification scripts in Ubuntu 14.04 / gcc 4.8.5 (with CMake 3.12 from ppa) and Windows 10 + MSVC 2015 (including the patch ARROW-2337, just merged) * Verified the binaries packages The rough edges we've run into in the release verification are unfortunate, b

Re: Petastorm: PyArrow based library for Tensorflow, PyTorch and others...

2018-10-05 Thread Uwe L. Korn
Hello Yevgeni, this looks interesting. Can you make a PR to https://github.com/apache/arrow so that Petastorm is listed on https://arrow.apache.org/powered_by/ ? I browsed a bit through your code. As far as I can see your approach is store to have a set of Parquet files in a directory with a

[jira] [Created] (ARROW-3446) [R] integer type promotion

2018-10-05 Thread JIRA
Romain François created ARROW-3446: -- Summary: [R] integer type promotion Key: ARROW-3446 URL: https://issues.apache.org/jira/browse/ARROW-3446 Project: Apache Arrow Issue Type: New Feature

Re: Gandiva snapshot releases

2018-10-05 Thread Krisztián Szűcs
Ohh, just read the thread, sorry! So crossbow is located here https://github.com/apache/arrow/tree/master/dev/tasks I suggest to "fork" the python-wheels directory which contains three templated ymls for osx, win and linux builds. For building on linux something like the following should be suf

Re: Using CUDA enabled pyarrow

2018-10-05 Thread Wes McKinney
Also, a Google document would be fine to get started. We can transfer it to Confluence and JIRA after some discussion On Thu, Oct 4, 2018, 11:45 AM Wes McKinney wrote: > hi Pearu -- yes, I had thought of this work working on the arrow_gpu > library. Some time ago I opened > > https://issues.apac

Re: Gandiva snapshot releases

2018-10-05 Thread Praveen Kumar
Thanks Wes. Sure we can look into Crossbow. Kristian - Could you please point me to any relevant docs/scripts and I can start looking into this. On Thu, Oct 4, 2018 at 5:34 PM Wes McKinney wrote: > Appveyor is running against master; there was an issue with the status > hooks that was fixed rec

Re: [VOTE] Release Apache Arrow 0.11.0 (RC1)

2018-10-05 Thread Kouhei Sutou
Hi, Thanks for verifying! > - meson: https://gist.github.com/kszucs/d6a47425764dea9ef76d8e69f589241f I'll look into this later. "/tmp/arrow-release-verify/install//tmp/arrow-release-verify/install/lib" is strange. parquet.pc may be broken...? Can you show your parquet.pc? > - autotools: https:

[jira] [Created] (ARROW-3445) [GLib] Parquet GLib doesn't link Arrow GLib

2018-10-05 Thread Kouhei Sutou (JIRA)
Kouhei Sutou created ARROW-3445: --- Summary: [GLib] Parquet GLib doesn't link Arrow GLib Key: ARROW-3445 URL: https://issues.apache.org/jira/browse/ARROW-3445 Project: Apache Arrow Issue Type: Bu

Re: [VOTE] Release Apache Arrow 0.11.0 (RC1)

2018-10-05 Thread Krisztián Szűcs
On OSX mojave I c_glib linking error and the same plasma test error Uwe mentioned. With the verification script: - meson: https://gist.github.com/kszucs/d6a47425764dea9ef76d8e69f589241f - autotools: https://gist.github.com/kszucs/52291265bc0f35a2e033fb3970795d9d When I use CONDA_PREFIX as install

[jira] [Created] (ARROW-3444) Table.nbytes attribute

2018-10-05 Thread Dave Hirschfeld (JIRA)
Dave Hirschfeld created ARROW-3444: -- Summary: Table.nbytes attribute Key: ARROW-3444 URL: https://issues.apache.org/jira/browse/ARROW-3444 Project: Apache Arrow Issue Type: New Feature