[jira] [Created] (ARROW-3574) Fix remaining bug with plasma static versus shared libraries.

2018-10-19 Thread Robert Nishihara (JIRA)
Robert Nishihara created ARROW-3574: --- Summary: Fix remaining bug with plasma static versus shared libraries. Key: ARROW-3574 URL: https://issues.apache.org/jira/browse/ARROW-3574 Project: Apache Arr

[jira] [Created] (ARROW-3573) [Rust] with_bitset does not set valid bits correctly

2018-10-19 Thread Paddy Horan (JIRA)
Paddy Horan created ARROW-3573: -- Summary: [Rust] with_bitset does not set valid bits correctly Key: ARROW-3573 URL: https://issues.apache.org/jira/browse/ARROW-3573 Project: Apache Arrow Issue T

[jira] [Created] (ARROW-3572) [Packaging] Correctly handle ssh origin urls for crossbow

2018-10-19 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-3572: -- Summary: [Packaging] Correctly handle ssh origin urls for crossbow Key: ARROW-3572 URL: https://issues.apache.org/jira/browse/ARROW-3572 Project: Apache Arrow

[jira] [Created] (ARROW-3571) [Wiki] Release management guide does not explain how to set up Crossbow or where to find instructions

2018-10-19 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3571: --- Summary: [Wiki] Release management guide does not explain how to set up Crossbow or where to find instructions Key: ARROW-3571 URL: https://issues.apache.org/jira/browse/ARROW-3571

[jira] [Created] (ARROW-3570) [Packaging] Don't bundle test data files with python wheels

2018-10-19 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-3570: -- Summary: [Packaging] Don't bundle test data files with python wheels Key: ARROW-3570 URL: https://issues.apache.org/jira/browse/ARROW-3570 Project: Apache Arrow

[jira] [Created] (ARROW-3569) [Packaging] Run pyarrow unittests for when building conda package

2018-10-19 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-3569: -- Summary: [Packaging] Run pyarrow unittests for when building conda package Key: ARROW-3569 URL: https://issues.apache.org/jira/browse/ARROW-3569 Project: Apache A

[jira] [Created] (ARROW-3568) [Packaging] Run pyarrow unittests for windows wheels

2018-10-19 Thread Krisztian Szucs (JIRA)
Krisztian Szucs created ARROW-3568: -- Summary: [Packaging] Run pyarrow unittests for windows wheels Key: ARROW-3568 URL: https://issues.apache.org/jira/browse/ARROW-3568 Project: Apache Arrow

[jira] [Created] (ARROW-3567) [Gandiva] [GLib] Add GLib bindings of Gandiva

2018-10-19 Thread Yosuke Shiro (JIRA)
Yosuke Shiro created ARROW-3567: --- Summary: [Gandiva] [GLib] Add GLib bindings of Gandiva Key: ARROW-3567 URL: https://issues.apache.org/jira/browse/ARROW-3567 Project: Apache Arrow Issue Type:

[jira] [Created] (ARROW-3566) Clarify that the type of dictionary encoded field should be the encoded(index) type

2018-10-19 Thread Li Jin (JIRA)
Li Jin created ARROW-3566: - Summary: Clarify that the type of dictionary encoded field should be the encoded(index) type Key: ARROW-3566 URL: https://issues.apache.org/jira/browse/ARROW-3566 Project: Apache A

Re: Efficient Pandas serialization for mixed object and numeric DataFrames

2018-10-19 Thread Wes McKinney
hi Mitar -- to Robert's point, we aren't sure which code path you are referring to. Perhaps related, I'm interested in handling Python pickling for "other" kinds of Python objects when converting to or from the Arrow format. So "Python object" would be defined as a user defined type that's embedde

Parquet format in Java

2018-10-19 Thread Tanveer Ahmad - EWI
Hi, In Java, I'm getting plasma object from C++ (in parquet format) as byte[] buffer. How can I convert it to back to Arrow Schema/columns? Thanks. -- Regards, Tanveer Ahmad

Re: Making a bugfix 0.11.1 release

2018-10-19 Thread Wes McKinney
I prepared the maintenance branch here https://github.com/apache/arrow/tree/maint-0.11.x I'm not fully set up with to create a release candidate yet with Crossbow but I'll work on it today and try to get a vote started by EOD On Fri, Oct 19, 2018 at 3:45 AM Antoine Pitrou wrote: > > > I would re

[jira] [Created] (ARROW-3565) [Python] Pin tensorflow to 1.11.0 in manylinux1 container

2018-10-19 Thread Uwe L. Korn (JIRA)
Uwe L. Korn created ARROW-3565: -- Summary: [Python] Pin tensorflow to 1.11.0 in manylinux1 container Key: ARROW-3565 URL: https://issues.apache.org/jira/browse/ARROW-3565 Project: Apache Arrow Is

[jira] [Created] (ARROW-3564) pyarrow: writing version 2.0 parquet format with dictionary encoding enabled

2018-10-19 Thread Hatem Helal (JIRA)
Hatem Helal created ARROW-3564: -- Summary: pyarrow: writing version 2.0 parquet format with dictionary encoding enabled Key: ARROW-3564 URL: https://issues.apache.org/jira/browse/ARROW-3564 Project: Apach

[jira] [Created] (ARROW-3563) [C++] Declare public link dependencies so arrow_static, plasma_static automatically pull in transitive dependencies

2018-10-19 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3563: --- Summary: [C++] Declare public link dependencies so arrow_static, plasma_static automatically pull in transitive dependencies Key: ARROW-3563 URL: https://issues.apache.org/jira/brow

[jira] [Created] (ARROW-3562) [R] Disallow creating of objects with null shared_ptr

2018-10-19 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-3562: --- Summary: [R] Disallow creating of objects with null shared_ptr Key: ARROW-3562 URL: https://issues.apache.org/jira/browse/ARROW-3562 Project: Apache Arrow Issu

Re: Efficient Pandas serialization for mixed object and numeric DataFrames

2018-10-19 Thread Antoine Pitrou
Slightly off-topic, but the recent work on PEP 574 (*) should allow efficient serialization of Pandas dataframes (**) with standard pickle (or the pickle5 backport). Experimental support for pickle5 has already been merged in Arrow and Numpy (and Pandas uses Numpy as its storage backend). My pe

[jira] [Created] (ARROW-3561) [JS] Update ts-jest

2018-10-19 Thread Dominik Moritz (JIRA)
Dominik Moritz created ARROW-3561: - Summary: [JS] Update ts-jest Key: ARROW-3561 URL: https://issues.apache.org/jira/browse/ARROW-3561 Project: Apache Arrow Issue Type: Task Compone

[jira] [Created] (ARROW-3560) Remove @std/esm

2018-10-19 Thread Dominik Moritz (JIRA)
Dominik Moritz created ARROW-3560: - Summary: Remove @std/esm Key: ARROW-3560 URL: https://issues.apache.org/jira/browse/ARROW-3560 Project: Apache Arrow Issue Type: Task Components:

Re: [VOTE] Accept donation of Ruby bindings to Parquet GLib

2018-10-19 Thread Krisztián Szűcs
+1 On Fri, Oct 19, 2018, 9:44 AM Antoine Pitrou wrote: > > +1 from me. Makes entire sense. > > > Le 18/10/2018 à 23:02, Uwe L. Korn a écrit : > > +1 > > > >> Am 18.10.2018 um 22:59 schrieb Wes McKinney : > >> > >> hello, > >> > >> Kouhei Sutou is proposing to donate Ruby bindings to the Parquet

Re: Making a bugfix 0.11.1 release

2018-10-19 Thread Antoine Pitrou
I would recommend cherry-picking a minimal number of patches for the bugfix and for packaging to work. It's better not to include API additions or changes. Regards Antoine. Le 17/10/2018 à 03:32, Wes McKinney a écrit : > hi folks, > > As a result of ARROW-3514, we need to release new Python

Re: [VOTE] Accept donation of Ruby bindings to Parquet GLib

2018-10-19 Thread Antoine Pitrou
+1 from me. Makes entire sense. Le 18/10/2018 à 23:02, Uwe L. Korn a écrit : > +1 > >> Am 18.10.2018 um 22:59 schrieb Wes McKinney : >> >> hello, >> >> Kouhei Sutou is proposing to donate Ruby bindings to the Parquet GLib >> library, which was received as a donation in September. This Ruby >