[jira] [Created] (ARROW-5625) [R] convert Array of struct type to data frame columns

2019-06-17 Thread JIRA
Romain François created ARROW-5625: -- Summary: [R] convert Array of struct type to data frame columns Key: ARROW-5625 URL: https://issues.apache.org/jira/browse/ARROW-5625 Project: Apache Arrow

Re: New CI system: Ursabot

2019-06-17 Thread Krisztián Szűcs
On Sun, Jun 16, 2019 at 6:17 AM Micah Kornfield wrote: > Hi Krisztian, > This is really cool, thank you for doing this. Two questions: > 1. How reliable is the build setup? Is it reliable enough at this point to > be considered a merge blocker if a build fails? > IMO yes. > 2. What is the p

[jira] [Created] (ARROW-5626) [C

2019-06-17 Thread Pindikura Ravindra (JIRA)
Pindikura Ravindra created ARROW-5626: - Summary: [C Key: ARROW-5626 URL: https://issues.apache.org/jira/browse/ARROW-5626 Project: Apache Arrow Issue Type: Bug Reporter: Pindi

Re: New CI system: Ursabot

2019-06-17 Thread Wes McKinney
On Mon, Jun 17, 2019 at 7:25 AM Krisztián Szűcs wrote: > > On Sun, Jun 16, 2019 at 6:17 AM Micah Kornfield > wrote: > > > Hi Krisztian, > > This is really cool, thank you for doing this. Two questions: > > 1. How reliable is the build setup? Is it reliable enough at this point to > > be consid

[jira] [Created] (ARROW-5627) [R] split code generation into mock and implementation

2019-06-17 Thread JIRA
Romain François created ARROW-5627: -- Summary: [R] split code generation into mock and implementation Key: ARROW-5627 URL: https://issues.apache.org/jira/browse/ARROW-5627 Project: Apache Arrow

[jira] [Created] (ARROW-5628) [R] Converter should be able to ingest part of an Array

2019-06-17 Thread JIRA
Romain François created ARROW-5628: -- Summary: [R] Converter should be able to ingest part of an Array Key: ARROW-5628 URL: https://issues.apache.org/jira/browse/ARROW-5628 Project: Apache Arrow

Re: [Discuss][Format][Java] Finalizing Union Types

2019-06-17 Thread Wes McKinney
I'm also +1 for generalized unions as we currently have specified. The objections from the Java users seems to be mostly on the basis of performance in the union-of-primitives case -- that's an implementation specific issue, so if Java needs to have a "GeneralizedDenseUnionVector" or something to h

Re: [Discuss][Format][Java] Finalizing Union Types

2019-06-17 Thread Wes McKinney
I'd already moved the Union issues to 1.0.0 so we are all good there On Mon, Jun 17, 2019 at 10:18 AM Wes McKinney wrote: > > I'm also +1 for generalized unions as we currently have specified. The > objections from the Java users seems to be mostly on the basis of > performance in the union-of-pr

[jira] [Created] (ARROW-5629) [C++] Fix Coverity issues

2019-06-17 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5629: - Summary: [C++] Fix Coverity issues Key: ARROW-5629 URL: https://issues.apache.org/jira/browse/ARROW-5629 Project: Apache Arrow Issue Type: Bug Co

Re: [Discuss][Format][Java] Finalizing Union Types

2019-06-17 Thread Micah Kornfield
Sounds good. Sorry I got distracted with some other stuff but should be getting back to this soonish On Monday, June 17, 2019, Wes McKinney wrote: > I'd already moved the Union issues to 1.0.0 so we are all good there > > On Mon, Jun 17, 2019 at 10:18 AM Wes McKinney wrote: > > > > I'm also +1

[jira] [Created] (ARROW-5630) [Python] Table of nested arrays doesn't round trip

2019-06-17 Thread Philip Felton (JIRA)
Philip Felton created ARROW-5630: Summary: [Python] Table of nested arrays doesn't round trip Key: ARROW-5630 URL: https://issues.apache.org/jira/browse/ARROW-5630 Project: Apache Arrow Issue

[jira] [Created] (ARROW-5631) [C++] CMake 3.2 build is broken

2019-06-17 Thread Wes McKinney (JIRA)
Wes McKinney created ARROW-5631: --- Summary: [C++] CMake 3.2 build is broken Key: ARROW-5631 URL: https://issues.apache.org/jira/browse/ARROW-5631 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-5632) [Doc] Add some documentation describing compile/debug workflow on macOS with Xcode IDE

2019-06-17 Thread Hatem Helal (JIRA)
Hatem Helal created ARROW-5632: -- Summary: [Doc] Add some documentation describing compile/debug workflow on macOS with Xcode IDE Key: ARROW-5632 URL: https://issues.apache.org/jira/browse/ARROW-5632 Proj

[jira] [Created] (ARROW-5633) [Python] Enable bz2 in wheels

2019-06-17 Thread Antoine Pitrou (JIRA)
Antoine Pitrou created ARROW-5633: - Summary: [Python] Enable bz2 in wheels Key: ARROW-5633 URL: https://issues.apache.org/jira/browse/ARROW-5633 Project: Apache Arrow Issue Type: Improvement

Re: [Discuss][Format][Java] Finalizing Union Types

2019-06-17 Thread Ben Kietzman
Somewhat related: Could we clarify the expected content of the type_ids buffer of union arrays? Layout.rst seems to indicate these should be indices of the corresponding child array, but the C++ implement

[jira] [Created] (ARROW-5634) [C#] ArrayData.NullCount should be a property

2019-06-17 Thread Prashanth Govindarajan (JIRA)
Prashanth Govindarajan created ARROW-5634: - Summary: [C#] ArrayData.NullCount should be a property Key: ARROW-5634 URL: https://issues.apache.org/jira/browse/ARROW-5634 Project: Apache Arrow

Re: [Discuss][Format][Java] Finalizing Union Types

2019-06-17 Thread Wes McKinney
https://github.com/apache/arrow/blob/master/format/Schema.fbs#L88 "optionally typeIds provides an indirection between the child offset and the type id for each child typeIds[offset] is the id used in the type vector" On Mon, Jun 17, 2019 at 12:26 PM Ben Kietzman wrote: > > Somewhat related: > >

Re: New CI system: Ursabot

2019-06-17 Thread Krisztián Szűcs
That's right, OWNER, MEMBER and CONTRIBUTOR roles are allowed: CONTRIBUTOR Author has previously committed to the repository. MEMBER Author is a member of the organization that owns the repository. OWNER Author is the owner of the repository. See https://developer.github.com/v4/enum/commentautho

Re: [Discuss][Format][Java] Finalizing Union Types

2019-06-17 Thread Antoine Pitrou
Le 17/06/2019 à 22:46, Wes McKinney a écrit : > https://github.com/apache/arrow/blob/master/format/Schema.fbs#L88 > > "optionally typeIds provides an indirection between the child offset > and the type id for each child typeIds[offset] is the id used in the > type vector" Does this mean typeIds

Re: [Discuss][Format][Java] Finalizing Union Types

2019-06-17 Thread Wes McKinney
example sparse union: types: (int64, utf8) type_ids: [0, 4] type buffer: [0, 0, 0, 4, 4, 4] child 0: [1, 2, 3, --, --, --] child 1: [--, --, --, 'foo', 'bar', 'baz'] example dense union: types: (int64, utf8) type_ids: [0, 4] type buffer: [0, 0, 0, 4, 4, 4] offsets buffer: [0, 1, 2, 0, 1, 2]

[jira] [Created] (ARROW-5635) Support "compacting" a table

2019-06-17 Thread Zhuo Peng (JIRA)
Zhuo Peng created ARROW-5635: Summary: Support "compacting" a table Key: ARROW-5635 URL: https://issues.apache.org/jira/browse/ARROW-5635 Project: Apache Arrow Issue Type: Improvement C

[jira] [Created] (ARROW-5636) [C++][Gandiva] Expression cache should not use ToString on data type

2019-06-17 Thread Pindikura Ravindra (JIRA)
Pindikura Ravindra created ARROW-5636: - Summary: [C++][Gandiva] Expression cache should not use ToString on data type Key: ARROW-5636 URL: https://issues.apache.org/jira/browse/ARROW-5636 Project:

[jira] [Created] (ARROW-5637) [Gandiva] [Java]Complete IN Expression

2019-06-17 Thread Praveen Kumar Desabandu (JIRA)
Praveen Kumar Desabandu created ARROW-5637: -- Summary: [Gandiva] [Java]Complete IN Expression Key: ARROW-5637 URL: https://issues.apache.org/jira/browse/ARROW-5637 Project: Apache Arrow