Re: [VOTE] Release Apache Arrow 0.16.0 - RC1

2020-01-29 Thread Krisztián Szűcs
Let's try to fix it, then we can cut RC2 afterwards Thanks for your help! On Wed, Jan 29, 2020 at 10:46 PM Wes McKinney wrote: > > I just commented on the issue. Seems likely to be fallout from > ARROW-3789 and so I think we should fix it > > On Wed, Jan 29, 2020 at 3:19 PM Bryan Cutler wrote:

[jira] [Created] (ARROW-7724) [Release][Yum] Ignore some arm64 verifications

2020-01-29 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7724: --- Summary: [Release][Yum] Ignore some arm64 verifications Key: ARROW-7724 URL: https://issues.apache.org/jira/browse/ARROW-7724 Project: Apache Arrow Issue Type:

Re: [VOTE] Release Apache Arrow 0.16.0 - RC1

2020-01-29 Thread Wes McKinney
I just commented on the issue. Seems likely to be fallout from ARROW-3789 and so I think we should fix it On Wed, Jan 29, 2020 at 3:19 PM Bryan Cutler wrote: > > An update on Spark integration tests: the new error looks to be a > regression so I made https://issues.apache.org/jira/browse/ARROW-77

Re: [VOTE] Release Apache Arrow 0.16.0 - RC1

2020-01-29 Thread Bryan Cutler
An update on Spark integration tests: the new error looks to be a regression so I made https://issues.apache.org/jira/browse/ARROW-7723 and marked as a blocker. It's possible to work around this bug, so I wouldn't call it a hard blocker if we need to proceed with the release. On Wed, Jan 29, 2020

[jira] [Created] (ARROW-7723) [Python] StructArray timestamp type with timezone to_pandas convert error

2020-01-29 Thread Bryan Cutler (Jira)
Bryan Cutler created ARROW-7723: --- Summary: [Python] StructArray timestamp type with timezone to_pandas convert error Key: ARROW-7723 URL: https://issues.apache.org/jira/browse/ARROW-7723 Project: Apach

Re: JDBC / Flight questions

2020-01-29 Thread Andy Grove
Thanks for all the information. This is very helpful. Andy. On Wed, Jan 29, 2020 at 9:24 AM Jacques Nadeau wrote: > At Dremio we have two things at the moment: > > A JDBC driver that is built on Arrow and served as the inspiration for some > of the design choices in flight [1] > A preview fligh

Re: JDBC / Flight questions

2020-01-29 Thread Jacques Nadeau
At Dremio we have two things at the moment: A JDBC driver that is built on Arrow and served as the inspiration for some of the design choices in flight [1] A preview flight connector that doesn't yet expose JDBC [2] These the former is built on Avatica (part of the Apache Calcite project) so the

Re: JDBC / Flight questions

2020-01-29 Thread Micah Kornfield
Sorry as a follow-up Uwe wrote a blog post [1] about using the JDBC to Arrow code via python. Other than that I'm not aware of anything. Thanks, Micah [1] https://uwekorn.com/2019/11/17/fast-jdbc-access-in-python-using-pyarrow-jvm.html On Wed, Jan 29, 2020 at 8:07 AM Micah Kornfield wrote: >

Re: JDBC / Flight questions

2020-01-29 Thread Micah Kornfield
Hi Andy, As far as I know there is no jdbc driver. What exists today is a wrapper to convert jdbc resultset to arrow. I believe dremio might have open sourced some code in their repo which wraps arrow inside of a jdbc driver. not sure if it uses flight or another protocol for actual transport I

Re: [VOTE] Release Apache Arrow 0.16.0 - RC1

2020-01-29 Thread Neal Richardson
The place where the segfault is triggered in the R nightlies is a couple of tests after the one I added in that patch. If that patch is causing the segfaults, we can skip the new test ( https://github.com/apache/arrow/blob/master/r/tests/testthat/test-parquet.R#L125) and investigate later. The patc

JDBC / Flight questions

2020-01-29 Thread Andy Grove
We're pretty close to having a Flight server implemented in Rust, executing SQL queries with DataFusion and I'm testing with a Java Flight client. Once this is working, I want to build a Flight JDBC driver. I see that we already have a JDBC driver in the project but I'm struggling to find document

Re: [VOTE] Release Apache Arrow 0.16.0 - RC1

2020-01-29 Thread David Li
The Flight leak should be unrelated to that commit, the failing test already existed before - it's a flaky test https://issues.apache.org/jira/browse/ARROW-7721. I'm hoping to look at the issue this week but we might just want to disable the test for now. David On 1/29/20, Krisztián Szűcs wrote

Re: [VOTE] Release Apache Arrow 0.16.0 - RC1

2020-01-29 Thread Krisztián Szűcs
Hi, - The fuzzit builds has been disabled by Neal on the current master. - Created a PR to resolve occasionally failing python dataset tests [1] - Merged the fix for C# timezone error [2] - Merged various fixes for the release scripts. - The nightly Gandiva OS X build is still failing, but because

[NIGHTLY] Arrow Build Report for Job nightly-2020-01-29-0

2020-01-29 Thread Crossbow
Arrow Build Report for Job nightly-2020-01-29-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-01-29-0 Failed Tasks: - gandiva-jar-osx: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-01-29-0-travis-gandiva-jar-osx - test-conda-py

[jira] [Created] (ARROW-7722) [Java][Flight] Memory leak

2020-01-29 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7722: -- Summary: [Java][Flight] Memory leak Key: ARROW-7722 URL: https://issues.apache.org/jira/browse/ARROW-7722 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-7721) [FlightRPC][Java] Flaky Flight auth test

2020-01-29 Thread David Li (Jira)
David Li created ARROW-7721: --- Summary: [FlightRPC][Java] Flaky Flight auth test Key: ARROW-7721 URL: https://issues.apache.org/jira/browse/ARROW-7721 Project: Apache Arrow Issue Type: Bug

[jira] [Created] (ARROW-7720) [C++][Python] Add check_metadata argument to Table.equals

2020-01-29 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7720: -- Summary: [C++][Python] Add check_metadata argument to Table.equals Key: ARROW-7720 URL: https://issues.apache.org/jira/browse/ARROW-7720 Project: Apache Arrow

Re: [NIGHTLY] Arrow Build Report for Job nightly-2020-01-28-0

2020-01-29 Thread Krisztián Szűcs
On Tue, Jan 28, 2020 at 2:32 PM Crossbow wrote: > > > Arrow Build Report for Job nightly-2020-01-28-0 > > All tasks: > https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2020-01-28-0 > > Failed Tasks: > - gandiva-jar-osx: > URL: > https://github.com/ursa-labs/crossbow/branches/al

[jira] [Created] (ARROW-7719) [Python][Dataset] Table equality check occasionally fails

2020-01-29 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7719: -- Summary: [Python][Dataset] Table equality check occasionally fails Key: ARROW-7719 URL: https://issues.apache.org/jira/browse/ARROW-7719 Project: Apache Arrow

[jira] [Created] (ARROW-7718) [Release] Fix auto-retry in the binary release script

2020-01-29 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7718: -- Summary: [Release] Fix auto-retry in the binary release script Key: ARROW-7718 URL: https://issues.apache.org/jira/browse/ARROW-7718 Project: Apache Arrow

[jira] [Created] (ARROW-7717) [CI] Have nightly integration test for Spark's latest release

2020-01-29 Thread Krisztian Szucs (Jira)
Krisztian Szucs created ARROW-7717: -- Summary: [CI] Have nightly integration test for Spark's latest release Key: ARROW-7717 URL: https://issues.apache.org/jira/browse/ARROW-7717 Project: Apache Arrow

[jira] [Created] (ARROW-7716) [Packaging][APT] Use the "main" component for Ubuntu 19.10

2020-01-29 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7716: --- Summary: [Packaging][APT] Use the "main" component for Ubuntu 19.10 Key: ARROW-7716 URL: https://issues.apache.org/jira/browse/ARROW-7716 Project: Apache Arrow

[jira] [Created] (ARROW-7715) [Release][APT] Ignore some arm64 verifications

2020-01-29 Thread Kouhei Sutou (Jira)
Kouhei Sutou created ARROW-7715: --- Summary: [Release][APT] Ignore some arm64 verifications Key: ARROW-7715 URL: https://issues.apache.org/jira/browse/ARROW-7715 Project: Apache Arrow Issue Type:

Re: [VOTE] Release Apache Arrow 0.16.0 - RC1

2020-01-29 Thread Sutou Kouhei
Hi, > Thank you. After the C# download fix, I have the following C# test failure: > https://gist.github.com/pitrou/d82ed1ff80db43b63f0c3d5e5f2474a4 https://github.com/apache/arrow/pull/6309 will fix it. I think that this is a test problem, not an implementation problem. Workaround: TZ=UTC

Re: [VOTE] Release Apache Arrow 0.16.0 - RC1

2020-01-29 Thread Antoine Pitrou
Thank you. After the C# download fix, I have the following C# test failure: https://gist.github.com/pitrou/d82ed1ff80db43b63f0c3d5e5f2474a4 Regards Antoine. Le 29/01/2020 à 00:42, Sutou Kouhei a écrit : > Hi, > >> Source verification succeeded on Java and C++ and then failed >> downloading