Re: [DISCUSS] Proposal about integration test of arrow parquet reader

Currently for parquet reader of rust version only, some static files covering some types would be enough. However, I agree with Wes that we should not rely on static binary files for functional tests because it's hard to maintain with the evolving of arrow. For example, currently parquet reader in

Re: [DISCUSS] Understanding Arrow's CI problems and needs

Do we have ticket to track this? ?? Outlook for Android From: Andy Grove Sent: Saturday, October 12, 2019 11:46:18 PM To: dev Subject: Re: [DISCUSS] Understanding Arrow's CI problems and needs I've started a new section to discuss proposa

[NIGHTLY] Arrow Build Report for Job nightly-2019-10-13-0

Arrow Build Report for Job nightly-2019-10-13-0 All tasks: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-10-13-0 Failed Tasks: - wheel-manylinux1-cp37m: URL: https://github.com/ursa-labs/crossbow/branches/all?query=nightly-2019-10-13-0-travis-wheel-manylinux1-cp37m -

[jira] [Created] (ARROW-6868) [Go] slicing Struct array does not slice child fields

Nick Poorman created ARROW-6868: --- Summary: [Go] slicing Struct array does not slice child fields Key: ARROW-6868 URL: https://issues.apache.org/jira/browse/ARROW-6868 Project: Apache Arrow Issu

Re: [DISCUSS] Dictionary Encoding Clarifications/Future Proofing

I think the only point asked on the PR that I think is worth discussing is assumptions about dictionaries at the beginning of streams. There are two options: 1. Based on the current wording, it does not seem that all dictionaries need to be at the beginning of the stream if they aren't made use o

Re: [C++] The quest for zero-dependency builds

> > > This might be taking the thread on more of a tangent, but maybe we should start collecting requirements for the C++ build system in general and see if there might be better solution that can address some of these concerns? In particular, Bazel at least on the surface seems like it might be a

[Discuss][FlightRPC] Extensions to Flight: "DoBidirectional"

Hi all, We've been using Flight quite successfully so far, but we have identified a new use case on the horizon: being able to both send and retrieve Arrow data within a single RPC call. To that end, I've written up a proposal for a new RPC method: https://docs.google.com/document/d/1Hh-3Z0hK5PxyE

Re: [DISCUSS][Java] Design of the algorithm module

Hi Liya Fan, > I think the algorithms should be better termed "micro-algorithms". They > are termed "micro" in the sense that they do not directly compose a query > engine, because they only provide primitive functionalities (e.g. vector > sort). > Instead, they can be used as building blocks for

[jira] [Created] (ARROW-6869) [C++] Dictionary "delta" building logic in builder_dict.h produces invalid arrays

Wes McKinney created ARROW-6869: --- Summary: [C++] Dictionary "delta" building logic in builder_dict.h produces invalid arrays Key: ARROW-6869 URL: https://issues.apache.org/jira/browse/ARROW-6869 Project

[jira] [Created] (ARROW-6870) Add Support for Dictionary Arrays and Dictionary Encoding

Daniel Parubotchy created ARROW-6870: Summary: Add Support for Dictionary Arrays and Dictionary Encoding Key: ARROW-6870 URL: https://issues.apache.org/jira/browse/ARROW-6870 Project: Apache Arrow

[jira] [Created] (ARROW-6871) [Java] Enhance TransferPair related parameters check and tests

Ji Liu created ARROW-6871: - Summary: [Java] Enhance TransferPair related parameters check and tests Key: ARROW-6871 URL: https://issues.apache.org/jira/browse/ARROW-6871 Project: Apache Arrow Issue