Re: [C++] Read Flight data source into Acero

2022-08-18 Thread Yaron Gvili
I have code in source_node.cc in a local branch adding factories for other sources in SourceNode (e.g., streams of RecordBatch, ExecBatch, or ArrayVector) which I could make a PR for, if there is interest. Yaron. From: David Li Sent: Wednesday, August 17, 2022

Re: [C++] Read Flight data source into Acero

2022-08-18 Thread Rok Mihevc
+1 for adding this either a utility function or cookbook recipe [1]. [1] https://github.com/apache/arrow-cookbook On Thu, Aug 18, 2022 at 2:34 PM Yaron Gvili wrote: > I have code in source_node.cc in a local branch adding factories for other > sources in SourceNode (e.g., streams of RecordBatch

Re: [VOTE][RUST][DataFusion] Release Apache Arrow DataFusion 11.0.0 RC1

2022-08-18 Thread Wang Xudong
+1 (Non-binding) Verified on M1 Mac. -- xudong Martin Grigorov 于2022年8月18日周四 14:45写道： > +1 (Non-binding) > > Veirified on Ubuntu 20.04.4 x86_64 > > On Tue, Aug 16, 2022 at 7:16 PM Andy Grove wrote: > > > Hi, > > > > I would like to propose a release of Apache Arrow DataFusion > > Implementati

[Rust] Proposal to use feature branches for changes that depend on unreleased versions of dependencies

2022-08-18 Thread Andy Grove
With multiple contributors adding new features to sqlparser and arrow-rs (often breaking changes), it is becoming more challenging to have corresponding draft DataFusion PRs that pick up the latest version of the dependency because this pulls in many breaking changes unrelated to the specific PR.

Proposal: A Table Data Structure for Arrow Java

2022-08-18 Thread Larry White
Hi all, I would like to propose a new Table data structure for Arrow Java that is similar to the existing VectorSchemaRoot, but has: - more table functionality (e.g. row-oriented operations) - a simpler and more general mutability API It lacks VectorSchemaRoot's buffer-like qualities, making it

Re: [Rust] Proposal to use feature branches for changes that depend on unreleased versions of dependencies

2022-08-18 Thread Andrew Lamb
I think a feature branch sounds like a good idea to me. In the interim, I will work on making another sqlparser release On Thu, Aug 18, 2022 at 12:47 PM Andy Grove wrote: > With multiple contributors adding new features to sqlparser and arrow-rs > (often breaking changes), it is becoming more c

Re: [C++] Read Flight data source into Acero

2022-08-18 Thread Li Jin
Thanks all. I will try this out. On Thu, Aug 18, 2022 at 9:06 AM Rok Mihevc wrote: > +1 for adding this either a utility function or cookbook recipe [1]. > > [1] https://github.com/apache/arrow-cookbook > > On Thu, Aug 18, 2022 at 2:34 PM Yaron Gvili wrote: > > > I have code in source_node.cc i

Re: [FlightSQL] Structured/Serialized representation of query (like JSON) rather than SQL string possible?

2022-08-18 Thread David Li
I've updated the PR [1] and I believe everything is resolved. (I've fixed ARROW-17254, and changed the Protobuf definition to work around Protobuf's issues.) If there's no further comments, I'll start a vote in the coming days. [1]: https://github.com/apache/arrow/pull/13492 Thanks, David On F

[VOTE][RUST] Release Apache Arrow Rust 21.0.0 RC2

2022-08-18 Thread Andrew Lamb
Hi, I would like to propose a release of Apache Arrow Rust Implementation, version 21.0.0. This release candidate is based on commit: 68934f0fa5da62ae9fcbb753d1dfd8f672a4eb1e [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, ve

cmake FindPackage fails in Windows

2022-08-18 Thread Niranda Perera
Hi all, I have Arrow v8.0.0 installed in my conda environment. Cmake (v3.24.0) is unable to find Arrow in Windows OS. I have no trouble running it in Linux though. We have been previously using arrow v5.0.0 and haven't had any trouble (I have verified it in a new conda env). CMakeLists.txt cmake

Re: cmake FindPackage fails in Windows

2022-08-18 Thread Niranda Perera
This issue is not there in v9.0.0 as well. On Thu, Aug 18, 2022 at 9:34 PM Niranda Perera wrote: > Hi all, > > I have Arrow v8.0.0 installed in my conda environment. Cmake (v3.24.0) is > unable to find Arrow in Windows OS. I have no trouble running it in Linux > though. We have been previously u

Re: [VOTE][RUST] Release Apache Arrow Rust 21.0.0 RC2

2022-08-18 Thread Remzi Yang
+1 (non-binding). Verified on M1 Mac. Thank you, Andrew. On Fri, 19 Aug 2022 at 05:23, Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache Arrow Rust Implementation, > version 21.0.0. > > This release candidate is based on commit: > 68934f0fa5da62ae9fcbb753d1dfd8f672a4eb1e [

Re: [VOTE][RUST] Release Apache Arrow Rust 21.0.0 RC2

2022-08-18 Thread L. C. Hsieh
+1 (non-binding). Verified on Intel Mac. Thanks, Andrew! Just one question. Is it intentional to remove the Cargo.toml at the root directory? In previous releases, it is included but not in this release. Though I still can go to each sub-dir to do build/test. On Thu, Aug 18, 2022 at 2:23 PM An

Re: [VOTE][RUST] Release Apache Arrow Rust 21.0.0 RC2

2022-08-18 Thread L. C. Hsieh
Oh, replied to myself. It is removed in https://github.com/apache/arrow-rs/pull/2339. On Thu, Aug 18, 2022 at 11:21 PM L. C. Hsieh wrote: > > +1 (non-binding). Verified on Intel Mac. > > Thanks, Andrew! > > Just one question. Is it intentional to remove the Cargo.toml at the > root directory? > I

Re: [VOTE][RUST] Release Apache Arrow Rust 21.0.0 RC2

2022-08-18 Thread Wang Xudong
+1 (non-binding). Verified on M1 Mac. Thanks, Andrew! L. C. Hsieh 于2022年8月19日周五 14:23写道： > Oh, replied to myself. It is removed in > https://github.com/apache/arrow-rs/pull/2339. > > On Thu, Aug 18, 2022 at 11:21 PM L. C. Hsieh wrote: > > > > +1 (non-binding). Verified on Intel Mac. > > > > T