output_schema for ExecNode

2021-11-14 Thread Yue Ni
Hi there, I am evaluating Apache Arrow C++ compute engine for my project, and wonder what the schema assumption is for execution operators in the compute engine. In my use case, multiple record batches for computation may have different schemas. I read the Apache Arrow Query Engine for C++ design

Re: [VOTE] Release Apache Arrow 6.0.1 - RC1

2021-11-14 Thread Sutou Kouhei
Hi, Unfortunately, it's too late for 6.0.1 RC1. If it's not a critical bug in 6.0.0, I think that it's not a blocker of 6.0.1 RC1. There are people who wait for fixes in 6.0.1 RC1. If it's needed, we can release 6.0.2 instead of preparing 6.0.1 RC2 for it. Thanks, -- kou In "Re: [VOTE] Rele

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0

2021-11-14 Thread Andy Grove
+1 (binding) I ran the release verification script on Ubuntu 20.04 and also ran the Ballista integration tests. Thanks, Andy. On Sun, Nov 14, 2021 at 10:10 AM Andrew Lamb wrote: > +1 (binding) > > I reviewed the CHANGELOG and ran the release verification script on MacOS > Big Sur (11.6) > >

Re: [DISCUSS] Community maintained extension repos for Datafusion

2021-11-14 Thread QP Hou
Thanks Jiayu, Benson, Micah and Andrew for your input on this. I have created an unofficial Github org [1] as a quick and dirty experiment for something like spark-packages.org. We should make it clear that code developed in this org will still need to go through the donation process in order to ge

Re: Independent JS patch releases

2021-11-14 Thread Wes McKinney
I think the idea would be to make a source tarball out of the JS directory — we had a script for this a few years ago from the last time we made independent JS releases — if you want to resurrect this and modify it for the current state of the project, this seems fine. It would also be helpful to h

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0

2021-11-14 Thread Andrew Lamb
+1 (binding) I reviewed the CHANGELOG and ran the release verification script on MacOS Big Sur (11.6) Thank you QP for doing the work to create the release -- this one is pretty awesome Andrew

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0

2021-11-14 Thread Benson Muite
+1 (non-binding) Tested on Rocky Linux 8 using the verification script On 11/14/21 2:43 PM, Wang Xudong wrote: +1 (non-binding) I checked on macOS Monterey. Thanks, — xudong963 QP Hou 于2021年11月14日周日 下午5:03写道: Hi, I would like to propose a release of Apache Arrow Datafusion Implementation

Re: [VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0

2021-11-14 Thread Wang Xudong
+1 (non-binding) I checked on macOS Monterey. Thanks, — xudong963 QP Hou 于2021年11月14日周日 下午5:03写道: > Hi, > > I would like to propose a release of Apache Arrow Datafusion > Implementation, > version 6.0.0. > > This release candidate is based on commit: > 7824a8d74093374da8a4f040d23a81b8436b7380

[VOTE][RUST][Datafusion] Release Apache Arrow Datafusion 6.0.0 RC0

2021-11-14 Thread QP Hou
Hi, I would like to propose a release of Apache Arrow Datafusion Implementation, version 6.0.0. This release candidate is based on commit: 7824a8d74093374da8a4f040d23a81b8436b7380 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download,