[VOTE] Release Apache DataFusion 38.0.0 RC1

2024-05-07 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion version 38.0.0. This release candidate is based on commit: cafbc9ddceb5af8c6408d0c8bbfed7568f655ddb [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums an

Re: [VOTE] Release Apache DataFusion 38.0.0 RC1

2024-05-07 Thread Andy Grove
restart them. > gpg: key F105883A1735623D: "William Wesley McKinney (CODE SIGNING KEY) < > w...@apache.org>" not changed > gpg: key 45127976E1E825D4: "Andrew A Lamb (https://github.com/alamb) < > and...@nerdnetworks.org>" not changed > gpg: key CA1AB41406

[Comet] Enable GitHub Discussions for datafusion-comet repo?

2024-05-09 Thread Andy Grove
There is a proposal [1] to enable the GitHub discussion feature for the datafusion-comet repo. We need to provide ASF INFRA with a link to a discussion showing that there is consensus for enabling this, so I would like to start an informal vote with this email to see if the majority of communit

[VOTE] Release DataFusion Python Bindings 37.1.0 RC1

2024-05-09 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 37.1.0. Many thanks to Michael Ward for actually preparing this release. This release candidate is based on commit: 7f276516a644cde908cf74795251746d482d1829 [1] The proposed release tarball and signatures a

Re: [VOTE] Release Apache DataFusion 38.0.0 RC1

2024-05-10 Thread Andy Grove
We need one more binding +1 vote for this release vote to pass. Thanks, Andy. > On May 7, 2024, at 6:47 PM, Phillip LeBlanc wrote: > > +1 (non-binding) > > I verified RC1 on my M1 Mac. Thanks! > > Phillip > > From: Andy Grove > Date: Wednesday, Ma

Re: [VOTE] Release Apache DataFusion 38.0.0 RC1

2024-05-10 Thread Andy Grove
t; On May 10, 2024, at 9:19 AM, L. C. Hsieh wrote: > > +1 (binding) > > Verified on M3 Mac. > > Thanks Andy. > > On 2024/05/10 13:55:57 Andy Grove wrote: >> We need one more binding +1 vote for this release vote to pass. >> >> Thanks, >> >

Re: [VOTE] Release DataFusion Python Bindings 37.1.0 RC1

2024-05-10 Thread Andy Grove
ailed to verify release candidate. See >> /var/folders/1l/tg68jc6550gg8xqf1hr4mlwrgn/T/arrow-37.1.0.X.59DJRHMkWV >> for details.' >> Failed to verify release candidate. See >> /var/folders/1l/tg68jc6550gg8xqf1hr4mlwrgn/T/arrow-37.1.0.X.59DJRHMkWV >> for details.

Re: [VOTE] Release DataFusion Python Bindings 37.1.0 RC1

2024-05-13 Thread Andy Grove
ification script from the repo now. It works. > > +1 (binding) > > Verified on M3 Mac. > > Thanks Andy. > > > On Fri, May 10, 2024 at 10:52 AM Andy Grove > wrote: >> >> Yes, the updated release verification script was merged into the repo after >>

Re: Proposal for new datafusion-benchmarks repository

2024-05-14 Thread Andy Grove
Benchmarks github.com Thanks, Andy. > On May 12, 2024, at 8:54 AM, Andy Grove wrote: > > Hello, > > I would like to propose creating a new datafusion-benchmarks repository for > shared documentation and scripts that can help with benchmarking efforts > acro

Recording of Comet community call today

2024-05-15 Thread Andy Grove
Here is the recording from today's Comet community call, which includes a code walkthrough for adding support for new Spark expressions. https://drive.google.com/file/d/1POU4lFAZfYwZR8zV1X2eoLiAmc1GDtSP/view?usp=sharing

[VOTE] Release DataFusion Python Bindings 38.0.0 RC1

2024-05-17 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 38.0.0. This release candidate is based on commit: f12a487d2e18be1d93e7494299b8a9eb6618b5e8 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The Python wheel

Re: [VOTE] Release DataFusion Python Bindings 38.0.0 RC1

2024-05-21 Thread Andy Grove
> > Also verified on M3 Mac. > > Thanks! > > Andrew > > On Fri, May 17, 2024 at 1:23 PM L. C. Hsieh wrote: > >> +1 (binding) >> >> Verified on M3 Mac. >> >> Thanks Andy. >> >> On Fri, May 17, 2024 at 10:11 AM Andy Grove &g

Re: [VOTE] Release DataFusion Python Bindings 38.0.0 RC1

2024-05-22 Thread Andy Grove
gt; Tim > > On Tue, May 21, 2024 at 10:49 AM Andy Grove > wrote: > >> There is apparently a regression in 38.0.0 [1] so we may want to resolve >> this and start a new RC2 vote. Please let me know if you have opinions on >> this. >> >> [1] https://github.com/

[VOTE] Release DataFusion Python Bindings 38.0.1 RC1

2024-05-25 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 38.0.1. This release candidate is based on commit: ea4a4dc7990c72cb65b999137da369a4e814cdbb [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The Python wheel

Re: [VOTE] Release DataFusion Python Bindings 38.0.1 RC1

2024-05-30 Thread Andy Grove
mb wrote: > > +1 (binding) > > Thanks Andy > > On Sat, May 25, 2024 at 11:13 AM Andy Grove > wrote: > >> Hi, >> >> I would like to propose a release of the Apache DataFusion Python Bindings, >> version 38.0.1. >> >> This release candida

Recording of DataFusion Comet community call May 29 2024

2024-05-30 Thread Andy Grove
Here is the recording of the DataFusion Comet community call on May 29, 2024. It includes a demo of using fuzz testing to find correctness issues. https://drive.google.com/file/d/1EgaPMKXB8ujk9QyRllkqU_w2BI7bVbO0/view

[VOTE] Release Apache DataFusion 39.0.0 RC1

2024-06-07 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion version 39.0.0. This release candidate is based on commit: 6a4a280e3cf70fe5f1a1cfe7c2de13e4c39f89bb [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums an

Re: [VOTE] Release Apache DataFusion 39.0.0 RC1

2024-06-10 Thread Andy Grove
Hsieh wrote: > >> +1 (binding) >> >> Verified on M3 Mac. >> I also tried to use the 39.0.0-rc1 tag on Comet and all tests were passed. >> >> Thanks Andy. >> >> >> >> On Fri, Jun 7, 2024 at 7:52 AM Andy Grove >> wrote: &g

[VOTE] Release DataFusion Python Bindings 39.0.0 RC1

2024-06-26 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 39.0.0. This release candidate is based on commit: a2468fb1c7619360838c984add69ded41dcaea5b [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The Python whee

Re: [VOTE] Release DataFusion Python Bindings 39.0.0 RC1

2024-07-02 Thread Andy Grove
The vote passes with four binding +1 votes. I have now released this version. Thanks, Andy. > On Jun 26, 2024, at 8:08 PM, vin jake wrote: > > +1 (binding) > > Thanks Andy > > On Wed, Jun 26, 2024 at 11:16 PM Andy Grove > wrote: > >> Hi, >> >

[RESULT][VOTE] Release DataFusion Python Bindings 39.0.0 RC1

2024-07-02 Thread Andy Grove
> On Jul 2, 2024, at 4:39 PM, Andy Grove wrote: > > The vote passes with four binding +1 votes. > > I have now released this version. > > Thanks, > > Andy. > >> On Jun 26, 2024, at 8:08 PM, vin jake wrote: >> >> +1 (binding

[VOTE] Accept donation of sqlparser-rs project

2024-07-08 Thread Andy Grove
Hi, We have been discussing moving the sqlparser-rs project [1] under ASF governance for some time now. The conversation started within the Apache Arrow project before DataFusion became a top-level project [2]. There is also a discussion within the sqlparser-rs community [3]. Feedback so far

[VOTE] Release Apache DataFusion 40.0.0 RC1

2024-07-09 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion version 40.0.0. This release candidate is based on commit: 4cae81363e29f011c6602a7a7a54e1aaee841046 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums an

Re: [VOTE] Release Apache DataFusion 40.0.0 RC1

2024-07-12 Thread Andy Grove
The vote passes with five +1 votes (4 binding). Thanks to everyone who helped verify the release. I have published the source release and crates. Thanks, Andy. > On Jul 9, 2024, at 5:52 AM, Andy Grove wrote: > > Hi, > > I would like to propose a release of Apache DataFusion

[RESULT][VOTE] Release Apache DataFusion 40.0.0 RC1

2024-07-12 Thread Andy Grove
> On Jul 12, 2024, at 7:09 AM, Andy Grove wrote: > > The vote passes with five +1 votes (4 binding). Thanks to everyone who helped > verify the release. > > I have published the source release and crates. > > Thanks, > > Andy. > >> On Jul 9, 2024, a

Re: [VOTE] Accept donation of sqlparser-rs project

2024-07-16 Thread Andy Grove
L using `unparser(expr).to_string()` and I realized that >>>> `ast::Statement` lives in sql-parser. I think keeping the SQL parsing >> code >>>> under the Datafusion umbrella could help development of features that >> are >>>> accessed via DataFus

[RESULT][VOTE] Accept donation of sqlparser-rs project

2024-07-16 Thread Andy Grove
> On Jul 16, 2024, at 1:15 PM, Andy Grove wrote: > > The vote has now been open for more than seven days and we have seven +1 > votes (three binding) so the vote passes. > > Thank you all. > > The next step will be to start the IP clearance process. > >

[VOTE] Release Apache DataFusion Comet 0.1.0 RC2

2024-07-20 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion Comet version 0.1.0. This release candidate is based on commit: df980bf67e59f439521b90dd2139c6a8d706c0bc [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksu

Re: [VOTE] Release Apache DataFusion Comet 0.1.0 RC2

2024-07-22 Thread Andy Grove
ied on M2 Mac. > >> > >> Ed > >> > >> Il giorno sab 20 lug 2024 alle ore 18:22 huaxin gao < > >> huaxin.ga...@gmail.com> > >> ha scritto: > >> > >>> +1 (non-binding) > >>> > >>> Verified on M2 Mac

Re: [VOTE] Release Apache DataFusion Comet 0.1.0 RC2

2024-07-22 Thread Andy Grove
this first release, so I propose that we continue with the vote and fix this for the next release. On Mon, Jul 22, 2024 at 9:00 AM Andy Grove wrote: > Thanks for the feedback so far on the release process. I have a PR open to > fix the issues reported so far. > > https://github.com/a

Re: [VOTE] Release Apache DataFusion Comet 0.1.0 RC2

2024-07-22 Thread Andy Grove
it-infos) on project comet-common-spark3.4_2.12: .git directory > is not found! Please specify a valid [dotGitDirectory] in your pom.xml -> > [Help 1] > > > On Sat, Jul 20, 2024 at 1:56 PM Andy Grove > wrote: > > > Hi, > > > > I would like to propose a relea

[RESULT] [VOTE] Release Apache DataFusion Comet 0.1.0 RC2

2024-07-23 Thread Andy Grove
> On Jul 23, 2024, at 3:01 PM, Andy Grove wrote: > > The vote passes with eight +1 votes (three binding). Thanks, everyone. > > The release is available at: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-comet-0.1.0/ > > Andy. > >>

Re: [VOTE] Release Apache DataFusion Comet 0.1.0 RC2

2024-07-23 Thread Andy Grove
m2 macbook pro. > > On Sat, Jul 20, 2024 at 4:57 PM Andy Grove > wrote: > >> Hi, >> >> I would like to propose a release of Apache DataFusion Comet version 0.1.0. >> >> This release candidate is based on commit: >> df980bf67e59f439521b90dd2139c6a8

IP clearance for sqlparser-rs donation

2024-07-27 Thread Andy Grove
I have started a Google document where we can collaborate on the IP clearance form for accepting the donation of the sqlparser-rs project. https://docs.google.com/document/d/1XPp1zG8yfkCfjusQH7_qr8FMBDDEQ5psR7HhZ1LuVC8/edit?usp=sharing Any help with filling this out would be greatly appreciated.

DataFusion 41.0.0 release planning

2024-08-07 Thread Andy Grove
I plan on starting the release process for DataFusion 41.0.0 in the next few days. The tracking issue is https://github.com/apache/datafusion/issues/11476 and this is a good place to discuss any issues/PRs that you would like to see make it into the release. Thanks, Andy. -

[VOTE] Release Apache DataFusion 41.0.0 RC1

2024-08-08 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion version 41.0.0. This release candidate is based on commit: b10b820acb6ad92b5d69810e3d4de0ef6f2d6a87 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums an

[VOTE] Release DataFusion Python Bindings 40.0.0 RC1

2024-08-09 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 40.0.0. This release candidate is based on commit: b5d7c92c870a28a30a5b393a88cc86352ab16ac4 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The Python wheel

Re: [VOTE] Release Apache DataFusion 41.0.0 RC1

2024-08-11 Thread Andy Grove
; >>> Thanks Andy >>> (do we hear an echo ? :) ) >>> >>> >>> >>> On Thu, Aug 8, 2024 at 2:56 PM L. C. Hsieh wrote: >>> >>>> +1 (binding) >>>> >>>> Verified on M3 Mac. >>>> >>&

Re: [VOTE] Release DataFusion Python Bindings 40.0.0 RC1

2024-08-12 Thread Andy Grove
t; On Sat, Aug 10, 2024 at 6:19 AM Andrew Lamb >> wrote: >> >>> +1 (binding) >>> >>> Verified on an M3 mac >>> >>> Thank you for keeping the releases flowing Andy >>> >>> Andrew >>> >>> On Sat, Aug 1

[VOTE] Release DataFusion Python Bindings 40.1.0 RC2

2024-08-16 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 40.1.0. This release candidate is based on commit: 81d8d57cce881ebfd1cfe3c3a755b77b772285cf [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The Python wheel

[VOTE] Release Apache DataFusion Comet 0.2.0 RC1

2024-08-25 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion Comet version 0.2.0. This release candidate is based on commit: 96252fee3773be029f7ab93fdc50d684bc71d59d [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Docker images are available at [

Draft blog post for DataFusion Comet 0.2.0 release

2024-08-27 Thread Andy Grove
Here is a draft blog post for the DataFusion Comet 0.2.0 release announcement. Feedback + contributions are welcome. https://docs.google.com/document/d/1A2dq_Z570TU-ba_jwC5LbiNnIdoDt6gGdBTAYy4MJ6s/edit?usp=sharing Thanks, Andy.

Re: [VOTE] Release Apache DataFusion Comet 0.2.0 RC1

2024-08-28 Thread Andy Grove
3 Mac and took a look at some of the linked PRs in the >> release notes. >> Looks like an exciting release! >> Andrew >> On Sun, Aug 25, 2024 at 5:19 PM L. C. Hsieh wrote: >>> +1 (binding) >>> >>> Verified on M3 Mac. >>> >>> Thanks

[RESULT][VOTE] Release Apache DataFusion Comet 0.2.0 RC1

2024-08-28 Thread Andy Grove
> On Aug 28, 2024, at 1:25 PM, Andy Grove wrote: > > The vote passes with four +1 votes (three binding). Thank you. > > >> On Aug 27, 2024, at 1:06 AM, Emil Ejbyfeldt >> wrote: >> >> +1 (non-binding) >> >> Verified on Linux x86-64 &g

[VOTE] Release DataFusion Python Bindings 41.0.0 RC1

2024-09-09 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 41.0.0. This release candidate is based on commit: 89b77abf14e8e2e7ee2a83ab23717cb7c1491a02 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The Python wheel

Setting up Nexus access for publishing DataFusion Maven artifacts

2024-09-11 Thread Andy Grove
The DataFusion Comet subproject plans on publishing JAR files to Maven, so I have filed a JIRA [1] requesting that Nexus access [2] be setup. Although this is being set up for the Comet subproject, it will allow other DataFusion subprojects to publish to Maven in the future, if needed. An exampl

[VOTE] Release Apache DataFusion 42.0.0 RC1

2024-09-14 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion version 42.0.0. This release candidate is based on commit: 8e8bb89a285c6fe6e8186378b7798d3d213f08f7 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums an

Proposal to bring Ray SQL code into DataFusion Python project

2024-09-15 Thread Andy Grove
There is a proposal [1] to bring the Ray SQL project [2] into the DataFusion Python project. This would mean that DataFusion Python can be run both in-process and also scale out on Ray clusters. Please feel free to comment on the proposal if you have any feedback. Thanks, Andy. [1] https://git

Re: [VOTE] Release DataFusion Python Bindings 41.0.0 RC1

2024-09-16 Thread Andy Grove
ramework 6.10.6 #1-NixOS SMP PREEMPT_DYNAMIC Mon Aug 19 > 04:05:40 UTC 2024 x86_64 GNU/Linux > > > > On Tue, Sep 10, 2024 at 5:55 AM Tim Saucer wrote: > >> +1 (non-binding) >> >> Verified on a m2 mac >> >> On Mon, Sep 9, 2024 at 7:49 PM Andy Gr

[RESULT][VOTE] Release DataFusion Python Bindings 41.0.0 RC1

2024-09-16 Thread Andy Grove
> On Sep 16, 2024, at 7:21 AM, Andy Grove wrote: > > The vote passes with five +1 votes (three binding). Thanks, everyone. I have > published the source release and also uploaded binaries to pypi. > > Andy. > >> On Sep 10, 2024, at 7:08 AM, Michael Ward wr

Proposal to trim down Ballista to a small library

2024-10-09 Thread Andy Grove
There is an epic PR/proposal [1] that I would like everyone to be aware of. The PR has a lot of detail to explain the motivation, but the TL;DR is that this PR trims Ballista down to be a library that people can extend rather than an out-of-the-box application. Copied from the PR description: Thi

Re: [VOTE] Release DataFusion Python Bindings 42.0.0 RC1

2024-10-11 Thread Andy Grove
inding >>> >>> Verified on m2 mac in python 3.10 and 3.12. >>> >>> Note: We need to add one line in the updated verification instructions to >>> do a submodule init and update. >>> >>> >>> On Tue, Oct 8, 2024 at 1:03 AM

[RESULT][VOTE] Release DataFusion Python Bindings 42.0.0 RC1

2024-10-11 Thread Andy Grove
> On Oct 11, 2024, at 7:38 AM, Andy Grove wrote: > > The vote passes with five +1 votes (three binding). > > Thanks, everyone. > > I have published source release and published binaries to PyPi. > >> On Oct 8, 2024, at 1:18 PM, Michael Ward wrote: >>

[VOTE] Release DataFusion Python Bindings 42.0.0 RC1

2024-10-07 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 42.0.0. This release candidate is based on commit: af2d66581817c21048ad77729069b7af40b4ba98 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The Python wheel

Major and minor release process

2024-10-16 Thread Andy Grove
There was a discussion in the weekly DataFusion community meeting [1] this morning about the release process for major and minor releases. We currently release major releases approximately once per month, and we release from release branches. We do have the ability to cherry pick PRs into the rel

[VOTE] Release Apache DataFusion 43.0.0 RC1

2024-11-05 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion version 43.0.0. This release candidate is based on commit: 88f58bf929167c5c5e2250ad87caa88d4dff11e5 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums an

Re: Recommendation to close 14 issues

2024-11-03 Thread Andy Grove
Thanks for triaging those, David. I went ahead and closed them. If anybody disagrees with closing any of these issues, please reopen them with a comment explaining why they are still relevant. Andy. On Sun, Nov 3, 2024 at 9:10 AM David Rauschenbach wrote: > Working through 3 pages of the oldes

Re: [VOTE] Release Apache DataFusion 42.2.0 RC1

2024-10-31 Thread Andy Grove
+1 (binding). Verified on M3 Mac. Thanks, Andrew. On Thu, Oct 31, 2024 at 7:01 AM Tim Saucer wrote: > +1 (non-binding) > > Verified on m2 mac > > On Thu, Oct 31, 2024 at 8:41 AM Andrew Lamb > wrote: > > > Hi, > > > > I would like to propose a release of Apache DataFusion version 42.2.0. > > > >

[RESULT][VOTE] Release Apache DataFusion 43.0.0 RC1

2024-11-08 Thread Andy Grove
> On Nov 8, 2024, at 1:34 PM, Andy Grove wrote: > > The vote passes with six +1 votes (four binding). Thanks, everyone. I have > released the source tarball and also published to crates.io > <http://crates.io/> > > Andy. > >> On Nov 6, 2024, at 2:05 AM,

Re: [VOTE] Release Apache DataFusion 43.0.0 RC1

2024-11-08 Thread Andy Grove
> > On Wed, Nov 6, 2024 at 3:08 AM Tim Saucer wrote: > >> +1 (non-binding) >> >> verified on a m2 mac >> >> On Tue, Nov 5, 2024 at 11:15 AM Andy Grove >> wrote: >> >>> Hi, >>> >>> I wo

Re: IP clearance for sqlparser-rs donation

2024-09-17 Thread Andy Grove
would be much appreciated. I am happy to complete the XML form and submit to svn. Thanks, Andy. On Sat, Jul 27, 2024 at 9:05 AM Andy Grove wrote: > I have started a Google document where we can collaborate on the IP > clearance form for accepting the donation of the sqlparser-rs p

Re: IP clearance for sqlparser-rs donation

2024-09-17 Thread Andy Grove
I will be happy to create the initial commit / donation PR and file follow > on tickets (for things like release process, move existing tickets , update > docs, etc) > > THANK YOU -- this is awesome that it will finally happen > > Andrew > > On Tue, Sep 17, 2024 at 11:41 AM

Re: [VOTE] Release Apache DataFusion 42.0.0 RC1

2024-09-17 Thread Andy Grove
gt; > +1 (binding) > > > > Verified on M3 Mac. > > > > Thanks Andy. > > > > On Sat, Sep 14, 2024 at 10:13 AM Andy Grove > > wrote: > > > > > > Hi, > > > > > > I would like to propose a release of Apache DataFusion version 42.

[RESULT][VOTE] Release Apache DataFusion 42.0.0 RC1

2024-09-17 Thread Andy Grove
On Tue, Sep 17, 2024 at 11:42 AM Andy Grove wrote: > The vote passes with four +1 votes (three binding). Thanks, everyone. > > I have published the source release and also published to crates io. > > I will create a PR to update the new download page later today. > > Thanks,

Re: IP clearance for sqlparser-rs donation

2024-09-23 Thread Andy Grove
e#licensing > [2]: https://github.com/sqlparser-rs/sqlparser-rs/pull/570/files > [3]: > > https://github.com/sqlparser-rs/sqlparser-rs/issues?q=is%3Aissue+license+is%3Aopen > > On Sat, Sep 21, 2024 at 3:02 PM Andy Grove wrote: > > > Thanks. I have updated the

Re: IP clearance for sqlparser-rs donation

2024-09-21 Thread Andy Grove
: > The ASF header has been added to all files: > https://github.com/sqlparser-rs/sqlparser-rs/pull/1437 > > Perhaps we can use commit > > https://github.com/sqlparser-rs/sqlparser-rs/commit/9934f3d93100720a2b15290be6f767fb675bec11 > > > On Thu, Sep 19, 2024 at 11:31 AM A

[DISCUSS] Enable GitHub Discussions for DataFusion Comet

2024-09-23 Thread Andy Grove
I only noticed a question about Comet by chance yesterday because it was posted as a discussion in the core DataFusion repository. Perhaps we should enable discussions in the Comet repository as well. Please let me know your thoughts. Thanks, Andy.

Re: [DISCUSS] Enable GitHub Discussions for DataFusion Comet

2024-09-23 Thread Andy Grove
> +1 > > > > On Mon, Sep 23, 2024 at 7:16 AM Andrew Lamb > > wrote: > > > > > > +1 in my opinion > > > > > > On Mon, Sep 23, 2024 at 9:50 AM Andy Grove > > wrote: > > > > > > > I only noticed a question about Comet

Re: [DISCUSS] Enable GitHub Discussions for DataFusion Comet

2024-09-23 Thread Andy Grove
Actually, no formal vote is needed, just proof of a mailing list discussion with consensus, so I will go ahead and request this. On Mon, Sep 23, 2024 at 7:25 PM Andy Grove wrote: > Thanks for the feedback so far. I will start a VOTE thread for this. I'll > need to be able to link

Re: [DISCUSS] Enable GitHub Discussions for DataFusion Comet

2024-09-23 Thread Andy Grove
INFRA issue: https://issues.apache.org/jira/browse/INFRA-26151 On Mon, Sep 23, 2024 at 7:29 PM Andy Grove wrote: > Actually, no formal vote is needed, just proof of a mailing list > discussion with consensus, so I will go ahead and request this. > > On Mon, Sep 23, 2024 at 7:25 P

Re: [DISCUSS] Enable GitHub Discussions for DataFusion Comet

2024-09-25 Thread Andy Grove
eeping in mind the following adage, I would also suggest that *decisions* > should be reposted on the mailing list - > " If it didn’t happen on a mailing list, it didn’t happen." [1] > > [1] https://incubator.apache.org/guides/committer.html#mailing_lists > > > On Mon, S

Re: DataFusion Logical Types and Typed expressions

2024-09-24 Thread Andy Grove
Technically, all GiotHub issue/PR discussions are on the mailing list because they get replicated to the git...@datafusion.apache.org mailing list, but it is definitely good to send emails to dev@ as well for issues like this that could affect downstream us

Re: [VOTE] Release Apache DataFusion Comet 0.3.0 RC1

2024-09-24 Thread Andy Grove
> >> [2]: >> https://dist.apache.org/repos/dist/dev/datafusion/apache-datafusion-comet-0.3.0-rc1 > > Is this link correct? I got a error of > > ``` > Not Found > The requested URL was not found on this server. > ``` > > > On Tue, Sep 24, 2024 at 6:

[VOTE] Release Apache DataFusion Comet 0.3.0 RC1

2024-09-24 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion Comet version 0.3.0. ** NOTE: we now have JAR files available for download for testing the release candidate. See notes below. ** This release candidate is based on commit: 3783faaa01078a35bee93b299368f8c72869198d [1] The proposed rele

Re: IP clearance for sqlparser-rs donation

2024-09-26 Thread Andy Grove
The IP clearance vote has passed. Thanks to everyone who helped with this process! https://lists.apache.org/thread/4qhyk23d0g01g3ccsffsxygwd6vj9b8k On Wed, Sep 25, 2024 at 8:02 AM Andrew Lamb wrote: > Ah, thank you! > > On Wed, Sep 25, 2024 at 9:18 AM Andy Grove wrote: > > >

Re: [VOTE] Release Apache DataFusion Comet 0.3.0 RC1

2024-09-28 Thread Andy Grove
Source release: https://dist.apache.org/repos/dist/release/datafusion/datafusion-comet-0.3.0/ Maven: https://central.sonatype.com/search?q=org.apache.datafusion On Sat, Sep 28, 2024 at 1:07 AM Andy Grove wrote: > The vote passes with five +1 votes (three binding). I will publish the >

Re: [VOTE] Accept donation of Ray SQL project into Apache DataFusion

2024-09-27 Thread Andy Grove
.com> wrote: > > > +1 (non-binding) > > > > On Mon, Sep 23, 2024 at 5:10 AM vin jake wrote: > > > > > +1 (binding) > > > > > > Thanks Andy > > > > > > On Fri, Sep 20, 2024 at 9:27 PM Andy Grove > > wrote: >

Re: [VOTE] Accept donation of Ray SQL project into Apache DataFusion

2024-09-27 Thread Andy Grove
Here is the IP clearance vote thread: https://lists.apache.org/thread/hytm7fl0z3c24sdhf9wbdvnpk2o5o9or On Fri, Sep 27, 2024 at 7:33 AM Andy Grove wrote: > The vote passes with nine +1 votes (six binding). Thanks, everyone! > > I will start the IP clearance process next. > > On Mo

Re: [VOTE] Release Apache DataFusion Comet 0.3.0 RC1

2024-09-28 Thread Andy Grove
The vote passes with five +1 votes (three binding). I will publish the source and binary releases over this weekend. Thanks! On Wed, Sep 25, 2024 at 3:43 PM Parth Chandra wrote: > +1 [non-binding] > > Tested local build with artifacts published to maven. > > On Tue, Sep 24, 2024

[VOTE] Accept donation of Ray SQL project into Apache DataFusion

2024-09-20 Thread Andy Grove
There is a discussion [1] about moving the Ray SQL project [2] from the `datafusion-contrib/ray-sql` GitHub repository into a new `apache/datafusion-ray` repository. The new DataFusion Ray project will provide a Python-first distributed version of DataFusion that can scale out on Ray clusters, pro

Re: IP clearance for sqlparser-rs donation

2024-09-19 Thread Andy Grove
ion [1] > > [1] > > https://github.com/sqlparser-rs/sqlparser-rs/issues/1294#issuecomment-2352932299 > > On Tue, Sep 17, 2024 at 12:17 PM Andy Grove wrote: > > > Thanks, Andrew. That will be a great help. > > > > I have created the repository: > > h

Re: IP clearance for sqlparser-rs donation

2024-09-19 Thread Andy Grove
One issue came up as I was completing the form. Before accepting the donation, we will need to add the ASF header to all source files in the sqlparser repo. On Thu, Sep 19, 2024 at 9:19 AM Andy Grove wrote: > Here is the XML form in svn: > > > https://svn.apache.org/repos/asf/incu

Re: IP clearance for sqlparser-rs donation

2024-09-25 Thread Andy Grove
it in the archives[1] > > Did it go to a different mailing list? > > [1]: https://lists.apache.org/list.html?dev@datafusion.apache.org > > On Mon, Sep 23, 2024 at 1:42 PM Andrew Lamb > wrote: > > > Sounds good -- thanks Andy > > > > On Mon, Sep 23, 2024 at

Interest in re-starting a weekly DataFusion sync call?

2024-10-02 Thread Andy Grove
Hi, I have been hosting a Comet-specific community meeting, but the turnout is pretty low. Rather than cancelling these meetings, I am considering making them more general DataFusion sync ups where we can discuss the core project and also the subprojects. I am curious to hear if there is interest

Re: Interest in re-starting a weekly DataFusion sync call?

2024-10-03 Thread Andy Grove
; > On Wed, Oct 2, 2024 at 2:11 PM Edmondo Porcu > wrote: > > > +1 > > > > > > > > On Wed, Oct 2, 2024 at 12:21 PM Andy Grove > wrote: > > > > > Hi, > > > > > > I have been hosting a Comet-specific community meeting, but

Re: [VOTE] Release Apache DataFusion 42.1.0 RC1

2024-10-17 Thread Andy Grove
+1 Verified on Mac M3. Thanks, Andrew. On Thu, Oct 17, 2024 at 8:09 AM Andrew Lamb wrote: > Hi, > > I would like to propose a release of Apache DataFusion version 42.1.0. > > This release candidate is based on commit: > 0011f450ada49fc3b724887eda14a788ec582f53 [1] > The proposed release tarbal

Re: [VOTE] Release Apache DataFusion Comet 0.4.0 RC1

2024-11-18 Thread Andy Grove
>>> +1 (binding) >>> >>> Verified on M3 Mac. >>> >>> Thanks Andy. >>> >>> On Fri, Nov 15, 2024 at 1:18 PM Andy Grove >> >>> wrote: >>>> >>>> Hi, >>>> >>>> I would like to

[RESULT][VOTE] Release Apache DataFusion Comet 0.4.0 RC1

2024-11-18 Thread Andy Grove
> On Nov 18, 2024, at 2:25 PM, Andy Grove wrote: > > The vote passes with five +1 votes (three binding). Thanks, everyone. > > I have released the source release and the datafusion-comet-spark-expr crate. > I also initiated publishing the Maven artifacts, but that w

Re: [VOTE] Release Apache DataFusion sqlparser-rs 0.52.0 RC3

2024-11-08 Thread Andy Grove
+1 (binding) Verified on Ubuntu 22.04 Thanks, Andrew. On Thu, Nov 7, 2024 at 10:06 AM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andrew. > > On Thu, Nov 7, 2024 at 8:52 AM Andrew Lamb wrote: > > > > Hi, > > > > I would like to propose a release of Apache DataFusion s

[VOTE] Release Apache DataFusion Comet 0.4.0 RC1

2024-11-15 Thread Andy Grove
Hi, I would like to propose a release of Apache DataFusion Comet version 0.4.0. This release candidate is based on commit: b74bfe4adc08c806b059cd8b85947b1fc15d7b9b [1] The proposed release tarball and signatures are hosted at [2]. Pre-built jar files are available in a Maven staging repository [

[VOTE] Release DataFusion Python Bindings 43.0.0 RC1

2024-12-02 Thread Andy Grove
Hi, I would like to propose a release of the Apache DataFusion Python Bindings, version 43.0.0. This release candidate is based on commit: 09b2f490e774339e1a00f9c620f7374916f3898e [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The Python wheels

Re: [VOTE] Release DataFusion Python Bindings 43.0.0 RC1

2024-12-02 Thread Andy Grove
y that is -- it does appear to be part of a tag ( > https://github.com/apache/datafusion-python/releases/tag/43.0.0-rc1) > > Andrew > > On Mon, Dec 2, 2024 at 8:15 PM Andy Grove wrote: > > > Hi, > > > > I would like to propose a release of the Apache DataFu

Re: [VOTE] Release DataFusion Python Bindings 43.0.0 RC1

2024-12-04 Thread Andy Grove
context. > 2) When you do pass in a session context to the `window` function you are > passing the wrapper and not the internal PySessionContext. > > I will put up a PR today to resolve both issues. > > I had some other failures and I'll continue to track them down. > >

Re: [VOTE] Release Apache DataFusion 44.0.0 RC2

2024-12-28 Thread Andy Grove
+1 (binding) Verified with Comet upgrade: https://github.com/apache/datafusion-comet/pull/1154 Thanks, Andrew. On Sat, Dec 28, 2024 at 11:23 AM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andrew. > > > On Sat, Dec 28, 2024 at 7:47 AM Andrew Lamb wrote: > > > > Hi, > >

Re: [VOTE] Release Apache DataFusion 45.0.0 RC1

2025-02-03 Thread Andy Grove
+1 (binding) Verified on Mac. Also verified with Comet CI in https://github.com/apache/datafusion-comet/pull/1364 Thanks, Andrew! On Mon, Feb 3, 2025 at 3:45 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Andrew. > > On Mon, Feb 3, 2025 at 1:59 PM Andrew Lamb wrote: >

Re: [VOTE] Release DataFusion Python Bindings 44.0.0 RC1

2025-02-06 Thread Andy Grove
+1 (binding) Verified on Mac. Thanks, Tim! On Sun, Feb 2, 2025 at 3:15 PM Tim Saucer wrote: > Hi, > > I would like to propose a release of the Apache DataFusion Python Bindings, > version 44.0.0. > > This release candidate is based on commit: > f5a9f25080a6774d9dd202774baae8a659b2e396 [1] > Th

Re: Adding new datafusion-functions-spark crate in main repo

2025-01-31 Thread Andy Grove
Oops, sent too soon. Please comment on the issue or PR with any feedback. Thanks. On Fri, Jan 31, 2025 at 1:43 PM Andy Grove wrote: > There is a discussion [1] about adding a crate to the core repository with > Apache Spark-compatible expressions. > > Based on this discussion I ha

Adding new datafusion-functions-spark crate in main repo

2025-01-31 Thread Andy Grove
There is a discussion [1] about adding a crate to the core repository with Apache Spark-compatible expressions. Based on this discussion I have created a PR [2] to add the new crate based on the existing datafusion-comet-spark-expr crate from the Comet subproject. PlesE [1] https://github.com/ap

Re: [VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

2024-12-18 Thread Andy Grove
+1 (binding) I ran into the same issue with cargo publish but commented that out. Thanks, Andrew. On Thu, Dec 12, 2024 at 1:58 PM Andrew Lamb wrote: > Thank you for sticking with it :pray: > > On Thu, Dec 12, 2024 at 2:17 PM L. C. Hsieh wrote: > > > Okay. Once commented out the `cargo publish

Re: [VOTE] Release DataFusion Python Bindings 43.1.0 RC2

2024-12-12 Thread Andy Grove
> Thank you, Andy! I'm sorry I didn't catch the problems before suggesting > > the release. > > > > On Fri, Dec 6, 2024 at 1:57 PM Andy Grove wrote: > > > > > Hi, > > > > > > I would like to propose a release o

  1   2   >