Welcome to DataFusion dev list

This is a test mail to ensure the list is working properly

Re: Welcome to DataFusion dev list

I think it might just be you and me for a while ;) On Mon, Apr 22, 2024 at 3:48 PM Phillip LeBlanc wrote: > Welcome everyone! > > On 4/23/24, 1:30 AM, "Andrew Lamb" wrote: > This is a test mail to ensure the list is working properly > >

Re: Subscribe to DataFusion mailing list

Specifically, I think you need to send an email to dev-subscr...@datafusion.apache.org On Wed, May 1, 2024 at 12:46 PM Curt Hagenlocher wrote: > Information about the mailing lists can be found at Communication — Apache > DataFusion documentation >

Other DataFusion Meetups

I started discussions on organizing DataFusion meetups, links below) -- if you are interested, please join the conversation. * SF Bay Area: https://github.com/apache/datafusion/discussions/10340 * Europe: https://github.com/apache/datafusion/discussions/10342 * China: https://github.com/apache/dat

Re: Other DataFusion Meetups

If there is interest in Seattle or Sydney meet ups, then would be happy to > help organize/sponsor. > > From: Andrew Lamb > Sent: Thursday, May 2, 2024 8:29:26 PM > To: dev@datafusion.apache.org > Subject: Other DataFusion Meetups > > I starte

Re: [VOTE] Release Apache DataFusion 38.0.0 RC1

+1 (binding) -- thank you Andy! I verified on mac M3. One thing I noticed is that the archive[1] is 46 MB compared to previous releases that were more like 6MB 37.1.0 [2] $ du -s -h apache-*.tar.gz 6.0M apache-arrow-datafusion-37.1.0.tar.gz 46M apache-datafusion-38.0.0.tar.gz Most of this diff

Re: [Comet] Enable GitHub Discussions for datafusion-comet repo?

I think discussions have served us very well in DataFusion core[1] and thus I think enabling them in datafusion-comet is a good idea +1 Andrew [1] https://github.com/apache/datafusion/discussions On Thu, May 9, 2024 at 1:00 PM Andy Grove wrote: > There is a proposal [1] to enable the GitHub d

Re: [VOTE] Release DataFusion Python Bindings 37.1.0 RC1

+1 (binding) Thank you Andy and Michael Ward (and everyone else who contrubuted) I verified on a mac m3 by using the verify script in the repo ~/Software/datafusion-python$ ./dev/release/verify-release-candidate.sh 37.1.0 1 Note that the verification script that was in the tarball did not work f

[ANNOUNCE] New DataFusion Committer: Jonah Gao

On behalf of the Arrow PMC, I'm happy to announce that Jonah Gao has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

[ANNOUNCE] New DataFusion PMC: Oleks V. (comphead)

On behalf of the DataFusion PMC, I'm happy to announce that Oleks V. (comphead) has accepted an invitation to join the PMC of Apache DataFusion. Welcome, and thank you for your contributions! Andrew

[ANNOUNCE] New DataFusion PMC: Mustafa Akur (akurmustafa)

On behalf of the DataFusion PMC, I'm happy to announce that Mustafa Akur (akurmustafa) has accepted an invitation to join the PMC of Apache DataFusion. Welcome, and thank you for your contributions! Andrew

Re: [VOTE] Release Apache DataFusion 38.0.0 RC1

;>> https://github.com/apache/datafusion/pull/10416 > >>> > >>> I think the untrusted key warning has always been there for more but > is more noticeable here due to the smaller number of keys. I think I need > to organize a key-signing party to become part of th

Re: [VOTE] Release DataFusion Python Bindings 38.0.0 RC1

+1 (binding) Also verified on M3 Mac. Thanks! Andrew On Fri, May 17, 2024 at 1:23 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andy. > > On Fri, May 17, 2024 at 10:11 AM Andy Grove > wrote: > > > > Hi, > > > > I would like to propose a release of the Apache DataFus

[CROWDSOURCING] DataFusion June 2024 Board Report

DataFusion PMC Chair Note: Please add any relevant comments / content to this document. I (Andrew Lamb) will submit to the ASF board on Wed June 12, 2024 (about one week prior to the scheduled board meeting). The format of this report and the metrics are from https://reporter.apache.org/wizard/?datafusion

Re: [VOTE] Release DataFusion Python Bindings 38.0.1 RC1

+1 (binding) Thanks Andy On Sat, May 25, 2024 at 11:13 AM Andy Grove wrote: > Hi, > > I would like to propose a release of the Apache DataFusion Python Bindings, > version 38.0.1. > > This release candidate is based on commit: > ea4a4dc7990c72cb65b999137da369a4e814cdbb [1] > The proposed releas

Re: Other DataFusion Meetups

FYI we are working on a June 24 meetup in the SF bay area. See [1] for more details / if you are interested in helping organize. Andrew [1] https://github.com/apache/datafusion/discussions/10340 On Thu, May 2, 2024 at 8:34 AM Andrew Lamb wrote: > Awesome -- I filed https://github.com/apa

Re: [DISCUSS] Move sqlparser-rs back into DataFusion project?

ct, > > and that it continues to have its own release process. > > > > The main benefit here is that it would bring it under ASF governance and > > allow those who have permission from their employers to contribute to > > Apache Arrow/DataFusion to be able to help with th

Re: [ANNOUNCE] New DataFusion Committer: Kazuyuki Tanimura

Welcome and congratulations! On Mon, Jun 3, 2024 at 11:38 AM L. C. Hsieh wrote: > On behalf of the DataFusion PMC, I'm happy to announce that Kazuyuki > Tanimura > has accepted an invitation to become a committer on Apache DataFusion. > > Welcome, and thank you for your contributions! > > Liang-

Re: [ANNOUNCE] New DataFusion Committer: Huaxin Gao

Welcome and congratulations! On Mon, Jun 3, 2024 at 11:39 AM L. C. Hsieh wrote: > > Corrected one error when I copied previous announcement: Arrow PMC -> > DataFusion PMC > > On behalf of the DataFusion PMC, I'm happy to announce that Huaxin Gao > has accepted an invitation to become a committer

Re: [VOTE] Release Apache DataFusion 39.0.0 RC1

+1 (binding) verified on M3 Mac Thank you very much Andy. Note we haven't updated to this version yet in InfluxDB 3.0 so we haven't run it through our regression tests yet. I don't think this is a blocker, FWIW, I just wanted to point it out. I expect we'll have it integrated next week sometime.

[ANNOUNCE] New DataFusion PMC member: Mehmet Ozan Kabak

The Project Management Committee (PMC) for Apache DataFusion has invited Mehmet Ozan Kabak to become a PMC member and we are pleased to announce that they have accepted! Congratulations and welcome!

[ANNOUNCE] New DataFusion PMC member: Ruihang Xia,

The Project Management Committee (PMC) for Apache DataFusion has invited Ruihang Xia to become a PMC member and we are pleased to announce that they have accepted! Congratulations and welcome!

[ANNOUNCE] New DataFusion committer: Lewis Zhang (lewiszlw)

On behalf of the DataFusion PMC, I'm happy to announce that Lewis Zhang has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

Re: [VOTE] Release DataFusion Python Bindings 39.0.0 RC1

+1 (binding) Thanks Andy Verified on M3 mac On Wed, Jun 26, 2024 at 2:33 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M1 Mac. > > Thanks Andy. > > On Wed, Jun 26, 2024 at 8:17 AM Andy Grove > wrote: > > > > Hi, > > > > I would like to propose a release of the Apache DataFusion Python

Proposal for UDFs library

There is an interesting proposal for a UDF library here: https://github.com/apache/datafusion/discussions/11192

[CROWDSOURCING] 2024-07-10 DataFusion ASF Board Report

It is time again for our monthly ASF board report. This month marks the last of the monthly reports required of new top level projects, so this activity will happen less frequently after this month. Please provide your comments on the ticket[1], google doc[2] or reply to this email I plan to sub

[RUST] Propose changing behavior of casting timestamp with timezone to without timezones

Hello, In the context of implementing date_bin for timestamps with timezones in DataFusion[1] (everyone's favorite corner-case riddled area) I would like to change how casting (and parsing) of timestamps without timezones works in Arrow [2]. If you have any comments (or information how other Arro

Re: [VOTE] Accept donation of sqlparser-rs project

+1 As for the new initial committers, at the moment there is only one active maintainer with write access (myself). However, there are three active maintainers[1] of sqlparser whom we had discussed granting commit rights to. My hope would be that if we proceed and continue sqlparser-rs developmen

Re: [VOTE] Release Apache DataFusion 40.0.0 RC1

+1 (binding) Thank you Andy Verified on an M3 Mac I also started a (very) rough blog post [1] for this release (and the last 6 monthly releases). If anyone has ideas of topics / features to include that would be great! Andrew [1]: https://github.com/apache/datafusion-site/pull/6 On Tue, Jul

Re: [CROWDSOURCING] 2024-07-10 DataFusion ASF Board Report

: Please add any relevant comments / content to this document. I (Andrew Lamb) will submit to the ASF board on Wed July 10, 2024 (about one week prior to the scheduled board meeting). New projects submit reports every month for the first three months. This is our last of those three monthly reports

[DISCUSS] Introducing Logical Type / DataType split

Hello, I encourage everyone to take a look at the LogicalTypes proposal from @notfillipo [1] Specifically I think this would help make adding support for StringView / REE / etc other encodings easier as well as making it possible to support User defined types. Andrew [1] https://github.com/apac

Re: [VOTE] Release Apache DataFusion Comet 0.1.0 RC2

+1 (binding) I verified it on a m3 mac I noted the changelog link in your email [3] gives me a 404. I think the right link may be [1] Thanks, Andrew [1]: https://github.com/apache/datafusion-comet/blob/df980bf67e59f439521b90dd2139c6a8d706c0bc/dev/changelog/0.1.0.md [3]: https://github.com/apac

[DISCUSS] TableProvider::Scan to take trait object rather than `SessionState`

We are contemplating changing the `TableProvider::Scan` method (to take a trait object, rather than `SessionState`). Please review and provide comments if you are interested[1] [1]: https://github.com/apache/datafusion/pull/11516

Re: [RESULT] [VOTE] Release Apache DataFusion Comet 0.1.0 RC2

Congratulations -- a great first release! On Tue, Jul 23, 2024 at 5:01 PM Andy Grove wrote: > > > > On Jul 23, 2024, at 3:01 PM, Andy Grove wrote: > > > > The vote passes with eight +1 votes (three binding). Thanks, everyone. > > > > The release is available at: > https://dist.apache.org/repos/

Re: [VOTE] Release Apache DataFusion 41.0.0 RC1

+1 (binding0 Verified also on an M3 Mac Thanks Andy (do we hear an echo ? :) ) On Thu, Aug 8, 2024 at 2:56 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andy. > > On Thu, Aug 8, 2024 at 11:30 AM Andy Grove > wrote: > > > > Hi, > > > > I would like to propose a relea

Re: [VOTE] Release DataFusion Python Bindings 40.0.0 RC1

+1 (binding) Verified on an M3 mac Thank you for keeping the releases flowing Andy Andrew On Sat, Aug 10, 2024 at 1:57 AM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andy. > > On Fri, Aug 9, 2024 at 3:42 PM Andy Grove > wrote: > > > > Hi, > > > > I would like to prop

[ANNOUNCE] New DataFusion PMC member: Jay Zhan

The Project Management Committee (PMC) for Apache DataFusion has invited Jay Zhan to become a PMC member and we are pleased to announce that Jay has accepted! Congratulations and welcome! Andrew (on behalf of the DataFusion PMC)

[ANNOUNCE] New DataFusion committer: Eduard Karacharov

On behalf of the DataFusion PMC, I'm happy to announce that Eduard Karacharov has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew On behalf of the PMC

Re: [DISCUSS][ORC] Donate datafusion-contrib/datafusion-orc

There is some good discussion on the ticket -- specifically maybe it makes sense to split out the actual orc->arrow code from the DataFusion integration On Wed, Aug 14, 2024 at 10:46 AM Hao Ding wrote: > +1 non-binding for the donation > > However, I have some other thoughts about the destinatio

Re: [VOTE] Release DataFusion Python Bindings 40.1.0 RC2

+1 (binding) Thank you Andy! On Fri, Aug 16, 2024 at 9:22 AM Andy Grove wrote: > Hi, > > I would like to propose a release of the Apache DataFusion Python Bindings, > version 40.1.0. > > This release candidate is based on commit: > 81d8d57cce881ebfd1cfe3c3a755b77b772285cf [1] > The proposed rel

[CROWDSOURCING] 2024-09-11 DataFusion ASF Board Report

It is time to provide another board report. This is the start of our quarterly reports so after this we'll have only reports each quarter I also think the primary reason for these reports is for the board to make sure the project is ok. The actual project details are more likely helpful for other

Re: [CROWDSOURCING] 2024-09-11 DataFusion ASF Board Report

meetups planned: New York City, San Francisco (for the second time!) and Belgrade. On Tue, Aug 20, 2024 at 2:34 PM Andrew Lamb wrote: > It is time to provide another board report. This is the start of our > quarterly reports so after this we'll have only reports each quarter > >

[ANNOUNCE] New DataFusion committer: Weijun Huang (Weijun-H)

On behalf of the DataFusion PMC, I'm happy to announce that Weijun Huang has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

Re: [VOTE] Release Apache DataFusion Comet 0.2.0 RC1

+1 (binding) Also verified on an M3 Mac and took a look at some of the linked PRs in the release notes. Looks like an exciting release! Andrew On Sun, Aug 25, 2024 at 5:19 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andy. > > On Sun, Aug 25, 2024 at 11:49 AM Andy Gr

[DISCUSSION] What criteria should we use for adding new features?

I started a discussion [1] about what features should be added to the core and what features should not be. Please weigh in if you are interested. [1]: https://github.com/apache/datafusion/issues/12357

Re: [VOTE] Release DataFusion Python Bindings 41.0.0 RC1

+1 (binding) Verified on M3 Mac. Thanks Andy On Mon, Sep 9, 2024 at 8:30 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andy. > > On Mon, Sep 9, 2024 at 4:49 PM Andy Grove > wrote: > > > > Hi, > > > > I would like to propose a release of the Apache DataFusion Python >

Re: Setting up Nexus access for publishing DataFusion Maven artifacts

Sounds like a good plan to me, for what it is worth Thanks for handling this On Wed, Sep 11, 2024 at 11:15 PM Andy Grove wrote: > The DataFusion Comet subproject plans on publishing JAR files to Maven, so > I have filed a JIRA [1] requesting that Nexus access [2] be setup. > > Although this is

Re: [VOTE] Release Apache DataFusion 42.0.0 RC1

+1 (binding) Verified on a M3 Mac. Thank you very much Andy. I also think it is time to start writing a blog post about the 42 release.[1] There has been a lot of good stuff in the last three months. [1]: https://github.com/apache/datafusion/issues/11631 On Sat, Sep 14, 2024 at 8:47 PM L. C. Hs

Re: [VOTE] Release DataFusion Python Bindings 42.0.0 RC1

+1 (binding) This looks like a great release to me. Thanks Tim and Andy for keeping things moving along. Verified on an m3 mac Andrew On Tue, Oct 8, 2024 at 5:23 AM Tim Saucer wrote: > +1 non-binding > > Verified on m2 mac in python 3.10 and 3.12. > > Note: We need to add one line in the upda

Re: [ANNOUNCE] New DataFusion committer: Jax Liu (goldmedal)

! > > On 2024/10/17 18:13:49 Andrew Lamb wrote: > > On behalf of the DataFusion PMC, I'm happy to announce that Jax Liu > > has accepted an invitation to become a committer on Apache > > DataFusio

[RESULT] [VOTE] Release Apache DataFusion 42.1.0 RC1

out to Andy and hopefully can get it resolved shortly Andrew On Thu, Oct 17, 2024 at 2:26 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M1 Mac. > > Thanks Andrew. > > On Thu, Oct 17, 2024 at 7:08 AM Andrew Lamb wrote: > > > > Hi, > > > >

Re: [RESULT] [VOTE] Release Apache DataFusion 42.1.0 RC1

Update -- Andy has helped me get the permissions needed and the release is now also available on crates.io: https://crates.io/crates/datafusion/42.1.0 Andrew On Sun, Oct 20, 2024 at 1:44 PM Andrew Lamb wrote: > With 4 +1 votes (3 binding) the release is approved > > The release is

Re: Major and minor release process

Thanks Andy -- this is a great idea. Also thanks for hosting the sync Kudos to Matthew and Xuanwo for starting to do this process for 41.1.0[1], so hopefully we'll have another concrete example to follow shortly. I hope to make a release candidate from the branch in the next few days. Andrew [

[ANNOUNCE] New DataFusion committer: Jax Liu (goldmedal)

On behalf of the DataFusion PMC, I'm happy to announce that Jax Liu has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions!

Re: [VOTE] Release Apache DataFusion 42.2.0 RC1

: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andrew. > > On Thu, Oct 31, 2024 at 5:41 AM Andrew Lamb > wrote: > > > > Hi, > > > > I would like to propose a release of Apache DataFusion version 42.2.0. &

Re: [VOTE] Release Apache DataFusion 43.0.0 RC1

+1 (binding) > This release consists of 403 commits from 96 contributors. See credits at the end of this changelog for more information. https://github.com/apache/datafusion/blob/88f58bf929167c5c5e2250ad87caa88d4dff11e5/dev/changelog/43.0.0.md Pretty epic 🤩 Thanks Andy and everyone else who mad

[ANNOUNCE] New DataFusion committer: Ifeanyi Ubah

On behalf of the DataFusion PMC, I'm happy to announce that Ifeanyi Ubah has accepted an invitation to become a committer on Apache DataFusion. Ifeanyi has reviewed many many PRs in sqparser[1] and helped move that project along immensely. Welcome, and thank you for your contributions! Andrew [

Re: Bugs to close

> What is the “Apache way” concerning closing out old issues? > DataFusion has a surprisingly large number of open issues. Of the 243 open issues labelled as a bug, here are 12 that should be closed. I think we are just waiting for someone to help curate / review them. As you know it takes time to

[RESULT][VOTE] Release Apache DataFusion sqlparser-rs 0.52.0 RC3

On Fri, Nov 8, 2024 at 9:56 AM Andy Grove wrote: > +1 (binding) > > Verified on Ubuntu 22.04 > > Thanks, Andrew. > > On Thu, Nov 7, 2024 at 10:06 AM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M3 Mac. > > > > Thanks Andr

[VOTE] Release Apache DataFusion 42.2.0 RC1

Hi, I would like to propose a release of Apache DataFusion version 42.2.0. This release candidate is based on commit: a43ce8bd67e8d649e0e4f5260f8a5e6e10d62dbc [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. This release has a single fix to disa

Re: [VOTE] Release Apache DataFusion 43.0.0 RC1

Wayne, do you think we file tickets for the issues you found? On Wed, Nov 6, 2024 at 4:06 AM Wayne Xia wrote: > +1 (binding) > > Verified on AMD64 ArchLinux. Thanks all for pushing this forward! > > Two unrelated issues in verifying the release: > - It requires too much memory to run (over 128GB

Re: IP clearance for sqlparser-rs donation

This sounds right to me I will be happy to create the initial commit / donation PR and file follow on tickets (for things like release process, move existing tickets , update docs, etc) THANK YOU -- this is awesome that it will finally happen Andrew On Tue, Sep 17, 2024 at 11:41 AM Andy Grove

Re: IP clearance for sqlparser-rs donation

sqlparser-rs > > I will start on the XML version of the IP clearance form later today. > > Andy. > > On Tue, Sep 17, 2024 at 10:04 AM Andrew Lamb > wrote: > > > This sounds right to me > > > > I will be happy to create the initial commit / donation PR and

Re: IP clearance for sqlparser-rs donation

tarted the lazy consensus IP clearance vote. If there are > no objections then the vote will pass in 72 hours time. > > On Sun, Sep 22, 2024 at 5:15 AM Andrew Lamb > wrote: > > > Thanks Andy -- I reviewed the writeup and it looks good to me. THANK YOU > SO > > MUCH for he

Re: IP clearance for sqlparser-rs donation

/svn.apache.org/repos/asf/incubator/public/trunk/content/ip-clearance/datafusion-sqlparser.xml > > > > I will now work on getting this published in HTML format and start the IP > > clearance vote > > > > > > On Tue, Sep 17, 2024 at 12:36 PM Andrew Lamb >

Re: IP clearance for sqlparser-rs donation

ks ok and I think we can start the vote. > > On Sat, Sep 21, 2024 at 4:26 AM Andrew Lamb > wrote: > > > The ASF header has been added to all files: > > https://github.com/sqlparser-rs/sqlparser-rs/pull/1437 > > > > Perhaps we can use co

Re: [DISCUSS] Enable GitHub Discussions for DataFusion Comet

+1 in my opinion On Mon, Sep 23, 2024 at 9:50 AM Andy Grove wrote: > I only noticed a question about Comet by chance yesterday because it was > posted as a discussion in the core DataFusion repository. > > Perhaps we should enable discussions in the Comet repository as well. > > Please let me kn

Re: [VOTE] Accept donation of Ray SQL project into Apache DataFusion

+1 (binding) On Mon, Sep 23, 2024 at 5:07 AM Vakaris Baškirov < vakaris.bashki...@gmail.com> wrote: > +1 (non-binding) > > On Mon, Sep 23, 2024 at 5:10 AM vin jake wrote: > > > +1 (binding) > > > > Thanks Andy > > > > On Fri, Sep 20, 2024 at 9:27 PM Andy Grove > wrote: > > > > > There is a disc

Re: DataFusion Logical Types and Typed expressions

I will review this again more carefully today. I am sorry I have not been more responsive -- It is / has been a very busy week for me On Tue, Sep 24, 2024 at 7:06 AM Piotr Findeisen wrote: > Hi > > I am aware this message may seem redundant, given most communication > happens in GitHub issues wi

Re: [VOTE] Release Apache DataFusion Comet 0.3.0 RC1

+1 Thanks Andy I verified this on a M3 Mac. Andrew On Tue, Sep 24, 2024 at 11:41 PM Andy Grove wrote: > Thanks for letting me know. Something seems to have changed with my local > gpg installation and the signing had failed. > > I had to add "--pinentry-mode loopback”. I will create a PR tomor

Re: IP clearance for sqlparser-rs donation

Ah, thank you! On Wed, Sep 25, 2024 at 9:18 AM Andy Grove wrote: > Yes. I'm sorry, I should have posted a link when I started the vote. > > https://lists.apache.org/thread/4qhyk23d0g01g3ccsffsxygwd6vj9b8k > > On Wed, Sep 25, 2024 at 6:57 AM Andrew Lamb > wrote: > &

Re: IP clearance for sqlparser-rs donation

Andy I haven't seen the vote thread come through on my email and I couldn't find it in the archives[1] Did it go to a different mailing list? [1]: https://lists.apache.org/list.html?dev@datafusion.apache.org On Mon, Sep 23, 2024 at 1:42 PM Andrew Lamb wrote: > Sounds good -

Re: Interest in re-starting a weekly DataFusion sync call?

+1 -- I will attempt to join as well On Wed, Oct 2, 2024 at 2:11 PM Edmondo Porcu wrote: > +1 > > > > On Wed, Oct 2, 2024 at 12:21 PM Andy Grove wrote: > > > Hi, > > > > I have been hosting a Comet-specific community meeting, but the turnout > is > > pretty low. Rather than cancelling these mee

[VOTE] Release Apache DataFusion sqlparser-rs 0.52.0 RC3

Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.52.0. Note this is RC*3* . This is the first release proposed as part of the DataFusion project. Again, huge thanks to Ifeanyi Ubah for helping making this happen This release candidate is based on commit: 334a5bf

[VOTE] Release Apache DataFusion 42.1.0 RC1

Hi, I would like to propose a release of Apache DataFusion version 42.1.0. This release candidate is based on commit: 0011f450ada49fc3b724887eda14a788ec582f53 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The rationale for the release is locat

Re: [VOTE] Release Apache DataFusion Comet 0.4.0 RC1

+1 (binding) I looked at the release notes and ran the verification script. Looks like a good release Andrew On Fri, Nov 15, 2024 at 4:18 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache DataFusion Comet version 0.4.0. > > This release candidate is based on commit: >

Re: [VOTE] Release DataFusion Python Bindings 43.0.0 RC1

+1 (binding) I verified on a M3 mac. Thanks Andy One thing I noticed is that the commit [1] [1]: https://github.com/apache/datafusion-python/tree/09b2f490e774339e1a00f9c620f7374916f3898e Reports that: > This commit does not belong to any branch on this repository, and may belong to a fork out

[DISCUSS] Jonah Gao for PMC

I would like to propose adding Jonah Gao[1] to the DataFusion PMC. Jonah has been a committer since April 2024, has a strong and sustained contribution record for more than a year. He helps care and fix bugs in the SQL layer, and has helped review many pull requests[3][4] in addition to his own st

Re: [DISCUSS] Jonah Gao for PMC

I apologize I sent this to the wrong list :( On Tue, Dec 3, 2024 at 7:38 AM Andrew Lamb wrote: > I would like to propose adding Jonah Gao[1] to the DataFusion PMC. > > Jonah has been a committer since April 2024, has a strong and sustained > contribution record for more than a ye

[CROWDSOURCING] 2024-12-11 DataFusion ASF Board Report

It's time again to provide another board report. As a reminder, the primary reason for these reports is for the board to make sure the project is ok. The actual project details are more likely helpful for other members of the project than the board. With that being said, please feel free to prov

[ANNOUNCE] New DataFusion committer: Piotr Findeisen (findepi)

On behalf of the DataFusion PMC, I'm happy to announce that Piotr Findeisen has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

Re: [VOTE] Release Apache DataFusion 44.0.0 RC1

6 AM Xudong Wang wrote: > > > +1 (non-binding) > > > > Verified on M1 Mac. > > > > Thanks Andrew > > > > On 2024/12/25 12:06:25 Andrew Lamb wrote: > > > Hi, > > > > > > I would like to propose a release of Apache DataFusion version 44.0.

[VOTE] Release Apache DataFusion 44.0.0 RC2

Hi, I would like to propose a release of Apache DataFusion version 44.0.0. Note this is RC2 (RC1 had an issue[5], thanks Tim Saucer for finding and fixing) The 44.0.0 release is tracked with [4] This release candidate is based on commit: 3cc3fca31e6edc2d953e663bfd7f856bcb70d8c4 [1] The proposed

Re: [PR] adding sqlite data files [datafusion-testing]

In case anyone else is curious, I believe Bruce updated .asf.yaml to send these notices to the github mailing list rather than the dev mailing list https://github.com/apache/datafusion-testing/blob/main/.asf.yaml On Thu, Dec 26, 2024 at 4:56 PM Omega359 (via GitHub) wrote: > > Omega359 opened a

[VOTE] Release Apache DataFusion 45.0.0 RC1

Hi, The releases are coming fast and furious. I would like to propose a release of Apache DataFusion version 45.0.0. This release candidate is based on commit: 26058ac024095ad8852eb3a8ab707ac09a02e8d7 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at

Re: [VOTE] Release DataFusion Python Bindings 44.0.0 RC1

-python/pull/1012 On Sun, Feb 2, 2025 at 8:05 PM Tim Saucer wrote: > Ah, I didn’t see that I needed to do that. I’ll upload in the morning. > Thank you for catching the issue. > > > On Feb 2, 2025, at 7:24 PM, Andrew Lamb wrote: > > > > Thanks for doing this Tim! >

Re: [VOTE] Release Apache DataFusion 45.0.0 RC1

ache/datafusion-comet/pull/1364 > > > > Thanks, Andrew! > > > > On Mon, Feb 3, 2025 at 3:45 PM L. C. Hsieh wrote: > > > > > +1 (binding) > > > > > > Verified on M4 Mac. > > > > > > Thanks Andrew. > > > > > >

[DISCUSS] Checking in Cargo.lock

BTW @mbrobbel has a nice PR to check in Cargo.lock and bring datafusion-cli part of the workspace. Please leave comments on the PR if interested: https://github.com/apache/datafusion/pull/14483 Thanks, Andrew

[RESULT][VOTE] Release DataFusion Python Bindings 44.0.0 RC1

With 5+1 votes (3 binding) the release is approved! Success! The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-python-44.0.0 I did not upload the artifacts to pypi / other repositories as I don't know how to do so. Maybe Tim you can help here. Thank

Re: [RESULT][VOTE] Release DataFusion Python Bindings 44.0.0 RC1

🎉 On Fri, Feb 7, 2025 at 10:40 AM Tim Saucer wrote: > Thank you, Andrew. Andy gave me pypi access and I've published it. > > Best, > Tim > > On Fri, Feb 7, 2025 at 9:01 AM Andrew Lamb wrote: > > > With 5+1 votes (3 binding) the release is approved! > >

Re: [VOTE] Release Apache DataFusion 45.0.0 RC1

hope this one is epic (and a low drama release) Andrew On Tue, Feb 4, 2025 at 12:37 PM Andrew Lamb wrote: > Awesome -- thank you for the report > > On Tue, Feb 4, 2025 at 12:19 PM Kevin Liu wrote: > >> Another data point: >> I've tested 45.0.0 RC1 against icebe

[RESULT] [VOTE] Release Apache DataFusion 45.0.0 RC1

(resending with correct subject) On Fri, Feb 7, 2025 at 10:49 AM Andrew Lamb wrote: > With 4 +1 votes (3 binding) the release is approved! > > The release is available here: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-45.0.0 > > I have also publis

Re: [RESULT] [VOTE] Release Apache DataFusion 45.0.0 RC1

Thanks Kevin On Fri, Feb 7, 2025 at 10:59 AM Kevin Liu wrote: > Cheers! Thanks for all the hard work and the super fast release process. > > Best, > Kevin Liu > > On Fri, Feb 7, 2025 at 7:50 AM Andrew Lamb wrote: > > > (resending with correct subject) > > &g

Re: [VOTE] Release DataFusion Python Bindings 44.0.0 RC1

Thanks for doing this Tim! As we have met in person, perhaps we could/should have a keysigning party (aka zoom call) where I can sign and add your keys One thing I noticed is that I can't find the key used for for keysigning andrewlamb@Andrews-MacBook-Pro-2:~/Downloads$ gpg --verify apache-dataf

[ANNOUNCE] New DataFusion committer: Ruiqiu Cao (Rachelint)

On behalf of the DataFusion PMC, I'm happy to announce that Ruiqiu Cao (Rachelint) has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

[VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.53.0. Notes: 1. This is RC2 (RC1 hit [6]) 2. there is a known, but I don't think blocking, issue with the verification script[7] This release candidate is based on commit: e7d2c852918fe273a4f13288eae3c95cc99dff30 [

[ANNOUNCE] New DataFusion PMC member: Jonah Gao

The Project Management Committee (PMC) for Apache DataFusion has invited Jonah Gao to become a PMC member and we are pleased to announce that Jonah Gao has accepted. Congratulations and welcome!

[RESULT] [VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

: https://crates.io/crates/sqlparser/0.53.0 Thanks again, Andrew On Wed, Dec 18, 2024 at 12:37 PM Andy Grove wrote: > +1 (binding) > > I ran into the same issue with cargo publish but commented that out. > > Thanks, Andrew. > > On Thu, Dec 12, 2024 at 1:58 PM Andrew Lamb >

Re: [VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

rser-rs-0.53.0.X.JaesmyIQIo/apache-datafusion-sqlparser-rs-0.53.0/derive/src/ > > > lib.rs:267: > > > > > > } > > > > > > > > > > > > fn is_option(ty: &Type) -> bool { > > > > > > -if let Type::Path(TypePath { path: Path

Re: [VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

t; +.. > > +}) = ty > > +{ > > if let Some(segment) = segments.last() { > > if segment.ident == "Option" { > > if let PathArguments::AngleBracketed(args) = > &segment.arguments { > > ``` > > On Thu,

  1   2   >