[VOTE] Release Apache DataFusion 47.0.0 RC1

2025-04-16 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 47.0.0. This release candidate is based on commit: e4433049b04ca2c1e2031eb05d1a0990210f11d6 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums and

[BLOG] Blog about User Defined Window Functions

2025-04-15 Thread Andrew Lamb
FYI we are working on a blog about user defined window functions[1] We would appreciate any comments Andrew [1]: https://github.com/apache/datafusion-site/pull/66

Re: [BLOG] Proposed blog post: Worlds fastest TPCH geneerator

2025-04-15 Thread Andrew Lamb
Following up here, the blog has been published[1] Andrew [1]: https://datafusion.apache.org/blog/2025/04/10/fastest-tpch-generator/ On Fri, Apr 4, 2025 at 4:36 PM Andrew Lamb wrote: > Hello, > > We have drafted a proposed Blog post with some others in the DataFusion > communi

[BLOG] Proposed blog post: Worlds fastest TPCH geneerator

2025-04-04 Thread Andrew Lamb
Hello, We have drafted a proposed Blog post with some others in the DataFusion community about our work on a TPCH data generator. We would welcome your feedback: [1]: https://github.com/apache/datafusion-site/pull/67

Re: [VOTE][RUST][Ballista] Release Apache DataFusion Ballista 45.0.0 RC1

2025-04-04 Thread Andrew Lamb
+1 (binding) Looks like a good release to me. I verified on an M3 mac Andrew On Fri, Apr 4, 2025 at 3:08 PM Renato Marroquín Mogrovejo < renatoj.marroq...@gmail.com> wrote: > +1 (non-binding) > > verified on M4 Mac. > > Thanks Andy! > > El vie, 4 abr 2025 a las 20:38, L. C. Hsieh () escribió: >

Re: [RESULT] [VOTE] Release DataFusion Python Bindings 46.0.0 RC1

2025-03-30 Thread Andrew Lamb
I have published the release to crates.io as well https://crates.io/crates/datafusion-python/46.0.0 Thanks again, Andrew On Sun, Mar 30, 2025 at 6:33 AM Andrew Lamb wrote: > With 6 +1 votes (3 binding) the release is approved > > The release is available here: > > https://

[RESULT] [VOTE] Release DataFusion Python Bindings 46.0.0 RC1

2025-03-30 Thread Andrew Lamb
With 6 +1 votes (3 binding) the release is approved The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-python-46.0.0 Note I did not upload this to crates.io or pypi Andrew On Sat, Mar 29, 2025 at 10:50 AM Andy Grove wrote: > +1 (binding) > > Verif

[DISCUSS] DataFusion 46 Blog

2025-03-25 Thread Andrew Lamb
In the subject of blogging they are coming fast and furious. There is another one for DataFusion 46 that is up for review[1]. Please leave comments if you are interested Andrew [1]: https://github.com/apache/datafusion-site/pull/64

Re: [VOTE] Release DataFusion Python Bindings 46.0.0 RC1

2025-03-23 Thread Andrew Lamb
+1 (binding) Verified on an M3 mac. Looks like a good release to me. Thanks everyone Andrew On Sat, Mar 22, 2025 at 11:27 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Tim. > > > On Sat, Mar 22, 2025 at 5:36 PM Tim Saucer wrote: > > > > Hi, > > > > I would like to p

[DISCUSS] Another Blog post on Parquet!

2025-03-20 Thread Andrew Lamb
Speaking of blogs, here is another proposed cross posted blog about Parquet filter pushdown for the DataFusion blog site[1]. Please take a look and leave comments if you are interested. [1]: https://github.com/apache/datafusion-site/pull/61

Re: [DISCUSS] Blog on Parquet Pruning

2025-03-20 Thread Andrew Lamb
The blog is now live on https://datafusion.apache.org/blog/2025/03/20/parquet-pruning/ On Wed, Mar 19, 2025 at 2:02 PM Kevin Liu wrote: > Thanks for posting here! Great read. > > Best, > Kevin Liu > > On Tue, Mar 18, 2025 at 1:46 PM Andrew Lamb wrote: > > > There i

[RESULT][VOTE] Release Apache DataFusion 46.0.1 RC1

2025-03-19 Thread Andrew Lamb
Resending with proper subject On Wed, Mar 19, 2025 at 2:01 PM Andrew Lamb wrote: > With 4 +1 votes (3 binding) the release is approved! > > Success! The release is available here: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-46.0.1 > > I have a

Re: [VOTE] Release Apache DataFusion 46.0.1 RC1

2025-03-19 Thread Andrew Lamb
With 4 +1 votes (3 binding) the release is approved! Success! The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-46.0.1 I have also uploaded it to crates.io Thanks again, Andrew On Sun, Mar 16, 2025 at 10:38 PM Wayne Xia wrote: > +1 (binding_ > >

[DISCUSS] Blog on Parquet Pruning

2025-03-18 Thread Andrew Lamb
There is a PR to cross post a blog about Parquet pruning on the DataFusion site[1]. Please take a look and leave comments if you are interested. [1]: https://github.com/apache/datafusion-site/pull/60

[ANNOUNCE] New DataFusion committer: Marko Milenković (milenkovicm)

2025-03-17 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Marko Milenković has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! The PMC

Re: [VOTE] Release Apache DataFusion 46.0.1 RC1

2025-03-16 Thread Andrew Lamb
+1 (binding) I verified this on Mac M3 Thank you Xudong! Andrew On Sun, Mar 16, 2025 at 7:00 AM Wang Xudong wrote: > Hi, > > I would like to propose a release of Apache DataFusion version 46.0.1. > > This release candidate is based on commit: > 68f29038953d91191a46656968488f1e7bb4c327 [1] > T

Re: [VOTE] Release Apache DataFusion Comet 0.7.0 RC1

2025-03-14 Thread Andrew Lamb
+1 (binding) Looks like a good release to me. Verified on M3 Mac Thanks Andy Andrew On Thu, Mar 13, 2025 at 11:25 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M4 Mac. > > Thanks Andy. > > > On Thu, Mar 13, 2025 at 5:57 PM Andy Grove wrote: > > > > Hi, > > > > > > I would like to pro

Re: [CROWDSOURCING] March 2025 ASF Board Report

2025-03-12 Thread Andrew Lamb
Thank you to everyone who contributed to this quarters report. I have submitted to the ASF board and filed a ticket for the next report in June [1] [1]: https://github.com/apache/datafusion/issues/15182 On Mon, Mar 10, 2025 at 8:52 AM Andrew Lamb wrote: > I have incorporated feedback left

Re: Request for Updated Discord Link for GSoC 2025 Participation

2025-03-11 Thread Andrew Lamb
THanks for the report. Can you confirm what link you tried and what error you saw? On Tue, Mar 11, 2025 at 6:08 AM ARKA DASH <23f2001...@ds.study.iitm.ac.in> wrote: > Dear Apache DataFusion Team, > > I hope this email finds you well. My name is Arka Dash, and I am interested > in applying for Goo

Re: [CROWDSOURCING] March 2025 ASF Board Report

2025-03-10 Thread Andrew Lamb
on organizing one in London in April 2025[1]. [1]: https://github.com/apache/datafusion/discussions/14647 On Sat, Mar 1, 2025 at 7:06 AM Andrew Lamb wrote: > Hello Fearless DataFusion(iers)! > > We have an ASF board report due in 2 weeks and I have started a draft. > > Please

Re: discuss: Forward github discussion to dev list

2025-03-08 Thread Andrew Lamb
Thank you Xuanwo, I agree with your broader point that using mailing lists for discussions makes it harder for many to participate (for example they need to already be subscribed to the mailing list to respond to a past comment / thread) We actually do forward all github activity to a mailing lis

[DISCUSS] Adding insta to DataFusion testing

2025-03-07 Thread Andrew Lamb
There is a very nice PR [1] that adds better testing for datafusion-cli, but also adds the insta to the stack. This is yet another test dependency, but I think adds significant value going forward Please comment on the PR if you are interested [1]: https://github.com/apache/datafusion/pull/13672

[RESULT] [VOTE] Release Apache DataFusion 46.0.0 RC2

2025-03-07 Thread Andrew Lamb
Resending with the correct subject line On Fri, Mar 7, 2025 at 2:25 PM Andrew Lamb wrote: > With 7 +1 votes, 5 binding the release is approved > > Success! The release is available here: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-46.0.0 > > I have

Re: [VOTE] Release Apache DataFusion 46.0.0 RC2

2025-03-07 Thread Andrew Lamb
With 7 +1 votes, 5 binding the release is approved Success! The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-46.0.0 I have also uploaded the release to crates.io Thanks again everyone for your help On Thu, Mar 6, 2025 at 11:19 AM Jonah Gao wrote

[RESULT][VOTE] Release Apache DataFusion sqlparser-rs 0.55.0 RC1

2025-03-05 Thread Andrew Lamb
.0 1` on M1 Mac. > > Ran an example, `echo "select 1;" | cargo run --example cli -` > > > > Best, > > Kevin Liu > > > > > > On Thu, Feb 27, 2025 at 11:30 AM L. C. Hsieh wrote: > > > > > +1 (binding) > > > > >

Re: [VOTE] Release Apache DataFusion 46.0.0 RC2

2025-03-04 Thread Andrew Lamb
variable to display a > backtrace > > > failures: > fuzz_cases::sort_fuzz::test_sort_10k_mem > > test result: FAILED. 64 passed; 1 failed; 0 ignored; 0 measured; 0 filtered > out; finished in 74.07s > ``` > > Best, > Kevin Liu > > On Tue, Mar 4, 2025 at 7

Re: [VOTE] Release Apache DataFusion 46.0.0 RC2

2025-03-04 Thread Andrew Lamb
+1 (binding) I ran the verification script on an M3 mac. Thank you so much Xudong! Andrew On Tue, Mar 4, 2025 at 9:47 AM Wang Xudong wrote: > Hi, > > I would like to propose a release of Apache DataFusion version 46.0.0. > > This release candidate is based on commit: > d5ca8307940c1a6345419a2c

Re: [VOTE] Release Apache DataFusion 46.0.0 RC1

2025-03-04 Thread Andrew Lamb
apache/datafusion/pull/14985 > > On Mon, Mar 3, 2025 at 10:04 AM Andrew Lamb > wrote: > > > I think something in rustup changed: > > > https://github.com/apache/datafusion/issues/14982#issuecomment-2694821546 > > > > On Mon, Mar 3, 2025 at 11:58 AM Andy Grove

Re: [VOTE] Release Apache DataFusion 46.0.0 RC1

2025-03-03 Thread Andrew Lamb
ng the rust-toolchain file > to refer to channel "stable" rather than a specific version number seems to > fix this. > > On Mon, Mar 3, 2025 at 9:25 AM Andrew Lamb wrote: > > > I have a PR with a workaround for the release verification issue[1]. > > > >

Re: [VOTE] Release Apache DataFusion 46.0.0 RC1

2025-03-03 Thread Andrew Lamb
Mon, Mar 3, 2025 at 10:44 AM Andrew Lamb wrote: > Thanks Xudong! > > I ran the verification script > ``` > $ ./dev/release/verify-release-candidate.sh 46.0.0 1 > ``` > > And it errored in the following way: > > ``` > error: toolchain '1.85.0-aarch64-appl

Re: [VOTE] Release Apache DataFusion 46.0.0 RC1

2025-03-03 Thread Andrew Lamb
Thanks Xudong! I ran the verification script ``` $ ./dev/release/verify-release-candidate.sh 46.0.0 1 ``` And it errored in the following way: ``` error: toolchain '1.85.0-aarch64-apple-darwin' is not installed help: run `rustup toolchain install 1.85.0-aarch64-apple-darwin` to install it + clea

Re: [VOTE] Release Apache DataFusion Ballista 44.0.0 RC1

2025-03-01 Thread Andrew Lamb
+1 (binding) Verified on M3 Mac Looks like a good release. Thanks Marko for all the work on this one and Andy for doing the release process! Andrew On Sat, Mar 1, 2025 at 2:40 PM Marko Milenković wrote: > +1 non-binding > Verified on Mac M4 > > Thanks Andy! > > Best regards, > > -- > Marko Mi

[CROWDSOURCING] March 2025 ASF Board Report

2025-03-01 Thread Andrew Lamb
Hello Fearless DataFusion(iers)! We have an ASF board report due in 2 weeks and I have started a draft. Please feel free to post comments to the doc[1] or the ticket[2] or this thread and I will incorporate them [1]: https://docs.google.com/document/d/11b2GEmPh5gblWWegeZi3G38e97vRqHSRElkLTwZHrjY

[VOTE] Release Apache DataFusion sqlparser-rs 0.55.0 RC1

2025-02-27 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.55.0. This release candidate is based on commit: ed416548dcfe4a73a3240bbf625fb9010a4925c8 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify

Re: Blog Post for 45 Release

2025-02-25 Thread Andrew Lamb
iu > > On Sun, Feb 23, 2025 at 5:16 AM Andrew Lamb > wrote: > > > Hello DataFusion community. > > > > Bruce has created a blog post for our most recent release[1]. > > > > It looks quite good in my opinion and I plan to merge / publish it > > t

Blog Post for 45 Release

2025-02-23 Thread Andrew Lamb
Hello DataFusion community. Bruce has created a blog post for our most recent release[1]. It looks quite good in my opinion and I plan to merge / publish it tomorrow. Please leave any comments you may have or let us know if you would like more time to review Andrew [1]: https://github.com/apach

[RESULT] [VOTE] Release DataFusion Python Bindings 45.2.0 RC2

2025-02-23 Thread Andrew Lamb
> Hey folks, > > > > > > Following up on the conversation about pyarrow, v19.0.1 has just been > > > released on pypi, https://pypi.org/project/pyarrow/. > > > I reran the test suite using `pyarrow==19.0.1` and verified that all > > tests > > > passed. >

[DISCUSS] Statistics Rework

2025-02-21 Thread Andrew Lamb
Hello DataFusion(ers?) There is a PR[1] that proposes a significant statistics rework. Please review and leave comments there if you are interested. [1]: https://github.com/apache/datafusion/pull/14699

Re: [VOTE] Release DataFusion Python Bindings 45.2.0 RC2

2025-02-18 Thread Andrew Lamb
+1 (binding) I ran the release verification script and it worked well for me on a M3 mac Thanks Tim and everyone else who is verifying these releases (Kevin it is great to see you here, and L.C. your voting participation is amazing!) Andrew On Mon, Feb 17, 2025 at 8:01 PM Kevin Liu wrote: > +

Re: [VOTE] Release Apache DataFusion Comet 0.6.0 RC1

2025-02-14 Thread Andrew Lamb
+1 (binding) I looked through the release notes and it is nice to see the list of contributors! Verified on an M3 Mac On Fri, Feb 14, 2025 at 2:27 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache DataFusion Comet version 0.6.0. > > This release candidate is based on c

Re: [RESULT][VOTE] Release DataFusion Python Bindings 44.0.0 RC1

2025-02-11 Thread Andrew Lamb
I have published version 44 now to crates.io: https://crates.io/crates/datafusion-python/44.0.0 Thanks for the ping Kevin Andrew On Tue, Feb 11, 2025 at 2:45 PM Andrew Lamb wrote: > I think it is an oversight -- it appears only Andy Grove is the only owner > of that crate so only

Re: [RESULT][VOTE] Release DataFusion Python Bindings 44.0.0 RC1

2025-02-11 Thread Andrew Lamb
, Feb 7, 2025 at 7:51 AM Kevin Liu wrote: > > > Late to the party, I just joined the devlist. > > Thanks everyone 🎉! I see v44.0.0 in pypi > > https://pypi.org/project/datafusion/ > > > > Best, > > Kevin Liu > > > > On Fri, Feb 7, 2025 at 7:42 AM

Re: [RESULT] [VOTE] Release Apache DataFusion 45.0.0 RC1

2025-02-07 Thread Andrew Lamb
Thanks Kevin On Fri, Feb 7, 2025 at 10:59 AM Kevin Liu wrote: > Cheers! Thanks for all the hard work and the super fast release process. > > Best, > Kevin Liu > > On Fri, Feb 7, 2025 at 7:50 AM Andrew Lamb wrote: > > > (resending with correct subject) > > &g

[RESULT] [VOTE] Release Apache DataFusion 45.0.0 RC1

2025-02-07 Thread Andrew Lamb
(resending with correct subject) On Fri, Feb 7, 2025 at 10:49 AM Andrew Lamb wrote: > With 4 +1 votes (3 binding) the release is approved! > > The release is available here: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-45.0.0 > > I have also publis

Re: [VOTE] Release Apache DataFusion 45.0.0 RC1

2025-02-07 Thread Andrew Lamb
hope this one is epic (and a low drama release) Andrew On Tue, Feb 4, 2025 at 12:37 PM Andrew Lamb wrote: > Awesome -- thank you for the report > > On Tue, Feb 4, 2025 at 12:19 PM Kevin Liu wrote: > >> Another data point: >> I've tested 45.0.0 RC1 against icebe

Re: [RESULT][VOTE] Release DataFusion Python Bindings 44.0.0 RC1

2025-02-07 Thread Andrew Lamb
🎉 On Fri, Feb 7, 2025 at 10:40 AM Tim Saucer wrote: > Thank you, Andrew. Andy gave me pypi access and I've published it. > > Best, > Tim > > On Fri, Feb 7, 2025 at 9:01 AM Andrew Lamb wrote: > > > With 5+1 votes (3 binding) the release is approved! > >

[RESULT][VOTE] Release DataFusion Python Bindings 44.0.0 RC1

2025-02-07 Thread Andrew Lamb
With 5+1 votes (3 binding) the release is approved! Success! The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-python-44.0.0 I did not upload the artifacts to pypi / other repositories as I don't know how to do so. Maybe Tim you can help here. Thank

[DISCUSS] Checking in Cargo.lock

2025-02-04 Thread Andrew Lamb
BTW @mbrobbel has a nice PR to check in Cargo.lock and bring datafusion-cli part of the workspace. Please leave comments on the PR if interested: https://github.com/apache/datafusion/pull/14483 Thanks, Andrew

Re: [VOTE] Release Apache DataFusion 45.0.0 RC1

2025-02-04 Thread Andrew Lamb
ache/datafusion-comet/pull/1364 > > > > Thanks, Andrew! > > > > On Mon, Feb 3, 2025 at 3:45 PM L. C. Hsieh wrote: > > > > > +1 (binding) > > > > > > Verified on M4 Mac. > > > > > > Thanks Andrew. > > > > > >

[VOTE] Release Apache DataFusion 45.0.0 RC1

2025-02-03 Thread Andrew Lamb
Hi, The releases are coming fast and furious. I would like to propose a release of Apache DataFusion version 45.0.0. This release candidate is based on commit: 26058ac024095ad8852eb3a8ab707ac09a02e8d7 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at

Re: [VOTE] Release DataFusion Python Bindings 44.0.0 RC1

2025-02-03 Thread Andrew Lamb
-python/pull/1012 On Sun, Feb 2, 2025 at 8:05 PM Tim Saucer wrote: > Ah, I didn’t see that I needed to do that. I’ll upload in the morning. > Thank you for catching the issue. > > > On Feb 2, 2025, at 7:24 PM, Andrew Lamb wrote: > > > > Thanks for doing this Tim! >

Re: [VOTE] Release DataFusion Python Bindings 44.0.0 RC1

2025-02-02 Thread Andrew Lamb
Thanks for doing this Tim! As we have met in person, perhaps we could/should have a keysigning party (aka zoom call) where I can sign and add your keys One thing I noticed is that I can't find the key used for for keysigning andrewlamb@Andrews-MacBook-Pro-2:~/Downloads$ gpg --verify apache-dataf

[RESULT] [VOTE] Release Apache DataFusion sqlparser-rs 0.54.0 RC1

2025-01-23 Thread Andrew Lamb
-sqlparser-rs-0.54.0 I have also published it to crates.io: https://crates.io/crates/sqlparser/0.54.0 Andrew On Tue, Jan 21, 2025 at 12:56 AM L. C. Hsieh wrote: > +1 (binding) > > Verified on Intel Mac. > > Thanks Andrew. > > On Mon, Jan 20, 2025 at 8:44 AM Andrew Lamb > wrot

Proposed API changes to ParquetExec, CsvExec, etc

2025-01-23 Thread Andrew Lamb
There is a large proposed API change[1] to ParquetExec, CsvExec, etc: -- please leave comments on the PR if you are interested [1]: https://github.com/apache/datafusion/pull/14224

[ANNOUNCE] New DataFusion committer: Yongting You (2010YOUY01)

2025-01-21 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Yongting You has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions!

[VOTE] Release Apache DataFusion sqlparser-rs 0.54.0 RC1

2025-01-20 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.54.0. This release candidate is based on commit: 4be9bcc0b6ddd334be49da92aaafab94259946d9 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Note this RC needed a sm

[DISCUSSION] Link to Discord #hiring channel

2025-01-18 Thread Andrew Lamb
There is a PR[1] proposing putting a link to the #hiring channel on the website https://datafusion.apache.org/ Please feel free to add your comments if you have any opinions on the matter Andrew [1]: https://github.com/apache/datafusion/pull/14191

Re: [VOTE] Release Apache DataFusion Ballista 43.0.0 RC2

2025-01-16 Thread Andrew Lamb
+1 (binding) I verified on M3 mac Thanks Andy! On Thu, Jan 16, 2025 at 9:55 AM Andy Grove wrote: > Hi Liang-Chi, > > It looks like you don't have the latest verify script from main. There was > a recent commit to fix this issue: > > > https://github.com/apache/datafusion-ballista/commit/3b789d

Re: [VOTE] Release Apache DataFusion Comet 0.5.0 RC1

2025-01-14 Thread Andrew Lamb
+1 (binding) I verified on an m3 mac. Looks like another good release Thank you Andy On Tue, Jan 14, 2025 at 3:12 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andy. > > On Tue, Jan 14, 2025 at 11:24 AM Andy Grove > wrote: > > > > Hi, > > > > I would like to propose

Re: PGQ discussion on agenda for this week's community call

2025-01-13 Thread Andrew Lamb
Sounds like a great topic. I will be very excited to hear about it! On Mon, Jan 13, 2025 at 7:06 PM Andy Grove wrote: > Semyon Grigorev would like to discuss PGQ on this week's community call. If > this is a topic that you are interested in or have views on, you may want > to attend. > > Call de

Re: Proposal: Investigate Dosu installation on Datafusion repositories

2025-01-05 Thread Andrew Lamb
Sounds like an interesting idea to try in my opinion. Thanks for bringing it up Edmondo On Sun, Jan 5, 2025 at 11:48 AM Edmondo Porcu wrote: > Hello, > > I have recently discovered an AI Github Assistant called https://dosu.dev/ > which helps with auto-labeling, issue-triage and QA. > > - It is

[RESULT][VOTE] Release Apache DataFusion 44.0.0 RC2

2024-12-31 Thread Andrew Lamb
(resending with updated subject) On Tue, Dec 31, 2024 at 4:57 PM Andrew Lamb wrote: > with 6 +1 votes (4 binding) the release is approved! > > The release is available here: > https://dist.apache.org/repos/dist/release/datafusion/datafusion-44.0.0 > > I have also publis

Re: [VOTE] Release Apache DataFusion 44.0.0 RC2

2024-12-31 Thread Andrew Lamb
with 6 +1 votes (4 binding) the release is approved! The release is available here: https://dist.apache.org/repos/dist/release/datafusion/datafusion-44.0.0 I have also published the release to crates.io Thank you very much to everyone who helped make this release happen, both with contribution

[VOTE] Release Apache DataFusion 44.0.0 RC2

2024-12-28 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 44.0.0. Note this is RC2 (RC1 had an issue[5], thanks Tim Saucer for finding and fixing) The 44.0.0 release is tracked with [4] This release candidate is based on commit: 3cc3fca31e6edc2d953e663bfd7f856bcb70d8c4 [1] The proposed

Re: [VOTE] Release Apache DataFusion 44.0.0 RC1

2024-12-28 Thread Andrew Lamb
6 AM Xudong Wang wrote: > > > +1 (non-binding) > > > > Verified on M1 Mac. > > > > Thanks Andrew > > > > On 2024/12/25 12:06:25 Andrew Lamb wrote: > > > Hi, > > > > > > I would like to propose a release of Apache DataFusion version 44.0.

Re: [PR] adding sqlite data files [datafusion-testing]

2024-12-27 Thread Andrew Lamb
In case anyone else is curious, I believe Bruce updated .asf.yaml to send these notices to the github mailing list rather than the dev mailing list https://github.com/apache/datafusion-testing/blob/main/.asf.yaml On Thu, Dec 26, 2024 at 4:56 PM Omega359 (via GitHub) wrote: > > Omega359 opened a

[VOTE] Release Apache DataFusion 44.0.0 RC1

2024-12-25 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 44.0.0. This release candidate is based on commit: 073a3b110852f97ccb7085ce4bfd19473b8a3f4f [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. Please download, verify checksums and

[RESULT] [VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

2024-12-18 Thread Andrew Lamb
: https://crates.io/crates/sqlparser/0.53.0 Thanks again, Andrew On Wed, Dec 18, 2024 at 12:37 PM Andy Grove wrote: > +1 (binding) > > I ran into the same issue with cargo publish but commented that out. > > Thanks, Andrew. > > On Thu, Dec 12, 2024 at 1:58 PM Andrew Lamb >

[ANNOUNCE] New DataFusion PMC member: Jonah Gao

2024-12-17 Thread Andrew Lamb
The Project Management Committee (PMC) for Apache DataFusion has invited Jonah Gao to become a PMC member and we are pleased to announce that Jonah Gao has accepted. Congratulations and welcome!

Re: [VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

2024-12-12 Thread Andrew Lamb
Thank you for sticking with it :pray: On Thu, Dec 12, 2024 at 2:17 PM L. C. Hsieh wrote: > Okay. Once commented out the `cargo publish` step, it is okay. > > +1 (binding) > > Verified on M3 Mac. > > Thanks Andrew. > > On Thu, Dec 12, 2024 at 11:00 AM Andr

Re: [VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

2024-12-12 Thread Andrew Lamb
rser-rs-0.53.0.X.JaesmyIQIo/apache-datafusion-sqlparser-rs-0.53.0/derive/src/ > > > lib.rs:267: > > > > > > } > > > > > > > > > > > > fn is_option(ty: &Type) -> bool { > > > > > > -if let Type::Path(TypePath { path: Path

Re: [VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

2024-12-12 Thread Andrew Lamb
t; +.. > > +}) = ty > > +{ > > if let Some(segment) = segments.last() { > > if segment.ident == "Option" { > > if let PathArguments::AngleBracketed(args) = > &segment.arguments { > > ``` > > On Thu,

[VOTE] Release Apache DataFusion sqlparser-rs 0.53.0 RC2

2024-12-12 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.53.0. Notes: 1. This is RC2 (RC1 hit [6]) 2. there is a known, but I don't think blocking, issue with the verification script[7] This release candidate is based on commit: e7d2c852918fe273a4f13288eae3c95cc99dff30 [

[ANNOUNCE] New DataFusion committer: Ruiqiu Cao (Rachelint)

2024-12-10 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Ruiqiu Cao (Rachelint) has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

Re: [VOTE] Release DataFusion Python Bindings 43.1.0 RC2

2024-12-07 Thread Andrew Lamb
+1 (binding) I verified on an M3 mac. Thanks everyone. One thing I noticed is that this is version 43.1.0, not 43.0.0 -- it wasn't quite clear from the changelog that 43.0.0 was not released https://github.com/apache/datafusion-python/tree/3afdd372447d6f43811ad3389c3cb1600ed1c697/dev/changelog

Re: [DISCUSS] Jonah Gao for PMC

2024-12-03 Thread Andrew Lamb
I apologize I sent this to the wrong list :( On Tue, Dec 3, 2024 at 7:38 AM Andrew Lamb wrote: > I would like to propose adding Jonah Gao[1] to the DataFusion PMC. > > Jonah has been a committer since April 2024, has a strong and sustained > contribution record for more than a ye

[DISCUSS] Jonah Gao for PMC

2024-12-03 Thread Andrew Lamb
I would like to propose adding Jonah Gao[1] to the DataFusion PMC. Jonah has been a committer since April 2024, has a strong and sustained contribution record for more than a year. He helps care and fix bugs in the SQL layer, and has helped review many pull requests[3][4] in addition to his own st

[ANNOUNCE] New DataFusion committer: Piotr Findeisen (findepi)

2024-12-03 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Piotr Findeisen has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions! Andrew

[CROWDSOURCING] 2024-12-11 DataFusion ASF Board Report

2024-12-03 Thread Andrew Lamb
It's time again to provide another board report. As a reminder, the primary reason for these reports is for the board to make sure the project is ok. The actual project details are more likely helpful for other members of the project than the board. With that being said, please feel free to prov

Re: [VOTE] Release DataFusion Python Bindings 43.0.0 RC1

2024-12-02 Thread Andrew Lamb
+1 (binding) I verified on a M3 mac. Thanks Andy One thing I noticed is that the commit [1] [1]: https://github.com/apache/datafusion-python/tree/09b2f490e774339e1a00f9c620f7374916f3898e Reports that: > This commit does not belong to any branch on this repository, and may belong to a fork out

Re: [VOTE] Release Apache DataFusion Comet 0.4.0 RC1

2024-11-15 Thread Andrew Lamb
+1 (binding) I looked at the release notes and ran the verification script. Looks like a good release Andrew On Fri, Nov 15, 2024 at 4:18 PM Andy Grove wrote: > Hi, > > I would like to propose a release of Apache DataFusion Comet version 0.4.0. > > This release candidate is based on commit: >

[RESULT][VOTE] Release Apache DataFusion sqlparser-rs 0.52.0 RC3

2024-11-11 Thread Andrew Lamb
On Fri, Nov 8, 2024 at 9:56 AM Andy Grove wrote: > +1 (binding) > > Verified on Ubuntu 22.04 > > Thanks, Andrew. > > On Thu, Nov 7, 2024 at 10:06 AM L. C. Hsieh wrote: > > > +1 (binding) > > > > Verified on M3 Mac. > > > > Thanks Andr

Re: [VOTE] Release Apache DataFusion 43.0.0 RC1

2024-11-08 Thread Andrew Lamb
Wayne, do you think we file tickets for the issues you found? On Wed, Nov 6, 2024 at 4:06 AM Wayne Xia wrote: > +1 (binding) > > Verified on AMD64 ArchLinux. Thanks all for pushing this forward! > > Two unrelated issues in verifying the release: > - It requires too much memory to run (over 128GB

[VOTE] Release Apache DataFusion sqlparser-rs 0.52.0 RC3

2024-11-07 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion sqlparser-rs version 0.52.0. Note this is RC*3* . This is the first release proposed as part of the DataFusion project. Again, huge thanks to Ifeanyi Ubah for helping making this happen This release candidate is based on commit: 334a5bf

[ANNOUNCE] New DataFusion committer: Ifeanyi Ubah

2024-11-05 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Ifeanyi Ubah has accepted an invitation to become a committer on Apache DataFusion. Ifeanyi has reviewed many many PRs in sqparser[1] and helped move that project along immensely. Welcome, and thank you for your contributions! Andrew [

Re: [VOTE] Release Apache DataFusion 43.0.0 RC1

2024-11-05 Thread Andrew Lamb
+1 (binding) > This release consists of 403 commits from 96 contributors. See credits at the end of this changelog for more information. https://github.com/apache/datafusion/blob/88f58bf929167c5c5e2250ad87caa88d4dff11e5/dev/changelog/43.0.0.md Pretty epic 🤩 Thanks Andy and everyone else who mad

Re: [VOTE] Release Apache DataFusion 42.2.0 RC1

2024-11-04 Thread Andrew Lamb
: > +1 (binding) > > Verified on M3 Mac. > > Thanks Andrew. > > On Thu, Oct 31, 2024 at 5:41 AM Andrew Lamb > wrote: > > > > Hi, > > > > I would like to propose a release of Apache DataFusion version 42.2.0. &

Re: Bugs to close

2024-11-02 Thread Andrew Lamb
> What is the “Apache way” concerning closing out old issues? > DataFusion has a surprisingly large number of open issues. Of the 243 open issues labelled as a bug, here are 12 that should be closed. I think we are just waiting for someone to help curate / review them. As you know it takes time to

[VOTE] Release Apache DataFusion 42.2.0 RC1

2024-10-31 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 42.2.0. This release candidate is based on commit: a43ce8bd67e8d649e0e4f5260f8a5e6e10d62dbc [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. This release has a single fix to disa

Re: [RESULT] [VOTE] Release Apache DataFusion 42.1.0 RC1

2024-10-20 Thread Andrew Lamb
Update -- Andy has helped me get the permissions needed and the release is now also available on crates.io: https://crates.io/crates/datafusion/42.1.0 Andrew On Sun, Oct 20, 2024 at 1:44 PM Andrew Lamb wrote: > With 4 +1 votes (3 binding) the release is approved > > The release is

[RESULT] [VOTE] Release Apache DataFusion 42.1.0 RC1

2024-10-20 Thread Andrew Lamb
out to Andy and hopefully can get it resolved shortly Andrew On Thu, Oct 17, 2024 at 2:26 PM L. C. Hsieh wrote: > +1 (binding) > > Verified on M1 Mac. > > Thanks Andrew. > > On Thu, Oct 17, 2024 at 7:08 AM Andrew Lamb wrote: > > > > Hi, > > > >

Re: [ANNOUNCE] New DataFusion committer: Jax Liu (goldmedal)

2024-10-19 Thread Andrew Lamb
! > > On 2024/10/17 18:13:49 Andrew Lamb wrote: > > On behalf of the DataFusion PMC, I'm happy to announce that Jax Liu > > has accepted an invitation to become a committer on Apache > > DataFusio

[ANNOUNCE] New DataFusion committer: Jax Liu (goldmedal)

2024-10-17 Thread Andrew Lamb
On behalf of the DataFusion PMC, I'm happy to announce that Jax Liu has accepted an invitation to become a committer on Apache DataFusion. Welcome, and thank you for your contributions!

[VOTE] Release Apache DataFusion 42.1.0 RC1

2024-10-17 Thread Andrew Lamb
Hi, I would like to propose a release of Apache DataFusion version 42.1.0. This release candidate is based on commit: 0011f450ada49fc3b724887eda14a788ec582f53 [1] The proposed release tarball and signatures are hosted at [2]. The changelog is located at [3]. The rationale for the release is locat

Re: Major and minor release process

2024-10-16 Thread Andrew Lamb
Thanks Andy -- this is a great idea. Also thanks for hosting the sync Kudos to Matthew and Xuanwo for starting to do this process for 41.1.0[1], so hopefully we'll have another concrete example to follow shortly. I hope to make a release candidate from the branch in the next few days. Andrew [

Re: [VOTE] Release DataFusion Python Bindings 42.0.0 RC1

2024-10-08 Thread Andrew Lamb
+1 (binding) This looks like a great release to me. Thanks Tim and Andy for keeping things moving along. Verified on an m3 mac Andrew On Tue, Oct 8, 2024 at 5:23 AM Tim Saucer wrote: > +1 non-binding > > Verified on m2 mac in python 3.10 and 3.12. > > Note: We need to add one line in the upda

Re: Interest in re-starting a weekly DataFusion sync call?

2024-10-02 Thread Andrew Lamb
+1 -- I will attempt to join as well On Wed, Oct 2, 2024 at 2:11 PM Edmondo Porcu wrote: > +1 > > > > On Wed, Oct 2, 2024 at 12:21 PM Andy Grove wrote: > > > Hi, > > > > I have been hosting a Comet-specific community meeting, but the turnout > is > > pretty low. Rather than cancelling these mee

Re: IP clearance for sqlparser-rs donation

2024-09-25 Thread Andrew Lamb
Ah, thank you! On Wed, Sep 25, 2024 at 9:18 AM Andy Grove wrote: > Yes. I'm sorry, I should have posted a link when I started the vote. > > https://lists.apache.org/thread/4qhyk23d0g01g3ccsffsxygwd6vj9b8k > > On Wed, Sep 25, 2024 at 6:57 AM Andrew Lamb > wrote: > &

Re: IP clearance for sqlparser-rs donation

2024-09-25 Thread Andrew Lamb
Andy I haven't seen the vote thread come through on my email and I couldn't find it in the archives[1] Did it go to a different mailing list? [1]: https://lists.apache.org/list.html?dev@datafusion.apache.org On Mon, Sep 23, 2024 at 1:42 PM Andrew Lamb wrote: > Sounds good -

Re: [VOTE] Release Apache DataFusion Comet 0.3.0 RC1

2024-09-25 Thread Andrew Lamb
+1 Thanks Andy I verified this on a M3 Mac. Andrew On Tue, Sep 24, 2024 at 11:41 PM Andy Grove wrote: > Thanks for letting me know. Something seems to have changed with my local > gpg installation and the signing had failed. > > I had to add "--pinentry-mode loopback”. I will create a PR tomor

  1   2   >