Thanks for preparing that, Andrew! > On Sep 9, 2026, at 8:52 AM, Andrew Lamb <[email protected]> wrote: > > Thank you to everyone who helped with the report. I have submitted it now > to the ASF board. The final report content is below > > Andrew > > ----- > > ## Description: > The mission of Apache DataFusion is the creation and maintenance of software > related to an extensible query engine > > ## Project Status: > Current project status: New + Ongoing (high activity) > Issues for the board: None > > ## Membership Data: > > Apache DataFusion was founded 2024-04-16 (2 years ago) > There are currently 61 committers and 24 PMC members in this project. > The Committer-to-PMC ratio is roughly 8:3. > > Community changes, past quarter: > - Matt Butrovich was added to the PMC on 2026-06-15 > - Qi Zhu was added to the PMC on 2026-08-04 > - Adam Gutglick was added as committer on 2026-07-20 > - Manu Zhang was added as committer on 2026-08-20 > - Neil Conway was added as committer on 2026-06-14 > > ## Project Activity: > Note that almost all communication for DataFusion and its subprojects > happens > on github and so our dev mailing list traffic is fairly light. > > ### DataFusion core > https://github.com/apache/datafusion > > 55.0.0 was released on 2026-08-18. > 54.1.0 was released on 2026-07-18. > 54.0.0 was released on 2026-06-08. > > Our releases now consist of contributions from over 170 distinct > contributors > (was 120), and we average around [11.2 commits per day] to the main repo (up > from [9.2 commits per day]) > > [11.2 commits per day]: git rev-list \ > --count apache/main --since='2026-06-09 00:00:00' \ > --until='2026-09-08 > 23:59:59' > [9.2 commits per day]: git rev-list \ > --count apache/main --since='2026-03-10 00:00:00' \ > --until='2026-06-08 > 23:59:59' > > The community continues to write blogs highlighting our work, see > https://datafusion.apache.org/blog/ > > Likewise we continue to hold in person meetups as community members have > bandwidth to organize them, see: > https://datafusion.apache.org/user-guide/concepts-readings-events.html#community-events > > We have been discussing the best process and setup to help maintain the > Apache > Iceberg’s Rust Implementation’s DataFusion Integration. The communities are > working together to find a consensus solution. See the [mailing list topic] > for more details > > [mailing list topic]: > https://lists.apache.org/thread/53lqjw7371myww42l19vx923cjzrgg68 > > ### Sub project: DataFusion Python > > https://github.com/apache/datafusion-python > > DATAFUSION-PYTHON-54.0.0 was > released on 2026-06-29. > > ### Sub project: DataFusion Java > > https://github.com/apache/datafusion-java > > There has been very little activity this quarter, since this is a new > subproject (created in the previous quarter) and is not widely known about > or > adopted yet. > > ### Sub project: DataFusion Comet > > https://github.com/apache/datafusion-comet > > COMET-1.0.0 was released on > 2026-08-07. COMET-0.17.1 was released on 2026-07-17. COMET-0.17.0 was > released > on 2026-06-20. > > Comet reached its 1.0.0 milestone this quarter. You can read about the > recent > happenings in Comet in the release blogs: > https://datafusion.apache.org/blog/2026/08/07/datafusion-comet-1.0.0 > https://datafusion.apache.org/blog/2026/06/20/datafusion-comet-0.17.0 > > The community also published a post about their experience running Spark > workloads with Comet on Amazon EKS: > https://datafusion.apache.org/blog/2026/06/03/comet-eks > > There is a discussion about promoting Comet to a top level ASF project: > https://github.com/apache/datafusion-comet/issues/5184 > > ### Sub project: DataFusion Ballista > > https://github.com/apache/datafusion-ballista BALLISTA-54.1.0 was released > on > 2026-08-09. BALLISTA-54.0.0 was released on 2026-07-15. > > Release blog posts: Apache DataFusion Ballista 54.0.0 Released Apache > DataFusion Ballista 54.1.0 Released > > Ballista has seen an increase in activity in this quarter, with 13 first > time > contributors, and a 64% increase in merged PRs as of 8/27 (366 PRs merged vs > 223 in previous quarter). > > Active areas of work include: Adaptive Query Execution (AQE): AQE is now > enabled by default, with dynamic join selection, and broadcast joins. > Stability: New HA chaos harness, improvements to recovery from executor > loss. > TPC-H and TPC-DS are now tested in CI to avoid regressions Performance: > Shuffle implementation improved, order-preserving range partitioning, KLL > sketches for runtime stats. Multi-partition tasks, parallel window functions > Usability: Upgrade guide, generated configuration docs, improved kubernetes > support & documentation > > > ### Sub project: sqlparser-rs > > https://github.com/apache/datafusion-sqlparser-rs > > There were no new sqlparser-rs releases this quarter (SQLPARSER-0.62.0 was > released on 2026-05-27). We plan the next one in September 2026. > > We are actively working to help Ifeanyi Ubah (iffyio), the primary > maintainer, > to identify additional community members who can help maintain the project. > > ## Community Health: > > The rise of AI coding tools, and the popularity of DataFusion in the > ecosystem > means we are moving code faster than ever before. Our code review capacity > is > never enough, but we have many active committers, and the community in > general > helps each other out with reviews. We continue to actively grow our > committer > and PMC ranks and the future looks bright. > > We continue to merge multiple PRs a day from multiple committers and have > contributions from a wide variety of individuals with a wide variety of > employers, organizations, and backgrounds. Recently, we have had some bursts > of spam PRs, where multiple PRs are opened by new contributors in a short > amount of time, with no follow up on any PR feedback. We have been > discussing > if a new "Policy on uptick of LLM PRs from new contributors" is warranted. > See > [24413] for more details > > [24413]: https://github.com/apache/datafusion/discussions/24413 > >> On Thu, Aug 27, 2026 at 9:25 AM Andrew Lamb <[email protected]> wrote: >> >> Hello, >> >> Our quarterly ASF board report is coming up. >> >> I have prepared a draft document here[1] and copy pasted its current >> contents below. The tracking ticket is at [2] >> >> As always, we welcome any and all community input. Please provide your >> feedback by September 9, 2026, either by proposing changes in the google >> doc, or by responding to this email >> >> Andrew >> >> >> [1]: >> https://docs.google.com/document/d/14HB7XRQiNQe5ghxUThqW6rMSj5mDqkQkvXVpgCIYMP8 >> [2]: https://github.com/apache/datafusion/issues/22889 >> >> >> ------- >> >> >> ## Description: >> The mission of Apache DataFusion is the creation and maintenance of >> software >> related to an extensible query engine >> >> ## Project Status: >> Current project status: New + Ongoing (high activity) >> Issues for the board: None >> >> ## Membership Data: >> >> Apache DataFusion was founded 2024-04-16 (2 years ago) >> There are currently 61 committers and 24 PMC members in this project. >> The Committer-to-PMC ratio is roughly 8:3. >> >> Community changes, past quarter: >> - Matt Butrovich was added to the PMC on 2026-06-15 >> - Qi Zhu was added to the PMC on 2026-08-04 >> - Adam Gutglick was added as committer on 2026-07-20 >> - Manu Zhang was added as committer on 2026-08-20 >> - Neil Conway was added as committer on 2026-06-14 >> >> ## Project Activity: >> Note that almost all communication for DataFusion and its subprojects >> happens >> on github and so our dev mailing list traffic is fairly light. >> >> ### DataFusion core >> https://github.com/apache/datafusion >> 55.0.0 was released on 2026-08-18. >> 54.1.0 was released on 2026-07-18. >> 54.0.0 was released on 2026-06-08. >> >> Our releases now consist of contributions from over 170 distinct >> contributors (was 120), and we average around [11.2 commits per day] to the >> main repo (up from [9.2 commits per day]) >> >> [11.2 commits per day]: git rev-list --count apache/main >> --since='2026-06-09 00:00:00' --until='2026-09-08 23:59:59' (measured >> 2026-08-27: 883 commits / 79 days) >> [9.2 commits per day]: git rev-list --count apache/main >> --since='2026-03-10 00:00:00' --until='2026-06-08 23:59:59' >> >> The community continues to write blogs highlighting our work, see >> https://datafusion.apache.org/blog/ >> >> Likewise we continue to hold in person meetups as community members have >> bandwidth to organize them, see: >> >> https://datafusion.apache.org/user-guide/concepts-readings-events.html#community-events >> >> We have been discussing the best process and setup to help maintain the >> Apache Iceberg’s Rust Implementation’s DataFusion Integration. The >> communities are working together to find a consensus solution. See the >> [mailing list topic] for more details >> >> [mailing list topic]: >> https://lists.apache.org/thread/53lqjw7371myww42l19vx923cjzrgg68 >> >> ### Sub project: DataFusion Python >> >> https://github.com/apache/datafusion-python >> DATAFUSION-PYTHON-54.0.0 was released on 2026-06-29. >> >> [TODO: DataFusion Python highlights this quarter] >> >> ### Sub project: DataFusion Java >> >> https://github.com/apache/datafusion-java >> >> [TODO: DataFusion Java highlights this quarter (added as a subproject last >> quarter)] >> >> ### Sub project: DataFusion Comet >> >> https://github.com/apache/datafusion-comet >> COMET-1.0.0 was released on 2026-08-07. >> COMET-0.17.1 was released on 2026-07-17. >> COMET-0.17.0 was released on 2026-06-20. >> >> Comet reached its 1.0.0 milestone this quarter. You can read about the >> recent happenings in Comet in the release blogs: >> https://datafusion.apache.org/blog/2026/08/07/datafusion-comet-1.0.0 >> https://datafusion.apache.org/blog/2026/06/20/datafusion-comet-0.17.0 >> >> The community also published a post about their experience running Spark >> workloads with Comet on Amazon EKS: >> https://datafusion.apache.org/blog/2026/06/03/comet-eks >> >> ### Sub project: DataFusion Ballista >> >> https://github.com/apache/datafusion-ballista >> BALLISTA-54.1.0 was released on 2026-08-09. >> BALLISTA-54.0.0 was released on 2026-07-15. >> >> [TODO: Ballista highlights this quarter] >> >> ### Sub project: sqlparser-rs >> >> https://github.com/apache/datafusion-sqlparser-rs >> >> There were no new sqlparser-rs releases this quarter (SQLPARSER-0.62.0 was >> released on 2026-05-27). We plan the next one in September 2026. >> >> We are actively working to help Ifeanyi Ubah (iffyio), the primary >> maintainer, to identify additional community members who can help maintain >> the project. >> >> ## Community Health: >> >> The rise of AI coding tools, and the popularity of DataFusion in the >> ecosystem means we are moving code faster than ever before. Our code review >> capacity is never enough, but we have many active committers, and the >> community in general helps each other out with reviews. We continue to >> actively grow our committer and PMC ranks and the future looks bright. >> >> We continue to merge multiple PRs a day from multiple committers and >> have contributions from a wide variety of individuals with a wide >> variety of employers, organizations, and backgrounds. Recently, we have >> had some bursts of spam PRs, where multiple PRs are opened by new >> contributors in a short amount of time, with no follow up on any PR >> feedback. We have been discussing if a new "Policy on uptick of LLM PRs >> from new contributors" is warranted. See [24413] for more details >> >> [24413]: https://github.com/apache/datafusion/discussions/24413 >> >> >>
--------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
