Thank you to everyone who helped with the report. I have submitted it now to the ASF board. The final report content is below
Andrew ----- ## Description: The mission of Apache DataFusion is the creation and maintenance of software related to an extensible query engine ## Project Status: Current project status: New + Ongoing (high activity) Issues for the board: None ## Membership Data: Apache DataFusion was founded 2024-04-16 (2 years ago) There are currently 61 committers and 24 PMC members in this project. The Committer-to-PMC ratio is roughly 8:3. Community changes, past quarter: - Matt Butrovich was added to the PMC on 2026-06-15 - Qi Zhu was added to the PMC on 2026-08-04 - Adam Gutglick was added as committer on 2026-07-20 - Manu Zhang was added as committer on 2026-08-20 - Neil Conway was added as committer on 2026-06-14 ## Project Activity: Note that almost all communication for DataFusion and its subprojects happens on github and so our dev mailing list traffic is fairly light. ### DataFusion core https://github.com/apache/datafusion 55.0.0 was released on 2026-08-18. 54.1.0 was released on 2026-07-18. 54.0.0 was released on 2026-06-08. Our releases now consist of contributions from over 170 distinct contributors (was 120), and we average around [11.2 commits per day] to the main repo (up from [9.2 commits per day]) [11.2 commits per day]: git rev-list \ --count apache/main --since='2026-06-09 00:00:00' \ --until='2026-09-08 23:59:59' [9.2 commits per day]: git rev-list \ --count apache/main --since='2026-03-10 00:00:00' \ --until='2026-06-08 23:59:59' The community continues to write blogs highlighting our work, see https://datafusion.apache.org/blog/ Likewise we continue to hold in person meetups as community members have bandwidth to organize them, see: https://datafusion.apache.org/user-guide/concepts-readings-events.html#community-events We have been discussing the best process and setup to help maintain the Apache Iceberg’s Rust Implementation’s DataFusion Integration. The communities are working together to find a consensus solution. See the [mailing list topic] for more details [mailing list topic]: https://lists.apache.org/thread/53lqjw7371myww42l19vx923cjzrgg68 ### Sub project: DataFusion Python https://github.com/apache/datafusion-python DATAFUSION-PYTHON-54.0.0 was released on 2026-06-29. ### Sub project: DataFusion Java https://github.com/apache/datafusion-java There has been very little activity this quarter, since this is a new subproject (created in the previous quarter) and is not widely known about or adopted yet. ### Sub project: DataFusion Comet https://github.com/apache/datafusion-comet COMET-1.0.0 was released on 2026-08-07. COMET-0.17.1 was released on 2026-07-17. COMET-0.17.0 was released on 2026-06-20. Comet reached its 1.0.0 milestone this quarter. You can read about the recent happenings in Comet in the release blogs: https://datafusion.apache.org/blog/2026/08/07/datafusion-comet-1.0.0 https://datafusion.apache.org/blog/2026/06/20/datafusion-comet-0.17.0 The community also published a post about their experience running Spark workloads with Comet on Amazon EKS: https://datafusion.apache.org/blog/2026/06/03/comet-eks There is a discussion about promoting Comet to a top level ASF project: https://github.com/apache/datafusion-comet/issues/5184 ### Sub project: DataFusion Ballista https://github.com/apache/datafusion-ballista BALLISTA-54.1.0 was released on 2026-08-09. BALLISTA-54.0.0 was released on 2026-07-15. Release blog posts: Apache DataFusion Ballista 54.0.0 Released Apache DataFusion Ballista 54.1.0 Released Ballista has seen an increase in activity in this quarter, with 13 first time contributors, and a 64% increase in merged PRs as of 8/27 (366 PRs merged vs 223 in previous quarter). Active areas of work include: Adaptive Query Execution (AQE): AQE is now enabled by default, with dynamic join selection, and broadcast joins. Stability: New HA chaos harness, improvements to recovery from executor loss. TPC-H and TPC-DS are now tested in CI to avoid regressions Performance: Shuffle implementation improved, order-preserving range partitioning, KLL sketches for runtime stats. Multi-partition tasks, parallel window functions Usability: Upgrade guide, generated configuration docs, improved kubernetes support & documentation ### Sub project: sqlparser-rs https://github.com/apache/datafusion-sqlparser-rs There were no new sqlparser-rs releases this quarter (SQLPARSER-0.62.0 was released on 2026-05-27). We plan the next one in September 2026. We are actively working to help Ifeanyi Ubah (iffyio), the primary maintainer, to identify additional community members who can help maintain the project. ## Community Health: The rise of AI coding tools, and the popularity of DataFusion in the ecosystem means we are moving code faster than ever before. Our code review capacity is never enough, but we have many active committers, and the community in general helps each other out with reviews. We continue to actively grow our committer and PMC ranks and the future looks bright. We continue to merge multiple PRs a day from multiple committers and have contributions from a wide variety of individuals with a wide variety of employers, organizations, and backgrounds. Recently, we have had some bursts of spam PRs, where multiple PRs are opened by new contributors in a short amount of time, with no follow up on any PR feedback. We have been discussing if a new "Policy on uptick of LLM PRs from new contributors" is warranted. See [24413] for more details [24413]: https://github.com/apache/datafusion/discussions/24413 On Thu, Aug 27, 2026 at 9:25 AM Andrew Lamb <[email protected]> wrote: > Hello, > > Our quarterly ASF board report is coming up. > > I have prepared a draft document here[1] and copy pasted its current > contents below. The tracking ticket is at [2] > > As always, we welcome any and all community input. Please provide your > feedback by September 9, 2026, either by proposing changes in the google > doc, or by responding to this email > > Andrew > > > [1]: > https://docs.google.com/document/d/14HB7XRQiNQe5ghxUThqW6rMSj5mDqkQkvXVpgCIYMP8 > [2]: https://github.com/apache/datafusion/issues/22889 > > > ------- > > > ## Description: > The mission of Apache DataFusion is the creation and maintenance of > software > related to an extensible query engine > > ## Project Status: > Current project status: New + Ongoing (high activity) > Issues for the board: None > > ## Membership Data: > > Apache DataFusion was founded 2024-04-16 (2 years ago) > There are currently 61 committers and 24 PMC members in this project. > The Committer-to-PMC ratio is roughly 8:3. > > Community changes, past quarter: > - Matt Butrovich was added to the PMC on 2026-06-15 > - Qi Zhu was added to the PMC on 2026-08-04 > - Adam Gutglick was added as committer on 2026-07-20 > - Manu Zhang was added as committer on 2026-08-20 > - Neil Conway was added as committer on 2026-06-14 > > ## Project Activity: > Note that almost all communication for DataFusion and its subprojects > happens > on github and so our dev mailing list traffic is fairly light. > > ### DataFusion core > https://github.com/apache/datafusion > 55.0.0 was released on 2026-08-18. > 54.1.0 was released on 2026-07-18. > 54.0.0 was released on 2026-06-08. > > Our releases now consist of contributions from over 170 distinct > contributors (was 120), and we average around [11.2 commits per day] to the > main repo (up from [9.2 commits per day]) > > [11.2 commits per day]: git rev-list --count apache/main > --since='2026-06-09 00:00:00' --until='2026-09-08 23:59:59' (measured > 2026-08-27: 883 commits / 79 days) > [9.2 commits per day]: git rev-list --count apache/main > --since='2026-03-10 00:00:00' --until='2026-06-08 23:59:59' > > The community continues to write blogs highlighting our work, see > https://datafusion.apache.org/blog/ > > Likewise we continue to hold in person meetups as community members have > bandwidth to organize them, see: > > https://datafusion.apache.org/user-guide/concepts-readings-events.html#community-events > > We have been discussing the best process and setup to help maintain the > Apache Iceberg’s Rust Implementation’s DataFusion Integration. The > communities are working together to find a consensus solution. See the > [mailing list topic] for more details > > [mailing list topic]: > https://lists.apache.org/thread/53lqjw7371myww42l19vx923cjzrgg68 > > ### Sub project: DataFusion Python > > https://github.com/apache/datafusion-python > DATAFUSION-PYTHON-54.0.0 was released on 2026-06-29. > > [TODO: DataFusion Python highlights this quarter] > > ### Sub project: DataFusion Java > > https://github.com/apache/datafusion-java > > [TODO: DataFusion Java highlights this quarter (added as a subproject last > quarter)] > > ### Sub project: DataFusion Comet > > https://github.com/apache/datafusion-comet > COMET-1.0.0 was released on 2026-08-07. > COMET-0.17.1 was released on 2026-07-17. > COMET-0.17.0 was released on 2026-06-20. > > Comet reached its 1.0.0 milestone this quarter. You can read about the > recent happenings in Comet in the release blogs: > https://datafusion.apache.org/blog/2026/08/07/datafusion-comet-1.0.0 > https://datafusion.apache.org/blog/2026/06/20/datafusion-comet-0.17.0 > > The community also published a post about their experience running Spark > workloads with Comet on Amazon EKS: > https://datafusion.apache.org/blog/2026/06/03/comet-eks > > ### Sub project: DataFusion Ballista > > https://github.com/apache/datafusion-ballista > BALLISTA-54.1.0 was released on 2026-08-09. > BALLISTA-54.0.0 was released on 2026-07-15. > > [TODO: Ballista highlights this quarter] > > ### Sub project: sqlparser-rs > > https://github.com/apache/datafusion-sqlparser-rs > > There were no new sqlparser-rs releases this quarter (SQLPARSER-0.62.0 was > released on 2026-05-27). We plan the next one in September 2026. > > We are actively working to help Ifeanyi Ubah (iffyio), the primary > maintainer, to identify additional community members who can help maintain > the project. > > ## Community Health: > > The rise of AI coding tools, and the popularity of DataFusion in the > ecosystem means we are moving code faster than ever before. Our code review > capacity is never enough, but we have many active committers, and the > community in general helps each other out with reviews. We continue to > actively grow our committer and PMC ranks and the future looks bright. > > We continue to merge multiple PRs a day from multiple committers and > have contributions from a wide variety of individuals with a wide > variety of employers, organizations, and backgrounds. Recently, we have > had some bursts of spam PRs, where multiple PRs are opened by new > contributors in a short amount of time, with no follow up on any PR > feedback. We have been discussing if a new "Policy on uptick of LLM PRs > from new contributors" is warranted. See [24413] for more details > > [24413]: https://github.com/apache/datafusion/discussions/24413 > > >
