Hello,

The DataFusion ASF board report[1] is due in 2 days (2025-12-10). I have
made a draft at [2] and copy/pasted below. If you have anything to add
please let me know by responding to this email or adding comments directly
in the document.

[1]: https://github.com/apache/datafusion/issues/17506
[2]:
https://docs.google.com/document/d/1UNZNLOGm4FiJ8l_8q6tIJkvyD2nmSpDi4SmtOAIU8qc/


Andrew

-------

2025-12-10 DataFusion ASF Board Report
https://github.com/apache/datafusion/issues/17506

DataFusion PMC Chair Note: Please add any relevant comments / content to
this document. I (Andrew Lamb) will submit to the ASF board on Wed Dec 10,
2025 (about one week prior to the scheduled board meeting).

The format of this report and the metrics are from
https://reporter.apache.org/wizard/?datafusion

The rationale and process for this report:
https://www.apache.org/foundation/board/reporting
Past examples:
2025-09-10 DataFusion ASF Board Report

## Description:
The mission of Apache DataFusion is the creation and maintenance of
software
related to an extensible query engine

## Project Status:
Current project status: New + Ongoing (high activity)
Issues for the board: None

## Membership Data:

Apache DataFusion was founded 2024-04-16 (2 years ago)
There are currently 54 committers and 20 PMC members in this project.
The Committer-to-PMC ratio is roughly 7:3.

Community changes, past quarter:
- Jeffrey Vo was added to the PMC on 2025-11-23
- Yongting You was added to the PMC on 2025-11-23
- Gabriel Musat was added as committer on 2025-10-31
- Raz Luvaton was added as committer on 2025-10-01
- Zhen Wang was added as committer on 2025-10-02
- Yoav Cohen was added as committer on 2025-09-17


## Project Activity:
Note that almost all communication for DataFusion and its subprojects
happens
on github and so our dev mailing list traffic is fairly light.


### DataFusion core
https://github.com/apache/datafusion
51.0.0 was released on 2025-11-19.
50.3.0 was released on 2025-10-24.
50.1.0 was released on 2025-10-02.
50.0.0 was released on 2025-09-16.



The most recent release (~ 2 months of contributions) had 128 distinct
contributors, which we think is a record and shows the project is able to
attract and sustain a large community. Development is now largely focused
on more advanced optimizations, and we have been able to attract a
significant amount of engineering investment from the community

We have gotten better about writing about our releases externally,
including several blogs
https://datafusion.apache.org/blog/2025/11/25/datafusion-51.0.0
https://datafusion.apache.org/blog/2025/09/29/datafusion-50.0.0
https://datafusion.apache.org/blog/2025/09/21/custom-types-using-metadata
https://datafusion.apache.org/blog/2025/09/10/dynamic-filters


We have also held several in person meetups in various locations, which
have been successful in bringing together contributors.

Finally, as always, the biggest bottleneck for increasing project velocity
is reviewer capacity. The rise of AI powered coding assistants has made
this bottleneck more acute as it makes it easier to create large PRs. The
community has written up [guidelines] for AI assisted contributions which
seems to have improved the overall PR quality.

[guidelines]:
https://datafusion.apache.org/contributor-guide/index.html#ai-assisted-contributions


### Sub project: DataFusion Python

https://github.com/apache/datafusion-python

DATAFUSION-PYTHON-50.1.0 was released on 2025-10-20.
DATAFUSION-PYTHON-50.0.0 was released on 2025-09-23.



### Sub project: DataFusion Comet

COMET-0.12.0 was released on 2025-12-01.
COMET-0.10.1 was released on 2025-10-06.
COMET-0.10.0 was released on 2025-09-16.


https://github.com/apache/datafusion-comet


You can read about the recent happenings in Comet in the blogs:
https://datafusion.apache.org/blog/2025/12/04/datafusion-comet-0.12.0
https://datafusion.apache.org/blog/2025/10/21/datafusion-comet-0.11.0
https://datafusion.apache.org/blog/2025/09/16/datafusion-comet-0.10.0



### Sub project: DataFusion Ballista

BALLISTA-50.0.0 was released on 2025-11-22.
BALLISTA-49.0.0 was released on 2025-10-06.


https://github.com/apache/datafusion-ballista


### Sub project: sqlparser-rs

SQLPARSER-0.59.0 was released on 2025-09-24.
SQLPARSER-0.60.0 was released on 2025-12-07.

https://github.com/apache/datafusion-sqlparser-rs

Ifeanyi Ubah (iffyio) continues to review most PRs in this repo. We added a
new committer Yoav Cohen focused on sqlparser in an attempt to increase the
review bandwidth available.


## Community Health:

While we as always struggle with code review capacity,
we have many active committers, and the community in general helps each
other out with reviews. We continue to actively grow our committer
and PMC ranks.

We continue to merge multiple PRs a day from multiple committers and
have contributions from a wide variety of individuals with a wide
variety of employers.

Reply via email to