Hi everyone, Following the community discussion [1], this vote is to determine whether the DataFusion PMC accepts the contribution of the datafusion-distributed codebase [2] as a subproject, hosted in a new apache/datafusion-distributed repository.
DataFusion Distributed (DFD) is a Rust library for adding distributed execution to existing DataFusion applications. It aims to stay close to native DataFusion while leaving worker management, networking, and deployment to the embedding application. It would coexist with Ballista, which provides a customizable distributed engine with its own scheduler, executors, and operational tooling. datafusion-distributed is an embeddable distribution library for applications that manage their own workers, networking, and deployment. Jayant Shrivastava (@jayshrivastava) and I plan to continue contributing to and maintaining datafusion-distributed within the DataFusion community. If the vote passes, we will work with the PMC to complete ASF IP clearance before moving the repository. Acceptance is subject to successful clearance; we are preparing the paperwork in parallel. The vote will remain open for at least seven days. DataFusion PMC votes are binding; everyone else is welcome to participate with a non-binding vote. [ ] +1 Accept datafusion-distributed as an Apache DataFusion subproject [ ] 0 No opinion [ ] -1 Reject datafusion-distributed as an Apache DataFusion subproject because... Here is my vote: +1 (non-binding) Thanks, Gabriel [1]: https://github.com/datafusion-contrib/datafusion-distributed/issues/784 [2]: https://github.com/datafusion-contrib/datafusion-distributed --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
