Great to see this proposal. GraphFrames has long been a very useful library, and I have used it many times.
One historical curiosity: Why was this not originally a part of the project? Was it just a historical accident, or was there some original blocker which has since been resolved? NIck > On Nov 8, 2026, at 2:39 PM, Sem via dev <[email protected]> wrote: > > Hello Apache Spark community, > > I would like to start a discussion about merging the GraphFrames > project into the Apache Spark project. > > SPIP: > https://docs.google.com/document/d/1v8OEV5Qqk5LE1XID4ZiPF5rLkAk-Zz6fp0tns9Z_TA8/edit?usp=sharing > > Shepherd: Ruifeng Zheng > > Following the deprecation of GraphX, there is no public, non-deprecated > API for working with graph-like data. At the same time, the GraphFrames > project (https://github.com/graphframes/graphframes) provides a solid > foundation for representing and processing connected data as Spark's > DataFrames, as well as a rich standard library of ready-to-use graph > algorithms such as PageRank, Connected Components and Node Embeddings. > > The proposal suggests moving the GraphFrames code (Apache 2.0 licence) > to the Apache Spark project as an in-tree module. > > Please reply to this thread. A [VOTE] will follow once the discussion > has concluded. > > Best regards, > Sem > > --------------------------------------------------------------------- > To unsubscribe e-mail: [email protected] > --------------------------------------------------------------------- To unsubscribe e-mail: [email protected]
