Great to see this proposal. GraphFrames has long been a very useful library, 
and I have used it many times.

One historical curiosity: Why was this not originally a part of the project? 
Was it just a historical accident, or was there some original blocker which has 
since been resolved?

NIck


> On Nov 8, 2026, at 2:39 PM, Sem via dev <[email protected]> wrote:
> 
> Hello Apache Spark community,
> 
> I would like to start a discussion about merging the GraphFrames
> project into the Apache Spark project.
> 
> SPIP:
> https://docs.google.com/document/d/1v8OEV5Qqk5LE1XID4ZiPF5rLkAk-Zz6fp0tns9Z_TA8/edit?usp=sharing
> 
> Shepherd: Ruifeng Zheng
> 
> Following the deprecation of GraphX, there is no public, non-deprecated
> API for working with graph-like data. At the same time, the GraphFrames
> project (https://github.com/graphframes/graphframes) provides a solid
> foundation for representing and processing connected data as Spark's
> DataFrames, as well as a rich standard library of ready-to-use graph
> algorithms such as PageRank, Connected Components and Node Embeddings.
> 
> The proposal suggests moving the GraphFrames code (Apache 2.0 licence)
> to the Apache Spark project as an in-tree module.
> 
> Please reply to this thread. A [VOTE] will follow once the discussion
> has concluded.
> 
> Best regards,
> Sem
> 
> ---------------------------------------------------------------------
> To unsubscribe e-mail: [email protected]
> 


---------------------------------------------------------------------
To unsubscribe e-mail: [email protected]

Reply via email to