Hello dear Spark community We are the developers behind the SparkGraph SPIP, which is a project created out of our work on openCypher Morpheus ( https://github.com/opencypher/morpheus). During this year we have collaborated with mainly Xiangrui Meng of Databricks to define and develop a new SparkGraph module based on our experience from working on Morpheus. Morpheus - formerly known as "Cypher for Apache Spark" - has been in development for over 3 years and matured in its API and implementation.
The SPIP work has been on hold for a period of time now, as priorities at Databricks have changed which has occupied Xiangrui's time (as well as other happenings). As you may know, the latest API PR ( https://github.com/apache/spark/pull/24851) is blocking us from moving forward with the implementation. In an attempt to not lose track of this project we now reach out to you to ask whether there are any Spark committers in the community who would be prepared to commit to helping us review and merge our code contributions to Apache Spark? We are not asking for lots of direct development support, as we believe we have the implementation more or less completed already since early this year. There is a proof-of-concept PR ( https://github.com/apache/spark/pull/24297) which contains the functionality. If you could offer such aid it would be greatly appreciated. None of us are Spark committers, which is hindering our ability to deliver this project in time for Spark 3.0. Sincerely the Neo4j Graph Analytics team Mats, Martin, Max, Sören, Jonatan