objects everything could be written in a numpy
friendly format into the mmap ?
--
View this message in context:
http://apache-spark-developers-list.1001551.n3.nabble.com/Interested-in-contributing-to-GraphX-in-Python-tp7629p9813.html
Sent from the Apache Spark Developers List mailing list
Thanks for your interest.
I think the main challenge is if we have to call Python functions per
record, it can be pretty expensive to serialize/deserialize across
boundaries of the Python process and JVM process. I don't know if there is
a good way to solve this problem yet.
On Fri, Aug 1, 2
Hi,
I just saw Ankur's GraphX presentation and it looks very exciting! I would
like to contribute to a Python version of GraphX. I checked out JIRA and
Github but I did not find much info.
- Are there limitations currently to port GraphX in Python? (e.g. Maybe the
Python Spark RDD API is incomplet