Re: Interested in contributing to GraphX in Python

2014-12-16 Thread GregBowyer
objects everything could be written in a numpy friendly format into the mmap ? -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/Interested-in-contributing-to-GraphX-in-Python-tp7629p9813.html Sent from the Apache Spark Developers List mailing list

Re: Interested in contributing to GraphX in Python

2014-08-04 Thread Reynold Xin
Thanks for your interest. I think the main challenge is if we have to call Python functions per record, it can be pretty expensive to serialize/deserialize across boundaries of the Python process and JVM process. I don't know if there is a good way to solve this problem yet. On Fri, Aug 1, 2

Interested in contributing to GraphX in Python

2014-08-01 Thread Rajiv Abraham
Hi, I just saw Ankur's GraphX presentation and it looks very exciting! I would like to contribute to a Python version of GraphX. I checked out JIRA and Github but I did not find much info. - Are there limitations currently to port GraphX in Python? (e.g. Maybe the Python Spark RDD API is incomplet