Fwd: ApacheCon CFP closes June 25

2014-06-12 Thread Matei Zaharia
(I’m forwarding this message on behalf of the ApacheCon organizers, who’d like to see involvement from every Apache project!) As you may be aware, ApacheCon will be held this year in Budapest, on November 17-23. (See http://apachecon.eu for more info.) The Call For Papers for that conference is

Subscription request for developer community

2014-06-12 Thread Priya Ch
Please accept the request

Big-Endian (IBM Power7) Spark Serialization issue

2014-06-12 Thread Yanjie Gao
Hi All, We are facing a Serialization issue , This issue has been submit to JIRA https://issues.apache.org/jira/browse/SPARK-2018 We have an application run on Spark on Power7 System . But we meet an important issue about serialization. The example HdfsWordCount can meet the problem. ./bin

Re: GraphX can not unpersist edges of old graph?

2014-06-12 Thread Ankur Dave
We didn't provide an unpersist API for Graph because the internal dependency structure of a graph can make it hard to unpersist correctly in a way that avoids recomputation. However, you can directly unpersist a graph's vertices and edges RDDs using graph.vertices.unpersist() and graph.edges.unpers

GraphX can not unpersist edges of old graph?

2014-06-12 Thread 余根茂(余根茂)
Hi All, I know the benefit of RDD caching, but abuse of using cache may cause memory leak. In graphx, we can cache a graph by using graph.cache(), and many transformation of graph create and cache new edges, like partitionBy() and subgraph(). However, I can not find an interface to unpe