Re: How to set persistence level of graph in GraphX in spark 1.0.0

2014-10-28 Thread Arpit Kumar
t; Best, > Yifan LI > > > > > On 28 Oct 2014, at 11:17, Arpit Kumar wrote: > > Any help regarding this issue please? > > Regards, > Arpit > > On Sat, Oct 25, 2014 at 8:56 AM, Arpit Kumar wrote: > >> Hi all, >> I am using the GrpahLoader class t

Re: How to set persistence level of graph in GraphX in spark 1.0.0

2014-10-28 Thread Arpit Kumar
Any help regarding this issue please? Regards, Arpit On Sat, Oct 25, 2014 at 8:56 AM, Arpit Kumar wrote: > Hi all, > I am using the GrpahLoader class to load graphs from edge list files. But > then I need to change the storage level of the graph to some other thing > than MEMORY_O

How to set persistence level of graph in GraphX in spark 1.0.0

2014-10-24 Thread Arpit Kumar
Hi all, I am using the GrpahLoader class to load graphs from edge list files. But then I need to change the storage level of the graph to some other thing than MEMORY_ONLY. val graph = GraphLoader.edgeListFile(sc, fname, minEdgePartitions = numEPart).persist(StorageLevel.MEMORY_AND_DISK_

Re: Workaround for SPARK-1931 not compiling

2014-10-24 Thread Arpit Kumar
Thanks a lot. Now it is working properly. On Sat, Oct 25, 2014 at 2:13 AM, Ankur Dave wrote: > At 2014-10-23 09:48:55 +0530, Arpit Kumar wrote: > > error: value partitionBy is not a member of > > org.apache.spark.rdd.RDD[(org.apache.spark.graphx.PartitionID, > > org.apache

Workaround for SPARK-1931 not compiling

2014-10-22 Thread Arpit Kumar
titioner(numPartitions)) [INFO] ^ Please help me in resolving the error. Note: I cant upgrade spark since I am only a client on the spark cluster. -- Arpit Kumar