Re: Spark Java example using external Jars

2014-03-13 Thread Adam Novak
oop through that directory, sending all the jars in there off to Spark. -Adam Novak UCSC Bioinformatics Ph.D. Student On Thu, Mar 13, 2014 at 2:46 AM, dmpour23 wrote: > Hi, > > Can anyone point out any examples on the web other than the java examples > offered by the spark documentation

Re: Incrementally add/remove vertices in GraphX

2014-03-17 Thread Adam Novak
I would assume that, regardless of the efficiency of such an operation, any method of adding or removing vertices would need to result in a new graph, since graphs in GraphX are supposed to be immutable. It sounds like what you probably want is an efficient union/subtract/whatever that operates on

Preconditions on RDDs for creating a Graph?

2014-04-08 Thread Adam Novak
eed to have the same number of partitions? The same number of partitions and no empty partitions? Do you need to repartition them with their default partitioners beforehand?) Why does GraphImpl repartition the vertices RDD? I'm using Spark 1.0.0-incubating-SNAPSHOT, if it helps. Thanks, -Adam