Fellow Sparkers, I'm rather puzzled at the submitJob API. I can't quite figure out how it is supposed to be used. Is there any more documentation about it?
Also, is there any simpler way to multiplex jobs on the cluster, such as starting multiple computations in as many threads in the driver and reaping all the results when they are available? Thanks, Alex
