Very interesting.
One of spark's attractive features is being able to do stuff interactively
via spark-shell. Is something like that still available via Ooyala's job
server?
Or do you use the spark-shell independently of that? If the latter then how
do you manage custom jars for spark-shell? Our
In general, as Andrew points out, it's possible to submit jobs from
multiple threads and many Spark applications do this.
One thing to check out is the job server from Ooyala, this is an
application on top of Spark that has an automated submission API:
https://github.com/ooyala/spark-jobserver
Yo
For the second question, you can submit multiple jobs through the same
SparkContext via different threads and this is a supported way of
interacting with Spark.
>From the documentation:
Second, *within* each Spark application, multiple “jobs” (Spark actions)
may be running concurrently if they we
