I am building (yet another) job server for Spark using Play! framework and it seems like Play's akka dependency conflicts with Spark's shaded akka dependency. Using SBT, I can force Play to use akka 2.2.3 (unshaded) but I haven't been able to figure out how to exclude com.typesafe.akka dependencies all together and introduce shaded akka dependencies instead.
I was wondering what can potentially go wrong if I use unshaded version in the job server? The job server is responsible for creating SparkContext/StreamingContext that connects to spark cluster (using spark.master config) and these contexts are then provided to jobs that would create RDDs/DStreams & perform computations on them. I am guessing in this case, the job server would act as a Spark driver.