There is a collectAsync action if you want to run them in parallel, but keep in
mind the two jobs will need to share resources and you should use the FAIR
scheduler.
________________________________
From: praveen S<mailto:[email protected]>
Sent: 10/26/2015 4:27 AM
To: [email protected]<mailto:[email protected]>
Subject: Concurrent execution of actions within a driver
Does spark run different actions of an rdd within a driver in parallel also?
Let's say
class Driver{
val rdd1= sc. textFile("... ")
val rdd2=sc.textFile("....")
rdd1. collect //Action 1
rdd2. collect //Action 2
}
Does Spark run Action 1 & 2 run in parallel? ( some kind of a pass through the
driver code and than start the execution)?
if not than is using threads safe for independent actions/red's?
