not parallel. Spark only execute tasks with Action,(‘collect' here)
rdd1.collect and rdd2.collect are executed sequencely, so Spark execute two tasks one by one. > On Oct 26, 2015, at 7:26 PM, praveen S <mylogi...@gmail.com> wrote: > > Does spark run different actions of an rdd within a driver in parallel also? > > Let's say > class Driver{ > > val rdd1= sc. textFile("... ") > val rdd2=sc.textFile("....") > rdd1. collect //Action 1 > rdd2. collect //Action 2 > > } > > Does Spark run Action 1 & 2 run in parallel? ( some kind of a pass through > the driver code and than start the execution)? > > if not than is using threads safe for independent actions/red's? >