Re: RDD: Execution and Scheduling

2015-09-22 Thread gsvic
I already have but I needed some clarifications. Thanks for all your help! -- View this message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/RDD-Execution-and-Scheduling-tp14177p14286.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com

Re: RDD: Execution and Scheduling

2015-09-20 Thread Reynold Xin
hy don't you just do a little bit of code reading yourself? > > Could you please also include the links of the source files for the two > questions above? > > > > -- > View this message in context: > http://apache-spark-developers-list.1001551.n3.nabble.com/RDD

Re: RDD: Execution and Scheduling

2015-09-20 Thread gsvic
is message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/RDD-Execution-and-Scheduling-tp14177p14226.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscribe, e

Re: RDD: Execution and Scheduling

2015-09-17 Thread gsvic
message in context: http://apache-spark-developers-list.1001551.n3.nabble.com/RDD-Execution-and-Scheduling-tp14177p14186.html Sent from the Apache Spark Developers List mailing list archive at Nabble.com. - To unsubscribe, e

Re: RDD: Execution and Scheduling

2015-09-17 Thread Reynold Xin
Your understanding is mostly correct. Replies inline. On Thu, Sep 17, 2015 at 5:23 AM, gsvic wrote: > After reading some parts of Spark source code I would like to make some > questions about RDD execution and scheduling. > > At first, please correct me if I am wrong at the followi

RDD: Execution and Scheduling

2015-09-17 Thread gsvic
After reading some parts of Spark source code I would like to make some questions about RDD execution and scheduling. At first, please correct me if I am wrong at the following: 1) The number of partitions equals to the number of tasks will be executed in parallel (e.g. , when an RDD is