If RDD is cached, this RDD is only computed once and the stages for computing this RDD in the following jobs are skipped.
On Wed, Mar 16, 2016 at 8:14 AM, Prabhu Joseph <prabhujose.ga...@gmail.com> wrote: > Hi All, > > > Spark UI Completed Jobs section shows below information, what is the > skipped value shown for Stages and Tasks below. > > Job_ID Description Submitted Duration > Stages (Succeeded/Total) Tasks (for all stages): Succeeded/Total > > 11 count 2016/03/14 15:35:32 1.4 min > 164/164 * (163 skipped) * 19841/19788 > *(41405 skipped)* > Thanks, > Prabhu Joseph > -- Best Regards Jeff Zhang
