Re: Spark Log information

2017-01-15 Thread KhajaAsmath Mohammed
Thanks Raju. On Sun, Jan 15, 2017 at 9:49 PM, Raju Bairishetti wrote: > Total number of tasks in the stage is: 21428 > Number of tasks completed so far: 44 > Number of tasks running now: 48 > > On Mon, Jan 16, 2017 at 11:41 AM, KhajaAsmath Mohammed < > mdkhajaasm...@gmail.com> wrote: > >> Hi, >

Re: Spark Log information

2017-01-15 Thread Raju Bairishetti
Total number of tasks in the stage is: 21428 Number of tasks completed so far: 44 Number of tasks running now: 48 On Mon, Jan 16, 2017 at 11:41 AM, KhajaAsmath Mohammed < mdkhajaasm...@gmail.com> wrote: > Hi, > > when running the spark jobs, I see the numbers in stages. can anyone tell > what do

Spark Log information

2017-01-15 Thread KhajaAsmath Mohammed
Hi, when running the spark jobs, I see the numbers in stages. can anyone tell what does this number indicate in the below case. [Stage 2:>(44 + 48) / 21428] 44+28 and 21428. Thanks, Asmath