Re: Checkpoint directory structure

2015-09-24 Thread Tathagata Das
u are seeing this error? >> >> On Wed, Sep 23, 2015 at 6:32 PM, Bin Wang wrote: >> >>> BTW, I just kill the application and restart it. Then the application >>> cannot recover from checkpoint because of some lost of RDD. So I'm wonder, >>> i

Re: Checkpoint directory structure

2015-09-23 Thread Bin Wang
gt;> if there are some failure in the application, won't it possible not be able >> to recovery from checkpoint? >> >> Bin Wang 于2015年9月23日周三 下午6:58写道: >> >>> I find the checkpoint directory structure is like this: >>> >>> -rw-r--r-- 1 root root

Re: Checkpoint directory structure

2015-09-23 Thread Tathagata Das
e some failure in the application, won't it possible not be able > to recovery from checkpoint? > > Bin Wang 于2015年9月23日周三 下午6:58写道: > >> I find the checkpoint directory structure is like this: >> >> -rw-r--r-- 1 root root 134820 2015-09-23 16:55 >> /us

Re: Checkpoint directory structure

2015-09-23 Thread Bin Wang
t; I find the checkpoint directory structure is like this: > > -rw-r--r-- 1 root root 134820 2015-09-23 16:55 > /user/root/checkpoint/checkpoint-144299850 > -rw-r--r-- 1 root root 134768 2015-09-23 17:00 > /user/root/checkpoint/checkpoint-144299880 > -rw-r--r--

Checkpoint directory structure

2015-09-23 Thread Bin Wang
I find the checkpoint directory structure is like this: -rw-r--r-- 1 root root 134820 2015-09-23 16:55 /user/root/checkpoint/checkpoint-144299850 -rw-r--r-- 1 root root 134768 2015-09-23 17:00 /user/root/checkpoint/checkpoint-144299880 -rw-r--r-- 1 root root 134895 2015