Re: Restarting HDFS datanode process

2014-09-19 Thread Biju N
Thanks Ted. On Thu, Sep 18, 2014 at 3:34 PM, Ted Yu wrote: > DFSClient would resume reading from where it stops from the next data node. > > Cheers > > On Thu, Sep 18, 2014 at 11:53 AM, Biju N wrote: > > > It is for the duration of the restart. The concern is what will happen to > > any reads w

Re: Restarting HDFS datanode process

2014-09-18 Thread Ted Yu
DFSClient would resume reading from where it stops from the next data node. Cheers On Thu, Sep 18, 2014 at 11:53 AM, Biju N wrote: > It is for the duration of the restart. The concern is what will happen to > any reads which is inflight that is using the data node. Will HDFS client > know the o

Re: Restarting HDFS datanode process

2014-09-18 Thread Biju N
It is for the duration of the restart. The concern is what will happen to any reads which is inflight that is using the data node. Will HDFS client know the offset to start reading from where the read failed using another DN? On Thu, Sep 18, 2014 at 1:57 PM, Ted Yu wrote: > How long would your d

Re: Restarting HDFS datanode process

2014-09-18 Thread Ted Yu
How long would your datanode be out of service ? If the duration is long (say 1 day), you'd better decommission it first. Otherwise, datanode restart can be done without going through decommissioning. On Thu, Sep 18, 2014 at 8:25 AM, Biju N wrote: > Hello There, > Can individual datanodes

Restarting HDFS datanode process

2014-09-18 Thread Biju N
Hello There, Can individual datanodes restarted (through service command) or do we need to add it to the exclude file in NN, restart DN it, remove it from the exclude file in NN as if the data node is being decommissioned and put back? Any feedback on this is much appreciated. Thanks, Biju