Tsz Wo Nicholas Sze created HDFS-8254: -----------------------------------------
Summary: In StripedDataStreamer, it is hard to tolerate datanode failure in the leading streamer Key: HDFS-8254 URL: https://issues.apache.org/jira/browse/HDFS-8254 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Tsz Wo Nicholas Sze Assignee: Tsz Wo Nicholas Sze StripedDataStreamer javadoc is shown below. {code} * The StripedDataStreamer class is used by {@link DFSStripedOutputStream}. * There are two kinds of StripedDataStreamer, leading streamer and ordinary * stream. Leading streamer requests a block group from NameNode, unwraps * it to located blocks and transfers each located block to its corresponding * ordinary streamer via a blocking queue. {code} Leading streamer is the streamer with index 0. When the datanode of the leading streamer fails, the other steamers cannot continue since no one will request a block group from NameNode anymore. -- This message was sent by Atlassian JIRA (v6.3.4#6332)