dragon created HDFS-10045:
-----------------------------

             Summary: CLONE - Erasure Coding: StripedDataStreamer fails to 
handle the blocklocations which doesn't satisfy BlockGroupSize
                 Key: HDFS-10045
                 URL: https://issues.apache.org/jira/browse/HDFS-10045
             Project: Hadoop HDFS
          Issue Type: Sub-task
            Reporter: dragon
            Assignee: Rakesh R
             Fix For: HDFS-7285


During write operations {{StripedDataStreamer#locateFollowingBlock}} fails to 
validate the available datanodes against the {{BlockGroupSize}}. Please see the 
exception to understand more:

{code}
2015-04-22 14:56:11,313 WARN  hdfs.DFSClient (DataStreamer.java:run(538)) - 
DataStreamer Exception
java.lang.NullPointerException
        at 
java.util.concurrent.LinkedBlockingQueue.offer(LinkedBlockingQueue.java:374)
        at 
org.apache.hadoop.hdfs.StripedDataStreamer.locateFollowingBlock(StripedDataStreamer.java:157)
        at 
org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1332)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:424)
        at 
org.apache.hadoop.hdfs.StripedDataStreamer.run(StripedDataStreamer.java:1)
2015-04-22 14:56:11,313 INFO  hdfs.MiniDFSCluster 
(MiniDFSCluster.java:shutdown(1718)) - Shutting down the Mini HDFS Cluster
2015-04-22 14:56:11,313 ERROR hdfs.DFSClient 
(DFSClient.java:closeAllFilesBeingWritten(608)) - Failed to close inode 16387
java.io.IOException: DataStreamer Exception: 
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:544)
        at 
org.apache.hadoop.hdfs.StripedDataStreamer.run(StripedDataStreamer.java:1)
Caused by: java.lang.NullPointerException
        at 
java.util.concurrent.LinkedBlockingQueue.offer(LinkedBlockingQueue.java:374)
        at 
org.apache.hadoop.hdfs.StripedDataStreamer.locateFollowingBlock(StripedDataStreamer.java:157)
        at 
org.apache.hadoop.hdfs.DataStreamer.nextBlockOutputStream(DataStreamer.java:1332)
        at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:424)
        ... 1 more
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to