[ https://issues.apache.org/jira/browse/HDFS-8391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Uma Maheswara Rao G resolved HDFS-8391. --------------------------------------- Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed > NN should consider current EC tasks handling count from DN while assigning > new tasks > ------------------------------------------------------------------------------------ > > Key: HDFS-8391 > URL: https://issues.apache.org/jira/browse/HDFS-8391 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: datanode, namenode > Reporter: Uma Maheswara Rao G > Assignee: Uma Maheswara Rao G > Fix For: HDFS-7285 > > Attachments: HDFS-8391-01.patch > > > Currently NN will pick the (maxStreams-XmitsCount) number of ECtasks at a > time for assigning to the respective DN. > {code} > //get datanode commands > final int maxTransfer = blockManager.getMaxReplicationStreams() > - xmitsInProgress; > {code} > But right now we increment xmitsInProgress count at DN only for regular > replication tasks but not for ECWorker tasks. > So, either we should treat this logic separately for EC or we should consider > EC current task handling count form DN. > This jira for discussing more for this case. -- This message was sent by Atlassian JIRA (v6.3.4#6332)