non-local map task input

2013-07-21 Thread Grandl Robert
Hi guys, I am trying to figure out all the points in hdfs code where hdfs traffic is read/written. As far as I can tell, it seems most of the traffic goes through BlockSender/BlockReceiver, right ? However, when a client do a copyFromLocal, or read a file, or for a map task whose input is not

[jira] [Created] (HDFS-5018) Misspelled DFSConfigKeys#DFS_NAMENODE_STALE_DATANODE_INTERVAL_DEFAULT in javadoc of DatanodeInfo#isStale()

2013-07-21 Thread Ted Yu (JIRA)
Ted Yu created HDFS-5018: Summary: Misspelled DFSConfigKeys#DFS_NAMENODE_STALE_DATANODE_INTERVAL_DEFAULT in javadoc of DatanodeInfo#isStale() Key: HDFS-5018 URL: https://issues.apache.org/jira/browse/HDFS-5018

[jira] [Resolved] (HDFS-5015) Error while running custom writable code - DFSClient_NONMAPREDUCE_549327626_1 doesnot have any open file

2013-07-21 Thread Suresh Srinivas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5015?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-5015. --- Resolution: Invalid Please use forums for help. Jira is for reporting bugs. >

Hadoop-Hdfs-trunk - Build # 1467 - Still Failing

2013-07-21 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/1467/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 15232 lines...] [INFO] Executing tasks main: [mkdir]

Build failed in Jenkins: Hadoop-Hdfs-trunk #1467

2013-07-21 Thread Apache Jenkins Server
See Changes: [kihwal] HDFS-5010. Reduce the frequency of getCurrentUser() calls from namenode. Contributed by Kihwal Lee. [acmurthy] YARN-897. Ensure child queues are ordered correctly to account for completed containers. Contribut

[jira] [Created] (HDFS-5017) Extends LightWeightGSet to support eviction of expired elements

2013-07-21 Thread Tsz Wo (Nicholas), SZE (JIRA)
Tsz Wo (Nicholas), SZE created HDFS-5017: Summary: Extends LightWeightGSet to support eviction of expired elements Key: HDFS-5017 URL: https://issues.apache.org/jira/browse/HDFS-5017 Project:

Re: [VOTE] Release Apache Hadoop 2.1.0-beta

2013-07-21 Thread Devaraj Das
I have just raised https://issues.apache.org/jira/browse/HDFS-5016 .. This bug can easily be reproduced by some HBase tests. I'd like this to be considered before we make a beta release. Have spoken about this with some hdfs folks offline and I am told that it is being worked on. Thanks Devaraj

[jira] [Created] (HDFS-5016) Heartbeating thread blocks under some failure conditions leading to loss of datanodes

2013-07-21 Thread Devaraj Das (JIRA)
Devaraj Das created HDFS-5016: - Summary: Heartbeating thread blocks under some failure conditions leading to loss of datanodes Key: HDFS-5016 URL: https://issues.apache.org/jira/browse/HDFS-5016 Project: