about hotspot

hello, i want to known something about hotspot in hadoop

Jenkins build is still unstable: Hadoop-Hdfs-trunk #899

See

Hadoop-Hdfs-trunk - Build # 899 - Still Unstable

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/899/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12083 lines...] main: [mkdir] Created dir: /home/jenk

Hadoop-Hdfs-0.23-Build - Build # 112 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/112/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14195 lines...] at hudson.tasks.junit.JUnitR

Hadoop-Hdfs-trunk-Commit - Build # 1525 - Failure

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Commit/1525/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6739 lines...] A hadoop-project/src/site A

Fwd: Hadoop-Hdfs-trunk - Build # 894 - Still unstable

HDFS Builds have been failing since HDFS-234 (bk support) went in 6 days ago. Can someone please fix this? Otherwise we should revert the patch. -Todd -- Forwarded message -- From: Apache Jenkins Server Date: Wed, Dec 14, 2011 at 7:54 AM Subject: Hadoop-Hdfs-trunk - Build # 894

[jira] [Created] (HDFS-2705) HttpFS server should check that upload requests have correct content-type

HttpFS server should check that upload requests have correct content-type - Key: HDFS-2705 URL: https://issues.apache.org/jira/browse/HDFS-2705 Project: Hadoop HDFS Issu

Re: Hadoop-Hdfs-trunk - Build # 894 - Still unstable

I'm going to commit the following fix if no one screams otherwise: Index: hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/pom.xml === --- hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/pom.xml (revision 1220312) +++ hado

Re: Hadoop-Hdfs-trunk - Build # 894 - Still unstable

I committed this. (r1220940) -Todd On Mon, Dec 19, 2011 at 11:49 AM, Todd Lipcon wrote: > I'm going to commit the following fix if no one screams otherwise: > > Index: hadoop-hdfs-project/hadoop-hdfs/src/contrib/bkjournal/pom.xml >

[jira] [Resolved] (HDFS-2678) HA: When a FailoverProxyProvider is used, DFSClient should not retry connection ten times before failing over

[ https://issues.apache.org/jira/browse/HDFS-2678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2678. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed Committed to

[jira] [Resolved] (HDFS-2682) HA: When a FailoverProxyProvider is used, Client should not retry for 45 times(hard coded value) if it is timing out to connect to server.

[ https://issues.apache.org/jira/browse/HDFS-2682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2682. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed > HA: W

[jira] [Created] (HDFS-2706) Use configuration for blockInvalidateLimit if it is set

Use configuration for blockInvalidateLimit if it is set --- Key: HDFS-2706 URL: https://issues.apache.org/jira/browse/HDFS-2706 Project: Hadoop HDFS Issue Type: Bug Components: na

[jira] [Resolved] (HDFS-2701) Cleanup FS* processIOError methods

[ https://issues.apache.org/jira/browse/HDFS-2701?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2701. --- Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: (was: 1.1.0) Hadoop

[jira] [Resolved] (HDFS-2703) removedStorageDirs is not updated everywhere we remove a storage dir

[ https://issues.apache.org/jira/browse/HDFS-2703?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2703. --- Resolution: Fixed Fix Version/s: 1.1.0 Target Version/s: (was: 1.1.0) Hadoop

[jira] [Resolved] (HDFS-2702) A single failed name dir can cause the NN to exit

[ https://issues.apache.org/jira/browse/HDFS-2702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eli Collins resolved HDFS-2702. --- Resolution: Fixed Hadoop Flags: Reviewed Tests and test-patch are clean. I've committed this. T

[jira] [Resolved] (HDFS-2007) Backupnode downloading image/edits from Namenode at every checkpoint ..

[ https://issues.apache.org/jira/browse/HDFS-2007?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] SreeHari resolved HDFS-2007. Resolution: Duplicate > Backupnode downloading image/edits from Namenode at every checkpoint .. > -

Re: Controlling the placement of data in Hadoop Cluster nodes ?

Moving to hdfs-dev@hadoop.apache.org. In future, please use the appropriate lists to post your questions, when they are about HDFS: http://hadoop.apache.org/hdfs/mailing_lists.html You can implement a custom BlockPlacementPolicy in 0.21+ versions of Hadoop, and use that to achieve this. Should