Re: Merging some trunk changes to 23

2012-01-05 Thread Dhruba Borthakur
+1 for 1 adding "BR scalability (HDFS-395, HDFS-2477, HDFS-2495, HDFS-2476)" These are very significant performance improvements that would be very valuable in 0.23. -dhruba On Thu, Jan 5, 2012 at 7:52 PM, Eli Collins wrote: > Hey gang, > > I was looking at the difference between hdfs trunk a

Merging some trunk changes to 23

2012-01-05 Thread Eli Collins
Hey gang, I was looking at the difference between hdfs trunk and 23, for the purpose of looking at what to merge to 23. Here's a summary of the differences: 1. BR scalability (HDFS-395, HDFS-2477, HDFS-2495, HDFS-2476) 2. BK support (HDFS-234 and related refactoring) 3. Protobuf RPC changes 4. A

[jira] [Created] (HDFS-2759) Pre-allocate HDFS edit log files after writing version number

2012-01-05 Thread Aaron T. Myers (Created) (JIRA)
Pre-allocate HDFS edit log files after writing version number - Key: HDFS-2759 URL: https://issues.apache.org/jira/browse/HDFS-2759 Project: Hadoop HDFS Issue Type: Sub-task

RE: Timeouts in Datanodes while block scanning

2012-01-05 Thread Uma Maheswara Rao G
Hi Aaron, Presently i am in 0.20.2 version. I debugged the problem for some time. Could not find any clue. Wanted to know any of the dev/users faced this situation in their clusters. Regards, Uma From: Aaron T. Myers [a...@cloudera.com] Sent: Thursday, J

[jira] [Created] (HDFS-2758) HA: multi-process MiniDFS cluster for testing ungraceful shutdown

2012-01-05 Thread Eli Collins (Created) (JIRA)
HA: multi-process MiniDFS cluster for testing ungraceful shutdown - Key: HDFS-2758 URL: https://issues.apache.org/jira/browse/HDFS-2758 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-2757) Cannot read a local file that's being written to when using the local read short circuit

2012-01-05 Thread Jean-Daniel Cryans (Created) (JIRA)
Cannot read a local file that's being written to when using the local read short circuit Key: HDFS-2757 URL: https://issues.apache.org/jira/browse/HDFS-2757 Proj

[jira] [Created] (HDFS-2756) Warm standby does not read the in_progress edit log

2012-01-05 Thread Hari Mankude (Created) (JIRA)
Warm standby does not read the in_progress edit log Key: HDFS-2756 URL: https://issues.apache.org/jira/browse/HDFS-2756 Project: Hadoop HDFS Issue Type: Bug Components: ha A

[jira] [Created] (HDFS-2755) HA: add tests for flaky and failed shared edits directories

2012-01-05 Thread Eli Collins (Created) (JIRA)
HA: add tests for flaky and failed shared edits directories --- Key: HDFS-2755 URL: https://issues.apache.org/jira/browse/HDFS-2755 Project: Hadoop HDFS Issue Type: Sub-task C

[jira] [Created] (HDFS-2754) HA: enable dfs.namenode.name.dir.restore if HA is enabled

2012-01-05 Thread Eli Collins (Created) (JIRA)
HA: enable dfs.namenode.name.dir.restore if HA is enabled - Key: HDFS-2754 URL: https://issues.apache.org/jira/browse/HDFS-2754 Project: Hadoop HDFS Issue Type: Sub-task Compo

[jira] [Created] (HDFS-2753) Standby namenode stuck in safenode during a failover

2012-01-05 Thread Hari Mankude (Created) (JIRA)
Standby namenode stuck in safenode during a failover Key: HDFS-2753 URL: https://issues.apache.org/jira/browse/HDFS-2753 Project: Hadoop HDFS Issue Type: Bug Components: name-nod

[jira] [Created] (HDFS-2752) HA: exit if multiple shared dirs are configured

2012-01-05 Thread Eli Collins (Created) (JIRA)
HA: exit if multiple shared dirs are configured --- Key: HDFS-2752 URL: https://issues.apache.org/jira/browse/HDFS-2752 Project: Hadoop HDFS Issue Type: Sub-task Components: ha Affect

Re: Timeouts in Datanodes while block scanning

2012-01-05 Thread Aaron T. Myers
What version of HDFS? This question might be more appropriate for hdfs-user@ . -- Aaron T. Myers Software Engineer, Cloudera On Thu, Jan 5, 2012 at 8:59 AM, Uma Maheswara Rao G wrote: > Hi, > > I have 10 Node cluster running from last 25days( running with Hbase > cluster). Recently observed t

Timeouts in Datanodes while block scanning

2012-01-05 Thread Uma Maheswara Rao G
Hi, I have 10 Node cluster running from last 25days( running with Hbase cluster). Recently observed that for every continuos blocks scans, there are many timeouts coming in DataNode. After this block scan verifications, again reads succeeded. This situation keep occurring many times now, for

Jenkins build is still unstable: Hadoop-Hdfs-0.23-Build #129

2012-01-05 Thread Apache Jenkins Server
See

Hadoop-Hdfs-0.23-Build - Build # 129 - Still Unstable

2012-01-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/129/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 14026 lines...] [INFO] [INFO] --- maven-site-plugin:

Hadoop-Hdfs-trunk - Build # 916 - Still Unstable

2012-01-05 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/916/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 12090 lines...] [INFO] Building Apache Hadoop HDFS Project

Jenkins build is still unstable: Hadoop-Hdfs-trunk #916

2012-01-05 Thread Apache Jenkins Server
See