[jira] [Created] (HDFS-2526) (Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry

2011-10-31 Thread Aaron T. Myers (Created) (JIRA)
(Client)NamenodeProtocolTranslatorR23 do not need to keep a reference to rpcProxyWithoutRetry - Key: HDFS-2526 URL: https://issues.apache.org/jira/browse/HDFS-2526

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #59

2011-10-31 Thread Apache Jenkins Server
See Changes: [suresh] Fix HDFS-2552 to HDFS-2522 [suresh] Disable TestDfsOverAvroRpc in 0.23. Contributed by Suresh Srinivas. [tomwhite] Merge -r 1195816:1195817 from trunk to branch-0.23. Fixes: HADOOP-7782. [mahadev] MAPREDUC

Hadoop-Hdfs-0.23-Build - Build # 59 - Still Failing

2011-10-31 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/59/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7867 lines...] [INFO] from /usr/inclu

[jira] [Resolved] (HDFS-2522) Disable TestDfsOverAvroRpc in 0.23

2011-10-31 Thread Suresh Srinivas (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Suresh Srinivas resolved HDFS-2522. --- Resolution: Fixed I committed the patch. > Disable TestDfsOverAvroRpc in 0.23

[jira] [Created] (HDFS-2525) Race between BlockPoolSliceScanner and append

2011-10-31 Thread Todd Lipcon (Created) (JIRA)
Race between BlockPoolSliceScanner and append - Key: HDFS-2525 URL: https://issues.apache.org/jira/browse/HDFS-2525 Project: Hadoop HDFS Issue Type: Bug Components: data-node Affects

[jira] [Created] (HDFS-2524) HA: Simple HealthMonitor class to watch an HAService

2011-10-31 Thread Todd Lipcon (Created) (JIRA)
HA: Simple HealthMonitor class to watch an HAService Key: HDFS-2524 URL: https://issues.apache.org/jira/browse/HDFS-2524 Project: Hadoop HDFS Issue Type: Sub-task Reporter: Tod

[jira] [Resolved] (HDFS-2523) NameNode needs to add HAServiceProtocol to its RPC Server

2011-10-31 Thread Todd Lipcon (Resolved) (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Todd Lipcon resolved HDFS-2523. --- Resolution: Fixed Fix Version/s: HA branch (HDFS-1623) Hadoop Flags: Reviewed committed to

[jira] [Created] (HDFS-2523) NameNode needs to add HAServiceProtocol to its RPC Server

2011-10-31 Thread Todd Lipcon (Created) (JIRA)
NameNode needs to add HAServiceProtocol to its RPC Server - Key: HDFS-2523 URL: https://issues.apache.org/jira/browse/HDFS-2523 Project: Hadoop HDFS Issue Type: Sub-task Compo

Hadoop-Hdfs-0.23-Build - Build # 58 - Still Failing

2011-10-31 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-0.23-Build/58/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7980 lines...] [INFO] from hdfs.c:19:

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #58

2011-10-31 Thread Apache Jenkins Server
See Changes: [todd] HDFS-2512. Add textual error message to data transfer protocol responses. Contributed by Todd Lipcon. [szetszwo] svn merge -c 1195656 from trunk for HDFS-2385. [acmurthy] Merge -c 1195579 from trunk to branch

Re: relative symbolic links in HDFS

2011-10-31 Thread Eli Collins
On Mon, Oct 31, 2011 at 2:19 PM, Charles Baker wrote: > I did a hasty test initially of getLinkTarget() but forgot to also use the > same for the input path to FileContext#createSymlink() so yeah, turns out it > does indeed work. Sorry about that. Looks like I won't need to modify > FileContext af

[jira] [Created] (HDFS-2522) Comment TestDfsOverAvroRpc in 0.23

2011-10-31 Thread Suresh Srinivas (Created) (JIRA)
Comment TestDfsOverAvroRpc in 0.23 -- Key: HDFS-2522 URL: https://issues.apache.org/jira/browse/HDFS-2522 Project: Hadoop HDFS Issue Type: Test Affects Versions: 0.23.0 Reporter: Suresh Sriniva

Re: hadoop-0.23.0 jiras

2011-10-31 Thread Tom White
Hi Arun, A couple more issues that I think are blockers: HADOOP-7782 (Aggregate project javadocs) should be a blocker since otherwise private APIs are published as a part of the public API. MAPREDUCE-3237 (Move LocalJobRunner to hadoop-mapreduce-client-core module) is also a blocker since without

RE: relative symbolic links in HDFS

2011-10-31 Thread Charles Baker
I did a hasty test initially of getLinkTarget() but forgot to also use the same for the input path to FileContext#createSymlink() so yeah, turns out it does indeed work. Sorry about that. Looks like I won't need to modify FileContext after all which is good :) The rationale of keeping things consi

Re: relative symbolic links in HDFS

2011-10-31 Thread Daryn Sharp
On Oct 31, 2011, at 1:45 PM, Eli Collins wrote: > On Mon, Oct 31, 2011 at 9:27 AM, Charles Baker wrote: >> But even >> if it did return the relative path, it seems counter-intuitive to me. I agree >> with Daryn and expect the behavior of getFileLinkStatus() to return the >> symlink as is and not

[jira] [Created] (HDFS-2521) Remove custom checksum headers from data transfer protocol

2011-10-31 Thread Todd Lipcon (Created) (JIRA)
Remove custom checksum headers from data transfer protocol -- Key: HDFS-2521 URL: https://issues.apache.org/jira/browse/HDFS-2521 Project: Hadoop HDFS Issue Type: Improvement

Re: replication in HDFS

2011-10-31 Thread Zheng Da
Hello Ram, Sorry, I didn't notice your reply. I don't really have a complete design in my mind. I wonder if the community is interested in using an alternative scheme to support data reliability and if the community plans to do it. You are right, we might need to buffer the source blocks on the

Re: relative symbolic links in HDFS

2011-10-31 Thread Eli Collins
On Mon, Oct 31, 2011 at 9:27 AM, Charles Baker wrote: > Hey guys. Thanks for the replies. Fully qualified symbolic links are > problematic in that when we wish to restore a directory structure containing > symlinks from HDFS to local filesystem, the relativity is lost. For instance: > > /user/cbak

Jenkins build is unstable: Hadoop-Hdfs-0.23-Build #57

2011-10-31 Thread Apache Jenkins Server
See

[jira] [Created] (HDFS-2520) Protobuf - Add protobuf service for InterDatanodeProtocol

2011-10-31 Thread Suresh Srinivas (Created) (JIRA)
Protobuf - Add protobuf service for InterDatanodeProtocol - Key: HDFS-2520 URL: https://issues.apache.org/jira/browse/HDFS-2520 Project: Hadoop HDFS Issue Type: New Feature Co

[jira] [Created] (HDFS-2519) Protobuf - Add protobuf service for DatanodeProtocol

2011-10-31 Thread Suresh Srinivas (Created) (JIRA)
Protobuf - Add protobuf service for DatanodeProtocol Key: HDFS-2519 URL: https://issues.apache.org/jira/browse/HDFS-2519 Project: Hadoop HDFS Issue Type: New Feature Components:

[jira] [Created] (HDFS-2518) Protobuf - Add protobuf service for NamenodeProtocol

2011-10-31 Thread Suresh Srinivas (Created) (JIRA)
Protobuf - Add protobuf service for NamenodeProtocol Key: HDFS-2518 URL: https://issues.apache.org/jira/browse/HDFS-2518 Project: Hadoop HDFS Issue Type: New Feature Components:

Re: relative symbolic links in HDFS

2011-10-31 Thread Daryn Sharp
Universal support for FileContext & symlinks in all commands should be coming "soon". A few jiras that removed complications recently were committed or in the process of being committed. Copy commands will require some extra parameters to control whether symlinks are dereferenced. Daryn On

[jira] [Created] (HDFS-2517) Protobuf - Add protocol service for JournalProtocol

2011-10-31 Thread Suresh Srinivas (Created) (JIRA)
Protobuf - Add protocol service for JournalProtocol --- Key: HDFS-2517 URL: https://issues.apache.org/jira/browse/HDFS-2517 Project: Hadoop HDFS Issue Type: New Feature Components: na

RE: relative symbolic links in HDFS

2011-10-31 Thread Charles Baker
Hey guys. Thanks for the replies. Fully qualified symbolic links are problematic in that when we wish to restore a directory structure containing symlinks from HDFS to local filesystem, the relativity is lost. For instance: /user/cbaker/foo/ link1 -> ../../cbaker The current behav

Re: relative symbolic links in HDFS

2011-10-31 Thread Daryn Sharp
It's generally been a problem that filesystem operations mangle paths to be something other than what the user provided. FsShell has to go to some (unnecessary, imho) lengths to independently track the user's given path so the output paths will match what the user provided. Not displaying the

[jira] [Created] (HDFS-2516) Tests for recursive copy/move commands

2011-10-31 Thread Daryn Sharp (Created) (JIRA)
Tests for recursive copy/move commands -- Key: HDFS-2516 URL: https://issues.apache.org/jira/browse/HDFS-2516 Project: Hadoop HDFS Issue Type: Bug Components: test Affects Versions: 0.20.205.

Hadoop-Hdfs-trunk - Build # 849 - Still Failing

2011-10-31 Thread Apache Jenkins Server
See https://builds.apache.org/job/Hadoop-Hdfs-trunk/849/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 10280 lines...] [INFO] [INFO] There are 12077 checkstyle

Build failed in Jenkins: Hadoop-Hdfs-trunk #849

2011-10-31 Thread Apache Jenkins Server
See Changes: [vinodkv] MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth. [vinodkv] MAPREDUCE-2696. Fixed NodeManag

Build failed in Jenkins: Hadoop-Hdfs-0.23-Build #56

2011-10-31 Thread Apache Jenkins Server
See Changes: [vinodkv] MAPREDUCE-3262. Fixed Container's state-machine in NodeManager to handle a couple of events in failure states correctly. Contributed by Hitesh Shah and Siddharth Seth. svn merge -c r1195416 --ignore-ancestr

Re: hadoop-0.23.0 jiras

2011-10-31 Thread Arun C Murthy
Done. Ping me if you find anything astray. thanks, Arun On Oct 30, 2011, at 9:18 PM, Arun C Murthy wrote: > FYI - I'm starting to change 'fix version' for all non-blockers and do a > final pass on open blockers. > > I'll send a note out when done. > > thanks, > Arun >