[jira] [Created] (HDFS-5858) Refactor common ACL test cases to be run through multiple FileSystem implementations.

2014-01-30 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5858: --- Summary: Refactor common ACL test cases to be run through multiple FileSystem implementations. Key: HDFS-5858 URL: https://issues.apache.org/jira/browse/HDFS-5858 Proje

Re: Issue with my username on my company provided dev box? (Was: …)

2014-01-30 Thread Stack
Thanks Mohammed for the suggestion though I will say you must have a bit of a perverse streak if you consider this 'enjoyment' -- smile. Going back to the issue of "username" in our version string, it looks like Arun won't have to buy a new machine after all. HADOOP-10313 just got checked in, a sc

[jira] [Resolved] (HDFS-5754) Split LayoutVerion into NamenodeLayoutVersion and DatanodeLayoutVersion

2014-01-30 Thread Tsz Wo (Nicholas), SZE (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5754?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo (Nicholas), SZE resolved HDFS-5754. -- Resolution: Fixed Fix Version/s: HDFS-5535 (Rolling upgrades) I have comm

Re: [VOTE] Merge HDFS-5698 Use protobuf to serialize / deserialize FSImage to trunk

2014-01-30 Thread Azuryy Yu
+1 This was very important improvement. hope it release at 2.4 On Jan 31, 2014 6:37 AM, "Haohui Mai" wrote: > Hello all, > > I would like to call a vote to merge of the new protobuf-based FSImage into > trunk. > > The changes introduce a protobuf-based FSImage format into HDFS. It > separates

Re: Issue with my username on my company provided dev box? (Was: ...)

2014-01-30 Thread Roman Shaposhnik
On Thu, Jan 30, 2014 at 4:45 PM, Mohammad Islam wrote: > I strongly believe the issue could be resolved > through in-person discussion of the related parties and move forward. > After that meeting, a synopsis email could be sent > if that would help and fit the bigger community. Speaking of which

Re: Apache jenkins job to build release artifacts (WAS: Issue with my username on my company provided dev box?)

2014-01-30 Thread Alejandro Abdelnur
I agree on not auto-signing (the script does not do it, on purpose). I was referring to deploying release artifact JARs. OK, then we are done then. Thanks. On Thu, Jan 30, 2014 at 5:02 PM, Roman Shaposhnik wrote: > On Thu, Jan 30, 2014 at 4:43 PM, Alejandro Abdelnur > wrote: > > We could

Re: Issue with my username on my company provided dev box? (Was: …)

2014-01-30 Thread Mohammad Islam
I was "enjoying" this discussion from the sideline.   I strongly believe the issue could be resolved through in-person discussion of the related parties and move forward. After that meeting, a synopsis email could be sent if that would help and fit the bigger community. Regards, Mohammad On Thu

Apache jenkins job to build release artifacts (WAS: Issue with my username on my company provided dev box?)

2014-01-30 Thread Alejandro Abdelnur
[Cross-posting with https://issues.apache.org/jira/browse/HADOOP-10313] OK, we have: * A script, create-release.sh, that creates release artifacts * An Apache Jenkins job that runs the script and produces the artifacts in Apache CI machines, thanks Yahoo! (or shouldn't I say that?) The Apache Je

Re: [VOTE] Merge HDFS-5698 Use protobuf to serialize / deserialize FSImage to trunk

2014-01-30 Thread Haohui Mai
Hi Todd, This is a great question. I don't see a lot of work from the implementation prospective. I anticipate that the branch-2 patch will be almost identical to the one for trunk. We plan on merging it into branch-2 after more testings. In my opinion it should fit in the 2.4 timeline. And to c

Re: [VOTE] Merge HDFS-5698 Use protobuf to serialize / deserialize FSImage to trunk

2014-01-30 Thread Todd Lipcon
One question - what's the intention with this work with regard to branch-2? Do you plan to merge it to branch-2, and if so, are you thinking for 2.4 or later? I'm a little afraid of the divergence between trunk and branch-2 in this area, since we'll likely want to add new features which require se

[jira] [Resolved] (HDFS-5608) WebHDFS: implement ACL APIs.

2014-01-30 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth resolved HDFS-5608. - Resolution: Fixed Fix Version/s: HDFS ACLs (HDFS-4685) Hadoop Flags: Reviewed Good ide

Re: [VOTE] Merge HDFS-5698 Use protobuf to serialize / deserialize FSImage to trunk

2014-01-30 Thread Jing Zhao
+1. I think this is a very useful improvement. In the past when I wanted to add a new snapshot field which needs to be persisted in fsimage, I found that I would break the binary compatibility thus some workaround had to be used (see HDFS-5428). Now protobuf gives us this flexibility to make these

[VOTE] Merge HDFS-5698 Use protobuf to serialize / deserialize FSImage to trunk

2014-01-30 Thread Haohui Mai
Hello all, I would like to call a vote to merge of the new protobuf-based FSImage into trunk. The changes introduce a protobuf-based FSImage format into HDFS. It separates the responsibility of serializing and reconstructing the namespace in the NameNode using Google's Protocol Buffers (protobuf)

[jira] [Resolved] (HDFS-4183) Throttle block recovery

2014-01-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-4183. -- Resolution: Duplicate Target Version/s: 2.1.0-beta, 3.0.0 (was: 3.0.0, 2.1.0-beta) > Throttle

Re: Re-swizzle 2.3

2014-01-30 Thread Vinod Kumar Vavilapalli
That was quite some exercise, but I'm done with it now. Updated YARN's and MAPREDUCE's CHANGES.txt on trunk, branch-2 and branch-2.3. Let me know if you find some inaccuracies. Thanks, +Vinod On Jan 29, 2014, at 10:49 PM, Vinod Kumar Vavilapalli wrote: > > Okay, I'll look at YARN and MR CHA

[jira] [Resolved] (HDFS-5852) Change the colors on the hdfs UI

2014-01-30 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5852?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] stack resolved HDFS-5852. - Resolution: Later > Change the colors on the hdfs UI > > > Key: H

Re: Issue with my username on my company provided dev box? (Was: …)

2014-01-30 Thread Stack
On Wed, Jan 29, 2014 at 7:31 PM, Arun C Murthy wrote: > > Stack, > > Apologies for the late response, I just saw this. > > On Jan 29, 2014, at 3:33 PM, Stack wrote: > > Slightly related, I just ran into this looking back at my 2.2.0 download: > > [stack@c2020 hadoop-2.2.0]$ ./bin/hadoop version

[jira] [Created] (HDFS-5857) TestWebHDFS#testNamenodeRestart fails with NoClassDefFoundError

2014-01-30 Thread Mit Desai (JIRA)
Mit Desai created HDFS-5857: --- Summary: TestWebHDFS#testNamenodeRestart fails with NoClassDefFoundError Key: HDFS-5857 URL: https://issues.apache.org/jira/browse/HDFS-5857 Project: Hadoop HDFS Issu

[jira] [Created] (HDFS-5856) DataNode.checkDiskError might throw NPE

2014-01-30 Thread Josh Elser (JIRA)
Josh Elser created HDFS-5856: Summary: DataNode.checkDiskError might throw NPE Key: HDFS-5856 URL: https://issues.apache.org/jira/browse/HDFS-5856 Project: Hadoop HDFS Issue Type: Bug C

Re: Issue with my username on my company provided dev box? (Was: ...)

2014-01-30 Thread Andrew Purtell
The Apache Software Foundation takes branding seriously, we all know this. Making an inquiry about a possible, and I believe unintended, mis-branding issue involving Apache Hadoop artifacts is not a personal assault. The hysterical responses here have been unprofessional and disgraceful, and only s

[jira] [Resolved] (HDFS-5855) Reading edits should not stop at UpgradeMarker for normal restart of the namenode

2014-01-30 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5855?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinay resolved HDFS-5855. - Resolution: Duplicate Assignee: Vinay > Reading edits should not stop at UpgradeMarker for normal restart of

Re: Re-swizzle 2.3

2014-01-30 Thread Aaron T. Myers
I just committed HADOOP-10310 to branch-2.3, so we're good to go there. (Thanks to Andrew and Daryn for the prompt reviews.) -- Aaron T. Myers Software Engineer, Cloudera On Wed, Jan 29, 2014 at 6:52 PM, Aaron T. Myers wrote: > I just filed this JIRA as a blocker for 2.3: > https://issues.apac

[jira] [Created] (HDFS-5855) Reading edits should not stop at UpgradeMarker for normal restart of the namenode

2014-01-30 Thread Vinay (JIRA)
Vinay created HDFS-5855: --- Summary: Reading edits should not stop at UpgradeMarker for normal restart of the namenode Key: HDFS-5855 URL: https://issues.apache.org/jira/browse/HDFS-5855 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-5850) DNS Issues during TrashEmptier initialization can silently leave it non-functional

2014-01-30 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5850?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-5850. -- Resolution: Won't Fix I don't think we need to fix this in 0.23, if it is already fixed in 2.x. > DNS I

Jenkins build is back to normal : Hadoop-Hdfs-trunk #1658

2014-01-30 Thread Apache Jenkins Server
See

[jira] [Created] (HDFS-5854) WebHDFS file browsing not working on secure cluster -or displaying meaningful errors

2014-01-30 Thread Steve Loughran (JIRA)
Steve Loughran created HDFS-5854: Summary: WebHDFS file browsing not working on secure cluster -or displaying meaningful errors Key: HDFS-5854 URL: https://issues.apache.org/jira/browse/HDFS-5854 Proj

Re: regression in 2.4? YARN severs on secure cluster startup

2014-01-30 Thread Steve Loughran
I can confirm that YARN-1600 fixes the YARN problem, so you can upgrade the YARN binaries without having to patch the yarn-site.xml to get them to start again. However, that leaves the need to set the 'dfs.web.authentication.kerberos.principal' on a secure cluster once you've upgrade -if you hadn'