Re: Branching 2.5

2014-07-29 Thread Andrew Wang
I looked in the log, it also looks like findbugs is OOMing: [java] Exception in thread "main" java.lang.OutOfMemoryError: GC overhead limit exceeded [java] at edu.umd.cs.findbugs.ba.Path.grow(Path.java:263) [java] at edu.umd.cs.findbugs.ba.Path.copyFrom(Path.java:113) [

Re: Branching 2.5

2014-07-29 Thread Karthik Kambatla
Devs, I created branch-2.5.0 and was trying to cut an RC, but ran into issues with creating one. If anyone knows what is going on, please help me out. I ll continue looking into it otherwise. https://builds.apache.org/job/HADOOP2_Release_Artifacts_Builder/24/console is the build that failed. It a

[jira] [Resolved] (HADOOP-6636) New hadoop version command to show which NameNode and JobTracker hosts are associated with the client node .

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6636. -- Resolution: Fixed org.apache.hadoop.util.VersionInfo was added at some point. Closing.

[jira] [Created] (HADOOP-10901) provide un-camelCased versions of shell commands

2014-07-29 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-10901: - Summary: provide un-camelCased versions of shell commands Key: HADOOP-10901 URL: https://issues.apache.org/jira/browse/HADOOP-10901 Project: Hadoop Common

[jira] [Resolved] (HADOOP-6629) versions of dependencies should be specified in a single place

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6629. -- Resolution: Fixed Closing this due to mavenization. > versions of dependencies should

[jira] [Resolved] (HADOOP-6619) Improve error messages when logging in from keytab

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6619?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6619. -- Resolution: Duplicate Yes, it is. Closing as a dupe. > Improve error messages when l

[jira] [Resolved] (HADOOP-6615) make SecurityAudit log to be created ONLY on the server side.

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6615. -- Resolution: Fixed Fixed. ... and essentially re-done in HADOOP-9902. > make Security

[jira] [Resolved] (HADOOP-6592) Scheduler: Pause button desirable

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6592?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6592. -- Resolution: Won't Fix > Scheduler: Pause button desirable > --

[jira] [Resolved] (HADOOP-6602) ClassLoader (Configuration#setClassLoader) in new Job API (0.20) does not work

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6602. -- Resolution: Fixed > ClassLoader (Configuration#setClassLoader) in new Job API (0.20) d

[jira] [Resolved] (HADOOP-6597) additional source only release tarball

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6597. -- Resolution: Fixed > additional source only release tarball > -

[jira] [Resolved] (HADOOP-6574) Commit HADOOP-6414:Add command line help for -expunge command. to Hadoop 0.20

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6574. -- Resolution: Fixed > Commit HADOOP-6414:Add command line help for -expunge command.

[jira] [Resolved] (HADOOP-10686) Writables are not always configured

2014-07-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla resolved HADOOP-10686. --- Resolution: Fixed Looks like I screwed up the merge to branch-2. I merged the chang

[jira] [Resolved] (HADOOP-6528) Jetty returns -1 resulting in Hadoop masters / slaves to fail during startup.

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6528. -- Resolution: Not a Problem Hello from the future! At this point, I'm assuming this iss

[jira] [Resolved] (HADOOP-6525) Support secure clients connecting to insecure servers

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6525. -- Resolution: Duplicate I believe this is the basics of HDFS-3905 and its related JIRAs.

[jira] [Reopened] (HADOOP-10686) Writables are not always configured

2014-07-29 Thread Karthik Kambatla (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-10686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Karthik Kambatla reopened HADOOP-10686: --- Looks like I messed up backporting to branch-2. > Writables are not always configured

[jira] [Resolved] (HADOOP-6514) Failed to run pseudo-distributed cluster on Win XP

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6514. -- Resolution: Won't Fix > Failed to run pseudo-distributed cluster on Win XP > -

[jira] [Resolved] (HADOOP-6499) Standardize when we return false and when we throw IOException in FileSystem API

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6499. -- Resolution: Won't Fix > Standardize when we return false and when we throw IOException

[jira] [Resolved] (HADOOP-6485) Trash fails on Windows

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6485?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6485. -- Resolution: Fixed Likely stale. > Trash fails on Windows > -- > >

[jira] [Resolved] (HADOOP-6483) Provide Hadoop as a Service based on standards

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6483. -- Resolution: Incomplete Interesting, but stale. > Provide Hadoop as a Service based on

[jira] [Resolved] (HADOOP-6476) o.a.h.io.Text - setCapacity does not shrink size

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6476. -- Resolution: Won't Fix > o.a.h.io.Text - setCapacity does not shrink size > --

[jira] [Resolved] (HADOOP-6470) JMX Context for Metrics

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6470. -- Resolution: Fixed > JMX Context for Metrics > --- > >

[jira] [Resolved] (HADOOP-6468) compile-core-test failing with java.lang.NoSuchMethodError: org.objectweb.asm.ClassWriter.

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6468. -- Resolution: Fixed > compile-core-test failing with java.lang.NoSuchMethodError: > org

[jira] [Created] (HADOOP-10900) CredentialShell args should use single-dash style

2014-07-29 Thread Andrew Wang (JIRA)
Andrew Wang created HADOOP-10900: Summary: CredentialShell args should use single-dash style Key: HADOOP-10900 URL: https://issues.apache.org/jira/browse/HADOOP-10900 Project: Hadoop Common I

[jira] [Resolved] (HADOOP-6458) Website nightly developer links to non-existant Hudson page Hadoop-trunk

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6458. -- Resolution: Fixed almost certainly fixed by now. > Website nightly developer links to

Re: Hadoop Code of Incompatible Changes

2014-07-29 Thread Sandy Ryza
Thanks Arpit! On Tue, Jul 29, 2014 at 2:24 PM, Arpit Agarwal wrote: > I cleared out the wiki page and left a forwarding link to the site docs. > From a quick scan all the content is included in the site docs. > > > On Tue, Jul 29, 2014 at 2:14 PM, Sandy Ryza > wrote: > > > Eli pointed out to m

[jira] [Resolved] (HADOOP-6457) Set Hadoop User/Group by System properties or environment variables

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6457. -- Resolution: Duplicate > Set Hadoop User/Group by System properties or environment vari

Re: Hadoop Code of Incompatible Changes

2014-07-29 Thread Arpit Agarwal
I cleared out the wiki page and left a forwarding link to the site docs. >From a quick scan all the content is included in the site docs. On Tue, Jul 29, 2014 at 2:14 PM, Sandy Ryza wrote: > Eli pointed out to me that this is the up-to-date compatibility guide: > > http://hadoop.apache.org/docs

Re: Hadoop Code of Incompatible Changes

2014-07-29 Thread Sandy Ryza
Eli pointed out to me that this is the up-to-date compatibility guide: http://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/Compatibility.html Thanks, Sandy On Tue, Jul 29, 2014 at 9:39 AM, Sandy Ryza wrote: > Hi Zhijie, > > The Hadoop compatibility guide mentions this as "s

[jira] [Resolved] (HADOOP-6406) hadoop-core.pom contains hardcoded and nonexistent commons-cli version and jetty groupId/artifactId mixup

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6406. -- Resolution: Not a Problem > hadoop-core.pom contains hardcoded and nonexistent commons

[jira] [Resolved] (HADOOP-6370) Contrib project ivy dependencies are not included in binary target

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6370. -- Resolution: Won't Fix > Contrib project ivy dependencies are not included in binary ta

[jira] [Resolved] (HADOOP-6446) Deprecate FileSystem

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6446. -- Resolution: Won't Fix Closing this as Won't Fix ..

[jira] [Resolved] (HADOOP-6368) hadoop classpath is too long

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6368. -- Resolution: Duplicate Closing this as part of the HADOOP-9902 work. > hadoop classpat

[jira] [Resolved] (HADOOP-6365) distributed cache doesn't work with HDFS and another file system

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6365. -- Resolution: Fixed This looks fixed. > distributed cache doesn't work with HDFS and an

[jira] [Resolved] (HADOOP-6363) Move Seekable and PositionedReadable interfaces from o.a.h.fs to o.a.h.io package

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6363. -- Resolution: Won't Fix > Move Seekable and PositionedReadable interfaces from o.a.h.fs

[jira] [Resolved] (HADOOP-6349) Implement FastLZCodec for fastlz/lzo algorithm

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6349. -- Resolution: Won't Fix > Implement FastLZCodec for fastlz/lzo algorithm > -

[jira] [Resolved] (HADOOP-6340) Change build/test/clean targets to prevent tar target from including clover instrumented code

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6340. -- Resolution: Won't Fix > Change build/test/clean targets to prevent tar target from inc

[jira] [Resolved] (HADOOP-6330) Integrating IBM General Parallel File System implementation of Hadoop Filesystem interface

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6330?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6330. -- Resolution: Won't Fix Supplemental FileSystem/FileContext code comes from their respec

[jira] [Resolved] (HADOOP-6319) Capacity reporting incorrect on Solaris

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6319. -- Resolution: Won't Fix > Capacity reporting incorrect on Solaris >

[jira] [Resolved] (HADOOP-6316) Add missing Junit tests for Hadoop-6314

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6316. -- Resolution: Won't Fix > Add missing Junit tests for Hadoop-6314 >

[jira] [Resolved] (HADOOP-6383) Add simulated data node cluster start/stop commands in hadoop-dameon.sh .

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6383. -- Resolution: Duplicate > Add simulated data node cluster start/stop commands in hadoop-

[jira] [Resolved] (HADOOP-6302) Move FileSystem and all of the implementations to HDFS project

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6302?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6302. -- Resolution: Won't Fix > Move FileSystem and all of the implementations to HDFS project

[jira] [Resolved] (HADOOP-6306) ant testcase target should run quickly

2014-07-29 Thread Allen Wittenauer (JIRA)
[ https://issues.apache.org/jira/browse/HADOOP-6306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Allen Wittenauer resolved HADOOP-6306. -- Resolution: Won't Fix > ant testcase target should run quickly >

[jira] [Created] (HADOOP-10899) Hadoop CommandsManual.vm documentation gives deprecated information

2014-07-29 Thread Allen Wittenauer (JIRA)
Allen Wittenauer created HADOOP-10899: - Summary: Hadoop CommandsManual.vm documentation gives deprecated information Key: HADOOP-10899 URL: https://issues.apache.org/jira/browse/HADOOP-10899 Proje

Re: Code guidelines and bash

2014-07-29 Thread Colin McCabe
On Tue, Jul 29, 2014 at 2:45 AM, 俊平堵 wrote: > Sun's java code convention (published in year of 97) suggest 80 column per > line for old-style terminals. It sounds pretty old, However, I saw some > developers (not me :)) like to open multiple terminals in one screen for > coding/debugging so 80-col

Re: Jenkins problem or patch problem?

2014-07-29 Thread Andrew Wang
We could change test-patch to use "git apply" instead of the patch command. I know a lot of us use git apply when committing, so it seems like a safe change. On Tue, Jul 29, 2014 at 1:44 AM, Niels Basjes wrote: > I think this behavior is better. > This way you know you patch was not (fully) app

Re: Hadoop Code of Incompatible Changes

2014-07-29 Thread Sandy Ryza
Hi Zhijie, The Hadoop compatibility guide mentions this as "semantic compatibility": http://wiki.apache.org/hadoop/Compatibility My interpretation of the section is that we can't change the behavior of public APIs unless we're fixing buggy behavior. If the change could break an existing applicat

Hadoop Code of Incompatible Changes

2014-07-29 Thread Zhijie Shen
Hi folks, Recently we have a conversation on YARN-2209 about the incompatible changes over releases. For those API changes that will break binary compatibility, source compatibility towards the existing API users, we've already had a rather clear picture about what we should do. However, YARN-2209

Re: Code guidelines and bash

2014-07-29 Thread 俊平堵
Sun's java code convention (published in year of 97) suggest 80 column per line for old-style terminals. It sounds pretty old, However, I saw some developers (not me :)) like to open multiple terminals in one screen for coding/debugging so 80-colum could be just fit. Google's java convention ( http

Build failed in Jenkins: Hadoop-Common-trunk #1190

2014-07-29 Thread Apache Jenkins Server
See Changes: [arp] HADOOP-8069. Enable TCP_NODELAY by default for IPC. (Contributed by Todd Lipcon) [wang] HADOOP-10876. The constructor of Path should not take an empty URL as a parameter. Contributed by Zhihai Xu. [szetszwo] H

Build failed in Jenkins: Hadoop-Common-0.23-Build #1025

2014-07-29 Thread Apache Jenkins Server
See -- [...truncated 8263 lines...] Running org.apache.hadoop.fs.TestFileSystemTokens Tests run: 10, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.512 sec Running org.apache.hadoop.fs.TestF

[jira] [Created] (HADOOP-10898) MapWritable instances cannot be reused when containing different custom Writable classes.

2014-07-29 Thread Eli Acherkan (JIRA)
Eli Acherkan created HADOOP-10898: - Summary: MapWritable instances cannot be reused when containing different custom Writable classes. Key: HADOOP-10898 URL: https://issues.apache.org/jira/browse/HADOOP-10898

Re: Jenkins problem or patch problem?

2014-07-29 Thread Niels Basjes
I think this behavior is better. This way you know you patch was not (fully) applied. It would be even better if there was a way to submit a patch with a binary file in there. Niels On Mon, Jul 28, 2014 at 11:29 PM, Andrew Wang wrote: > I had the same issue on HDFS-6696, patch generated with

Re: Code guidelines and bash

2014-07-29 Thread Andrew Purtell
On Mon, Jul 28, 2014 at 12:05 PM, Doug Cutting wrote: > On Sun, Jul 27, 2014 at 9:28 PM, Ted Dunning > wrote: > > I don't know of any dev environments in common use today that can't > display >100 characters. > > I edit in an 80-column Emacs window that just fits beside an 80-column > shell wind