Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

2020-03-04 Thread John Zhuge
>> contributions to the > > >> project. > > >> > > >> Please join me in congratulating him. > > >> > > >> Hearty Congratulations & Welcome aboard Stephen! > > >> > > >> Wei-Chiu Chuang > > >> (On behalf of the Hadoop PMC) > > >> > > > > - > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > > -- John Zhuge

Re: [VOTE] EOL Hadoop branch-2.8

2020-03-08 Thread John Zhuge
>>>>>> Thanks Wei-Chiu for starting the discussion, > > > >>>>>> > > > >>>>>> +1 for the EoL. > > > >>>>>> > > > >>>>>> -Akira > > > >>>>>> > > > >>>>>> On Tue, Feb 18, 2020 at 4:59 PM Ayush Saxena < > ayush...@gmail.com> > > > >>>> wrote: > > > >>>>>> > > > >>>>>>> Thanx Wei-Chiu for initiating this > > > >>>>>>> +1 for marking 2.8 EOL > > > >>>>>>> > > > >>>>>>> -Ayush > > > >>>>>>> > > > >>>>>>>> On 17-Feb-2020, at 11:14 PM, Wei-Chiu Chuang < > > > >>> weic...@apache.org> > > > >>>>>> wrote: > > > >>>>>>>> > > > >>>>>>>> The last Hadoop 2.8.x release, 2.8.5, was GA on September > 15th > > > >>>> 2018. > > > >>>>>>>> > > > >>>>>>>> It's been 17 months since the release and the community by and > > > >>>> large > > > >>>>>> have > > > >>>>>>>> moved up to 2.9/2.10/3.x. > > > >>>>>>>> > > > >>>>>>>> With Hadoop 3.3.0 over the horizon, is it time to start the > EOL > > > >>>>>>> discussion > > > >>>>>>>> and reduce the number of active branches? > > > >>>>>>> > > > >>>>>>> > > > >>> > - > > > >>>>>>> To unsubscribe, e-mail: > common-dev-unsubscr...@hadoop.apache.org > > > >>>>>>> For additional commands, e-mail: > > > >>> common-dev-h...@hadoop.apache.org > > > >>>>>>> > > > >>>>>>> > > > >>>>>> > > > >>>>> > > > >>>> > > > >>> > > > >> > > > > > > Wilfred Spiegelenburg > > > Staff Software Engineer > > > <https://www.cloudera.com/> > > > > > > -- John Zhuge

Re: [DISCUSS] fate of branch-2.9

2020-08-27 Thread John Zhuge
t; > >> >>>> On Mon, Mar 2, 2020 at 6:30 PM Sree Vaddi > >> >>>> wrote: > >> >>>> > >> >>>>> +1 > >> >>>>> > >> >>>>> Sent from Yahoo Mail on Android > >> >>>>> > >> >>>>> On Mon, Mar 2, 2020 at 5:12 PM, Wei-Chiu Chuang< > weic...@apache.org> > >> >>>>> wrote: Hi, > >> >>>>> > >> >>>>> Following the discussion to end branch-2.8, I want to start a > >> >>>>> discussion > >> >>>>> around what's next with branch-2.9. I am hesitant to use the word > "end > >> >>>>> of > >> >>>>> life" but consider these facts: > >> >>>>> > >> >>>>> * 2.9.0 was released Dec 17, 2017. > >> >>>>> * 2.9.2, the last 2.9.x release, went out Nov 19 2018, which is > more > >> >>>>> than > >> >>>>> 15 months ago. > >> >>>>> * no one seems to be interested in being the release manager for > 2.9.3. > >> >>>>> * Most if not all of the active Hadoop contributors are using > Hadoop > >> >>>>> 2.10 > >> >>>>> or Hadoop 3.x. > >> >>>>> * We as a community do not have the cycle to manage multiple > release > >> >>>>> line, > >> >>>>> especially since Hadoop 3.3.0 is coming out soon. > >> >>>>> > >> >>>>> It is perhaps the time to gradually reduce our footprint in Hadoop > >> >>>>> 2.x, and > >> >>>>> encourage people to upgrade to Hadoop 3.x > >> >>>>> > >> >>>>> Thoughts? > >> >>>>> > >> >>>>> > -- John Zhuge

Re: [VOTE] End of Life Hadoop 2.9

2020-09-02 Thread John Zhuge
t; will be made after 2.9.2 (which was GA on 11/19/2019) > > (2) resolve JIRAs that specifically target 2.9.3 as won't fix. > > > > > > This vote will run for 7 days and will conclude by September 7th, 12:00pm > > pacific time. > > Committers are eligible to cast binding votes. Non-committers are > welcomed > > to cast non-binding votes. > > > > Here is my vote, +1 > > > -- John Zhuge

Re: [DISCUSS] Change project style guidelines to allow line length 100

2021-05-20 Thread John Zhuge
> Thanks, > > > > > > >> > > Akira > > > > > > >> > > > > > > > > >> > > On Thu, May 20, 2021 at 6:36 AM Sean Busbey > > > > > > >> mailto:sbus...@apple.com.invalid > > >> > > > > > > >> > wrote: > > > > > > >> > >> > > > > > > >> > >> Hello! > > > > > > >> > >> > > > > > > >> > >> What do folks think about changing our line > length > > > > > > >> guidelines to allow > > > > > > >> > for 100 character width? > > > > > > >> > >> > > > > > > >> > >> Currently, we tell folks to follow the sun style > > > guide > > > > > > with > > > > > > >> some > > > > > > >> > exception unrelated to line length. That guide says width > > of > > > 80 > > > > > is > > > > > > the > > > > > > >> > standard and our current check style rules act as > > > enforcement. > > > > > > >> > >> > > > > > > >> > >> Looking at the current trunk codebase our > nightly > > > > build > > > > > > >> shows a total > > > > > > >> > of ~15k line length violations; it’s about 18% of > > identified > > > > > > >> checkstyle > > > > > > >> > issues. > > > > > > >> > >> > > > > > > >> > >> The vast majority of those line length > violations > > > are > > > > <= > > > > > > 100 > > > > > > >> characters > > > > > > >> > long. 100 characters happens to be the length for the > > Google > > > > Java > > > > > > >> Style > > > > > > >> > Guide, another commonly adopted style guide for java > > > projects, > > > > > so I > > > > > > >> suspect > > > > > > >> > these longer lines leaking past the checkstyle precommit > > > > warning > > > > > > >> might be a > > > > > > >> > reflection of committers working across multiple java > > > > codebases. > > > > > > >> > >> > > > > > > >> > >> I don’t feel strongly about lines being longer, > > but > > > I > > > > > > would > > > > > > >> like to > > > > > > >> > move towards more consistent style enforcement as a > > project. > > > > > > Updating > > > > > > >> our > > > > > > >> > project guidance to allow for 100 character lines would > > > reduce > > > > > the > > > > > > >> > likelihood that folks bringing in new contributions need > a > > > > > > precommit > > > > > > >> test > > > > > > >> > cycle to get the formatting correct. > > > > > > >> > >> > > > > > > >> > >> Does anyone feel strongly about keeping the line > > > > length > > > > > > >> limit at 80 > > > > > > >> > characters? > > > > > > >> > >> > > > > > > >> > >> Does anyone feel strongly about contributions > > coming > > > > in > > > > > > that > > > > > > >> clear up > > > > > > >> > line length violations? > > > > > > >> > >> > > > > > > >> > >> > > > > > > >> > >> > > > > > > >> > > > > - > > > > > > >> > >> To unsubscribe, e-mail: > > > > > > >> common-dev-unsubscr...@hadoop.apache.org > > > > > common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > >> For additional commands, e-mail: > > > > > > >> common-dev-h...@hadoop.apache.org > > > > > common-dev-h...@hadoop.apache.org> > > > > > > >> > >> > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > - > > > > > > >> > > To unsubscribe, e-mail: > > > > > > common-dev-unsubscr...@hadoop.apache.org > > > > > common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > > For additional commands, e-mail: > > > > > > >> common-dev-h...@hadoop.apache.org > > > > > common-dev-h...@hadoop.apache.org> > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > > > - > > > > > > >> > To unsubscribe, e-mail: > > > > common-dev-unsubscr...@hadoop.apache.org > > > > > > <mailto:common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > For additional commands, e-mail: > > > > > common-dev-h...@hadoop.apache.org > > > > > > <mailto:common-dev-h...@hadoop.apache.org> > > > > > > >> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- John Zhuge

Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0

2017-10-03 Thread John Zhuge
+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo cluster

Re: Interested to Contribute in Hadoop Development

2017-10-04 Thread John Zhuge
Welcome Kumar! You can start with this wiki https://wiki.apache.org/hadoop/HowToContribute. Work on a few simple JIRAs in https://issues.apache.org/ jira/issues/?jql=project%20in%20(HADOOP%2C%20HDFS)%20AND% 20status%20%3D%20Open%20AND%20resolution%20%3D%20Unresolved%20AND%20labels% 20%3D%20newbie

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC1)

2017-10-23 Thread John Zhuge
+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo cluste

Re: Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-25 Thread John Zhuge
Hi Xie Gang, Thanks for reporting the issue. How was the block invalidated on DN? I recently created a unit test that might trigger a somewhat similar symptom: 1. Read a 4000-byte file in MiniDFS. It should go thru domain socket. 2. Call input stream unbuffer. It will close the block reade

Re: Block invalid IOException causes the DFSClient domain socket being disabled

2017-10-26 Thread John Zhuge
Please go ahead. On Thu, Oct 26, 2017 at 6:12 PM, Xie Gang wrote: > Shall I create the jira directly? > > On Thu, Oct 26, 2017 at 12:34 PM, Xie Gang wrote: > > > Hi, > > > > We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain > > socket is disabled when datanode throw block inv

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC1)

2017-11-09 Thread John Zhuge
+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified these cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo c

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

2017-11-16 Thread John Zhuge
+1 (binding) - Verified checksums of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Passed all S3A and ADL integration tests - Deployed both binary and built source to a pseudo cluster, passed the following sanity tests in insecure, SSL, and SSL+Ke

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-12 Thread John Zhuge
Thanks Junping for the great effort! - Verified checksums and signatures of all tarballs - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 - Verified cloud connectors: - All S3A integration tests - Deployed both binary and built source to a pseudo cluster, pass

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

2017-12-12 Thread John Zhuge
Thanks Konstantin for the great effort! +1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 - Verified cloud connectors: - All S3A integration tests - Deployed both binary and built source to a pse

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

2017-12-12 Thread John Zhuge
Oops, the vote was meant for 2.7.5. Sorry for the confusion. My 2.8.3 vote coming up shortly. On Tue, Dec 12, 2017 at 4:28 PM, John Zhuge wrote: > Thanks Junping for the great effort! > > >- Verified checksums and signatures of all tarballs >- Built source with na

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

2017-12-13 Thread John Zhuge
Thanks Andrew for the great effort! Here is my late vote. +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.2 - Verified cloud connectors: - S3A integration tests (perf tests skipped) - Deployed both

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

2018-06-08 Thread John Zhuge
Thanks Xongjun for the excellent work to drive this release! +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.5 - Verified cloud connectors: - ADLS integration tests passed with 1 failure, not a blocke

Re: HADOOP-14163 proposal for new hadoop.apache.org

2018-09-02 Thread John Zhuge
+1 Like the new site. On Sun, Sep 2, 2018 at 7:02 PM Weiwei Yang wrote: > That's really nice, +1. > > -- > Weiwei > > On Sat, Sep 1, 2018 at 4:36 AM Wangda Tan wrote: > > > +1, thanks for working on this, Marton! > > > > Best, > > Wangda > > > > On Fri, Aug 31, 2018 at 11:24 AM Arpit Agarwal >

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

2016-05-16 Thread John Zhuge
Thanks Andrew. Looking forward to CompletableFuture and Streams. John Zhuge Software Engineer, Cloudera > On May 16, 2016, at 3:58 PM, Andrew Wang wrote: > > Very happy to announce that we've committed HADOOP-11858. I'm looking > forward to writing my first lambda in J

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

2016-07-27 Thread John Zhuge
examples - Start balancer Thanks, John John Zhuge Software Engineer, Cloudera On Wed, Jul 27, 2016 at 11:38 AM, Robert Kanter wrote: > +1 (binding) > > - Downloaded binary tarball > - verified signatures > - setup pseudo cluster > - ran some of the example jobs, clicked a

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

2016-08-31 Thread John Zhuge
+1 (non-binding) - Build source with Java 1.8.0_101 on Centos 6.6 without native - Verify license and notice using the shell script in HADOOP-13374 - Deploy a pseudo cluster - Run basic dfs, distcp, ACL, webhdfs commands - Run MapReduce workcount and pi examples - Run balancer Thanks, John John

Permission bit 12 in getFileInfo response

2016-09-19 Thread John Zhuge
plication: 0 blocksize: 0 fileId: 8798130 childrenNum: 1 storagePolicy: 0 }} Thanks, John Zhuge Software Engineer, Cloudera

Re: Permission bit 12 in getFileInfo response

2016-09-19 Thread John Zhuge
Thanks Chris! Silly me, didn't look at "FsPermissionExtension". John Zhuge Software Engineer, Cloudera On Mon, Sep 19, 2016 at 11:33 AM, Chris Nauroth wrote: > Hello John, > > That is the ACL bit. The NameNode toggles on the ACL bit in getFileInfo > responses for i

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

2016-09-30 Thread John Zhuge
ransitionToActive failure from refeshAll() (Bibin A Chundatt via > rohithsharmaks) Thanks, John Zhuge Software Engineer, Cloudera On Tue, Sep 27, 2016 at 1:28 PM, Sangjin Lee wrote: > Hi folks, > > I have created a release candidate RC0 for the Apache Hadoop 2.6.5 release > (

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

2016-09-30 Thread John Zhuge
, webhdfs commands - Ran MapReduce workcount example - Ran balancer Thanks, John John Zhuge Software Engineer, Cloudera On Fri, Sep 30, 2016 at 6:15 PM, Chris Douglas wrote: > +1 Verified checksum and signature. Unpacked the jar, started > single-node HDFS cluster, did some cursory checks. &g

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

2016-10-07 Thread John Zhuge
- Ran balancer Thanks, John John Zhuge Software Engineer, Cloudera On Sun, Oct 2, 2016 at 5:12 PM, Sangjin Lee wrote: > Hi folks, > > I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5 > release (the next maintenance release in the 2.6.x release line). RC1 > co

Re: [DISCUSS] HADOOP-13603 - Remove package line length checkstyle rule

2016-10-20 Thread John Zhuge
classes or methods. Thanks, John Zhuge John Zhuge Software Engineer, Cloudera On Thu, Oct 20, 2016 at 3:22 AM, Steve Loughran wrote: > > > On 19 Oct 2016, at 14:52, Shane Kumpf > wrote: > > > > All, > > > > I would like to start a discussion on the possi

Enhance FileUtil#list to throw ACE when the dir is not readable

2016-10-24 Thread John Zhuge
more precise exception class and message. Thanks, John Zhuge Software Engineer, Cloudera

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

2017-01-20 Thread John Zhuge
pseudo cluster, passed the following sanity tests in both insecure and SSL mode: - basic dfs, distcp, ACL commands - KMS and HttpFS tests - MapReduce wordcount example - balancer start/stop John Zhuge Software Engineer, Cloudera On Fri, Jan 20, 2017 at 2:36 PM, Andrew Wang wrote: > Hi

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-20 Thread John Zhuge
doop-tools-dist/pom.xml. I am working on a patch. John Zhuge Software Engineer, Cloudera On Fri, Mar 17, 2017 at 2:18 AM, Junping Du wrote: > Hi all, > With fix of HDFS-11431 get in, I've created a new release candidate > (RC3) for Apache Hadoop 2.8.0. > > Thi

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-20 Thread John Zhuge
54 » AccessControl TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.testMkdirsFailsForSubdirectoryOfExistingFile:190 » AccessControl Stay tuned... John Zhuge Software Engineer, Cloudera On Mon, Mar 20, 2017 at 10:02 AM, Junping Du wrote: > Thank you for reporting th

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

2017-03-21 Thread John Zhuge
- balancer start/stop Needs the following JIRAs to pass all ADL tests: - HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge. - HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

2017-07-05 Thread John Zhuge
For some reason, I can't build the source. Got this when running "mvn install -U" inside directory "hadoop-maven-plugins": [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project hadoop-maven-plugins: Execution default of goal org.apa

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

2017-07-05 Thread John Zhuge
False alarm, fixed the build issue with "mvn -U clean install". On Wed, Jul 5, 2017 at 6:08 PM, John Zhuge wrote: > For some reason, I can't build the source. > > Got this when running "mvn install -U" inside directory > "hadoop-maven-pl

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

2017-07-05 Thread John Zhuge
+1 (non-binding) - Verified checksums and signatures of the tarballs - Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 - Cloud connectors: - A few S3A integration tests - A few ADL live unit tests - Deployed both binary and built source to a pseudo cluster, pa

Re: Running HDFS from source broken since HDFS-11596

2017-07-20 Thread John Zhuge
Hi Lars, I am able to run pseudo-distributed mode from a dev tree. Here is the wiki: https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html#Pseudo-Distributed_Operation . Check out my script pseudo_dist

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-07-30 Thread John Zhuge
Hi Konstantin, Thanks a lot for the effort to prepare the 2.7.4-RC0 release! +1 (non-binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - Deploy

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

2017-07-31 Thread John Zhuge
or that > https://issues.apache.org/jira/browse/HDFS-11985 > but decided it should not block the release. > The "dr,who" thing is a configuration issue. This page may be helpful: > http://hadoop.apache.org/docs/stable/hadoop-hdfs-httpfs/ServerSetup.html > > Thanks, > --Konstan

Re: [DISCUSS] Making submarine to different release model like Ozone

2019-02-01 Thread John Zhuge
+1 Does Submarine support Jupyter? On Fri, Feb 1, 2019 at 8:54 AM Zhe Zhang wrote: > +1 on the proposal and looking forward to the progress of the project! > > On Thu, Jan 31, 2019 at 10:51 PM Weiwei Yang wrote: > > > Thanks for proposing this Wangda, my +1 as well. > > It is amazing to see th

[jira] [Reopened] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-23 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HDFS-9438: -- I probably should not have clicked "Resolve Issue" because the 2nd patch still needs to

[jira] [Created] (HDFS-9522) Cleanup DiffReportEntry

2015-12-08 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9522: Summary: Cleanup DiffReportEntry Key: HDFS-9522 URL: https://issues.apache.org/jira/browse/HDFS-9522 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-9554) Change string modificationLabel to enum in protobuf message SnapshotDiffReportEntryProto

2015-12-13 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9554: Summary: Change string modificationLabel to enum in protobuf message SnapshotDiffReportEntryProto Key: HDFS-9554 URL: https://issues.apache.org/jira/browse/HDFS-9554 Project

[jira] [Created] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9568: Summary: Support NFSv4 interface to HDFS Key: HDFS-9568 URL: https://issues.apache.org/jira/browse/HDFS-9568 Project: Hadoop HDFS Issue Type: New Feature

[jira] [Resolved] (HDFS-9568) Support NFSv4 interface to HDFS

2015-12-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-9568. -- Resolution: Duplicate > Support NFSv4 interface to H

[jira] [Created] (HDFS-9573) o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry$hashCode inconsistent with equals

2015-12-17 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9573: Summary: o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry$hashCode inconsistent with equals Key: HDFS-9573 URL: https://issues.apache.org/jira/browse/HDFS-9573

[jira] [Resolved] (HDFS-9573) o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry$hashCode inconsistent with equals

2015-12-17 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-9573. -- Resolution: Duplicate > o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry$hashCode inconsist

[jira] [Created] (HDFS-9633) Test SnapshotDiffReport file path corner cases

2016-01-09 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9633: Summary: Test SnapshotDiffReport file path corner cases Key: HDFS-9633 URL: https://issues.apache.org/jira/browse/HDFS-9633 Project: Hadoop HDFS Issue Type: Test

[jira] [Reopened] (HDFS-9573) o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEntry$hashCode inconsistent with equals

2016-01-12 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HDFS-9573: -- Unlink this jira from HDFS-9522 for granularity. > o.a.h.hdfs.protocol.SnapshotDiffReport$DiffReportEn

[jira] [Created] (HDFS-9655) NN should start JVM pause monitor before loading fsimage

2016-01-16 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9655: Summary: NN should start JVM pause monitor before loading fsimage Key: HDFS-9655 URL: https://issues.apache.org/jira/browse/HDFS-9655 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-12491) Support wildcard in CLASSPATH for libhdfs

2017-09-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-12491: - Summary: Support wildcard in CLASSPATH for libhdfs Key: HDFS-12491 URL: https://issues.apache.org/jira/browse/HDFS-12491 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

2017-09-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-12494: - Summary: libhdfs SIGSEGV in setTLSExceptionStrings Key: HDFS-12494 URL: https://issues.apache.org/jira/browse/HDFS-12494 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

2017-10-31 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12714. --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 3.1.0 Committed to trunk and

[jira] [Resolved] (HDFS-12821) Block invalid IOException causes the DFSClient domain socket being disabled

2017-11-16 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12821. --- Resolution: Duplicate > Block invalid IOException causes the DFSClient domain socket being disab

[jira] [Resolved] (HDFS-12815) Fix TestUnbuffer#testUnbufferException because of expected error message mismatch

2017-11-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12815. --- Resolution: Duplicate Thanks [~msingh] for reporting the issue. I think it is a dup of HADOOP-15056

[jira] [Resolved] (HDFS-12604) StreamCapability enums are not displayed in javadoc

2017-11-29 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12604. --- Resolution: Won't Fix StreamCapability enums are deprecated by HADOOP-15012. > StreamCa

[jira] [Reopened] (HDFS-9573) SnapshotDiffReport$DiffReportEntry$hashCode should use type field

2016-01-22 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HDFS-9573: -- Fix the summary based on Nicholas's comment. > SnapshotDiffReport$DiffReportEntry$hashCode should

[jira] [Created] (HDFS-9728) TestDFSShell should not create MiniDFSCluster in each test case

2016-01-31 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9728: Summary: TestDFSShell should not create MiniDFSCluster in each test case Key: HDFS-9728 URL: https://issues.apache.org/jira/browse/HDFS-9728 Project: Hadoop HDFS

[jira] [Created] (HDFS-9915) Typo in DistCp.html

2016-03-07 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9915: Summary: Typo in DistCp.html Key: HDFS-9915 URL: https://issues.apache.org/jira/browse/HDFS-9915 Project: Hadoop HDFS Issue Type: Improvement Components

[jira] [Created] (HDFS-9940) New property dfs.balancer.max.concurrent.moves for Balancer

2016-03-10 Thread John Zhuge (JIRA)
John Zhuge created HDFS-9940: Summary: New property dfs.balancer.max.concurrent.moves for Balancer Key: HDFS-9940 URL: https://issues.apache.org/jira/browse/HDFS-9940 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10171) Balancer should log config values and iteration termination reasons

2016-03-15 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10171: - Summary: Balancer should log config values and iteration termination reasons Key: HDFS-10171 URL: https://issues.apache.org/jira/browse/HDFS-10171 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10171) Balancer should log config values

2016-03-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10171. --- Resolution: Duplicate Fix Version/s: 2.8.0 {noformat} 2016-03-15 22:42:31,618 [Thread-0] INFO

[jira] [Created] (HDFS-10190) Expose FSDatasetImpl lock metrics

2016-03-21 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10190: - Summary: Expose FSDatasetImpl lock metrics Key: HDFS-10190 URL: https://issues.apache.org/jira/browse/HDFS-10190 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-10215) distcp throws vague exception without home directory

2016-03-25 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10215: - Summary: distcp throws vague exception without home directory Key: HDFS-10215 URL: https://issues.apache.org/jira/browse/HDFS-10215 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10216) distcp -diff relative path exception

2016-03-25 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10216: - Summary: distcp -diff relative path exception Key: HDFS-10216 URL: https://issues.apache.org/jira/browse/HDFS-10216 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10230) HDFS Native Client build failed

2016-03-29 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10230: - Summary: HDFS Native Client build failed Key: HDFS-10230 URL: https://issues.apache.org/jira/browse/HDFS-10230 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10287) MiniDFSCluster should implement AutoCloseable

2016-04-13 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10287: - Summary: MiniDFSCluster should implement AutoCloseable Key: HDFS-10287 URL: https://issues.apache.org/jira/browse/HDFS-10287 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10288) MiniYARNCluster should implement AutoCloseable

2016-04-13 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10288: - Summary: MiniYARNCluster should implement AutoCloseable Key: HDFS-10288 URL: https://issues.apache.org/jira/browse/HDFS-10288 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10289) Balancer configures DNs directly

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10289: - Summary: Balancer configures DNs directly Key: HDFS-10289 URL: https://issues.apache.org/jira/browse/HDFS-10289 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-10294) Balancer configures DN properties

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10294: - Summary: Balancer configures DN properties Key: HDFS-10294 URL: https://issues.apache.org/jira/browse/HDFS-10294 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Created] (HDFS-10295) Balancer configures DN properties directly on-demand

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10295: - Summary: Balancer configures DN properties directly on-demand Key: HDFS-10295 URL: https://issues.apache.org/jira/browse/HDFS-10295 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10297) Increase default balance bandwidth and concurrent moves

2016-04-14 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10297: - Summary: Increase default balance bandwidth and concurrent moves Key: HDFS-10297 URL: https://issues.apache.org/jira/browse/HDFS-10297 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

2016-04-15 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10300: - Summary: TestDistCpSystem should share MiniDFSCluster Key: HDFS-10300 URL: https://issues.apache.org/jira/browse/HDFS-10300 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10375) Remove redundent TestMiniDFSCluster.testDualClusters

2016-05-06 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10375: - Summary: Remove redundent TestMiniDFSCluster.testDualClusters Key: HDFS-10375 URL: https://issues.apache.org/jira/browse/HDFS-10375 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10378) setOwner throws AccessControlException with wrong message

2016-05-06 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10378: - Summary: setOwner throws AccessControlException with wrong message Key: HDFS-10378 URL: https://issues.apache.org/jira/browse/HDFS-10378 Project: Hadoop HDFS

[jira] [Created] (HDFS-10381) DataNode exclusion log message should be a warning

2016-05-09 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10381: - Summary: DataNode exclusion log message should be a warning Key: HDFS-10381 URL: https://issues.apache.org/jira/browse/HDFS-10381 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

2016-05-16 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10410: - Summary: RedundantEditLogInputStream#LOG is set to wrong class Key: HDFS-10410 URL: https://issues.apache.org/jira/browse/HDFS-10410 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10439) Update setOwner doc in HdfsPermissionsGuide

2016-05-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10439: - Summary: Update setOwner doc in HdfsPermissionsGuide Key: HDFS-10439 URL: https://issues.apache.org/jira/browse/HDFS-10439 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-4821) It's possible to create files with special characters in the filenames, but 'hadoop fs -ls' gives no indication

2016-06-07 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-4821. -- Resolution: Duplicate > It's possible to create files with special characters in the filena

[jira] [Created] (HDFS-10649) Remove unused PermissionStatus#applyUMask

2016-07-18 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10649: - Summary: Remove unused PermissionStatus#applyUMask Key: HDFS-10649 URL: https://issues.apache.org/jira/browse/HDFS-10649 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

2016-07-18 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10650: - Summary: DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission Key: HDFS-10650 URL: https://issues.apache.org/jira/browse/HDFS-10650

[jira] [Created] (HDFS-10657) testAclCLI.xml inherit default ACL to dir test should expect mask r-x

2016-07-20 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10657: - Summary: testAclCLI.xml inherit default ACL to dir test should expect mask r-x Key: HDFS-10657 URL: https://issues.apache.org/jira/browse/HDFS-10657 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10661) Make MiniDFSCluster AutoCloseable

2016-07-20 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10661. --- Resolution: Duplicate [~ajisakaa] Looks like a dup of HDFS-10287. Please re-open if you think

[jira] [Created] (HDFS-10683) Refactor Token.PrivateToken

2016-07-24 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10683: - Summary: Refactor Token.PrivateToken Key: HDFS-10683 URL: https://issues.apache.org/jira/browse/HDFS-10683 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

2016-07-29 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10703: - Summary: HA NameNode Web UI should show last checkpoint time Key: HDFS-10703 URL: https://issues.apache.org/jira/browse/HDFS-10703 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10822) Log DataNodes in the write pipeline

2016-08-31 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10822: - Summary: Log DataNodes in the write pipeline Key: HDFS-10822 URL: https://issues.apache.org/jira/browse/HDFS-10822 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-10835) Typo in httpfs.sh hadoop_usage

2016-09-02 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10835: - Summary: Typo in httpfs.sh hadoop_usage Key: HDFS-10835 URL: https://issues.apache.org/jira/browse/HDFS-10835 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-10860) Switch HttpFS to use Jetty

2016-09-12 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10860: - Summary: Switch HttpFS to use Jetty Key: HDFS-10860 URL: https://issues.apache.org/jira/browse/HDFS-10860 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

2016-09-13 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10378. --- Resolution: Invalid In {{HDFS-10378-unit.patch}}, super user creates {{CHILD_DIR1}}, so it makes

[jira] [Created] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

2016-09-19 Thread John Zhuge (JIRA)
John Zhuge created HDFS-10870: - Summary: Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm Key: HDFS-10870 URL: https://issues.apache.org/jira/browse/HDFS-10870 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10863) hadoop superusergroup supergroup issue

2016-09-26 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10863. --- Resolution: Not A Problem > hadoop superusergroup supergroup is

[jira] [Created] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

2016-10-23 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11045: - Summary: TestDirectoryScanner#testThrottling fails: Throttle is too permissive Key: HDFS-11045 URL: https://issues.apache.org/jira/browse/HDFS-11045 Project: Hadoop HDFS

[jira] [Created] (HDFS-11059) TestWebHdfsTimeouts fails due to null SocketTimeoutException

2016-10-25 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11059: - Summary: TestWebHdfsTimeouts fails due to null SocketTimeoutException Key: HDFS-11059 URL: https://issues.apache.org/jira/browse/HDFS-11059 Project: Hadoop HDFS

[jira] [Created] (HDFS-11100) Recursively deleting directory with file protected by sticky bit should fail

2016-11-03 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11100: - Summary: Recursively deleting directory with file protected by sticky bit should fail Key: HDFS-11100 URL: https://issues.apache.org/jira/browse/HDFS-11100 Project: Hadoop

[jira] [Created] (HDFS-11174) Wrong HttpFS test command in doc

2016-11-24 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11174: - Summary: Wrong HttpFS test command in doc Key: HDFS-11174 URL: https://issues.apache.org/jira/browse/HDFS-11174 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11176) httpfs.sh run fails due to missing temp dir

2016-11-25 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11176: - Summary: httpfs.sh run fails due to missing temp dir Key: HDFS-11176 URL: https://issues.apache.org/jira/browse/HDFS-11176 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11202) httpfs.sh will not run when temp dir does not exist

2016-12-04 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11202: - Summary: httpfs.sh will not run when temp dir does not exist Key: HDFS-11202 URL: https://issues.apache.org/jira/browse/HDFS-11202 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11255) TestHttpFSWithKerberos failed

2016-12-15 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11255: - Summary: TestHttpFSWithKerberos failed Key: HDFS-11255 URL: https://issues.apache.org/jira/browse/HDFS-11255 Project: Hadoop HDFS Issue Type: Bug

[jira] [Resolved] (HDFS-11255) TestHttpFSWithKerberos failed

2016-12-15 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-11255. --- Resolution: Invalid The test is excluded in pom.xml. > TestHttpFSWithKerberos fai

[jira] [Resolved] (HDFS-11202) httpfs.sh will not run when temp dir does not exist

2017-01-05 Thread John Zhuge (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-11202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-11202. --- Resolution: Duplicate Fix Version/s: 3.0.0-alpha2 HDFS-10860 does fix this issue. > httpfs

[jira] [Created] (HDFS-11381) PreCommit TestDataNodeOutlierDetectionViaMetrics failure

2017-01-27 Thread John Zhuge (JIRA)
John Zhuge created HDFS-11381: - Summary: PreCommit TestDataNodeOutlierDetectionViaMetrics failure Key: HDFS-11381 URL: https://issues.apache.org/jira/browse/HDFS-11381 Project: Hadoop HDFS Issue

  1   2   >