Re: [DISCUSS] Change project style guidelines to allow line length 100

> Thanks, > > > > > > >> > > Akira > > > > > > >> > > > > > > > > >> > > On Thu, May 20, 2021 at 6:36 AM Sean Busbey > > > > > > >> mailto:sbus...@apple.com.invalid > > >> > > > > > > >> > wrote: > > > > > > >> > >> > > > > > > >> > >> Hello! > > > > > > >> > >> > > > > > > >> > >> What do folks think about changing our line > length > > > > > > >> guidelines to allow > > > > > > >> > for 100 character width? > > > > > > >> > >> > > > > > > >> > >> Currently, we tell folks to follow the sun style > > > guide > > > > > > with > > > > > > >> some > > > > > > >> > exception unrelated to line length. That guide says width > > of > > > 80 > > > > > is > > > > > > the > > > > > > >> > standard and our current check style rules act as > > > enforcement. > > > > > > >> > >> > > > > > > >> > >> Looking at the current trunk codebase our > nightly > > > > build > > > > > > >> shows a total > > > > > > >> > of ~15k line length violations; it’s about 18% of > > identified > > > > > > >> checkstyle > > > > > > >> > issues. > > > > > > >> > >> > > > > > > >> > >> The vast majority of those line length > violations > > > are > > > > <= > > > > > > 100 > > > > > > >> characters > > > > > > >> > long. 100 characters happens to be the length for the > > Google > > > > Java > > > > > > >> Style > > > > > > >> > Guide, another commonly adopted style guide for java > > > projects, > > > > > so I > > > > > > >> suspect > > > > > > >> > these longer lines leaking past the checkstyle precommit > > > > warning > > > > > > >> might be a > > > > > > >> > reflection of committers working across multiple java > > > > codebases. > > > > > > >> > >> > > > > > > >> > >> I don’t feel strongly about lines being longer, > > but > > > I > > > > > > would > > > > > > >> like to > > > > > > >> > move towards more consistent style enforcement as a > > project. > > > > > > Updating > > > > > > >> our > > > > > > >> > project guidance to allow for 100 character lines would > > > reduce > > > > > the > > > > > > >> > likelihood that folks bringing in new contributions need > a > > > > > > precommit > > > > > > >> test > > > > > > >> > cycle to get the formatting correct. > > > > > > >> > >> > > > > > > >> > >> Does anyone feel strongly about keeping the line > > > > length > > > > > > >> limit at 80 > > > > > > >> > characters? > > > > > > >> > >> > > > > > > >> > >> Does anyone feel strongly about contributions > > coming > > > > in > > > > > > that > > > > > > >> clear up > > > > > > >> > line length violations? > > > > > > >> > >> > > > > > > >> > >> > > > > > > >> > >> > > > > > > >> > > > > - > > > > > > >> > >> To unsubscribe, e-mail: > > > > > > >> common-dev-unsubscr...@hadoop.apache.org > > > > > common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > >> For additional commands, e-mail: > > > > > > >> common-dev-h...@hadoop.apache.org > > > > > common-dev-h...@hadoop.apache.org> > > > > > > >> > >> > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > - > > > > > > >> > > To unsubscribe, e-mail: > > > > > > common-dev-unsubscr...@hadoop.apache.org > > > > > common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > > For additional commands, e-mail: > > > > > > >> common-dev-h...@hadoop.apache.org > > > > > common-dev-h...@hadoop.apache.org> > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > > > - > > > > > > >> > To unsubscribe, e-mail: > > > > common-dev-unsubscr...@hadoop.apache.org > > > > > > <mailto:common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > For additional commands, e-mail: > > > > > common-dev-h...@hadoop.apache.org > > > > > > <mailto:common-dev-h...@hadoop.apache.org> > > > > > > >> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- John Zhuge

Re: [VOTE] End of Life Hadoop 2.9

t; will be made after 2.9.2 (which was GA on 11/19/2019) > > (2) resolve JIRAs that specifically target 2.9.3 as won't fix. > > > > > > This vote will run for 7 days and will conclude by September 7th, 12:00pm > > pacific time. > > Committers are eligible to cast binding votes. Non-committers are > welcomed > > to cast non-binding votes. > > > > Here is my vote, +1 > > > -- John Zhuge

Re: [DISCUSS] fate of branch-2.9

t; > >> >>>> On Mon, Mar 2, 2020 at 6:30 PM Sree Vaddi > >> >>>> wrote: > >> >>>> > >> >>>>> +1 > >> >>>>> > >> >>>>> Sent from Yahoo Mail on Android > >> >>>>> > >> >>>>> On Mon, Mar 2, 2020 at 5:12 PM, Wei-Chiu Chuang< > weic...@apache.org> > >> >>>>> wrote: Hi, > >> >>>>> > >> >>>>> Following the discussion to end branch-2.8, I want to start a > >> >>>>> discussion > >> >>>>> around what's next with branch-2.9. I am hesitant to use the word > "end > >> >>>>> of > >> >>>>> life" but consider these facts: > >> >>>>> > >> >>>>> * 2.9.0 was released Dec 17, 2017. > >> >>>>> * 2.9.2, the last 2.9.x release, went out Nov 19 2018, which is > more > >> >>>>> than > >> >>>>> 15 months ago. > >> >>>>> * no one seems to be interested in being the release manager for > 2.9.3. > >> >>>>> * Most if not all of the active Hadoop contributors are using > Hadoop > >> >>>>> 2.10 > >> >>>>> or Hadoop 3.x. > >> >>>>> * We as a community do not have the cycle to manage multiple > release > >> >>>>> line, > >> >>>>> especially since Hadoop 3.3.0 is coming out soon. > >> >>>>> > >> >>>>> It is perhaps the time to gradually reduce our footprint in Hadoop > >> >>>>> 2.x, and > >> >>>>> encourage people to upgrade to Hadoop 3.x > >> >>>>> > >> >>>>> Thoughts? > >> >>>>> > >> >>>>> > -- John Zhuge

Re: [VOTE] EOL Hadoop branch-2.8

>>>>>> Thanks Wei-Chiu for starting the discussion, > > > >>>>>> > > > >>>>>> +1 for the EoL. > > > >>>>>> > > > >>>>>> -Akira > > > >>>>>> > > > >>>>>> On Tue, Feb 18, 2020 at 4:59 PM Ayush Saxena < > ayush...@gmail.com> > > > >>>> wrote: > > > >>>>>> > > > >>>>>>> Thanx Wei-Chiu for initiating this > > > >>>>>>> +1 for marking 2.8 EOL > > > >>>>>>> > > > >>>>>>> -Ayush > > > >>>>>>> > > > >>>>>>>> On 17-Feb-2020, at 11:14 PM, Wei-Chiu Chuang < > > > >>> weic...@apache.org> > > > >>>>>> wrote: > > > >>>>>>>> > > > >>>>>>>> The last Hadoop 2.8.x release, 2.8.5, was GA on September > 15th > > > >>>> 2018. > > > >>>>>>>> > > > >>>>>>>> It's been 17 months since the release and the community by and > > > >>>> large > > > >>>>>> have > > > >>>>>>>> moved up to 2.9/2.10/3.x. > > > >>>>>>>> > > > >>>>>>>> With Hadoop 3.3.0 over the horizon, is it time to start the > EOL > > > >>>>>>> discussion > > > >>>>>>>> and reduce the number of active branches? > > > >>>>>>> > > > >>>>>>> > > > >>> > - > > > >>>>>>> To unsubscribe, e-mail: > common-dev-unsubscr...@hadoop.apache.org > > > >>>>>>> For additional commands, e-mail: > > > >>> common-dev-h...@hadoop.apache.org > > > >>>>>>> > > > >>>>>>> > > > >>>>>> > > > >>>>> > > > >>>> > > > >>> > > > >> > > > > > > Wilfred Spiegelenburg > > > Staff Software Engineer > > > <https://www.cloudera.com/> > > > > > > -- John Zhuge

Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

>> contributions to the > > >> project. > > >> > > >> Please join me in congratulating him. > > >> > > >> Hearty Congratulations & Welcome aboard Stephen! > > >> > > >> Wei-Chiu Chuang > > >> (On behalf of the Hadoop PMC) > > >> > > > > - > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > > -- John Zhuge

Re: [DISCUSS] Making submarine to different release model like Ozone

+1 Does Submarine support Jupyter? On Fri, Feb 1, 2019 at 8:54 AM Zhe Zhang wrote: > +1 on the proposal and looking forward to the progress of the project! > > On Thu, Jan 31, 2019 at 10:51 PM Weiwei Yang wrote: > > > Thanks for proposing this Wangda, my +1 as well. > > It is amazing to see th

Re: HADOOP-14163 proposal for new hadoop.apache.org

+1 Like the new site. On Sun, Sep 2, 2018 at 7:02 PM Weiwei Yang wrote: > That's really nice, +1. > > -- > Weiwei > > On Sat, Sep 1, 2018 at 4:36 AM Wangda Tan wrote: > > > +1, thanks for working on this, Marton! > > > > Best, > > Wangda > > > > On Fri, Aug 31, 2018 at 11:24 AM Arpit Agarwal >

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

Thanks Xongjun for the excellent work to drive this release! +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.5 - Verified cloud connectors: - ADLS integration tests passed with 1 failure, not a blocke

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Thanks Andrew for the great effort! Here is my late vote. +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.2 - Verified cloud connectors: - S3A integration tests (perf tests skipped) - Deployed both

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

Oops, the vote was meant for 2.7.5. Sorry for the confusion. My 2.8.3 vote coming up shortly. On Tue, Dec 12, 2017 at 4:28 PM, John Zhuge wrote: > Thanks Junping for the great effort! > > >- Verified checksums and signatures of all tarballs >- Built source with na

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

Thanks Konstantin for the great effort! +1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 - Verified cloud connectors: - All S3A integration tests - Deployed both binary and built source to a pse

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

Thanks Junping for the great effort! - Verified checksums and signatures of all tarballs - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 - Verified cloud connectors: - All S3A integration tests - Deployed both binary and built source to a pseudo cluster, pass

[jira] [Resolved] (HDFS-12604) StreamCapability enums are not displayed in javadoc

[ https://issues.apache.org/jira/browse/HDFS-12604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12604. --- Resolution: Won't Fix StreamCapability enums are deprecated by HADOOP-15012. > StreamCa

[jira] [Resolved] (HDFS-12815) Fix TestUnbuffer#testUnbufferException because of expected error message mismatch

[ https://issues.apache.org/jira/browse/HDFS-12815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12815. --- Resolution: Duplicate Thanks [~msingh] for reporting the issue. I think it is a dup of HADOOP-15056

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

+1 (binding) - Verified checksums of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Passed all S3A and ADL integration tests - Deployed both binary and built source to a pseudo cluster, passed the following sanity tests in insecure, SSL, and SSL+Ke

[jira] [Resolved] (HDFS-12821) Block invalid IOException causes the DFSClient domain socket being disabled

[ https://issues.apache.org/jira/browse/HDFS-12821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12821. --- Resolution: Duplicate > Block invalid IOException causes the DFSClient domain socket being disab

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC1)

+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified these cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo c

[jira] [Resolved] (HDFS-12714) Hadoop 3 missing fix for HDFS-5169

[ https://issues.apache.org/jira/browse/HDFS-12714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12714. --- Resolution: Fixed Fix Version/s: 3.0.0-beta1 3.1.0 Committed to trunk and

Re: Block invalid IOException causes the DFSClient domain socket being disabled

Please go ahead. On Thu, Oct 26, 2017 at 6:12 PM, Xie Gang wrote: > Shall I create the jira directly? > > On Thu, Oct 26, 2017 at 12:34 PM, Xie Gang wrote: > > > Hi, > > > > We use HDFS2.4 & 2.6, and recently hit a issue that DFSClient domain > > socket is disabled when datanode throw block inv

Re: Block invalid IOException causes the DFSClient domain socket being disabled

Hi Xie Gang, Thanks for reporting the issue. How was the block invalidated on DN? I recently created a unit test that might trigger a somewhat similar symptom: 1. Read a 4000-byte file in MiniDFS. It should go thru domain socket. 2. Call input stream unbuffer. It will close the block reade

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC1)

+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo cluste

Re: Interested to Contribute in Hadoop Development

Welcome Kumar! You can start with this wiki https://wiki.apache.org/hadoop/HowToContribute. Work on a few simple JIRAs in https://issues.apache.org/ jira/issues/?jql=project%20in%20(HADOOP%2C%20HDFS)%20AND% 20status%20%3D%20Open%20AND%20resolution%20%3D%20Unresolved%20AND%20labels% 20%3D%20newbie

Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0

+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo cluster

[jira] [Created] (HDFS-12494) libhdfs SIGSEGV in setTLSExceptionStrings

John Zhuge created HDFS-12494: - Summary: libhdfs SIGSEGV in setTLSExceptionStrings Key: HDFS-12494 URL: https://issues.apache.org/jira/browse/HDFS-12494 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12491) Support wildcard in CLASSPATH for libhdfs

John Zhuge created HDFS-12491: - Summary: Support wildcard in CLASSPATH for libhdfs Key: HDFS-12491 URL: https://issues.apache.org/jira/browse/HDFS-12491 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-12113) `hadoop fs -setrep` requries huge amount of memory on client side

[ https://issues.apache.org/jira/browse/HDFS-12113?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-12113. --- Resolution: Duplicate [~Tagar] Thanks for reporting the issue. It is a dup of HADOOP-12502

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

or that > https://issues.apache.org/jira/browse/HDFS-11985 > but decided it should not block the release. > The "dr,who" thing is a configuration issue. This page may be helpful: > http://hadoop.apache.org/docs/stable/hadoop-hdfs-httpfs/ServerSetup.html > > Thanks, > --Konstan

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Konstantin, Thanks a lot for the effort to prepare the 2.7.4-RC0 release! +1 (non-binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - Deploy

[jira] [Resolved] (HDFS-11176) httpfs.sh run fails due to missing temp dir

[ https://issues.apache.org/jira/browse/HDFS-11176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-11176. --- Resolution: Duplicate Fix Version/s: 3.0.0-alpha4 Fixed by HDFS-10860: https://github.com

Re: Running HDFS from source broken since HDFS-11596

Hi Lars, I am able to run pseudo-distributed mode from a dev tree. Here is the wiki: https://hadoop.apache.org/docs/current/hadoop-project-dist/hadoop-common/SingleCluster.html#Pseudo-Distributed_Operation . Check out my script pseudo_dist

[jira] [Created] (HDFS-12166) Do not deprecate HTTPFS_TEMP

John Zhuge created HDFS-12166: - Summary: Do not deprecate HTTPFS_TEMP Key: HDFS-12166 URL: https://issues.apache.org/jira/browse/HDFS-12166 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-12122) TestEditLogTailer is flaky

John Zhuge created HDFS-12122: - Summary: TestEditLogTailer is flaky Key: HDFS-12122 URL: https://issues.apache.org/jira/browse/HDFS-12122 Project: Hadoop HDFS Issue Type: Test

[jira] [Created] (HDFS-12114) Incorrect property name to indicate SSL is enabled for HttpFS

John Zhuge created HDFS-12114: - Summary: Incorrect property name to indicate SSL is enabled for HttpFS Key: HDFS-12114 URL: https://issues.apache.org/jira/browse/HDFS-12114 Project: Hadoop HDFS

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

+1 (non-binding) - Verified checksums and signatures of the tarballs - Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 - Cloud connectors: - A few S3A integration tests - A few ADL live unit tests - Deployed both binary and built source to a pseudo cluster, pa

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

False alarm, fixed the build issue with "mvn -U clean install". On Wed, Jul 5, 2017 at 6:08 PM, John Zhuge wrote: > For some reason, I can't build the source. > > Got this when running "mvn install -U" inside directory > "hadoop-maven-pl

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

For some reason, I can't build the source. Got this when running "mvn install -U" inside directory "hadoop-maven-plugins": [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project hadoop-maven-plugins: Execution default of goal org.apa

[jira] [Created] (HDFS-11957) Enable POSIX ACL inheritance by default

John Zhuge created HDFS-11957: - Summary: Enable POSIX ACL inheritance by default Key: HDFS-11957 URL: https://issues.apache.org/jira/browse/HDFS-11957 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11954) WritableRpcEngine.Invocation#toString should handle null parameters

John Zhuge created HDFS-11954: - Summary: WritableRpcEngine.Invocation#toString should handle null parameters Key: HDFS-11954 URL: https://issues.apache.org/jira/browse/HDFS-11954 Project: Hadoop HDFS

[jira] [Created] (HDFS-11950) Disable libhdfs zerocopy test on Mac

John Zhuge created HDFS-11950: - Summary: Disable libhdfs zerocopy test on Mac Key: HDFS-11950 URL: https://issues.apache.org/jira/browse/HDFS-11950 Project: Hadoop HDFS Issue Type: Test

[jira] [Created] (HDFS-11900) HEDGED_READ_THREAD_POOL should not be static

John Zhuge created HDFS-11900: - Summary: HEDGED_READ_THREAD_POOL should not be static Key: HDFS-11900 URL: https://issues.apache.org/jira/browse/HDFS-11900 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11861) ipc.Client#sendRpcRequest should log request name

John Zhuge created HDFS-11861: - Summary: ipc.Client#sendRpcRequest should log request name Key: HDFS-11861 URL: https://issues.apache.org/jira/browse/HDFS-11861 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11816) Update ciphers list for HttpFS

John Zhuge created HDFS-11816: - Summary: Update ciphers list for HttpFS Key: HDFS-11816 URL: https://issues.apache.org/jira/browse/HDFS-11816 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-11685) TestDistributedFileSystem.java fails to compile

John Zhuge created HDFS-11685: - Summary: TestDistributedFileSystem.java fails to compile Key: HDFS-11685 URL: https://issues.apache.org/jira/browse/HDFS-11685 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11665) HttpFSServerWebServer$deprecateEnv may leak secret

John Zhuge created HDFS-11665: - Summary: HttpFSServerWebServer$deprecateEnv may leak secret Key: HDFS-11665 URL: https://issues.apache.org/jira/browse/HDFS-11665 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11602) Enable HttpFS Tomcat access logging

John Zhuge created HDFS-11602: - Summary: Enable HttpFS Tomcat access logging Key: HDFS-11602 URL: https://issues.apache.org/jira/browse/HDFS-11602 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-11579) Configure HttpFS Tomcat SSL property sslEnabledProtocols

John Zhuge created HDFS-11579: - Summary: Configure HttpFS Tomcat SSL property sslEnabledProtocols Key: HDFS-11579 URL: https://issues.apache.org/jira/browse/HDFS-11579 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

- balancer start/stop Needs the following JIRAs to pass all ADL tests: - HADOOP-14205. No FileSystem for scheme: adl. Contributed by John Zhuge. - HDFS-11132. Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files. Contributed by Vishwajeet

[jira] [Reopened] (HDFS-11132) Allow AccessControlException in contract tests when getFileStatus on subdirectory of existing files

[ https://issues.apache.org/jira/browse/HDFS-11132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HDFS-11132: --- Re-open to attach HDFS-11132.branch-2.001.patch > Allow AccessControlException in contract tests w

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

54 » AccessControl TestAdlFileSystemContractLive.runTest:60->FileSystemContractBaseTest.testMkdirsFailsForSubdirectoryOfExistingFile:190 » AccessControl Stay tuned... John Zhuge Software Engineer, Cloudera On Mon, Mar 20, 2017 at 10:02 AM, Junping Du wrote: > Thank you for reporting th

Re: [VOTE] Release Apache Hadoop 2.8.0 (RC3)

doop-tools-dist/pom.xml. I am working on a patch. John Zhuge Software Engineer, Cloudera On Fri, Mar 17, 2017 at 2:18 AM, Junping Du wrote: > Hi all, > With fix of HDFS-11431 get in, I've created a new release candidate > (RC3) for Apache Hadoop 2.8.0. > > Thi

[jira] [Created] (HDFS-11490) Store KMS SSL keystore password in catalina.properties

John Zhuge created HDFS-11490: - Summary: Store KMS SSL keystore password in catalina.properties Key: HDFS-11490 URL: https://issues.apache.org/jira/browse/HDFS-11490 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11489) KMS should warning about weak SSL ciphers

John Zhuge created HDFS-11489: - Summary: KMS should warning about weak SSL ciphers Key: HDFS-11489 URL: https://issues.apache.org/jira/browse/HDFS-11489 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11485) HttpFS should warn about weak ssl ciphers

John Zhuge created HDFS-11485: - Summary: HttpFS should warn about weak ssl ciphers Key: HDFS-11485 URL: https://issues.apache.org/jira/browse/HDFS-11485 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11418) HttpFS should support old SSL clients

John Zhuge created HDFS-11418: - Summary: HttpFS should support old SSL clients Key: HDFS-11418 URL: https://issues.apache.org/jira/browse/HDFS-11418 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-11397) TestThrottledAsyncChecker.testCancellation timed out

John Zhuge created HDFS-11397: - Summary: TestThrottledAsyncChecker.testCancellation timed out Key: HDFS-11397 URL: https://issues.apache.org/jira/browse/HDFS-11397 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-11396) TestNameNodeMetadataConsistency timed out

John Zhuge created HDFS-11396: - Summary: TestNameNodeMetadataConsistency timed out Key: HDFS-11396 URL: https://issues.apache.org/jira/browse/HDFS-11396 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11392) FSPermissionChecker#checkSubAccess should support inodeattribute provider

John Zhuge created HDFS-11392: - Summary: FSPermissionChecker#checkSubAccess should support inodeattribute provider Key: HDFS-11392 URL: https://issues.apache.org/jira/browse/HDFS-11392 Project: Hadoop

[jira] [Created] (HDFS-11390) Add process name to httpfs process

John Zhuge created HDFS-11390: - Summary: Add process name to httpfs process Key: HDFS-11390 URL: https://issues.apache.org/jira/browse/HDFS-11390 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-11381) PreCommit TestDataNodeOutlierDetectionViaMetrics failure

John Zhuge created HDFS-11381: - Summary: PreCommit TestDataNodeOutlierDetectionViaMetrics failure Key: HDFS-11381 URL: https://issues.apache.org/jira/browse/HDFS-11381 Project: Hadoop HDFS Issue

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha2 RC0

pseudo cluster, passed the following sanity tests in both insecure and SSL mode: - basic dfs, distcp, ACL commands - KMS and HttpFS tests - MapReduce wordcount example - balancer start/stop John Zhuge Software Engineer, Cloudera On Fri, Jan 20, 2017 at 2:36 PM, Andrew Wang wrote: > Hi

[jira] [Resolved] (HDFS-11202) httpfs.sh will not run when temp dir does not exist

[ https://issues.apache.org/jira/browse/HDFS-11202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-11202. --- Resolution: Duplicate Fix Version/s: 3.0.0-alpha2 HDFS-10860 does fix this issue. > httpfs

[jira] [Resolved] (HDFS-11255) TestHttpFSWithKerberos failed

[ https://issues.apache.org/jira/browse/HDFS-11255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-11255. --- Resolution: Invalid The test is excluded in pom.xml. > TestHttpFSWithKerberos fai

[jira] [Created] (HDFS-11255) TestHttpFSWithKerberos failed

John Zhuge created HDFS-11255: - Summary: TestHttpFSWithKerberos failed Key: HDFS-11255 URL: https://issues.apache.org/jira/browse/HDFS-11255 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11202) httpfs.sh will not run when temp dir does not exist

John Zhuge created HDFS-11202: - Summary: httpfs.sh will not run when temp dir does not exist Key: HDFS-11202 URL: https://issues.apache.org/jira/browse/HDFS-11202 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-11176) httpfs.sh run fails due to missing temp dir

John Zhuge created HDFS-11176: - Summary: httpfs.sh run fails due to missing temp dir Key: HDFS-11176 URL: https://issues.apache.org/jira/browse/HDFS-11176 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11174) Wrong HttpFS test command in doc

John Zhuge created HDFS-11174: - Summary: Wrong HttpFS test command in doc Key: HDFS-11174 URL: https://issues.apache.org/jira/browse/HDFS-11174 Project: Hadoop HDFS Issue Type: Bug

[jira] [Created] (HDFS-11100) Recursively deleting directory with file protected by sticky bit should fail

John Zhuge created HDFS-11100: - Summary: Recursively deleting directory with file protected by sticky bit should fail Key: HDFS-11100 URL: https://issues.apache.org/jira/browse/HDFS-11100 Project: Hadoop

[jira] [Created] (HDFS-11059) TestWebHdfsTimeouts fails due to null SocketTimeoutException

John Zhuge created HDFS-11059: - Summary: TestWebHdfsTimeouts fails due to null SocketTimeoutException Key: HDFS-11059 URL: https://issues.apache.org/jira/browse/HDFS-11059 Project: Hadoop HDFS

Enhance FileUtil#list to throw ACE when the dir is not readable

more precise exception class and message. Thanks, John Zhuge Software Engineer, Cloudera

[jira] [Created] (HDFS-11045) TestDirectoryScanner#testThrottling fails: Throttle is too permissive

John Zhuge created HDFS-11045: - Summary: TestDirectoryScanner#testThrottling fails: Throttle is too permissive Key: HDFS-11045 URL: https://issues.apache.org/jira/browse/HDFS-11045 Project: Hadoop HDFS

Re: [DISCUSS] HADOOP-13603 - Remove package line length checkstyle rule

classes or methods. Thanks, John Zhuge John Zhuge Software Engineer, Cloudera On Thu, Oct 20, 2016 at 3:22 AM, Steve Loughran wrote: > > > On 19 Oct 2016, at 14:52, Shane Kumpf > wrote: > > > > All, > > > > I would like to start a discussion on the possi

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC1)

- Ran balancer Thanks, John John Zhuge Software Engineer, Cloudera On Sun, Oct 2, 2016 at 5:12 PM, Sangjin Lee wrote: > Hi folks, > > I have pushed a new release candidate (R1) for the Apache Hadoop 2.6.5 > release (the next maintenance release in the 2.6.x release line). RC1 > co

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

, webhdfs commands - Ran MapReduce workcount example - Ran balancer Thanks, John John Zhuge Software Engineer, Cloudera On Fri, Sep 30, 2016 at 6:15 PM, Chris Douglas wrote: > +1 Verified checksum and signature. Unpacked the jar, started > single-node HDFS cluster, did some cursory checks. &g

Re: [VOTE] Release Apache Hadoop 2.6.5 (RC0)

ransitionToActive failure from refeshAll() (Bibin A Chundatt via > rohithsharmaks) Thanks, John Zhuge Software Engineer, Cloudera On Tue, Sep 27, 2016 at 1:28 PM, Sangjin Lee wrote: > Hi folks, > > I have created a release candidate RC0 for the Apache Hadoop 2.6.5 release > (

[jira] [Resolved] (HDFS-10863) hadoop superusergroup supergroup issue

[ https://issues.apache.org/jira/browse/HDFS-10863?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10863. --- Resolution: Not A Problem > hadoop superusergroup supergroup is

Re: Permission bit 12 in getFileInfo response

Thanks Chris! Silly me, didn't look at "FsPermissionExtension". John Zhuge Software Engineer, Cloudera On Mon, Sep 19, 2016 at 11:33 AM, Chris Nauroth wrote: > Hello John, > > That is the ACL bit. The NameNode toggles on the ACL bit in getFileInfo > responses for i

Permission bit 12 in getFileInfo response

plication: 0 blocksize: 0 fileId: 8798130 childrenNum: 1 storagePolicy: 0 }} Thanks, John Zhuge Software Engineer, Cloudera

[jira] [Created] (HDFS-10870) Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm

John Zhuge created HDFS-10870: - Summary: Wrong dfs.namenode.acls.enabled default in HdfsPermissionsGuide.apt.vm Key: HDFS-10870 URL: https://issues.apache.org/jira/browse/HDFS-10870 Project: Hadoop HDFS

[jira] [Resolved] (HDFS-10378) FSDirAttrOp#setOwner throws ACE with misleading message

[ https://issues.apache.org/jira/browse/HDFS-10378?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10378. --- Resolution: Invalid In {{HDFS-10378-unit.patch}}, super user creates {{CHILD_DIR1}}, so it makes

[jira] [Created] (HDFS-10860) Switch HttpFS to use Jetty

John Zhuge created HDFS-10860: - Summary: Switch HttpFS to use Jetty Key: HDFS-10860 URL: https://issues.apache.org/jira/browse/HDFS-10860 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-10835) Typo in httpfs.sh hadoop_usage

John Zhuge created HDFS-10835: - Summary: Typo in httpfs.sh hadoop_usage Key: HDFS-10835 URL: https://issues.apache.org/jira/browse/HDFS-10835 Project: Hadoop HDFS Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha1 RC0

+1 (non-binding) - Build source with Java 1.8.0_101 on Centos 6.6 without native - Verify license and notice using the shell script in HADOOP-13374 - Deploy a pseudo cluster - Run basic dfs, distcp, ACL, webhdfs commands - Run MapReduce workcount and pi examples - Run balancer Thanks, John John

[jira] [Created] (HDFS-10822) Log DataNodes in the write pipeline

John Zhuge created HDFS-10822: - Summary: Log DataNodes in the write pipeline Key: HDFS-10822 URL: https://issues.apache.org/jira/browse/HDFS-10822 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Created] (HDFS-10703) HA NameNode Web UI should show last checkpoint time

John Zhuge created HDFS-10703: - Summary: HA NameNode Web UI should show last checkpoint time Key: HDFS-10703 URL: https://issues.apache.org/jira/browse/HDFS-10703 Project: Hadoop HDFS Issue Type

Re: [VOTE] Release Apache Hadoop 2.7.3 RC0

examples - Start balancer Thanks, John John Zhuge Software Engineer, Cloudera On Wed, Jul 27, 2016 at 11:38 AM, Robert Kanter wrote: > +1 (binding) > > - Downloaded binary tarball > - verified signatures > - setup pseudo cluster > - ran some of the example jobs, clicked a

[jira] [Created] (HDFS-10683) Refactor Token.PrivateToken

John Zhuge created HDFS-10683: - Summary: Refactor Token.PrivateToken Key: HDFS-10683 URL: https://issues.apache.org/jira/browse/HDFS-10683 Project: Hadoop HDFS Issue Type: Improvement

[jira] [Resolved] (HDFS-10661) Make MiniDFSCluster AutoCloseable

[ https://issues.apache.org/jira/browse/HDFS-10661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-10661. --- Resolution: Duplicate [~ajisakaa] Looks like a dup of HDFS-10287. Please re-open if you think

[jira] [Created] (HDFS-10657) testAclCLI.xml inherit default ACL to dir test should expect mask r-x

John Zhuge created HDFS-10657: - Summary: testAclCLI.xml inherit default ACL to dir test should expect mask r-x Key: HDFS-10657 URL: https://issues.apache.org/jira/browse/HDFS-10657 Project: Hadoop HDFS

[jira] [Created] (HDFS-10650) DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission

John Zhuge created HDFS-10650: - Summary: DFSClient#mkdirs and DFSClient#primitiveMkdir should use default directory permission Key: HDFS-10650 URL: https://issues.apache.org/jira/browse/HDFS-10650

[jira] [Created] (HDFS-10649) Remove unused PermissionStatus#applyUMask

John Zhuge created HDFS-10649: - Summary: Remove unused PermissionStatus#applyUMask Key: HDFS-10649 URL: https://issues.apache.org/jira/browse/HDFS-10649 Project: Hadoop HDFS Issue Type

[jira] [Resolved] (HDFS-4821) It's possible to create files with special characters in the filenames, but 'hadoop fs -ls' gives no indication

[ https://issues.apache.org/jira/browse/HDFS-4821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HDFS-4821. -- Resolution: Duplicate > It's possible to create files with special characters in the filena

[jira] [Created] (HDFS-10439) Update setOwner doc in HdfsPermissionsGuide

John Zhuge created HDFS-10439: - Summary: Update setOwner doc in HdfsPermissionsGuide Key: HDFS-10439 URL: https://issues.apache.org/jira/browse/HDFS-10439 Project: Hadoop HDFS Issue Type: Bug

Re: [DISCUSS] Set minimum version of Hadoop 3 to JDK8 (HADOOP-11858)

Thanks Andrew. Looking forward to CompletableFuture and Streams. John Zhuge Software Engineer, Cloudera > On May 16, 2016, at 3:58 PM, Andrew Wang wrote: > > Very happy to announce that we've committed HADOOP-11858. I'm looking > forward to writing my first lambda in J

[jira] [Created] (HDFS-10410) RedundantEditLogInputStream#LOG is set to wrong class

John Zhuge created HDFS-10410: - Summary: RedundantEditLogInputStream#LOG is set to wrong class Key: HDFS-10410 URL: https://issues.apache.org/jira/browse/HDFS-10410 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10381) DataNode exclusion log message should be a warning

John Zhuge created HDFS-10381: - Summary: DataNode exclusion log message should be a warning Key: HDFS-10381 URL: https://issues.apache.org/jira/browse/HDFS-10381 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10378) setOwner throws AccessControlException with wrong message

John Zhuge created HDFS-10378: - Summary: setOwner throws AccessControlException with wrong message Key: HDFS-10378 URL: https://issues.apache.org/jira/browse/HDFS-10378 Project: Hadoop HDFS

[jira] [Created] (HDFS-10375) Remove redundent TestMiniDFSCluster.testDualClusters

John Zhuge created HDFS-10375: - Summary: Remove redundent TestMiniDFSCluster.testDualClusters Key: HDFS-10375 URL: https://issues.apache.org/jira/browse/HDFS-10375 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10300) TestDistCpSystem should share MiniDFSCluster

John Zhuge created HDFS-10300: - Summary: TestDistCpSystem should share MiniDFSCluster Key: HDFS-10300 URL: https://issues.apache.org/jira/browse/HDFS-10300 Project: Hadoop HDFS Issue Type

[jira] [Created] (HDFS-10297) Increase default balance bandwidth and concurrent moves

John Zhuge created HDFS-10297: - Summary: Increase default balance bandwidth and concurrent moves Key: HDFS-10297 URL: https://issues.apache.org/jira/browse/HDFS-10297 Project: Hadoop HDFS Issue

[jira] [Created] (HDFS-10295) Balancer configures DN properties directly on-demand

John Zhuge created HDFS-10295: - Summary: Balancer configures DN properties directly on-demand Key: HDFS-10295 URL: https://issues.apache.org/jira/browse/HDFS-10295 Project: Hadoop HDFS Issue

  1   2   >