[jira] [Resolved] (HADOOP-18132) S3 exponential backoff

[ https://issues.apache.org/jira/browse/HADOOP-18132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-18132. - Resolution: Not A Problem S3A already performs retries on S3 errors. For details, please check

Re: [DISCUSS] Change project style guidelines to allow line length 100

> Thanks, > > > > > > >> > > Akira > > > > > > >> > > > > > > > > >> > > On Thu, May 20, 2021 at 6:36 AM Sean Busbey > > > > > > >> mailto:sbus...@apple.com.invalid > > >> > > > > > > >> > wrote: > > > > > > >> > >> > > > > > > >> > >> Hello! > > > > > > >> > >> > > > > > > >> > >> What do folks think about changing our line > length > > > > > > >> guidelines to allow > > > > > > >> > for 100 character width? > > > > > > >> > >> > > > > > > >> > >> Currently, we tell folks to follow the sun style > > > guide > > > > > > with > > > > > > >> some > > > > > > >> > exception unrelated to line length. That guide says width > > of > > > 80 > > > > > is > > > > > > the > > > > > > >> > standard and our current check style rules act as > > > enforcement. > > > > > > >> > >> > > > > > > >> > >> Looking at the current trunk codebase our > nightly > > > > build > > > > > > >> shows a total > > > > > > >> > of ~15k line length violations; it’s about 18% of > > identified > > > > > > >> checkstyle > > > > > > >> > issues. > > > > > > >> > >> > > > > > > >> > >> The vast majority of those line length > violations > > > are > > > > <= > > > > > > 100 > > > > > > >> characters > > > > > > >> > long. 100 characters happens to be the length for the > > Google > > > > Java > > > > > > >> Style > > > > > > >> > Guide, another commonly adopted style guide for java > > > projects, > > > > > so I > > > > > > >> suspect > > > > > > >> > these longer lines leaking past the checkstyle precommit > > > > warning > > > > > > >> might be a > > > > > > >> > reflection of committers working across multiple java > > > > codebases. > > > > > > >> > >> > > > > > > >> > >> I don’t feel strongly about lines being longer, > > but > > > I > > > > > > would > > > > > > >> like to > > > > > > >> > move towards more consistent style enforcement as a > > project. > > > > > > Updating > > > > > > >> our > > > > > > >> > project guidance to allow for 100 character lines would > > > reduce > > > > > the > > > > > > >> > likelihood that folks bringing in new contributions need > a > > > > > > precommit > > > > > > >> test > > > > > > >> > cycle to get the formatting correct. > > > > > > >> > >> > > > > > > >> > >> Does anyone feel strongly about keeping the line > > > > length > > > > > > >> limit at 80 > > > > > > >> > characters? > > > > > > >> > >> > > > > > > >> > >> Does anyone feel strongly about contributions > > coming > > > > in > > > > > > that > > > > > > >> clear up > > > > > > >> > line length violations? > > > > > > >> > >> > > > > > > >> > >> > > > > > > >> > >> > > > > > > >> > > > > - > > > > > > >> > >> To unsubscribe, e-mail: > > > > > > >> common-dev-unsubscr...@hadoop.apache.org > > > > > common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > >> For additional commands, e-mail: > > > > > > >> common-dev-h...@hadoop.apache.org > > > > > common-dev-h...@hadoop.apache.org> > > > > > > >> > >> > > > > > > >> > > > > > > > > >> > > > > > > > > >> > > > > - > > > > > > >> > > To unsubscribe, e-mail: > > > > > > common-dev-unsubscr...@hadoop.apache.org > > > > > common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > > For additional commands, e-mail: > > > > > > >> common-dev-h...@hadoop.apache.org > > > > > common-dev-h...@hadoop.apache.org> > > > > > > >> > > > > > > > > >> > > > > > > > >> > > > > > > > > > - > > > > > > >> > To unsubscribe, e-mail: > > > > common-dev-unsubscr...@hadoop.apache.org > > > > > > <mailto:common-dev-unsubscr...@hadoop.apache.org> > > > > > > >> > For additional commands, e-mail: > > > > > common-dev-h...@hadoop.apache.org > > > > > > <mailto:common-dev-h...@hadoop.apache.org> > > > > > > >> > > > > > > > >> > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > > -- John Zhuge

Re: [VOTE] End of Life Hadoop 2.9

t; will be made after 2.9.2 (which was GA on 11/19/2019) > > (2) resolve JIRAs that specifically target 2.9.3 as won't fix. > > > > > > This vote will run for 7 days and will conclude by September 7th, 12:00pm > > pacific time. > > Committers are eligible to cast binding votes. Non-committers are > welcomed > > to cast non-binding votes. > > > > Here is my vote, +1 > > > -- John Zhuge

Re: [DISCUSS] fate of branch-2.9

t; > >> >>>> On Mon, Mar 2, 2020 at 6:30 PM Sree Vaddi > >> >>>> wrote: > >> >>>> > >> >>>>> +1 > >> >>>>> > >> >>>>> Sent from Yahoo Mail on Android > >> >>>>> > >> >>>>> On Mon, Mar 2, 2020 at 5:12 PM, Wei-Chiu Chuang< > weic...@apache.org> > >> >>>>> wrote: Hi, > >> >>>>> > >> >>>>> Following the discussion to end branch-2.8, I want to start a > >> >>>>> discussion > >> >>>>> around what's next with branch-2.9. I am hesitant to use the word > "end > >> >>>>> of > >> >>>>> life" but consider these facts: > >> >>>>> > >> >>>>> * 2.9.0 was released Dec 17, 2017. > >> >>>>> * 2.9.2, the last 2.9.x release, went out Nov 19 2018, which is > more > >> >>>>> than > >> >>>>> 15 months ago. > >> >>>>> * no one seems to be interested in being the release manager for > 2.9.3. > >> >>>>> * Most if not all of the active Hadoop contributors are using > Hadoop > >> >>>>> 2.10 > >> >>>>> or Hadoop 3.x. > >> >>>>> * We as a community do not have the cycle to manage multiple > release > >> >>>>> line, > >> >>>>> especially since Hadoop 3.3.0 is coming out soon. > >> >>>>> > >> >>>>> It is perhaps the time to gradually reduce our footprint in Hadoop > >> >>>>> 2.x, and > >> >>>>> encourage people to upgrade to Hadoop 3.x > >> >>>>> > >> >>>>> Thoughts? > >> >>>>> > >> >>>>> > -- John Zhuge

Re: [VOTE] EOL Hadoop branch-2.8

>>>>>> Thanks Wei-Chiu for starting the discussion, > > > >>>>>> > > > >>>>>> +1 for the EoL. > > > >>>>>> > > > >>>>>> -Akira > > > >>>>>> > > > >>>>>> On Tue, Feb 18, 2020 at 4:59 PM Ayush Saxena < > ayush...@gmail.com> > > > >>>> wrote: > > > >>>>>> > > > >>>>>>> Thanx Wei-Chiu for initiating this > > > >>>>>>> +1 for marking 2.8 EOL > > > >>>>>>> > > > >>>>>>> -Ayush > > > >>>>>>> > > > >>>>>>>> On 17-Feb-2020, at 11:14 PM, Wei-Chiu Chuang < > > > >>> weic...@apache.org> > > > >>>>>> wrote: > > > >>>>>>>> > > > >>>>>>>> The last Hadoop 2.8.x release, 2.8.5, was GA on September > 15th > > > >>>> 2018. > > > >>>>>>>> > > > >>>>>>>> It's been 17 months since the release and the community by and > > > >>>> large > > > >>>>>> have > > > >>>>>>>> moved up to 2.9/2.10/3.x. > > > >>>>>>>> > > > >>>>>>>> With Hadoop 3.3.0 over the horizon, is it time to start the > EOL > > > >>>>>>> discussion > > > >>>>>>>> and reduce the number of active branches? > > > >>>>>>> > > > >>>>>>> > > > >>> > - > > > >>>>>>> To unsubscribe, e-mail: > common-dev-unsubscr...@hadoop.apache.org > > > >>>>>>> For additional commands, e-mail: > > > >>> common-dev-h...@hadoop.apache.org > > > >>>>>>> > > > >>>>>>> > > > >>>>>> > > > >>>>> > > > >>>> > > > >>> > > > >> > > > > > > Wilfred Spiegelenburg > > > Staff Software Engineer > > > <https://www.cloudera.com/> > > > > > > -- John Zhuge

Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

>> contributions to the > > >> project. > > >> > > >> Please join me in congratulating him. > > >> > > >> Hearty Congratulations & Welcome aboard Stephen! > > >> > > >> Wei-Chiu Chuang > > >> (On behalf of the Hadoop PMC) > > >> > > > > - > > To unsubscribe, e-mail: yarn-dev-unsubscr...@hadoop.apache.org > > For additional commands, e-mail: yarn-dev-h...@hadoop.apache.org > > > > > -- John Zhuge

Re: [jira] [Created] (HADOOP-16219) Hadoop branch-2 to set java language version to 1.8

+1 On Thu, Mar 28, 2019 at 12:33 PM Steve Loughran (JIRA) wrote: > Steve Loughran created HADOOP-16219: > --- > > Summary: Hadoop branch-2 to set java language version to 1.8 > Key: HADOOP-16219 > URL: https://iss

Re: [DISCUSS] Making submarine to different release model like Ozone

+1 Does Submarine support Jupyter? On Fri, Feb 1, 2019 at 8:54 AM Zhe Zhang wrote: > +1 on the proposal and looking forward to the progress of the project! > > On Thu, Jan 31, 2019 at 10:51 PM Weiwei Yang wrote: > > > Thanks for proposing this Wangda, my +1 as well. > > It is amazing to see th

Re: [VOTE] Merge HADOOP-15407 to trunk

+1 (Binding) Nice effort all around. On Tue, Sep 18, 2018 at 2:45 AM Steve Loughran wrote: > +1 (Binding) > > Ive been testing this; the current branch is rebased to trunk and all the > new tests are happy. > > > the connector is as good as any of the connectors get before they are > ready for

Re: HADOOP-14163 proposal for new hadoop.apache.org

+1 Like the new site. On Sun, Sep 2, 2018 at 7:02 PM Weiwei Yang wrote: > That's really nice, +1. > > -- > Weiwei > > On Sat, Sep 1, 2018 at 4:36 AM Wangda Tan wrote: > > > +1, thanks for working on this, Marton! > > > > Best, > > Wangda > > > > On Fri, Aug 31, 2018 at 11:24 AM Arpit Agarwal >

Re: [VOTE] Release Apache Hadoop 3.0.3 (RC0)

Thanks Xongjun for the excellent work to drive this release! +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.5 - Verified cloud connectors: - ADLS integration tests passed with 1 failure, not a blocke

[jira] [Resolved] (HADOOP-14961) Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed

[ https://issues.apache.org/jira/browse/HADOOP-14961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14961. - Resolution: Duplicate Fixed by HADOOP-14816. > Docker failed to build yetus/hadoop:0de4

[jira] [Reopened] (HADOOP-14961) Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed

[ https://issues.apache.org/jira/browse/HADOOP-14961?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HADOOP-14961: - > Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT instal

Re: [VOTE] Release Apache Hadoop 3.0.0 RC1

Thanks Andrew for the great effort! Here is my late vote. +1 (binding) - Verified checksums and signatures of tarballs - Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.2 - Verified cloud connectors: - S3A integration tests (perf tests skipped) - Deployed both

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

Oops, the vote was meant for 2.7.5. Sorry for the confusion. My 2.8.3 vote coming up shortly. On Tue, Dec 12, 2017 at 4:28 PM, John Zhuge wrote: > Thanks Junping for the great effort! > > >- Verified checksums and signatures of all tarballs >- Built source with na

Re: [VOTE] Release Apache Hadoop 2.7.5 (RC1)

Thanks Konstantin for the great effort! +1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 - Verified cloud connectors: - All S3A integration tests - Deployed both binary and built source to a pse

Re: [VOTE] Release Apache Hadoop 2.8.3 (RC0)

Thanks Junping for the great effort! - Verified checksums and signatures of all tarballs - Built source with native, Azul Java 1.7.0_161 on Mac OS X 10.13.2 - Verified cloud connectors: - All S3A integration tests - Deployed both binary and built source to a pseudo cluster, pass

Re: [VOTE] Release Apache Hadoop 3.0.0 RC0

+1 (binding) - Verified checksums of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Passed all S3A and ADL integration tests - Deployed both binary and built source to a pseudo cluster, passed the following sanity tests in insecure, SSL, and SSL+Ke

Re: [VOTE] Release Apache Hadoop 2.9.0 (RC1)

+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified these cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo c

[jira] [Resolved] (HADOOP-15012) Add readahead, dropbehind, and unbuffer to StreamCapabilities

[ https://issues.apache.org/jira/browse/HADOOP-15012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-15012. - Resolution: Fixed Fix Version/s: 3.1.0 Committed to trunk together with HADOOP-14872

[jira] [Created] (HADOOP-15012) Enhance StreamCapabilities with READAHEAD, DROPBEHIND, and UNBUFFER

John Zhuge created HADOOP-15012: --- Summary: Enhance StreamCapabilities with READAHEAD, DROPBEHIND, and UNBUFFER Key: HADOOP-15012 URL: https://issues.apache.org/jira/browse/HADOOP-15012 Project: Hadoop

[jira] [Resolved] (HADOOP-14974) org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.TestContainerAllocation fails in trunk

[ https://issues.apache.org/jira/browse/HADOOP-14974?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14974. - Resolution: Fixed Fix Version/s: 3.1.0 Target Version/s: 3.1.0

[jira] [Reopened] (HADOOP-14954) MetricsSystemImpl#init should increment refCount when already initialized

[ https://issues.apache.org/jira/browse/HADOOP-14954?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HADOOP-14954: - Reverted because it broke a bunch of YARN tests, e.g., TestContainerAllocation

Re: [VOTE] Release Apache Hadoop 2.8.2 (RC1)

+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo cluste

[jira] [Created] (HADOOP-14963) Add HTrace to ADLS connector

John Zhuge created HADOOP-14963: --- Summary: Add HTrace to ADLS connector Key: HADOOP-14963 URL: https://issues.apache.org/jira/browse/HADOOP-14963 Project: Hadoop Common Issue Type: Sub-task

[jira] [Created] (HADOOP-14961) Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed

John Zhuge created HADOOP-14961: --- Summary: Docker failed to build yetus/hadoop:0de40f0: Oracle JDK 8 is NOT installed Key: HADOOP-14961 URL: https://issues.apache.org/jira/browse/HADOOP-14961 Project

[jira] [Created] (HADOOP-14954) MetricsSystemImpl#init should increment refCount when already initialized

John Zhuge created HADOOP-14954: --- Summary: MetricsSystemImpl#init should increment refCount when already initialized Key: HADOOP-14954 URL: https://issues.apache.org/jira/browse/HADOOP-14954 Project

Re: [VOTE] Release Apache Hadoop 3.0.0-beta1 RC0

+1 (binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - All ADL live unit tests - Deployed both binary and built source to a pseudo cluster

[jira] [Created] (HADOOP-14925) hadoop-aliyun has missing dependencies

John Zhuge created HADOOP-14925: --- Summary: hadoop-aliyun has missing dependencies Key: HADOOP-14925 URL: https://issues.apache.org/jira/browse/HADOOP-14925 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14924) hadoop-azure-datalake has missing dependencies

John Zhuge created HADOOP-14924: --- Summary: hadoop-azure-datalake has missing dependencies Key: HADOOP-14924 URL: https://issues.apache.org/jira/browse/HADOOP-14924 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14923) hadoop-azure has missing dependencies

John Zhuge created HADOOP-14923: --- Summary: hadoop-azure has missing dependencies Key: HADOOP-14923 URL: https://issues.apache.org/jira/browse/HADOOP-14923 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14917) AdlFileSystem should support getStorageStatistics

John Zhuge created HADOOP-14917: --- Summary: AdlFileSystem should support getStorageStatistics Key: HADOOP-14917 URL: https://issues.apache.org/jira/browse/HADOOP-14917 Project: Hadoop Common

[jira] [Created] (HADOOP-14872) CryptoInputStream should implement unbuffer

John Zhuge created HADOOP-14872: --- Summary: CryptoInputStream should implement unbuffer Key: HADOOP-14872 URL: https://issues.apache.org/jira/browse/HADOOP-14872 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14864) FSDataInputStream#unbuffer UOE exception should print the stream class name

John Zhuge created HADOOP-14864: --- Summary: FSDataInputStream#unbuffer UOE exception should print the stream class name Key: HADOOP-14864 URL: https://issues.apache.org/jira/browse/HADOOP-14864 Project

[jira] [Created] (HADOOP-14862) Metrics for AdlFileSystem

John Zhuge created HADOOP-14862: --- Summary: Metrics for AdlFileSystem Key: HADOOP-14862 URL: https://issues.apache.org/jira/browse/HADOOP-14862 Project: Hadoop Common Issue Type: Sub-task

[jira] [Created] (HADOOP-14832) listing s3a bucket without credentials gives Interrupted error

John Zhuge created HADOOP-14832: --- Summary: listing s3a bucket without credentials gives Interrupted error Key: HADOOP-14832 URL: https://issues.apache.org/jira/browse/HADOOP-14832 Project: Hadoop

Re: native folder not found in hadoop-common build on Ubuntu

Hi Ping, Thanks for using Hadoop. Linux is Unix-like. Hadoop supports native code on Linux. Please read BUILDING.txt in the root of the Hadoop source tree. Could you provide the entire Maven command line when you built Hadoop? On Thu, Aug 31, 2017 at 3:06 PM, Ping Liu wrote: > I built hadoop-c

[jira] [Created] (HADOOP-14808) Hadoop keychain

John Zhuge created HADOOP-14808: --- Summary: Hadoop keychain Key: HADOOP-14808 URL: https://issues.apache.org/jira/browse/HADOOP-14808 Project: Hadoop Common Issue Type: New Feature

[jira] [Created] (HADOOP-14794) Standalone MiniKdc server

John Zhuge created HADOOP-14794: --- Summary: Standalone MiniKdc server Key: HADOOP-14794 URL: https://issues.apache.org/jira/browse/HADOOP-14794 Project: Hadoop Common Issue Type: New Feature

[jira] [Created] (HADOOP-14791) SimpleKdcServer: Fail to delete krb5 conf

John Zhuge created HADOOP-14791: --- Summary: SimpleKdcServer: Fail to delete krb5 conf Key: HADOOP-14791 URL: https://issues.apache.org/jira/browse/HADOOP-14791 Project: Hadoop Common Issue Type

Re: [VOTE] Merge HADOOP-13345 (S3Guard feature branch)

That will be great. Please record it if possible. On Fri, Aug 18, 2017 at 4:12 AM, Steve Loughran wrote: > > I can do a demo of this next week if people are interested > > > On 17 Aug 2017, at 23:07, Aaron Fabbri wrote: > > > > Hello, > > > > I'd like to open a vote (7 days, ending August 24 at

[jira] [Created] (HADOOP-14786) HTTP default servlets do not require authentication when kerberos is enabled

John Zhuge created HADOOP-14786: --- Summary: HTTP default servlets do not require authentication when kerberos is enabled Key: HADOOP-14786 URL: https://issues.apache.org/jira/browse/HADOOP-14786 Project

[jira] [Resolved] (HADOOP-14438) Make ADLS doc of setting up client key up to date

[ https://issues.apache.org/jira/browse/HADOOP-14438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14438. - Resolution: Duplicate Assignee: John Zhuge Take care of both issues in HADOOP-14627

[jira] [Created] (HADOOP-14765) AdlFsInputStream to implement CanUnbuffer

John Zhuge created HADOOP-14765: --- Summary: AdlFsInputStream to implement CanUnbuffer Key: HADOOP-14765 URL: https://issues.apache.org/jira/browse/HADOOP-14765 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14764) Über-jira adl:// Azure Data Lake Phase II: Performance and Testing

John Zhuge created HADOOP-14764: --- Summary: Über-jira adl:// Azure Data Lake Phase II: Performance and Testing Key: HADOOP-14764 URL: https://issues.apache.org/jira/browse/HADOOP-14764 Project: Hadoop

[jira] [Created] (HADOOP-14754) TestCommonConfigurationFields failed: core-default.xml has 2 properties missing in class

John Zhuge created HADOOP-14754: --- Summary: TestCommonConfigurationFields failed: core-default.xml has 2 properties missing in class Key: HADOOP-14754 URL: https://issues.apache.org/jira/browse/HADOOP-14754

[jira] [Created] (HADOOP-14753) Add WASB FileContext tests

John Zhuge created HADOOP-14753: --- Summary: Add WASB FileContext tests Key: HADOOP-14753 URL: https://issues.apache.org/jira/browse/HADOOP-14753 Project: Hadoop Common Issue Type: Improvement

Re: Question about how to best contribute

And check out HADOOP-12145 Organize and update CodeReviewChecklist wiki. Thanks, your contribution will be greatly appreciated! On Mon, Aug 7, 2017 at 5:53 AM, Steve Loughran wrote: > > Hi Lars & Welcome! > > Maybe the first step here would

[jira] [Created] (HADOOP-14737) Sort out hadoop-common contract-test-options.xml

John Zhuge created HADOOP-14737: --- Summary: Sort out hadoop-common contract-test-options.xml Key: HADOOP-14737 URL: https://issues.apache.org/jira/browse/HADOOP-14737 Project: Hadoop Common

[jira] [Created] (HADOOP-14721) Add StreamCapabilities support to Aliyun OSS

John Zhuge created HADOOP-14721: --- Summary: Add StreamCapabilities support to Aliyun OSS Key: HADOOP-14721 URL: https://issues.apache.org/jira/browse/HADOOP-14721 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14720) Add StreamCapabilities support to Swift

John Zhuge created HADOOP-14720: --- Summary: Add StreamCapabilities support to Swift Key: HADOOP-14720 URL: https://issues.apache.org/jira/browse/HADOOP-14720 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14719) Add StreamCapabilities support to WASB

John Zhuge created HADOOP-14719: --- Summary: Add StreamCapabilities support to WASB Key: HADOOP-14719 URL: https://issues.apache.org/jira/browse/HADOOP-14719 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14718) Add StreamCapabilities support to ADLS

John Zhuge created HADOOP-14718: --- Summary: Add StreamCapabilities support to ADLS Key: HADOOP-14718 URL: https://issues.apache.org/jira/browse/HADOOP-14718 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14712) Document support for AWS Snowball

John Zhuge created HADOOP-14712: --- Summary: Document support for AWS Snowball Key: HADOOP-14712 URL: https://issues.apache.org/jira/browse/HADOOP-14712 Project: Hadoop Common Issue Type: Sub

[jira] [Created] (HADOOP-14711) Test data transfer between Hadoop and AWS Snowball

John Zhuge created HADOOP-14711: --- Summary: Test data transfer between Hadoop and AWS Snowball Key: HADOOP-14711 URL: https://issues.apache.org/jira/browse/HADOOP-14711 Project: Hadoop Common

[jira] [Created] (HADOOP-14710) Uber-JIRA: Support AWS Snowball

John Zhuge created HADOOP-14710: --- Summary: Uber-JIRA: Support AWS Snowball Key: HADOOP-14710 URL: https://issues.apache.org/jira/browse/HADOOP-14710 Project: Hadoop Common Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

or that > https://issues.apache.org/jira/browse/HDFS-11985 > but decided it should not block the release. > The "dr,who" thing is a configuration issue. This page may be helpful: > http://hadoop.apache.org/docs/stable/hadoop-hdfs-httpfs/ServerSetup.html > > Thanks, > --Konstan

Re: [VOTE] Release Apache Hadoop 2.7.4 (RC0)

Hi Konstantin, Thanks a lot for the effort to prepare the 2.7.4-RC0 release! +1 (non-binding) - Verified checksums and signatures of all tarballs - Built source with native, Java 1.8.0_131-b11 on Mac OS X 10.12.6 - Verified cloud connectors: - All S3A integration tests - Deploy

[jira] [Created] (HADOOP-14695) Allow disabling chunked encoding

John Zhuge created HADOOP-14695: --- Summary: Allow disabling chunked encoding Key: HADOOP-14695 URL: https://issues.apache.org/jira/browse/HADOOP-14695 Project: Hadoop Common Issue Type

Re: Should ToolRunner call UserGroupInformation.setConfiguration?

The static UGI.conf is set to a new Configuration object in UGI.ensureInitialized if setConfiguration is not already called. ToolRunner.conf does take -D overrides but it is not copied to UGI.conf. On Wed, Jul 26, 2017 at 8:42 PM, John Zhuge wrote: > Hi Gurus, > > Unlike YarnChil

Should ToolRunner call UserGroupInformation.setConfiguration?

Hi Gurus, Unlike YarnChild, DN, NN, and many others, ToolRunner does not call UserGroupInformation.setConfiguration. Is this by design? The means you can not use "-D" to override any conf property used in UGI. The only direct call I found is: String cmd = conf.get("hadoop.kerberos.kinit.

[jira] [Created] (HADOOP-14679) Obtain ADLS access token provider type from credential provider

John Zhuge created HADOOP-14679: --- Summary: Obtain ADLS access token provider type from credential provider Key: HADOOP-14679 URL: https://issues.apache.org/jira/browse/HADOOP-14679 Project: Hadoop

[jira] [Created] (HADOOP-14678) AdlFilesystem#initialize swallows exception when getting user name

John Zhuge created HADOOP-14678: --- Summary: AdlFilesystem#initialize swallows exception when getting user name Key: HADOOP-14678 URL: https://issues.apache.org/jira/browse/HADOOP-14678 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

+1 (non-binding) - Verified checksums and signatures of the tarballs - Built source with native, Java 1.8.0_131 on Mac OS X 10.12.5 - Cloud connectors: - A few S3A integration tests - A few ADL live unit tests - Deployed both binary and built source to a pseudo cluster, pa

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

False alarm, fixed the build issue with "mvn -U clean install". On Wed, Jul 5, 2017 at 6:08 PM, John Zhuge wrote: > For some reason, I can't build the source. > > Got this when running "mvn install -U" inside directory > "hadoop-maven-pl

Re: [VOTE] Release Apache Hadoop 3.0.0-alpha4-RC0

For some reason, I can't build the source. Got this when running "mvn install -U" inside directory "hadoop-maven-plugins": [ERROR] Failed to execute goal org.apache.maven.plugins:maven-remote-resources-plugin:1.5:process (default) on project hadoop-maven-plugins: Execution default of goal org.apa

[jira] [Created] (HADOOP-14608) KMS JMX servlet path not backwards compatible

John Zhuge created HADOOP-14608: --- Summary: KMS JMX servlet path not backwards compatible Key: HADOOP-14608 URL: https://issues.apache.org/jira/browse/HADOOP-14608 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14519) Client$Connection#waitForWork may suffer spurious wakeup

John Zhuge created HADOOP-14519: --- Summary: Client$Connection#waitForWork may suffer spurious wakeup Key: HADOOP-14519 URL: https://issues.apache.org/jira/browse/HADOOP-14519 Project: Hadoop Common

[jira] [Created] (HADOOP-14471) Upgrade Jetty to latest version

John Zhuge created HADOOP-14471: --- Summary: Upgrade Jetty to latest version Key: HADOOP-14471 URL: https://issues.apache.org/jira/browse/HADOOP-14471 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14464) hadoop-aws doc header warning #5 line wrapped

John Zhuge created HADOOP-14464: --- Summary: hadoop-aws doc header warning #5 line wrapped Key: HADOOP-14464 URL: https://issues.apache.org/jira/browse/HADOOP-14464 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-14421) TestAdlFileSystemContractLive#testListStatus assertion failed

[ https://issues.apache.org/jira/browse/HADOOP-14421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14421. - Resolution: Duplicate Fix Version/s: 2.8.1 Sorry for the false alarm. This issue is

[jira] [Reopened] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HADOOP-14435: - Great idea! Re-opened this as a doc JIRA to add a new section {{Troubleshooting}} to {{index.md

[jira] [Resolved] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

[ https://issues.apache.org/jira/browse/HADOOP-14435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14435. - Resolution: Not A Bug Release Note: The "Other" entry in the default permissi

[jira] [Created] (HADOOP-14435) TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed

John Zhuge created HADOOP-14435: --- Summary: TestAdlFileSystemContractLive#testMkdirsWithUmask assertion failed Key: HADOOP-14435 URL: https://issues.apache.org/jira/browse/HADOOP-14435 Project: Hadoop

[jira] [Created] (HADOOP-14421) TestAdlFileSystemContractLive#testListStatus assertion failed

John Zhuge created HADOOP-14421: --- Summary: TestAdlFileSystemContractLive#testListStatus assertion failed Key: HADOOP-14421 URL: https://issues.apache.org/jira/browse/HADOOP-14421 Project: Hadoop Common

[jira] [Created] (HADOOP-14417) Update cipher list for KMS

John Zhuge created HADOOP-14417: --- Summary: Update cipher list for KMS Key: HADOOP-14417 URL: https://issues.apache.org/jira/browse/HADOOP-14417 Project: Hadoop Common Issue Type: Improvement

[jira] [Created] (HADOOP-14352) Make some HttpServer2 SSL properties optional

John Zhuge created HADOOP-14352: --- Summary: Make some HttpServer2 SSL properties optional Key: HADOOP-14352 URL: https://issues.apache.org/jira/browse/HADOOP-14352 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-14347) Make KMS Jetty connection backlog configurable

John Zhuge created HADOOP-14347: --- Summary: Make KMS Jetty connection backlog configurable Key: HADOOP-14347 URL: https://issues.apache.org/jira/browse/HADOOP-14347 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-14344) Revert HADOOP-13606 swift FS to add a service load metadata file

[ https://issues.apache.org/jira/browse/HADOOP-14344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14344. - Resolution: Fixed Fix Version/s: 3.0.0-alpha3 2.8.1

[jira] [Created] (HADOOP-14344) Revert HADOOP-13606 swift FS to add a service load metadata file

John Zhuge created HADOOP-14344: --- Summary: Revert HADOOP-13606 swift FS to add a service load metadata file Key: HADOOP-14344 URL: https://issues.apache.org/jira/browse/HADOOP-14344 Project: Hadoop

[jira] [Created] (HADOOP-14341) Support multi-line value for ssl.server.exclude.cipher.list

John Zhuge created HADOOP-14341: --- Summary: Support multi-line value for ssl.server.exclude.cipher.list Key: HADOOP-14341 URL: https://issues.apache.org/jira/browse/HADOOP-14341 Project: Hadoop Common

[jira] [Created] (HADOOP-14340) Enable KMS and HttpFS to exclude weak SSL ciphers

John Zhuge created HADOOP-14340: --- Summary: Enable KMS and HttpFS to exclude weak SSL ciphers Key: HADOOP-14340 URL: https://issues.apache.org/jira/browse/HADOOP-14340 Project: Hadoop Common

[jira] [Reopened] (HADOOP-14241) Add ADLS sensitive config keys to default list

[ https://issues.apache.org/jira/browse/HADOOP-14241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge reopened HADOOP-14241: - Reopen to run pre-commit > Add ADLS sensitive config keys to default l

[jira] [Created] (HADOOP-14317) KMSWebServer$deprecateEnv may leak secret

John Zhuge created HADOOP-14317: --- Summary: KMSWebServer$deprecateEnv may leak secret Key: HADOOP-14317 URL: https://issues.apache.org/jira/browse/HADOOP-14317 Project: Hadoop Common Issue Type

[jira] [Resolved] (HADOOP-14151) Swift treats 0-len file as directory

[ https://issues.apache.org/jira/browse/HADOOP-14151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14151. - Resolution: Duplicate > Swift treats 0-len file as direct

Re: Local trunk build is flaky

This command works for me (similar to Eric's): mvn clean && mvn install package -Pdist -Dtar -DskipTests -DskipShade -Dmaven.javadoc.skip $ mvn -v Apache Maven 3.3.9 (bb52d8502b132ec0a5a3f4c09453c07478323dc5; 2015-11-10T08:41:47-08:00) Maven home: /Users/jzhuge/apache-maven-3.3.9 Java version

[jira] [Resolved] (HADOOP-14292) Transient TestAdlContractRootDirLive failure

[ https://issues.apache.org/jira/browse/HADOOP-14292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14292. - Resolution: Not A Problem Assignee: Atul Sikaria (was: Vishwajeet Dusane) Thanks

[jira] [Created] (HADOOP-14304) AdlStoreClient#getExceptionFromResponse should not swallow defaultMessage

John Zhuge created HADOOP-14304: --- Summary: AdlStoreClient#getExceptionFromResponse should not swallow defaultMessage Key: HADOOP-14304 URL: https://issues.apache.org/jira/browse/HADOOP-14304 Project

[jira] [Created] (HADOOP-14294) Rename ADLS mountpoint properties

John Zhuge created HADOOP-14294: --- Summary: Rename ADLS mountpoint properties Key: HADOOP-14294 URL: https://issues.apache.org/jira/browse/HADOOP-14294 Project: Hadoop Common Issue Type: Bug

[jira] [Created] (HADOOP-14292) Transient TestAdlContractRootDirLive failure

John Zhuge created HADOOP-14292: --- Summary: Transient TestAdlContractRootDirLive failure Key: HADOOP-14292 URL: https://issues.apache.org/jira/browse/HADOOP-14292 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-14243) Add S3A sensitive config keys to default list

[ https://issues.apache.org/jira/browse/HADOOP-14243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Zhuge resolved HADOOP-14243. - Resolution: Not A Problem {{fs.s3a.secret.key}} already on the default list

[jira] [Created] (HADOOP-14259) Verify viewfs works with ADLS

John Zhuge created HADOOP-14259: --- Summary: Verify viewfs works with ADLS Key: HADOOP-14259 URL: https://issues.apache.org/jira/browse/HADOOP-14259 Project: Hadoop Common Issue Type: Test

[jira] [Created] (HADOOP-14258) Verify and document ADLS client mount table feature

John Zhuge created HADOOP-14258: --- Summary: Verify and document ADLS client mount table feature Key: HADOOP-14258 URL: https://issues.apache.org/jira/browse/HADOOP-14258 Project: Hadoop Common

[jira] [Created] (HADOOP-14251) Credential provider should handle property key deprecation

John Zhuge created HADOOP-14251: --- Summary: Credential provider should handle property key deprecation Key: HADOOP-14251 URL: https://issues.apache.org/jira/browse/HADOOP-14251 Project: Hadoop Common

Re: Review request for HADOOP-14202

Sure Allen. I will help. On Mon, Mar 27, 2017 at 4:01 PM, Allen Wittenauer wrote: > > Hey gang. > > Could I get a quick review of HADOOP-14202? This changes a few > things: > > * Makes the rest of the _USER vars consistent with the other > changes in trunk (e.g., HADOOP_SECURE_

[jira] [Created] (HADOOP-14243) Add S3A sensitive keys to default Hadoop sensitive keys

John Zhuge created HADOOP-14243: --- Summary: Add S3A sensitive keys to default Hadoop sensitive keys Key: HADOOP-14243 URL: https://issues.apache.org/jira/browse/HADOOP-14243 Project: Hadoop Common

[jira] [Created] (HADOOP-14242) Configure KMS Tomcat SSL property sslEnabledProtocols

John Zhuge created HADOOP-14242: --- Summary: Configure KMS Tomcat SSL property sslEnabledProtocols Key: HADOOP-14242 URL: https://issues.apache.org/jira/browse/HADOOP-14242 Project: Hadoop Common

[jira] [Created] (HADOOP-14241) Add ADLS credential keys to Hadoop sensitive key list

John Zhuge created HADOOP-14241: --- Summary: Add ADLS credential keys to Hadoop sensitive key list Key: HADOOP-14241 URL: https://issues.apache.org/jira/browse/HADOOP-14241 Project: Hadoop Common

[jira] [Created] (HADOOP-14234) Improve ADLS FileSystem tests with JUnit4

John Zhuge created HADOOP-14234: --- Summary: Improve ADLS FileSystem tests with JUnit4 Key: HADOOP-14234 URL: https://issues.apache.org/jira/browse/HADOOP-14234 Project: Hadoop Common Issue Type

[jira] [Created] (HADOOP-14230) TestAdlFileSystemContractLive fails to clean up

John Zhuge created HADOOP-14230: --- Summary: TestAdlFileSystemContractLive fails to clean up Key: HADOOP-14230 URL: https://issues.apache.org/jira/browse/HADOOP-14230 Project: Hadoop Common

  1   2   3   >