Re: [VOTE] Release Apache Hadoop 2.6.2

+1 ( Non-binding) - Downloaded 2.6.1 — created a cluster with namenode and a bunch of data nodes. - verified that Rolling upgrade and Rollback options work correctly in moving from 2.61 to 2.6.2 —Anu On 10/22/15, 2:14 PM, "sjl...@gmail.com on behalf of Sangjin Lee" wrote: >Hi all, > >I ha

Re: [VOTE] Release Apache Hadoop 2.6.2

+1 (non-binding) - Downloaded both source and binary tarballs (Mac and Linux): CHECK - Verified checksum on both files (Mac and Linux): CHECK - Extracted the source tarball and built the code (Mac and Linux): CHECK - Deployed a single-node cluster (Linux): CHECK - Ran example MR job word

RE: [VOTE] Release Apache Hadoop 2.6.2

+1(non-binding) Downloaded tar.gz, and installed 2 node HA cluster. RMHA/RMRestart/RMWorkpreservingRestart cluster are fine. Verified cluster for high availability. Ran sample MR applications with RM HA enabled. Run sanity test cases and are working fine. Thanks & Regards Rohith Sharma K S ---

Build failed in Jenkins: Hadoop-Hdfs-trunk #2478

See Changes: [wang] HDFS-9284. fsck command should not print exception trace when file not [lei] HDFS-9291. Fix TestInterDatanodeProtocol to be FsDataset-agnostic. (lei) [wang] HDFS-8945. Update the description about replica placeme

Hadoop-Hdfs-trunk - Build # 2478 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2478/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6209 lines...] [INFO] [INFO] --- maven-source-plugin:2.3

Re: Java 8 + Jersey updates

> I assume you are targetting this only at trunk / 3.0 based on the "target > version" and the incompatibility discussion? Yes, you're right. Best regards, - Tsuyoshi On Tue, Oct 27, 2015 at 5:12 AM, Colin P. McCabe wrote: > Looks like a good idea. I assume you are targetting this only at tr

[jira] [Created] (HDFS-9315) Update excess storage type list properly when del hint is picked

Ming Ma created HDFS-9315: - Summary: Update excess storage type list properly when del hint is picked Key: HDFS-9315 URL: https://issues.apache.org/jira/browse/HDFS-9315 Project: Hadoop HDFS Issue T

Hadoop-Hdfs-trunk-Java8 - Build # 540 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/540/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7618 lines...] [INFO] [INFO] --- maven-source-plugi

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #540

See Changes: [wheat9] HDFS-9304. Add HdfsClientConfigKeys class to [jlowe] YARN-4284. condition for AM blacklisting is too narrow. Contributed by [wangda] YARN-4285. Display resource usage as percentage of queue and cluster in

[jira] [Created] (HDFS-9314) Improve BlockPlacementPolicyDefault's picking of excess replicas

Ming Ma created HDFS-9314: - Summary: Improve BlockPlacementPolicyDefault's picking of excess replicas Key: HDFS-9314 URL: https://issues.apache.org/jira/browse/HDFS-9314 Project: Hadoop HDFS Issue T

[jira] [Created] (HDFS-9313) Possible NullPointerException in BlockManager if no excess replica can be chosen

Ming Ma created HDFS-9313: - Summary: Possible NullPointerException in BlockManager if no excess replica can be chosen Key: HDFS-9313 URL: https://issues.apache.org/jira/browse/HDFS-9313 Project: Hadoop HDFS

[jira] [Created] (HDFS-9312) Fix TestReplication to be FsDataset-agnostic.

Lei (Eddy) Xu created HDFS-9312: --- Summary: Fix TestReplication to be FsDataset-agnostic. Key: HDFS-9312 URL: https://issues.apache.org/jira/browse/HDFS-9312 Project: Hadoop HDFS Issue Type: Imp

[jira] [Created] (HDFS-9311) Support optional offload of NameNode HA service health checks to a separate RPC server.

Chris Nauroth created HDFS-9311: --- Summary: Support optional offload of NameNode HA service health checks to a separate RPC server. Key: HDFS-9311 URL: https://issues.apache.org/jira/browse/HDFS-9311 Pro

Build failed in Jenkins: Hadoop-Hdfs-trunk #2477

See Changes: [wheat9] HDFS-9304. Add HdfsClientConfigKeys class to [jlowe] YARN-4284. condition for AM blacklisting is too narrow. Contributed by [wangda] YARN-4285. Display resource usage as percentage of queue and cluster in [yzh

Hadoop-Hdfs-trunk - Build # 2477 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2477/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6223 lines...] [INFO] Executed tasks [INFO] [INFO] --- m

[jira] [Created] (HDFS-9310) TestDataNodeHotSwapVolumes fails occasionally

Arpit Agarwal created HDFS-9310: --- Summary: TestDataNodeHotSwapVolumes fails occasionally Key: HDFS-9310 URL: https://issues.apache.org/jira/browse/HDFS-9310 Project: Hadoop HDFS Issue Type: Bug

Re: [VOTE] Release Apache Hadoop 2.6.2

+1 (binding) - Verified signatures and digests- Performed native build from source- Deployed a single-node cluster and ran some test jobs Jason From: Sangjin Lee To: "common-...@hadoop.apache.org" ; "yarn-...@hadoop.apache.org" ; "hdfs-dev@hadoop.apache.org" ; "mapreduce-...@hadoop.apa

Re: [VOTE] Release Apache Hadoop 2.6.2

Thanks all for the quick action on the KEYS file Steps: * Reviewed list of changed JIRAs, all in YARN/MR. * Release notes and CHANGES.txt looked good * Verified checksums and signature via `gpg --verify` * Ran `mvn apache-rat:check` on source tarball, passed * Tarball size looks reasonable * Built

Re: [VOTE] Release Apache Hadoop 2.6.2

This is done: https://dist.apache.org/repos/dist/release/hadoop/common/KEYS is updated with Sangjin’s keys now. Thanks +Vinod On Oct 26, 2015, at 2:06 PM, Vinod Kumar Vavilapalli mailto:vino...@hortonworks.com>> wrote: I will get his KEYS committed right-away

[jira] [Resolved] (HDFS-5032) Write pipeline failures caused by slow or busy disk may not be handled properly.

[ https://issues.apache.org/jira/browse/HDFS-5032?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee resolved HDFS-5032. -- Resolution: Fixed > Write pipeline failures caused by slow or busy disk may not be handled > properly. >

Re: [VOTE] Release Apache Hadoop 2.6.2

+1 (binding) Download the tarball and run some HDFS tests and MR examples in a pseudo-distributed cluster. Thanks, -Jing On Mon, Oct 26, 2015 at 2:06 PM, Vinod Vavilapalli wrote: > I was helping Sangjin offline with the release. > > We briefly discussed the KEYS problem before, but it missed m

Re: [VOTE] Release Apache Hadoop 2.6.2

Thanks Vinod! Thanks for the correction on the vote Andrew. Making some rookie mistakes here. :) On Mon, Oct 26, 2015 at 2:06 PM, Vinod Vavilapalli wrote: > I was helping Sangjin offline with the release. > > We briefly discussed the KEYS problem before, but it missed my attention. > > I will ge

Re: [VOTE] Release Apache Hadoop 2.6.2

I was helping Sangjin offline with the release. We briefly discussed the KEYS problem before, but it missed my attention. I will get his KEYS committed right-away, the release is testable right away though. Regarding the voting period, let’s continue voting for two more days, the period also h

[jira] [Created] (HDFS-9309) Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig()

Wei-Chiu Chuang created HDFS-9309: - Summary: Tests that use KeyStoreUtil must call KeyStoreUtil.cleanupSSLConfig() Key: HDFS-9309 URL: https://issues.apache.org/jira/browse/HDFS-9309 Project: Hadoop H

[jira] [Created] (HDFS-9308) Add truncateMeta() to MiniDFSCluster

Tony Wu created HDFS-9308: - Summary: Add truncateMeta() to MiniDFSCluster Key: HDFS-9308 URL: https://issues.apache.org/jira/browse/HDFS-9308 Project: Hadoop HDFS Issue Type: Improvement Co

[jira] [Created] (HDFS-9307) fuseConnect should be private to fuse_connect.c

Colin Patrick McCabe created HDFS-9307: -- Summary: fuseConnect should be private to fuse_connect.c Key: HDFS-9307 URL: https://issues.apache.org/jira/browse/HDFS-9307 Project: Hadoop HDFS

Re: Java 8 + Jersey updates

Looks like a good idea. I assume you are targetting this only at trunk / 3.0 based on the "target version" and the incompatibility discussion? best, Colin On Mon, Oct 26, 2015 at 7:07 AM, Tsuyoshi Ozawa wrote: > Hi Steve, > > Thanks for your help. > > > 2. it's "significant" > > This change in

Hadoop-Hdfs-trunk - Build # 2476 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2476/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6870 lines...] [INFO] --- maven-antrun-plugin:1.7:run (cr

Build failed in Jenkins: Hadoop-Hdfs-trunk #2476

See Changes: [ozawa] HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by -- [...truncated 6677 lines...] Running org.apache.hadoop.hdfs.server.balancer.TestBalancerWithEncry

Hadoop-Hdfs-trunk-Java8 - Build # 539 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/539/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8084 lines...] [INFO] --- maven-antrun-plugin:1.7:ru

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #539

See Changes: [ozawa] HADOOP-12513. Dockerfile lacks initial 'apt-get update'. Contributed by -- [...truncated 7891 lines...] Running org.apache.hadoop.hdfs.web.TestWebHdfsTimeouts Tests ru

[jira] [Resolved] (HDFS-8128) hadoop-hdfs-client dependency convergence error

[ https://issues.apache.org/jira/browse/HDFS-8128?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai resolved HDFS-8128. -- Resolution: Cannot Reproduce Resolving this issue. It looks like it is no longer reproducible in trunk.

Re: Planning Apache Hadoop 2.7.2

Got swamped again. We already have about 112 patches in 2.7.2 already. There are 15 open tickets in progress. I’ll push progress on them for an RC towards end of this week. Thanks +Vinod On Sep 25, 2015, at 3:27 PM, Vinod Kumar Vavilapalli mailto:vino...@apache.org>> wrote: Hi all, We relea

Re: 2.7.2 release plan

+1. Thanks +Vinod > On Jul 16, 2015, at 8:18 AM, Chris Nauroth wrote: > > I'd be comfortable with inclusion of any doc-only patch in minor releases. > There is a lot of value to end users in pushing documentation fixes as > quickly as possible, and they don't bear the same risk of regressions o

Re: [VOTE] Release Apache Hadoop 2.6.2

Thanks Akira! A friendly reminder to the community that the vote closes tomorrow. It would be great if you could check out the release candidate and cast your vote. Sangjin On Mon, Oct 26, 2015 at 5:00 AM, Akira AJISAKA wrote: > Thanks Sangjin for creating RC for 2.6.2. +1 (non-binding) > > -

Hadoop-Hdfs-trunk - Build # 2475 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2475/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6913 lines...] main: [mkdir] Created dir: /home/jenk

Build failed in Jenkins: Hadoop-Hdfs-trunk #2475

See Changes: [ozawa] YARN-3528. Tests with 12345 as hard-coded port break jenkins. [rohithsharmaks] YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager [rohithsharmaks] YARN-2729. Support script based NodeLabelsPro

Hadoop-Hdfs-trunk-Java8 - Build # 538 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/538/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6403 lines...] [INFO] Executing tasks main: [mk

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #538

See Changes: [rohithsharmaks] YARN-4223. Fixed findbugs warnings in hadoop-yarn-server-nodemanager [rohithsharmaks] YARN-2729. Support script based NodeLabelsProvider Interface in -- [..

Re: Java 8 + Jersey updates

Hi Steve, Thanks for your help. > 2. it's "significant" This change includes upgrading not only Jersey, but also its dependencies like grizzly, asm, and so on. > I'll try to rebuild a YARN app (slider) with the patch to see how it fares It helps us a lot. I'd like to suggest that the incompat

Hadoop-Hdfs-trunk-Java8 - Build # 537 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/537/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7481 lines...] main: [mkdir] Created dir: /hom

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #537

See Changes: [rohithsharmaks] YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks) [ozawa] YARN-3528. Tests with 12345 as hard-coded port break jenkins. -- [...trunca

[jira] [Created] (HDFS-9306) libhdfs++ configuration should do deprecated key lookup

Bob Hansen created HDFS-9306: Summary: libhdfs++ configuration should do deprecated key lookup Key: HDFS-9306 URL: https://issues.apache.org/jira/browse/HDFS-9306 Project: Hadoop HDFS Issue Type:

Re: [VOTE] Release Apache Hadoop 2.6.2

Thanks Sangjin for creating RC for 2.6.2. +1 (non-binding) - Verified signatures and checksums - Deployed a single node cluster - Built Tez 0.7.0 with Hadoop 2.6.2 pom - Built Hive 1.2.1 with Hadoop 2.6.2 pom - Ran some Hive on Tez queries successfully Regards, Akira On 10/23/15 06:14, Sangjin

Build failed in Jenkins: Hadoop-Hdfs-trunk #2474

See Changes: [rohithsharmaks] YARN-4246. NPE while listing app attempt. (Nijel S F via rohithsharmaks) -- [...truncated 8237 lines...] Running org.apache.hadoop.hdfs.web.oauth2.TestClientCred

Hadoop-Hdfs-trunk - Build # 2474 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2474/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 8430 lines...] [INFO] Executing tasks main: [mkdir]

Build failed in Jenkins: Hadoop-Hdfs-trunk-Java8 #536

See Changes: [aw] YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw) -- [...truncated 7436 lines...] Tests run: 14, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.1

Hadoop-Hdfs-trunk-Java8 - Build # 536 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/536/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 7629 lines...] main: [mkdir] Created dir: /hom

Build failed in Jenkins: Hadoop-Hdfs-trunk #2473

See Changes: [aw] YARN-3724. Use POSIX nftw(3) instead of fts(3) (Alan Burlison via aw) -- [...truncated 6795 lines...] Running org.apache.hadoop.hdfs.server.mover.TestStorageMover Tests run: 6

Hadoop-Hdfs-trunk - Build # 2473 - Still Failing

See https://builds.apache.org/job/Hadoop-Hdfs-trunk/2473/ ### ## LAST 60 LINES OF THE CONSOLE ### [...truncated 6988 lines...] [INFO] Executing tasks main: [mkdir]