This is a great work to be in to evolve HDFS towards cloud storage. Thanks
Chris and folks!
I had participated in the design review meeting and it looks good to me. I will
take some time to look at the cocdes closely.
+1 on the merge.
Regards,Kai
-
Thanks Andrew for the hard driving!!
I downloaded the source tar bao and built it successfully on a MacOS. I haven't
got the chance to try it yet, so mynon-binding +1.
Regards,Kai
--发件人:John
Zhuge 发送时间:2017年12月14日(星期四) 11:06收件人:Vino
Thanks Andrew for the great effort! Here is my late vote.
+1 (binding)
- Verified checksums and signatures of tarballs
- Built source with native, Oracle Java 1.8.0_152 on Mac OS X 10.13.2
- Verified cloud connectors:
- S3A integration tests (perf tests skipped)
- Deployed both
Yes, JIRAs will be filed, the wiki-page idea from YARN meetup is to record all
combinations of testing that need to be done and correspondingly capture all
the testing that someone in the community has already done and record it for
future perusal.
From what you are saying, I guess we haven't a
Good stuff Andrew, and thanks everyone!
+Vinod
> On Dec 13, 2017, at 1:05 PM, Andrew Wang wrote:
>
> To close this out, the vote passes successfully with 13 binding +1s, 5
> non-binding +1s, and no -1s. Thanks everyone for voting! I'll work on staging.
>
+1
I have been reviewing some of the latest patches.
I skimmed through the patch in HDFS-9806 and it looks good.
In addition, we have ported it to 2.7.1 (minor differences to what would be
merged).
It has been running in our test cluster for a couple months.
All the issues we have been finding are
Thanks to all who verified and voted!
I give my binding +1 to conclude the vote for 2.8.3 RC0, based on:
- Build from source and verify signatures
- Deploy pseudo-distributed cluster and run some simple job, like: pi, sleep,
etc.
- Verify UI of daemons, like: NameNode, DataNode, ResourceManager,
Here is my +1(binding) too.
Sorry for late vote.
Verified signatures of the source tarball.
built from source.
set up a 2-node test cluster.
Tested via HDFS commands and java API – Written bunch of files and read back.
Ran basic MR job
Thanks Andrew and others for the hard work for getting Hado
[
https://issues.apache.org/jira/browse/HDFS-12923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Lei (Eddy) Xu resolved HDFS-12923.
--
Resolution: Won't Fix
Fix Version/s: 3.0.0
Resolved as not an issue.
> DFS.concat should
Hi folks,
To close this out, the vote passes successfully with 13 binding +1s, 5
non-binding +1s, and no -1s. Thanks everyone for voting! I'll work on
staging.
I'm hoping we can address YARN-7588 and any remaining rolling upgrade
issues in 3.0.x maintenance releases. Beyond a wiki page, it would
I was waiting for Daniel to post the minutes from YARN meetup to talk about
this. Anyways, in that discussion, we identified a bunch of key upgrade related
scenarios that no-one seems to have validated - atleast from the representation
in the YARN meetup. I'm going to create a wiki-page listing
Looked at RC1. Went through my usual check-list. Here's my summary.
+1 (binding) overall
Verification
- [Check] Successful recompilation from source tar-ball
- [Check] Signature verification
- [Check] Generating dist tarballs from source tar-ball
- [Check] Validating the layout of the binary tar-
Thanks to everyone who pushed on this release, really great to see a
release coming off trunk.
+1 (binding).
Deployed the RC on a federated YARN cluster consisting of 8 sub-clusters on
CentOs 7.4 running Java 1.8.0_144.
Hit YARN-7652[1] which is not a blocker as I was able to run multiple jobs
s
Thanks Konstantin for working on this.
+1 (non-binding)
- Downloaded binary and verified md5
- Deployed RM HA and tested failover
Jonathan Hung
On Wed, Dec 13, 2017 at 11:02 AM, Eric Payne wrote:
> Thanks for the hard work on this release, Konstantin.
> +1 (binding)
> - Built from source
>
+1 from me. There are some unrelated errors building the branch right now
due to annotations in some YARN code, etc. but I was able to generate an fs
image from an S3 bucket and serve the content through HDFS on a
pseudo-distributed HDFS node this morning. Seems like a good point for a
merge.
On W
Thanks Andrew again,
+1 (binding)
* Downloaded source tarball, and compiled with native libs
successfully: -Pdist,native -Drequire.isal -Drequire.snappy
-Drequire.openssl -Drequire.zstd.
* hadoop checknative ran successfully.
* Upgraded a fsimage that was previously used in a Hadoop 2.6-based CDH
Thanks for the hard work on this release, Konstantin.
+1 (binding)
- Built from source
- Verified that refreshing of queues works as expected.
- Verified can run multiple users in a single queue
- Ran terasort test
- Verified that cross-queue preemption works as expected
Thanks. Eric Payne
Hi Virajith / Chris/ Thomas / Ewan,
Thanks for developing this feature and getting to merge state.
I would like to vote +1 for this merge. Thanks for all the hard work.
Thanks
Anu
On 12/8/17, 7:11 PM, "Virajith Jalaparti" wrote:
Hi,
We have tested the HDFS-9806 branch in two set
[
https://issues.apache.org/jira/browse/HDFS-12265?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chen Liang resolved HDFS-12265.
---
Resolution: Fixed
Release Note: Looks like this has been handled as part of HDFS-12387, close
th
Thanks Junping for the release. +1 (binding)
Tested on a single node pseudo cluster, I performed the following tests:
- Downloaded the tars and verified the signatures, installed using the tar
- Successfully ran few MR jobs
- Verified few hdfs operations
- Verified RM,NM and HDFS webui's
- configu
For more details, see
https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/621/
[Dec 12, 2017 6:56:26 PM] (jlowe) YARN-7625. Expose NM node/containers resource
utilization in JVM
[Dec 12, 2017 9:35:56 PM] (jianhe) YARN-7565. Yarn service pre-maturely
releases the container after AM
[D
+1 (non-binding)
* Verified md5 of all artifacts
* Built with -Pdist
* Ran several s3a shell commands
* Started a pseudo-distributed HDFS and YARN cluster
* Ran grep and pi MR examples
* Sanity-checked contents of release notes, rat report, and changes
On Fri, Dec 8, 2017 at 1:31 PM, Andrew Wang
Thanks Andrew for driving this.
+1 (Binding)
Ran SLS + CS's Perf unit test and saw similar performance compared to
trunk.
Compiled from source, deployed single node cluster and ran several jobs.
Best,
Wangda
On Wed, Dec 13, 2017 at 7:29 AM, Sunil G wrote:
> +1 (binding)
>
> Thanks Andrew
+1 (binding)
Thanks Andrew Wang for driving this effort and also thanks to all others
who helped in this release. Kudos!!!
I tested this RC by building it from source. I met with couple of issues
(not blocker) HADOOP-15116 and YARN-7650. This could be tracked separately.
- Ran many MR apps a
+1 (non-binding),Thanks Andrew wang for driving this.
---Built from the source
--Installed 3 Node HA cluster
--Verified Basic shell commands
--Ran Sample jobs like pi,wordcount
--Verified the UI's
--Brahma Reddy Battula
-Original Message-
From: Andrew Wang [mailto:andrew.w...@clouder
+1 (binding)
- built from source and deployed 3 node cluster
- installed RM HA cluster along with ATSv2 enabled and new YARN UI.
- verified for
-- RM HA switch / RM Restart / RM Work preserving restart
-- NM work preserving restart
-- Ran sample MR jobs and Distributed shell along with multiple RM
+1 (binding)
Thanks Junping for the effort.
I have deployed a cluster built from source tar ball.
- Ran few MR apps and verified UI. CLI commands are also fine related to
app.
- Tested below feature sanity
- Application priority
- Application timeout
- Tested basic NodeLa
+1 (binding)
Built from source and deployed non-secure 3 node cluster
Verified for
- RM HA/RM Restart/RM work preserving restart
- Ran sample MR and Distributed shell jobs.
Thanks & Regards
Rohith Sharma K S
On 8 December 2017 at 08:52, Konstantin Shvachko
wrote:
> Hi everybody,
>
> I updated
+1 (Binding)
Built from source and deployed non-secure 3 node cluster
Verified for
- RM HA/RM Restart/RM work preserving restart
- NM work preserving restart
- Ran sample MR and Distributed shell jobs.
Thanks & Regards
Rohith Sharma K S
On 5 December 2017 at 15:28, Junping Du wrote:
> Hi all,
29 matches
Mail list logo