+1 (binding)
- Built from source
- Brought up a non-secure virtual cluster w/ NN, 1 DN, RM, AHS, JHS, and 3 NMs
- Validated inter- and intra-queue preemption
- Validated exclusive node labels
Thanks a lot Chao for your diligence and hard work on this release.
Eric
On Wednesday,
Eric Payne created HADOOP-17857:
---
Summary: Check real user ACLs in addition to proxied user ACLs
Key: HADOOP-17857
URL: https://issues.apache.org/jira/browse/HADOOP-17857
Project: Hadoop Common
+1 (binding)
- Built from source
- Brought up cluster
- Tested streaming and sleep jobs
-Eric Payne
On Wednesday, December 9, 2020, 11:01:38 AM CST, Xiaoqiao He
wrote:
Hi folks,
The release candidate (RC4) for Hadoop-3.2.2 is available now.
There are 10 commits[1] differences between RC4
[
https://issues.apache.org/jira/browse/HADOOP-17346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Payne resolved HADOOP-17346.
-
Fix Version/s: 3.2.3
3.1.5
3.4.0
3.3.1
Eric Payne created HADOOP-17381:
---
Summary: Ability to specify separate compression settings when
intermediate and final output use the same codec
Key: HADOOP-17381
URL: https://issues.apache.org/jira/browse/HADOOP
[
https://issues.apache.org/jira/browse/HADOOP-17373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Payne resolved HADOOP-17373.
-
Fix Version/s: 3.4.0
Resolution: Fixed
> hadoop-client-integration-tests doesn
Congratulations, Lisheng Sun!
-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org
Masatake,
Thank you for the good work on creating this release!
+1
I downloaded and built the source. I ran a one-node cluster with 6 NMs.
I manually ran apps in the Capacity Scheduler to test labels and capacity
assignments.
-Eric
On Monday, September 14, 2020, 12:59:17 PM CDT, Masatake Iwa
Congratulations Tao! Well deserved!
On Monday, July 15, 2019, 4:54:10 AM CDT, Weiwei Yang
wrote:
Hi Dear Apache Hadoop Community
It's my pleasure to announce that Tao Yang has been elected as an Apache
Hadoop committer, this is to recognize his contributions to Apache Hadoop
YARN proj
It is my pleasure to announce that Eric Badger has accepted an invitation to
become a Hadoop Core committer.
Congratulations, Eric! This is well-deserved!
-Eric Payne
Eric Payne created HADOOP-16096:
---
Summary: HADOOP-15281 breaks 3.1 build
Key: HADOOP-16096
URL: https://issues.apache.org/jira/browse/HADOOP-16096
Project: Hadoop Common
Issue Type: Bug
+1 (binding)
- RM refresh updates values as expected
- Streaming jobs complete successfully
- Moving apps between queues succeeds
- Inter-queue preemption works as expected
- Successfully ran selected yarn unit tests.
===
Eric Payne
===
On Tuesday, January 8, 2019, 5:42:46 AM CST
Eric Payne created HADOOP-15973:
---
Summary: Configuration: Included properties are not cached if
resource is a stream
Key: HADOOP-15973
URL: https://issues.apache.org/jira/browse/HADOOP-15973
Project
locker for
release. I'm on the fence.
Thanks,
-Eric
On Wednesday, November 28, 2018, 4:58:50 PM CST, Eric Payne
wrote:
Sunil,
So, the basic symptoms are that if preemption is enabled on any queue, the
preemption is disabled after a 'yarn rm -refreshQueues'. In additio
1:47:06 AM CST, Eric Payne
wrote:
Sunil, thanks for all of the hard work on this release.
I have discovered that queue refresh doesn't work in some cases. For example,
when I change yarn.scheduler.capacity.root.default.disable_preemption, it
doesn't take effect unless I restart
Sunil, thanks for all of the hard work on this release.
I have discovered that queue refresh doesn't work in some cases. For example,
when I change yarn.scheduler.capacity.root.default.disable_preemption, it
doesn't take effect unless I restart the RM.
I am still investigating, but I thought I
+1 (binding)
-- Built from source-- Installed on 6-node pseudo cluster-- Tested intra-
inter-queue preemption, user weights-- Ran streaming jobs, word count, and tara
gen/sort tests
Thanks Akira for all of the hard work.-Eric Payne
On Tuesday, November 13, 2018, 7:02:51 PM CST, Akira
Thanks a lot Junping!
+1 (binding)
Tested the following:
- Built from source
- Installed on a 7 node, multi-tenant, insecure pseudo cluster, running YARN
capacity scheduler
- Added a queue via refresh
- Verified various GUI pages
- Streaming jobs
- Cross-queue (Inter) preemption
- In-queue (Intr
Thanks Wangda for creating this release.
+1 (binding)
Tested:
- Built from source
- Deployed to 6-node, multi-tennant, unsecured pseudo cluster with hierarchical
queue structure (CS)
- Refreshed queue (CS) properties
- Intra-queue preemption (CS)
- inter-queue preemption (CS)
- User weights (CS)
Sorry, Yongjun. My +1 is also binding+1 (binding)-Eric Payne
On Friday, June 1, 2018, 12:25:36 PM CDT, Eric Payne
wrote:
Thanks a lot, Yongjun, for your hard work on this release.
+1
- Built from source
- Installed on 6 node pseudo cluster
Tested the following in the Capacity
Thanks a lot, Yongjun, for your hard work on this release.
+1
- Built from source
- Installed on 6 node pseudo cluster
Tested the following in the Capacity Scheduler:
- Verified that running apps in labelled queues restricts tasks to the labelled
nodes.
- Verified that various queue config p
if the branch is cut too early.
My 2 cents...
Thanks,
-Eric Payne
On Monday, May 7, 2018, 12:09:00 AM CDT, Yongjun Zhang
wrote:
Hi All,
>
We have released Apache Hadoop 3.0.2 in April of this year [1]. Since then,
there are quite some commits done to branch-3.0. To further improve th
line
- intra-queue preemption
- inter-queue preemption- verified preemption properties are refreshable
Thanks,
Eric Payne
On Wednesday, April 25, 2018, 12:12:24 AM CDT, Chen, Sammi
wrote:
Paste the links here,
The artifacts are available here:
https://dist.apache.org/repos/dist/dev
and without size-based
weight
- tested user weights
Thanks!
Eric Payne
On Monday, April 16, 2018, 7:00:03 PM CDT, Lei Xu wrote:
Hi, All
I've created release candidate RC-1 for Apache Hadoop 3.0.2, to
address missing source jars in the maven repository in RC-0.
Thanks Ajay Kuma
weights with FifoOrderingPolicy to ensure that weights were
assigned to users as expected.
Eric Payne
On Friday, April 6, 2018, 1:17:10 PM CDT, Lei Xu wrote:
Hi, All
I've created release candidate RC-0 for Apache Hadoop 3.0.2.
Please note: this is an amendment for Apache Hadoop
- Tested simple inter-queue preemption
- Tested priority first intra-queue preemption
- Tested userlimit first intra-queue preemption
Thanks,Eric Payne
===
On Thursday, March 29, 2018, 11:15:51 PM CDT, Wangda Tan
wrote:
Hi folks
Thanks for working on this release!
+1 (binding)
I tested the following:
- yarn distributed shell job
- yarn streaming job
- inter-queue preemption
- compared behavior of fair and fifo ordering policy
- both userlimit_first mode and priority_first mode of intra-queue preemption
Eric Payne
+1 for removing the branch-3 branch. It should be done soon so more confusion
can be avoided. Thanks Jason for tracking this down.
-Eric
From: Jason Lowe
To: Hadoop Common ; ma...@cloudera.com
Sent: Wednesday, January 17, 2018 12:42 PM
Subject: Re: What's the difference between branch
Thanks for the hard work on this release, Konstantin.
+1 (binding)
- Built from source
- Verified that refreshing of queues works as expected.
- Verified can run multiple users in a single queue
- Ran terasort test
- Verified that cross-queue preemption works as expected
Thanks. Eric Payne
.
Eric Payne
From: Junping Du
To: "common-dev@hadoop.apache.org" ;
"hdfs-...@hadoop.apache.org" ;
"mapreduce-...@hadoop.apache.org" ;
"yarn-...@hadoop.apache.org"
Sent: Tuesday, December 5, 2017 3:58 AM
Subject: [VOTE] Release Apache Hadoop 2.8.
erformance degradation is observed with this branch work. SLS
and UT performance
tests are done.
There were 11 subtasks completed for this feature.
Huge thanks to everyone who helped with reviews, commits, guidance, and
technical discussion/design, including Wangda Tan, Vinod Vavilapalli,
Rohi
Thanks Sunil for the great work on this feature.
I looked through the design document, reviewed the code, and tested out branch
YARN-5881. The design makes sense and the code looks like it is implementing
the desing in a sensible way. However, I have encountered a couple of bugs. I
opened https:
during In-queue preemption
o Users with different weights are assigned resources proportional to their
weights.
o User weights are refreshable, and in-queue preemption works to honor the
post-refresh weights
Thanks,
-Eric Payne
From: Andrew Wang
To: "common-dev@hadoop.apache.org"
command line
o Users with different weights are assigned resources proportional to their
weights.
Thanks,-Eric Payne
From: Arun Suresh
To: yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org; Hadoop Common
; Hdfs-dev
Cc: Subramaniam Krishnan
Sent: Monday, November 13, 2017 6:10 PM
+1 (binding)
Thanks a lot, Junping!
I built and installed the source on a 6-node pseudo cluster. I simple sleep and
streaming jobs that exercised intra-queue and inter-queue preemption, and used
user weights.
-Eric
From: Junping Du
To: "common-dev@hadoop.apache.org" ;
"hdfs-...@hadoop.a
) preemption, both USERFIRST and PRIORITYFIRST
o User weights not equals to 1
o User weights in conjunction with in-queue preemption.
-Eric Payne
From: Andrew Wang
To: "common-dev@hadoop.apache.org" ;
"hdfs-...@hadoop.apache.org" ;
"mapreduce-...@ha
[
https://issues.apache.org/jira/browse/HADOOP-9383?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Eric Payne reopened HADOOP-9383:
Something similar is definitely still happening on fedora and redhat. This is
what I'm ge
+1 for this branching proposal.-Eric
From: Andrew Wang
To: "common-dev@hadoop.apache.org" ;
"mapreduce-...@hadoop.apache.org" ;
"hdfs-...@hadoop.apache.org" ;
"yarn-...@hadoop.apache.org"
Sent: Friday, August 25, 2017 12:36 PM
Subject: [DISCUSS] Branches and versions for Hadoop 3
+1 (binding)
Tested the following:
- Application History Server
-- Apps can be observed from UI
-- App and container metadata can be retrieved via REST APIs
- RM UI
-- Can kill an app from the RM UI
- Apps run in different frameworks. Frameworks tested: MR and yarn shell
-- In yarn shel
Thanks Andrew.
I downloaded the source, built it, and installed it onto a pseudo distributed
4-node cluster.
I ran mapred and streaming test cases, including sleep and wordcount.
+1 (non-binding)
-Eric
From: Andrew Wang
To: "common-dev@hadoop.apache.org" ;
"hdfs-...@hadoop.apache.org"
+1
Thanks, Junping, for your efforts to get this release out.
I downloaded and built the source, and i did the following manual testing on a
2-node pseudo cluster:
- Streaming job
- Inter-queue (cross-queue) preemption--verified that only the expected amount
of preemptions occured.
- Inter-queue
How do we come to a resolution regarding whether or not re-cut branch-2.8 or
release it as it is (after fixing blockers)?
There are some things in branch-2 that I would like to pull back into
branch-2.8, so a resolution to this question will affect how I proceed.
Thanks,-Eric
From: Karthik
Thank you very much, Andrew.
+1 (non-binding)
- Downloaded source and built native
- Installed on 3-node, non-secure cluster
- Ran sleep jobs
- Ensured preemption works as expected
-Eric Payne
- Original Message -
From: Andrew Wang
To: "common-dev@hadoop.apache.org"
preempted as I thought should have
been, but once the other underserved app began to run, it stopped preempting.
Also, it didn't preempt between 2 queues with the same partition label.
Partition preemption may not be supported in 2.7, so this is probably also okay.
jobs are running
in labelled queues (YARN-4751).
- Ensure that a yarn distributed shell application can be launched and complete
successfully.
Eric Payne
From: Vinod Kumar Vavilapalli
To: "common-dev@hadoop.apache.org" ;
hdfs-...@hadoop.apache.org; yarn-...@hadoop.apache.org;
Vinod, I have opened https://issues.apache.org/jira/browse/YARN-4751 to cover
this issue.It happens in 2.7, not 2.8.Thanks,-Eric
From: Vinod Kumar Vavilapalli
To: hdfs-...@hadoop.apache.org; Eric Payne
Cc: Hadoop Common ; "yarn-...@hadoop.apache.org"
;
e.org; Eric Payne
Cc: "common-dev@hadoop.apache.org" ;
"hdfs-...@hadoop.apache.org" ;
"yarn-...@hadoop.apache.org"
Sent: Monday, February 8, 2016 1:01 PM
Subject: Re: [VOTE] Release Apache Hadoop 2.6.4 RC0
+1 (non binding)
* Downloaded hadoop-2.6.4-RC0-src.tar
, which is
the behavior I would expect if no node had the specified label. I will also add
that this procedure works fine in 2.7.
Thanks,-Eric Payne
From: Junping Du
To: "hdfs-...@hadoop.apache.org" ;
"yarn-...@hadoop.apache.org" ;
"mapreduce-...@hadoop.a
that queue in the "Application
Queues" section.
- Tested to make sure application data is preserved in the generic application
history server when the AM crashes during startup (e.g., exceeds max splits).
-Eric Payne
From: Vinod Kumar Vavilapalli
aggressively given back to preempted queue (see YARN-3769).
- Verified resource metrics on Application UI were correct by comparing against
time spent in each container as calculated by the timeline server.
- Wordcount test
-Eric Payne
From: Sangjin Lee
To: "common-dev@hadoop.apach
y set, killed the AM
container, and verified that it would in fact keep the containers running
across AM restarts.- sucessfully ran wordcount jobs.
Thank you,
-Eric Payne
From: Vinod Kumar Vavilapalli
To: common-dev@hadoop.apache.org; yarn-...@hadoop.apache.org;
hdfs-...@hadoop.a
+1 (non-binding)
+ Downloaded and built source+ Installed on one-node cluster+ Ran simple manual
tests+ spot-checked unit tests
Thanks, Vinod, for managing this release!-Eric Payne
From: Vinod Kumar Vavilapalli
To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
yarn
Thank you Allen and Barbara for organizing the bug bash and for the
post-mortem. I would definitely like to have another one in the fall.
From: Allen Wittenauer
To: "common-dev@hadoop.apache.org"
Cc: "mapreduce-...@hadoop.apache.org" ;
"hdfs-...@hadoop.apache.org" ;
"yarn-...@hadoop.
, and
TestWebHdfsFileSystemContract#testGetFileBlockLocations.
Thank you,-Eric Payne
From: Vinod Kumar Vavilapalli
To: common-dev@hadoop.apache.org; hdfs-...@hadoop.apache.org;
yarn-...@hadoop.apache.org; mapreduce-...@hadoop.apache.org
Cc: vino...@apache.org
Sent: Friday, April 10, 2015 6:44 PM
Subject:
Eric Payne created HADOOP-11802:
---
Summary: DomainSocketWatcher#watcherThread encounters
IllegalStateException in finally block when calling sendCallback
Key: HADOOP-11802
URL: https://issues.apache.org/jira/browse
+1.The "different color for newest patch" doesn't work very well if you are
color blind, so I do appreciate a revision number in the name.
From: Yongjun Zhang
To: common-dev@hadoop.apache.org
Sent: Tuesday, November 25, 2014 11:37 PM
Subject: Re: a friendly suggestion for developers w
you,-Eric Payne
From: Arun C Murthy
To: "common-dev@hadoop.apache.org" ;
"hdfs-...@hadoop.apache.org" ;
"yarn-...@hadoop.apache.org" ;
"mapreduce-...@hadoop.apache.org"
Sent: Thursday, November 13, 2014 5:08 PM
Subject: [VOTE] Release Apach
the containers start.
Enabled the preemption feature and verified containers were preempted and
queues were levelized.
Ran unit tests for hadoop-yarn-server-resourcemanagerRan unit tests for
hadoop-hdfs
Thank you,-Eric Payne
From: Arun C Murthy
To: "common-dev@hadoop.apache.org"
the containers start.
Ran unit tests for hadoop-yarn-server-resourcemanager, with one failure:
TestRMWebServicesAppsModification#testSingleAppKill. (YARN-2158)
Ran unit tests for hadoop-hdfs, with one failure:
TestByteRangeInputStream#testPropagatedClose
Thank you,
-Eric Payne
Type: Bug
Components: documentation
Affects Versions: 0.23.0
Reporter: Eric Payne
Assignee: Arun C Murthy
- In section +Prerequisites+
-- Please add a link to download locaion of 0.23 release tar-ball.
- In section +Installation+
-- It would be good to have
Sorry, my bad. It's the 'FAILED DOWNLOADS' error that goes away the second
time. I don't see the 'UNRESOLVED DEPENDENCIES' error.
-Eric
>________
>From: Eric Payne
>To: "common-dev@hadoop.apache.org"
>Sent: Fri
tes/m2e
-- I go to the project explorer and choose to import a maven project and select
the 'branch-0.23' directory. It works for a while (10 minutes or so), and then
you can edit, navigate, etc.
NOTE: I build from the command line, not from w/i eclipse.
Hope that helps.
-Eri
So, if a patch is the same for trunk plus one or more branches, would we need
to upload multiple patches?
Thanks,
-Eric Payne
-Original Message-
From: Eli Collins [mailto:e...@cloudera.com]
Sent: Friday, September 09, 2011 1:11 PM
To: common-dev@hadoop.apache.org
Subject: Re: JIRA
> If you post the same patch with the same name, JIRA helps you out by greying
> all the earlier versions out.
Hmm. Except this is a bit of a hassle for folks like me with vision issues and
color blindness.
-Eric Payne
-Original Message-
From: Doug Cutting [mailto:cutt...@apac
\
-duration 300 -files 1024 -ls 0,uniform -maps 20 -mkdir 0,uniform -ops
1 \
-packetSize 65536 -readSize 1,4294967295 -read 0,uniform -reduces 5 \
-rename 0,uniform -replication 1,3 -resFile $RESFILE -seed 12345678 \
-sleep 100,1000 -writeSize 1,67108864
Thanks,
-Eric Payne
t" = 27148
Rate for measurement "op_count" = 4.519 operations/sec
-
#####
I also ran randomwriter.
Thanks,
-Eric Payne
-- Forwarded Message
From: Owen O'Malley
Reply-To: "common-dev@ha
66 matches
Mail list logo
