+1
> On Jun 3, 2021, at 1:14 AM, Akira Ajisaka wrote:
>
> Dear Hadoop developers,
>
> Given the feedback from the discussion thread [1], I'd like to start
> an official vote
> thread for the community to vote and start the 3.1 EOL process.
>
> What this entails:
>
> (1) an official announceme
Sounds good to me. That would be until Thursday June 10th, right?
As a side note it’s concerning that a double-dot maintenance release is a big
release, but I get that it’s the current state of the project.
> On Jun 3, 2021, at 11:30 AM, Wei-Chiu Chuang wrote:
>
> Hello,
> do we want to extend
Hi Brahma!
Thanks for organizing this. What’s the timezone for the 10p - midnight? Pacific
Time?
> On Sep 8, 2021, at 1:17 AM, Brahma Reddy Battula wrote:
>
> Hi All,
>
> Updated the meeting to record the session.. Please use the following link
> to attend the conference tomorrow.
>
>
> Ube
I think consolidating on a common library and tooling for defining API
expectations for Hadoop would be great.
Unfortunately, the Apache Yetus community recently started a discussion around
dropping their maintenance of the audience annotations codebase[1] due to lack
of community interest. In
If you add a line in the commit message that the commit closes a given PR #
then GitHub will annotate the PR as related to the specific commit and close it
for you.
i.e. you can add “closes #3454” to the commit message body and then PR 3454
will close and link to that commit when it hits the de
speaking with my HBase hat on instead of my Hadoop hat, when the
Hadoop project publishes that there's a CVE but does not include a
maintenance release that mitigates it for a given minor release line,
we assume that means the Hadoop project is saying that release line is
EOM and should be abandone
Hi folks!
I’d like to start cleaning up our nightly tests. As a bit of low hanging fruit
I’d like to alter some of our check style rules to match what I think we’ve
been doing in the community. How would folks prefer I make sure we have
consensus on such changes?
As an example, our last nightl
Hello!
What do folks think about changing our line length guidelines to allow for 100
character width?
Currently, we tell folks to follow the sun style guide with some exception
unrelated to line length. That guide says width of 80 is the standard and our
current check style rules act as enfor
t;
>> <https://lists.apache.org/thread.html/7813c2f8a49b1d1e7655dad180f2d915a280b2f4d562cfe981e1dd4e%401406489966%40%3Ccommon-dev.hadoop.apache.org%3E>>>;
>> > -
>> >
>> https://lists.apache.org/thread.html/3e1785cbbe14dcab9bb970fa0f534811cfe00795a8cd1100580f27
Hi folks!
Which release lines do we as a community still consider actively maintained?
I found an earlier discussion[1] where we had consensus to consider branches
that don’t get maintenance releases on a regular basis end-of-life for
practical purposes. The result of that discussion was writ
Hi folks!
The consensus seems pretty strongly in favor of increasing the line length
limit. Do folks still want to see a formal VOTE thread?
> On May 19, 2021, at 4:22 PM, Sean Busbey wrote:
>
> Hello!
>
> What do folks think about changing our line length guidelines to a
Early december would be great, presuming the RC process doesn't take too
long. By then it'll already have over a month since the 2.6.2 release and
I'm sure the folks contributing the 18 patches we already have in would
like to see their work out there.
On Fri, Nov 20, 2015 at 7:51 AM, Junping Du
When Apache Yetus formed, it started with several key pieces of Hadoop that
looked reusable. In addition to our contribution testing infra, the project
also stood up a version of our audience annotations for delineating the
public facing API[1].
I recently got the Apache HBase community onto the Y
his itself an incompatible change? I imagine the bytecode will be
> different.
>
> I think we're too late to do this for beta1 given that I want to cut an
> RC0 today.
>
> On Fri, Sep 22, 2017 at 7:03 AM, Sean Busbey wrote:
>
>> When Apache Yetus formed, it started with s
Here's the email from last night to common-dev@hadoop:
https://s.apache.org/ARe1
On Wed, Oct 18, 2017 at 10:42 PM, Akira Ajisaka wrote:
> Yes, qbt runs nightly and it sends e-mail to dev lists.
> https://builds.apache.org/job/hadoop-qbt-trunk-java8-linux-x86/
>
> Regards,
> Akira
>
>
> On 2017/
Just curious, Junping what would "solid evidence" look like? Is the
supposition here that the memory leak is within HDFS test code rather than
library runtime code? How would such a distinction be shown?
On Tue, Oct 24, 2017 at 4:06 PM, Junping Du wrote:
> Allen,
> Do we have any solid evid
The ASF Jenkins farm has been under duress lately, at least in part due to
HDFS-12711.
I'd say wait for work on containing that issue to finish and then take a
look at if it's backlog or the test itself so you can determine if we need
to talk on builds@a.o or here.
On Fri, Oct 27, 2017 at 10:26
I really, really like the approach of defaulting to only non-routeable
IPs allowed. it seems like a good tradeoff for complexity of
implementation, pain to reconfigure, and level of protection.
On Thu, Jul 5, 2018 at 2:25 PM, Todd Lipcon wrote:
> The approach we took in Apache Kudu is that, if Ke
-1 (non-binding)
force pushes are extremely disruptive. there's no way to know who's
updated their local git repo to include these changes since the commit
went in. if a merge commit is so disruptive that we need to subject folks
to the inconvenience of a force push then we should have more toolin
A layout change in a maintenance release sounds very risky. I saw some
discussion on the JIRA about those risks, but the consensus seemed to
be "we'll leave it up to the 2.6 and 2.7 release managers." I thought
we did RMs per release rather than per branch? No one claiming to be a
release manager e
2.7. In addition, I didn't see any blocker issue to bring it into
> 2.6.5 now.
> Just my 2 cents.
>
> Thanks,
>
> Junping
>
>
> From: Sean Busbey
> Sent: Thursday, March 31, 2016 2:57 PM
> To: hdfs-dev@hadoop.apache.o
+1 (non-binding)
reviewed everything, filed an additional subtask for a very trivial
typo in the docs. should be fine to make a full issue after close and
then fix.
tried merging locally, tried running through new shell tests (both
with and without bats installed), tried making an example custom
+dev@hbase
HBase has recently been cleaning up our precommit jenkins jobs to make them
more robust. From what I can tell our stuff started off as an earlier
version of what Hadoop uses for testing.
Folks on either side open to an experiment of combining our precommit check
tooling? In principle w
You could rely on a destructive git clean call instead of maven to do the
directory removal.
--
Sean
On Mar 11, 2015 4:11 PM, "Colin McCabe" wrote:
> Is there a maven plugin or setting we can use to simply remove
> directories that have no executable permissions on them? Clearly we
> have the
>> }
> >>>> if(cluster != null) {
> >>>> cluster.shutdown();
> >>>> }
> >>>> for (int i = 0; i < 3; i++) {
> >>>> FileUtil.setExecutable(new File(dataDir, "data"+(2*i+1)), t
Can someone point me to an example build that is broken?
On Mon, Mar 16, 2015 at 3:52 PM, Sean Busbey wrote:
> I'm on it. HADOOP-11721
>
> On Mon, Mar 16, 2015 at 3:44 PM, Haohui Mai wrote:
>
>> +1 for git clean.
>>
>> Colin, can you please get it in
clean' will not remove the directory.
> mvn fails where as git simply ignores (not even display any warning) the
> problem.
>
>
>
> Regards,
> Vinay
>
> On Tue, Mar 17, 2015 at 2:32 AM, Sean Busbey wrote:
>
> > Can someone point me to an example build t
t; mvn fails where as git simply ignores (not even display any warning) the
> > problem.
> >
> >
> >
> > Regards,
> > Vinay
> >
> > On Tue, Mar 17, 2015 at 2:32 AM, Sean Busbey
> wrote:
> >
> >> Can someone point me to an example buil
A few options:
* Only change the builds for master to use jdk8
* build with both jdk7 and jdk8 by copying jobs
* build with both jdk7 and jdk8 using a jenkins matrix build
Robert, if you'd like help with any of these please send me a ping off-list.
On Tue, Apr 21, 2015 at 8:19 PM, Vinod Kumar Va
On Wed, Apr 22, 2015 at 2:10 AM, Allen Wittenauer wrote:
>
>
> * There have been a few runs which seems to indicate that *something* is
> destroying the artifact directory in the middle of runs…. which is very
> very odd and something I hadn’t seen in any of my testing. In any case, I
> clearly
The patch artifact directory in the mainline hadoop jenkins jobs are
outside of the workspace. I'm not sure what, if anything, jenkins
guarantees about files out of the main workspace.
They all write to ${WORKSPACE}/../patchProcess, which will probably collide
if multiple runs happen on the same m
nough
code base and a sufficient fledgling community, so I'm going to put
together a tlp proposal.
Thanks for the feedback thus far from use within Hadoop. I hope we can
continue to make things more useful.
-Sean
On Wed, Mar 11, 2015 at 5:16 PM, Sean Busbey wrote:
> HBase's dev
pre-commit will already test on branch-2 provided you follow the patch
naming guidelines.
there is also a branch-2 specific jenkins job:
https://builds.apache.org/view/H-L/view/Hadoop/job/Hadoop-branch2/
I'd suggest starting by looking at that job and filing jiras to address
whatever the failures
On Mon, Jun 15, 2015 at 1:39 PM, Yongjun Zhang wrote:
> Thanks Sean and Allen!
>
> I was not aware of that there is already a way to trigger branch-2 test.
> Good to know.
>
> There are multiple solutions here:
>
> 1. When posting patches, we can post two versions of patches, one for
> trunk, and
Thanks for hte heads up.
On Fri, Jun 19, 2015 at 1:43 PM, Chris Nauroth
wrote:
> Hi everyone,
>
> I was just in contact with Apache infrastructure. Jenkins wasn't running
> jobs for a while, so there is a large backlog in the queue now (over 200
> jobs). Infra has fixed the problems, so jobs a
Any update on a release plan for 2.6.1?
On Wed, Jun 10, 2015 at 1:25 AM, Brahma Reddy Battula <
brahmareddy.batt...@huawei.com> wrote:
> HI vinod
>
> any update on this..? are we planning to give 2.6.1 Or can we make 2.7.1
> as stable give..?
>
>
> Thanks & Regards
> Brahma Reddy Battula
>
> ___
On Jul 8, 2015 2:13 AM, "Tsuyoshi Ozawa" wrote:
>
> +1, thanks Allen and Andrew for taking lots effort!
>
> > Is there any possibility that, we can restrict someone from editing the
> > issue in jira once its marked as "closed" after release?
>
> Vinay's comment looks considerable for us to me. Wh
If we haven't frozen yet, HDFS-8850 is a straight forward fix that is
currently only in 2.8+ and would benefit 2.6 and 2.7.
On Wed, Aug 5, 2015 at 2:56 PM, Junping Du wrote:
> I would like to nominate YARN-3832 as 2.6.1 candidate which is critical
> and I also saw it happened recently on a 2.6.0
Some talk about the MSDN-for-committers program recently passed by on a private
list. It's still active, it just changed homes within Microsoft. The
info should still be in the committer repo. If something is amiss
please let me know and I'll pipe up to the folks already plugged in to
confirming it
At the very least, I'm running through an updated shaded hadoop client
this week[1] (HBase is my test application and it wandered onto some
private things that broke in branch-2). And Sangjin has a good lead on
an lower-short-term-cost incremental improvement for runtime isolation
of apps built on
FWIW, there is a "blessed" apache area on docker hub now, and it's
just an INFRA request to point out the needed Dockerfile in the repo.
PMCs can also request write access to bintray hosting of docker images
for PMC members.
Info on INFRA-8441, example on INFRA-12019.
A Docker image that starts
thanks for bringing this up! big +1 on upgrading dependencies for 3.0.
I have an updated patch for HADOOP-11804 ready to post this week. I've
been updating HBase's master branch to try to make use of it, but
could use some other reviews.
On Thu, Jul 21, 2016 at 4:30 AM, Tsuyoshi Ozawa wrote:
> H
Folks might want to take a look at
https://issues.apache.org/jira/browse/HBASE-12721
and its associated review board posting of aggregate work. One of hte
HBase community members has been creating infra (geared towards test
ATM) for spinning up clusters of docker images. from what I
understand, r
My work on HADOOP-11804 *only* helps processes that sit outside of YARN. :)
On Fri, Jul 22, 2016 at 10:48 AM, Allen Wittenauer
wrote:
>
> Does any of this work actually help processes that sit outside of YARN?
>
>> On Jul 21, 2016, at 12:29 PM, Sean Busbey wrote:
>>
>&g
Hi!
I'm already in the contributor role on the HADOOP jira, could someone
add me as one on the HDFS jira? I'd like the ability to do some jira
gardening.
the relevant username is : busbey
--
busbey
-
To unsubscribe, e-mail: hd
It's also the key Andrew has in the project's KEYS file:
http://www.apache.org/dist/hadoop/common/KEYS
On Tue, Aug 30, 2016 at 4:12 PM, Andrew Wang wrote:
> Hi Eric, thanks for trying this out,
>
> I tried this gpg command to get my key, seemed to work:
>
> # gpg --keyserver pgp.mit.edu --recv
Hi folks!
a host of precommit checks are currently timing out due to an update
to our job configs (the timeout is currently set to 50 minutes).
I'm in the process of giving things more time based on our historic
usage, but if your check fails in the mean time and
1) the total run time is close t
Should be all set now.
On Tue, Nov 8, 2016 at 5:54 PM, Sean Busbey wrote:
> Hi folks!
>
> a host of precommit checks are currently timing out due to an update
> to our job configs (the timeout is currently set to 50 minutes).
>
> I'm in the process of giving things
disallowing force pushes to trunk was done back in:
* August 2014: INFRA-8195
* February 2016: INFRA-11136
On Mon, Apr 17, 2017 at 11:18 AM, Jason Lowe
wrote:
> I found at least one commit that was dropped, MAPREDUCE-6673. I was able to
> cherry-pick the original commit hash since it was recor
-dev@yetus to bcc, since I think this is a Hadoop issue and not a yetus
issue.
Please review/commit HADOOP-14686 (which I am providing as a
volunteer/contributor on the Hadoop project).
On Tue, Jul 25, 2017 at 7:54 PM, Allen Wittenauer
wrote:
>
> Again: just grab the .gitignore file fro
+1
If we can make things look like HBase support for precommit testing on
branches (HBASE-12944), that would make it easier for new and occasional
contributors who might end up working in other ecosystem projects. AFAICT,
Jonathan's proposal for branch names in patch names does this.
On Wed, Ma
a word of caution. according to INFRA-18748, asf infra is going to be
cutting out blind PR building. So we'll need to be sure that precommit
integration works e.g. testing PRs because there's a JIRA that a
whitelisted contributor has associated and put in patch available
status.
On Mon, Jul 22, 20
For what it's worth, in HBase we've been approximating which Hadoop
lines are EOL by looking at release rates and specifically CVE
announcements that include an affected release line but do not include
a fix for that release line. Our current approximation[1] lists 2.6,
2.7, and 3.0 as dead. So tha
+1
On Tue, Aug 20, 2019 at 10:03 PM Wangda Tan wrote:
>
> Hi all,
>
> This is a vote thread to mark any versions smaller than 2.7 (inclusive),
> and 3.0 EOL. This is based on discussions of [1]
>
> This discussion runs for 7 days and will conclude on Aug 28 Wed.
>
> Please feel free to share your
+1 (non-binding)
On Fri, Aug 23, 2019 at 9:06 PM Wangda Tan wrote:
>
> Hi devs,
>
> This is a voting thread to move Submarine source code, documentation from
> Hadoop repo to a separate Apache Git repo. Which is based on discussions of
> https://lists.apache.org/thread.html/e49d60b2e0e021206e22bb
On Mon, Aug 26, 2019 at 9:20 AM Eric Badger wrote:
>
> - Stuff has been going into branch-2 sporadically but I don't who is
> actively
> using that code other than as part of a cherrypick backwards strategy.
>
> - Should we do a 2.10.x release? Or just say "time to upgrade?"
>
> We have talked at
We should add a Pull Request Template that specifically calls out the
expectation that folks need to have a JIRA associated with their PR
for it to get reviewed. Expectations around time to response and how
to go about getting attention when things lag would also be good to
include. (e.g. are folks
[
https://issues.apache.org/jira/browse/HDFS-12715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey resolved HDFS-12715.
Resolution: Invalid
Fix Version/s: (was: 2.6.0)
Please use the user@hadoop mailing list
Sean Busbey created HDFS-8101:
-
Summary: DFSConfigKeys pulls in WebHDFS classes at runtime
Key: HDFS-8101
URL: https://issues.apache.org/jira/browse/HDFS-8101
Project: Hadoop HDFS
Issue Type
[
https://issues.apache.org/jira/browse/HDFS-8332?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey reopened HDFS-8332:
---
According to git-bisect, this is the commit that started failing the following
tests in hadoop-hdfs
[
https://issues.apache.org/jira/browse/HDFS-8135?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey reopened HDFS-8135:
---
This change breaks HBase.
The comment at the start of the removed class was
{code}
- * @deprecated
[
https://issues.apache.org/jira/browse/HDFS-10767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sean Busbey resolved HDFS-10767.
Resolution: Invalid
> downgrade from 2.7.2 to 2.
62 matches
Mail list logo
