Re: Do I need a +1 to merge a backport PR?

For trivial changes, like changes in import or conflicts due to line number or other trivial stuff, I don’t think that is required. Unless the general logic isn’t changing, we can go ahead, may be we can do a test run before merging, to be on the safer side as and when required. :-) -Ayush >

Re: [VOTE] Hadoop 3.1.x EOL

+1 -Ayush > On 03-Jun-2021, at 11:26 PM, hemanth boyina > wrote: > > +1 > > Thanks > HemanthBoyina > >> On Thu, 3 Jun 2021, 20:33 Wanqiang Ji, wrote: >> >> +1 (non-binding) >> >> Wanqiang Ji >> >>> On Thu, Jun 3, 2021 at 10:47 PM Sangjin Lee wrote: >>> >>> +1 >>> >>> On Thu, Jun 3, 2

Re: Yetus unable to build YARN / HADOOP for any patch

Yeps, something is broken since last week. I tried a bunch of things on HDFS-PreCommit this weekend, kept on solving issues one after the other. https://issues.apache.org/jira/browse/HADOOP-17787?focusedCommentId=17374212&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#com

Re: Yetus unable to build YARN / HADOOP for any patch

pre commit jobs as well and see if things work. I can check and get the creds stuff sorted out in a couple of days… -Ayush > On 05-Jul-2021, at 6:31 PM, Ayush Saxena wrote: > Yeps, something is broken since last week. I tried a bunch of things on > HDFS-PreCommit this weekend, ke

Re: [DISCUSS] Hadoop 3.3.2 release?

+1, Thanx Chao for volunteering!!! > On 07-Sep-2021, at 10:36 PM, Chao Sun wrote: > > Hi all, > > It has been almost 3 months since the 3.3.1 release and branch-3.3 has > accumulated quite a few commits (118 atm). In particular, Spark community > recently found an issue which prevents one from

Re: [DISCUSS] Checkin Hadoop code formatter

Thanx Viraj for initiating, Makes sense to me to include a formmater inline with our checkstyle rules in the code, would make life simpler for all devs. -Ayush > On 12-Sep-2021, at 12:28 AM, Viraj Jasani wrote: > > + common-...@hadoop.apache.org > > -- Forwarded message - > F

Re: [DISCUSS] Add remote port information to HDFS audit log

Hey I am not sure whether we can directly go and change this. Any changes to Audit Log format are considered incompatible. https://hadoop.apache.org/docs/stable/hadoop-project-dist/hadoop-common/Compatibility.html#Audit_Log_Output -Ayush > On 10-Oct-2021, at 7:57 PM, tom lee wrote: > > Hi al

Re: [DISCUSS] Merging PRs vs. commit from CLI and keep committer field

Yahh, remember chasing Github support regarding this last year and they reverted back that they are aware of this and have an internal jira for this but can not comment upon how much time it would take. (As of now 1 year & counting) As far as I remember this is with squash & commit only. If you

Re: [DISCUSS] Merging PRs vs. commit from CLI and keep committer field

d, at least last year it did when I tried. :-) > > > Thanks for this dirty hack :) > Probably I will refrain from doing this, I don't like to force push if it's > not "mandatory". > Anyway, if the community is fine with it, I will continue to commit from > th

Re: Possibility of using ci-hadoop.a.o for Nutch integration tests

Moved to Dev lists. Not sure about this though: when a PR is submitted to Nutch project it will run some MR job in Hadoop CI. Whatever that PR requires should run as part of Nutch Infra. Why in Hadoop CI? Our CI is already loaded with our own workloads. If by any chance the above assertion gets

Re: [DISCUSS] Race condition in ProtobufRpcEngine2

Hey Andras, I had a quick look at HADOOP-18143, the methods in question in ProtobufRpcEngine2 are identical to the ones in ProtobufRpcEngine. So, I am not very sure how the race condition doesn't happen in ProtobufRpcEngine. I have to debug and spend some more time, considering that I have revert

Fwd: Applications for Travel Assistance to ApacheCon NA 2022 now open

Forwarded as asked in the mail. -Ayush Begin forwarded message: > From: Gavin McDonald > Date: 4 April 2022 at 1:56:40 PM IST > To: travel-assista...@apache.org > Subject: Applications for Travel Assistance to ApacheCon NA 2022 now open > Reply-To: tac-ap...@apache.org > > Hello, Apache PMCs

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

>From functional point of view it does makes sense to validate all the platforms as part of the builds, but the Pre commits builds taking time is now no longer a small things, In past one year or may be two, we have already increased it more than twice as compared to what it was before, If someone

Re: [VOTE] Release Apache Hadoop 3.3.3

+1, * Built from source * Successful native build on Ubuntu 18.04 * Verified Checksums (CHANGELOG.md,RELEASENOTES.md,hadoop-3.3.3-rat.txt,hadoop-3.3.3-site.tar.gz,hadoop-3.3.3-src.tar.gz,hadoop-3.3.3.tar.gz) * Successful RAT check * Ran some basic HDFS shell commands * Ran some basic YARN shell com

Re: [VOTE] Release Apache Hadoop 3.3.3

There were two 3.3.3 staged. The earlier one was with skipShade, the date was also april 22, I archived that. Chao can you use the one that Steve mentioned in the mail? On Sat, 7 May 2022 at 06:18, Chao Sun wrote: > Seems there are some issues with the shaded client as I was not able > to compil

Re: [VOTE] Release Apache Hadoop 3.3.3

che/hadoop > and Spark build will be able to pick them up for testing. However in > this case I don't see any 3.3.3 jars in the URL. > >> On Fri, May 6, 2022 at 6:24 PM Ayush Saxena wrote: >> >> There were two 3.3.3 staged. The earlier one was with skipShade, the

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

I had done earlier). > > So, I'll settle down to integrating the full suite of platform > builds into the nightly builds. Could anyone please point > me to the Jenkins job for this? > > [1] = https://github.com/apache/hadoop/pull/3166 > > Thanks, > --Gautham >

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

like >> test.build.data, indirectly through utility classes like GenericTestUtils, >> or modifying shared resources within target/test-classes. I've been working >> towards cleaning up flaky tests, and I plan on submitting some patches today. >> From: Steve Loughran >&

Re: [VOTE] Release Apache Hadoop 3.3.3 (RC1)

+1, * Built from source. * Successful native build on Ubuntu 18.04 * Verified Checksums. (CHANGELOG.md,RELEASENOTES.md,hadoop-3.3.3-rat.txt,hadoop-3.3.3-site.tar.gz,hadoop-3.3.3-src.tar.gz,hadoop-3.3.3.tar.gz) * Verified Signature. * Successful RAT check * Ran basic HDFS shell commands. * Ran basic

Re: [DISCUSS] Enabling all platform builds in CI for all Hadoop PRs

Have raised HADOOP-18241 There is a WIP PR linked to it as well https://issues.apache.org/jira/browse/HADOOP-18241 On Wed, 11 May 2022 at 01:28, Ayush Saxena wrote: > +1 for moving to Java 11 for trunk. > If nobody objects by EOW will create a jira for that > > -Ayush > &

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

The checksum stuff was addressed in HADOOP-16985, so that filename stuff is sorted only post 3.3.x BTW it is a known issue: https://issues.apache.org/jira/browse/HADOOP-16494?focusedCommentId=16927236&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16927236 Must not

Re: [VOTE] Release Apache Hadoop 2.10.2 - RC0

the help, Ayush. >> >> I committed HADOOP-16663/HADOOP-16664 and cherry-picked HADOOP-16985 to >> branch-2.10 (and branch-3.2). >> If I need to cut RC1, I will try cherry-picking them to branch-2.10.2 >> >> Masatake Iwasaki >> >> >> On 2022/05/28 5:23

Re: [DISCUSS] Filesystem API shim library to assist applications still targeting previous hadoop releases.

Just answering the last point: > > Is there a way we could release it as an ASF Library but on a different > timetable from normal Hadoop releases? There is always incubator, but this > is such a minor project it is closer to the org.apache.hadoop.thirdparty > library in that it is something all cu

Re: [VOTE] Release Apache Hadoop 3.2.4 - RC0

+1(Binding) * Built from Source * Successful native build on Ubuntu 18.04 * Verified Checksums * Verified Signatures * Successful RAT check * Ran Basic HDFS shell commands * Ran basic MR example Jobs (TeraGen/TeraSort & TeraValidate) * Browsed through UI(NN, DN, RM, NM & JHS) * Skimmed through the

2022 ASF Community Survey

Apache community, your opinion matters: we want to hear your voice. If you have any questions about the survey or otherwise, please reach out to us! Kindly, Ayush Saxena On Behalf of: Katia Rojas V.P. of Diversity and Inclusion The Apache Software Foundation

Re: [DISCUSS] Supporting partial file rewrite/compose

Hi Wei-Chiu, I think this got lost somewhere or the discussion moved somewhere else, if so please loop in me as well. Just guessing why everyone is so quiet :-) 1. Apache Iceberg or other evolvable table format. The first point that you mentioned regarding the iceberg, may be the use case that

[DISCUSS] JIRA Public Signup Disabled

Hi Folks, Just driving the attention towards the recent change from Infra, which disables new people from creating a Jira account, in order to prevent spams around JIRA. So, the new Jira account creation request needs to be routed via the PMC of the project. So, we have 2 options, which I can think

Re: Code coverage report on github PRs

A simple Infra ticket I suppose should get it done for us, eg. https://issues.apache.org/jira/browse/INFRA-23561 -Ayush On Thu, 24 Nov 2022 at 01:00, Iñigo Goiri wrote: > Now that we are using mostly GitHub PRs for the reviews and we have decent > integration for the builds etc there, I was won

Re: Code coverage report on github PRs

rkflow. There's a > marketplace for these tools and most of them are free for open source > projects. > > On Wed, Nov 23, 2022 at 11:43 AM Ayush Saxena wrote: > >> A simple Infra ticket I suppose should get it done for us, eg. >> https://issues.apache.org/jira/browse/INFRA-2

Re: [DISCUSS] JIRA Public Signup Disabled

, Mingliang Liu wrote: > Thanks Ayush for taking care of this. I think option 1 sounds good. > > > On Nov 22, 2022, at 2:51 PM, Ayush Saxena wrote: > > > > Hi Folks, > > Just driving the attention towards the recent change from Infra, which > > disables new people fr

Re: exciting new content needed for the 3.3.5 index.md file

Hi Steve, I just went through the Jira's fixed in HDFS[1] Sharing some stuff which I find good enough to find a mention. 1.HDFS-13522 , HDFS-16767 & Related Jiras: Allow Observer Reads in HDFS Route

Re: [VOTE] Release Apache Hadoop 3.3.5

Mostly or may be all of those failures are due to HADOOP-18324 , there is a Jira tracking issues with TestLeaseRecovery2 linked to that as well HDFS-16853 -Ayush On Wed, 28 Dec 2022 at 09:13, Vi

Re: [VOTE] Release Apache Hadoop 3.3.5

> > Hmm I'm looking at HADOOP-11867 related stuff but couldn't find it > mentioned anywhere in change log or release notes. Are they actually > up-to-date? I don't think there is any issue with the ReleaseNotes generation as such but with the Resolution type of this ticket, It ain't marked as Fix

Re: [VOTE] Release Apache Hadoop 3.3.5

t > downstream projects have tests that do restarts on a MiniDFSCluster. > > Chris Nauroth > > > On Wed, Jan 4, 2023 at 4:22 PM Ayush Saxena wrote: > > > Hmm I'm looking at HADOOP-11867 related stuff but couldn't find it > >> mentioned anywhere in change

Re: [VOTE] Release Apache Hadoop 3.3.5

> > And i > think we need to change the PR template to mention transitive updates in > the license bit too Not sure if that is gonna help, People might ignore that or check that in overconfidence. No harm though.. BTW Ozone has some cool stuff to handle this, it was added here: https://github.c

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC2)

> > I will highlight that I am completely fed up with doing this release and > really want to get it out the way -for which I depend on support from as > many other developers as possible. hmm, I can feel the pain. I tried to find if there is any config or any workaround which can dodge this HDF

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

Count me in as well. I am almost done. So, you have 3 potential votes, can be happy now :) Thanx Steve for the efforts!!! -Ayush > On 19-Mar-2023, at 2:46 AM, Chris Nauroth wrote: > > Yes, I'm in progress on verification, so you can expect to get a vote from > me. Thank you, Steve! > > Chri

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

+1(Binding) * Built from source (x86 & ARM) * Successful Native Build (x86 & ARM) * Verified Checksums (x86 & ARM) * Verified Signature (x86 & ARM) * Checked the output of hadoop version (x86 & ARM) * Verified the output of hadoop checknative (x86 & ARM) * Ran some basic HDFS shell commands. * Ran

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

Hbase doesn’t want to add Ozone as a dependency sounds to me like a ‘Hbase having resistance against the people proposing or against Ozone’ Anyway doesn’t ViewDistributedFileSystem not solve this Ozone problem, I remember Uma chasing that to solve these problems only? Pulling up the core HDFS A

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

I am not sure what classifies as a Hack and what not, I thought reflections are part of Java. Whatever solution but pulling in just the HDFS specific stuff to FileSystem just for Ozone, because Hbase guys didn’t agree and we have people in Hadoop who we can convince, I am -1 to such an approach an

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

nown code such as loading a plugin, > code analysis, etc. However, it probably is not a good way to define APIs. > > > > Tsz-Wo > > > On Tuesday, March 21, 2023, 01:00:20 PM GMT+8, Ayush Saxena < > ayush...@gmail.com> wrote: > > > I am not sure what classi

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

d. In FileSystem, there is an > initialize(..) and its javadoc says: > >* Called after the new FileSystem instance is constructed, and before it >* is ready for use. > > However, there is no way to check if the FileSystem instance is ready. > > > These are currently

Fwd: TAC supporting Berlin Buzzwords

Forwarded a recieved. -Ayush -- Forwarded message - From: Gavin McDonald Date: Fri, 24 Mar 2023 at 15:27 Subject: TAC supporting Berlin Buzzwords To: PMCs, Please forward to your dev and user lists. Hi All, The ASF Travel Assistance Committee is supporting taking up to six

Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

I know Jersey upgrade as a blocker. Some folks were chasing that last year during 3.3.4 time, I don’t know where it is now, didn’t see then what’s the problem there but I remember there was some intitial PR which did it for HDFS atleast, so I never looked beyond that… I too had jdk-11 in my min

Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

hts. Probably bad takes: > > There are projects experimenting with JDK17 now. > JDK11 active support will end in 6 months. If it's already hard to migrate > from JDK8 why not retarget JDK17. > > On Tue, Mar 28, 2023 at 10:30 AM Ayush Saxena wrote: > >> I know Jersey u

A Message from the Board to PMC members

d...@hadoop.apache.org received a mail from the apache board, forwarding it to the mailing lists which we use, sharing the link here: https://www.mail-archive.com/dev@hadoop.apache.org/msg00158.html private@ in bcc -Ayush - To

Re: [VOTE] Release Apache Hadoop 3.3.5 (RC3)

gt; > Steve Loughran > Chris Nauroth > Masatake Iwasaki > Ayush Saxena > Xiaoqiao He > > +1 non-binding > > Viraj Jasani > > > 0 or -1 votes: none. > > > Accordingly: the release is good! > > I will send the formal announcement out tomorrow >

Re: [jira] [Resolved] (HADOOP-18134) Setup Jenkins nightly CI for Windows 10

Just saw this mail, This sounds like a project level achievement to me considering Windows is an OS which we officially claim to support, worth making more noise :) Awesome stuft guys!!! This was on my bucket list for 2-3 days when it was in draft state, couldn’t get time since then , but it's re

Re: [DISCUSS] Hadoop 3.3.6 release planning

Thanx Wei-Chiu for the initiative, Good to have quick releases :) With my Hive developer hat on, I would like to bring some stuff up for consideration(feel free to say no, if it is beyond scope or feels even a bit unsafe, don't want to mess up the release) * HADOOP-18662: ListFiles with recursive

Re: [DISCUSS] Hadoop 3.3.6 release planning

That openssl change ain't a blocker now from my side, that ABFS-Jdk-17 stuff got sorted out, Steve knew a way out On Sat, 6 May 2023 at 00:51, Ayush Saxena wrote: > > Thanx Wei-Chiu for the initiative, Good to have quick releases :) > > With my Hive developer hat on, I wo

Re: Nightly Jenkins CI for Hadoop on Windows 10

Awesome!!! Do you plan to run some builds per PR to ensure no commits breaks it in the future? Worth exploring GithubActions in the later stages if we can have an action for maven install on windows, it won't affect the normal build time as well. can run in parallel with the existing builds. -Ayu

Re: Nightly Jenkins CI for Hadoop on Windows 10

oint and we certainly don't want to > regress > in this regard. I think I'll pursue this once I stabilize the nightly CI > and after > I sort out the rest of the failing parts (mvnsite, javadoc etc). > > Also, does Github Actions provide any advantage over precommit CI? &g

Re: Nightly Jenkins CI for Hadoop on Windows 10

hit the timeout -Ayush On Tue, 9 May 2023 at 11:49 PM, Ayush Saxena wrote: > Hi Gautham, > The only advantage I can think of is your limitation to nodes shouldn’t > bother much. Though there are limited resources given to Apache but still > never observed any starvation in any pro

RE: Call for Presentations, Community Over Code 2023

Forwarding from dev@hadoop to the dev ML which we use. The actual mail lies here: https://www.mail-archive.com/dev@hadoop.apache.org/msg00160.html -Ayush On 2023/05/09 21:24:09 Rich Bowen wrote: > (Note: You are receiving this because you are subscribed to the dev@ > list for one or more Apache

Issues with Github PR integration with Jira

Hi Folks, Just wanted to let everyone know, there is an ongoing issue with Github PR & Jira integration since the last few days. The Pull Requests aren't getting linked automatically to Jira in some cases, If you observe that Please link manually unless this issue is resolved. I have an INFRA tic

Re: Call for Presentations, Community Over Code 2023

r Community over Code Asia 2023 > > https://www.bagevent.com/event/cocasia-2023-EN > Happening Aug 18-20. CfP due by 6/6 > > > On Tue, May 9, 2023 at 8:39 PM Ayush Saxena wrote: >> >> Forwarding from dev@hadoop to the dev ML which we use. >> >> The actua

Re: Issues with Github PR integration with Jira

It is sorted now. the github bot got blocked as a spam user. poor fellow :-) -Ayush On Fri, 19 May 2023 at 05:33, Ayush Saxena wrote: > Hi Folks, > Just wanted to let everyone know, there is an ongoing issue with > Github PR & Jira integration since the last few days. > >

Fwd: Call for Presentations, Community Over Code Asia 2023

Forwarding from dev@hadoop to the ML we use. Original Mail: https://lists.apache.org/thread/3c16xyvmdyvg4slmtfywcwjbck1b4x02 -Ayush -- Forwarded message - From: Rich Bowen Date: Mon, 5 Jun 2023 at 21:43 Subject: Call for Presentations, Community Over Code Asia 2023 To: rbo...@apa

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

Hi Masatake, That ticket is just a backport of: https://issues.apache.org/jira/browse/HADOOP-17612 and the only java code change is in test [1], which is causing issues for you. That ticket isn't marked incompatible either, so maybe that is why it got pulled back. btw. the original PR does men

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

Folks you had put your vote on the wrong thread, this is the RC0 thead, you need to put on the RC1, https://lists.apache.org/thread/022p4rml5tvsx9xpq6t7b3n1td8lzz1d -Ayush Sent from my iPhone > On 20-Jun-2023, at 10:03 PM, Ashutosh Gupta > wrote: > > Hi > > Thanks Wei-Chiu for driving the

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

+1 (Binding) * Built from source (x86 & Arm) * Successful native build on ubuntu 18.04(x86) & ubuntu 20.04(Arm) * Verified Checksums (x86 & Arm) * Verified Signatures (x86 & Arm) * Successful RAT check (x86 & Arm) * Verified the diff b/w the tag & the source tar * Built Ozone with 3.3.6, green bui

RE: [DISCUSS][HDFS] Add rust binding for libhdfs

Forwarding from dev@hadoop to relevant ML Original mail: https://lists.apache.org/thread/r5rcmc7lwwvkysj0320myxltsyokp9kq -Ayush On 2023/07/15 09:18:42 Xuanwo wrote: > Hello, everyone. > > I'm the maintainer of [hdfs-sys]: A binding to HDFS Native C API for Rust. I > want to know is it a good i

Fwd: Signing releases using automated release infra

Something we can explore as well!! -Ayush Begin forwarded message: > From: Volkan Yazıcı > Date: 19 July 2023 at 1:24:49 AM IST > To: d...@community.apache.org > Subject: Signing releases using automated release infra > Reply-To: d...@community.apache.org > > Abstract: Signing release artifac

Re: Signing releases using automated release infra

ue, 18 Jul 2023 at 21:05, Ayush Saxena wrote: >> >> Something we can explore as well!! >> >> -Ayush >> >> Begin forwarded message: >> >> > From: Volkan Yazıcı >> > Date: 19 July 2023 at 1:24:49 AM IST >> > To: d...@communit

Re: HADOOP-18207 hadoop-logging module about to land

Hi Wei-Chiu, I am glad this activity finally made it to the dev mailing list. Just sharing the context being the guy who actually reverted this last time it was in: It had a test failure on the PR itself and it went in, that had nothing to do with the nature of the PR, generic for all PR and all pr

Re: HADOOP-18207 hadoop-logging module about to land

tial num of incompatibilities that would arise with jersey 2 > migration. > > I am really grateful to all reviewers that have reviewed the tasks so far, > I am not expecting reviewers to be able to provide their reviews as quickly > as possible, this particular sub-task has been dev and test ready f

Re: [ANNOUNCE] New Hadoop Committer - Shuyan Zhang

Congratulations!!! Sent from my iPhone > On 27-Sep-2023, at 9:56 AM, Xiaoqiao He wrote: > > I am pleased to announce that Shuyan Zhang has been elected as > a committer on the Apache Hadoop project. We appreciate all of > Shuyan's work, and look forward to her/his continued contributions. > >

Re: [ANNOUNCE] New Hadoop Committer - Simbarashe Dzinamarira

Congratulations!!! -Ayush > On 03-Oct-2023, at 5:42 AM, Erik Krogen wrote: > > Congratulations Simba! Thanks for the great work you've done on making HDFS > more scalable! > >> On Mon, Oct 2, 2023 at 4:31 PM Iñigo Goiri wrote: >> >> I am pleased to announce that Simbarashe Dzinamarira has b

Re: [DISCUSS] Remove Ozone and Submarine from Hadoop repo

Thanx Akira for putting this up. +1, Makes sense removing. -Ayush > On 25-Oct-2019, at 6:55 AM, Dinesh Chitlangia > wrote: > > +1 and Anu's approach of creating a tag makes sense. > > Dinesh > > > > >> On Thu, Oct 24, 2019 at 9:24 PM Sunil Govindan wrote: >> >> +1 on this to remove stal

Re: [VOTE] create ozone-dev and ozone-issues mailing lists

+1 -Ayush > On 27-Oct-2019, at 1:55 PM, Elek, Marton wrote: > > > As discussed earlier in the thread of "Hadoop-Ozone repository mailing list > configurations" [1] I suggested to solve the current misconfiguration problem > with creating separated mailing lists (dev/issues) for Hadoop Ozone.

Re: [VOTE] create ozone-dev and ozone-issues mailing lists

Hi, Probably we should mention the new lists in the document too. Here : https://hadoop.apache.org/mailing_lists.html -Ayush On Mon, 4 Nov 2019 at 16:19, Elek, Marton wrote: > Thanks Arpit. > > Notification rules has also been adjusted (thanks to INFRA). > > https://issues.apache.org/jira/brows

Re: yetus, docker and HDFS-15042 Add more tests for ByteBufferPositionedReadable

Hi Steve, I think so something got broken. I too observed it for a PR this morning, This wasn’t there couple of days back. May be we need to inform the Infra people. https://github.com/apache/hadoop/pull/1748#issuecomment-563894996 -Ayush > On 10-Dec-2019, at 4:17 PM, Steve Loughran > wrote: >

Re: [DISCUSS] Making 2.10 the last minor 2.x release

Hi Akira Seems there was an INFRA ticket for that. INFRA-19581, But the INFRA people closed as wont do and yes, the branch is protected, we can’t delete it directly. Ref: https://issues.apache.org/jira/browse/INFRA-19581 -Ayush > On 23-Dec-2019, at 5:03 PM, Akira Ajisaka wrote: > > Thank you

Re: [DISCUSS] Making 2.10 the last minor 2.x release

master. >> >> -Akira >> >> >> On Mon, Dec 23, 2019 at 9:14 PM Ayush Saxena wrote: >> >> > Hi Akira >> > Seems there was an INFRA ticket for that. INFRA-19581, >> > But the INFRA people closed as wont do and yes, the branch is p

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

Hey Sree > apache/hadoop-thirdparty, How would it fit into ASF ? As an Incubating > Project ? Or as a TLP ? > Or as a new project definition ? > A sub project of Apache Hadoop, having its own independent release cycles. May be you can put this into the same column as ozone or as submarine(couple o

Re: [DISCUSS] Hadoop 2019 Release Planning

Hi Gabor Seams like you need to create one, I too can't find anything related. Most I could find was : https://cwiki.apache.org/confluence/display/HADOOP/Roadmap#Roadmap-3.1.3 -Ayush On Wed, 8 Jan 2020 at 18:45, Gabor Bota wrote: > I'm volunteering to be the release manager for 3.1.4. > Whe

Re: [DISCUSS] About creation of Hadoop Thirdparty repository for shaded artifacts

t >> for Hadoop we can go ahead as per current approach. >> We can also start the parallel effort to address these problems in a >> separate discussion/proposal. Once the solution is available we can revisit >> and adopt new solution accordingly in all such projects (ex: HBase, H

Re: [DISCUSS] Feature branch for HDFS-14978 In-place Erasure Coding Conversion

+1 for the feature branch -Ayush > On 24-Jan-2020, at 3:04 AM, Wei-Chiu Chuang > wrote: > > Hi we are working on a feature to improve Erasure Coding, and I would like > to seek your opinion on creating a feature branch for it. (HDFS-14978 > )

Restrict Frequency of BlockReport To Namenode startup and failover

Hi All, Me and Surendra have been lately trying to minimise the impact of Block Reports on Namenode in huge cluster. We observed in a huge cluster, about 10k datanodes, the periodic block reports impact the Namenode performance adversely. We have been thinking to restrict the block reports to be

Re: Restrict Frequency of BlockReport To Namenode startup and failover

report >> implementation. In other words, it's a fail-safe mechanism. Any bugs in >> IBRs get corrected after a FBR that refreshes the state of blocks at >> NameNode. At least, that's my understanding of FBRs in its early days. >> >> On Tue, Feb 4, 2020 at 1

Re: Restrict Frequency of BlockReport To Namenode startup and failover

nch 3.x. If BR is just added to prevent >> bugs in IBR, I feel we should fix such bug in IBR. Adding one new >> functionality to prevent bug in other is not good. >> >> I also thing, DN should send BR in failure and process start scenario only. >> >> -Surendra

Re: Restrict Frequency of BlockReport To Namenode startup and failover

Thanx Everyone!!! Just to conclude the thread. Have created HDFS-15162 to track this. -Ayush > On 09-Feb-2020, at 5:01 PM, Ayush Saxena wrote: > > Hi Stephen, > We are trying this on 3.1.1 > We aren’t upgrading from 2.x, we are trying to increase the cluster size to > go be

Re: [DISCUSS] EOL Hadoop branch-2.8

Thanx Wei-Chiu for initiating this +1 for marking 2.8 EOL -Ayush > On 17-Feb-2020, at 11:14 PM, Wei-Chiu Chuang wrote: > > The last Hadoop 2.8.x release, 2.8.5, was GA on September 15th 2018. > > It's been 17 months since the release and the community by and large have > moved up to 2.9/2.10/

Re: [DISCUSS] hadoop-thirdparty 1.0.0 release

Thanx Vinay for initiating this. +1, for the plan. Good luck!!! -Ayush > On 21-Feb-2020, at 12:26 PM, Vinayakumar B wrote: > > Hi All, > > Since Hadoop-3.3.0 release is around the corner, its time to release > hadoop-thirdparty's first ever release, without which hadoop-3.3.0 cannot > proceed

Re: [VOTE] EOL Hadoop branch-2.8

o file a jira, update the wiki and post the >>> announcement >>>> to general@ and user@ >>>> >>>> On Wed, Feb 19, 2020 at 1:40 PM Dinesh Chitlangia < >>> dineshc@gmail.com> >>>> wrote: >>>> >>>>>

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0

Hi Vinay Thanx for driving the release. Verified checksums and tried building from source. Everything seems to be working fine. But I feel the concerns regarding licences are valid. IMO we should fix them and include HADOOP-16895 too in the release -Ayush > On 29-Feb-2020, at 1:45 AM, Vinayakumar

Re: [ANNOUNCE] New Apache Hadoop Committer - Stephen O'Donnell

Congratulations Stephen!!! -Ayush > On 04-Mar-2020, at 1:51 AM, Bharat Viswanadham wrote: > > Congratulations Stephen! > > Thanks, > Bharat > > >> On Tue, Mar 3, 2020 at 12:12 PM Wei-Chiu Chuang wrote: >> >> In bcc: general@ >> >> It's my pleasure to announce that Stephen O'Donnell has b

Re: [ANNOUNCEMENT] New Apache Hadoop PMC member: Surendra Singh Lilhore

Missed this completely. Heartiest Congratulations Surendra!!! BR Ayush > On 06-Jan-2020, at 8:30 PM, Brahma Reddy Battula wrote: > > Hi all, > > I am very glad to announce > that Surendra was voted to join Apache Hadoop PMC. > > Congratulations Surendra!! Well deserved and thank you for you

Re: [VOTE] Release Apache Hadoop Thirdparty 1.0.0 - RC1

Thanx Vinay for driving the release. +1(non-binding) Built trunk with -Dhadoop-thirdparty-protobuf.version=1.0.0 Build from source on Ubuntu 19.10 Verified source checksum. Good Luck!!! -Ayush On Thu, 12 Mar 2020 at 01:56, Vinayakumar B wrote: > Hi folks, > > Thanks to everyone's help on this

Re: [ANNOUNCE] New Apache Hadoop Committer - Siyao Meng

Congratulations Siyao!!! -Ayush > On 21-Mar-2020, at 8:13 AM, Zhankun Tang wrote: > > Welcome onboard. Siyao! > > BR, > Zhankun > > Xiaoyu Yao 于2020年3月21日 周六上午1:24写道： > >> It's my pleasure to announce that Siyao Meng has been elected as committer >> on the Apache Hadoop project recognizing

Re: [VOTE] Apache Hadoop Ozone 0.5.0-beta RC2

+1(non binding) *Built from source *Verified Checksums *Ran some basic Shell Commands. Thanx Dinesh for driving the release. -Ayush On Mon, 16 Mar 2020 at 07:57, Dinesh Chitlangia wrote: > Hi Folks, > > We have put together RC2 for Apache Hadoop Ozone 0.5.0-beta. > > The RC artifacts are at: >

Re: [DISCUSS] Shade guava into hadoop-thirdparty

+1 -Ayush > On 05-Apr-2020, at 12:43 AM, Wei-Chiu Chuang wrote: > > Hi Hadoop devs, > > I spent a good part of the past 7 months working with a dozen of colleagues > to update the guava version in Cloudera's software (that includes Hadoop, > HBase, Spark, Hive, Cloudera Manager ... more than

Re: asf git repo sync

Hey Steve [image: image.png] There are two commits above YARN-10240, As of now both repos seems to be in sync. -Ayush On Wed, 22 Apr 2020 at 00:43, Steve Loughran wrote: > FYI, looks like the ASF git repo @ > https://gitbox.apache.org/repos/asf/hadoop.git and the github repo at > https://githu

Re: Changing the default Datanode Volume Choosing policy

Hey Stephen, Thanx for initiating this. Just had a look on HDFS-8538, Seems it had concerns couple of concerns regarding the write throughput and performance by Arpit Agarwal & Tsz-wo-Sze. It concluded with a solution in the end as mentioned here : https://issues.apache.org/jira/browse/HDFS-8538?fo

Client Caller Context Through Router(RBF)

Hi All, Wanted to share and discuss a problem that we are facing in the present situation when using Router Based Federation. Presently when a client connects through Router to Namenode, the Namenode receives the caller context of the router rather than being of the actual client. This typically ca

Re: ZStandard compression crashes

Hi Wei Chiu, What is the Hadoop version being used? Give a check if HADOOP-15822 is there, it had something similar error. -Ayush > On 11-May-2020, at 10:11 PM, Wei-Chiu Chuang wrote: > > Hadoop devs, > > A colleague of mine recently hit a strange issue where zstd compression > codec crashes.

Re: [DISCUSS] making Ozone a separate Apache project

+1 -Ayush > On 13-May-2020, at 11:26 PM, Aravindan Vijayan > wrote: > > +1. > > Thank you for taking this up Marton. > > >> On Wed, May 13, 2020 at 10:48 AM Uma Maheswara Rao G >> wrote: >> >> +1 >> >> Regards, >> Uma >> >>> On Wed, May 13, 2020 at 12:53 AM Elek, Marton wrote: >>> >>

Re: [ANNOUNCE] New Apache Hadoop Committer - He Xiaoqiao

Congratulations He Xiaoqiao!!! -Ayush > On 11-Jun-2020, at 9:30 PM, Wei-Chiu Chuang wrote: > > In bcc: general@ > > It's my pleasure to announce that He Xiaoqiao has been elected as a > committer on the Apache Hadoop project recognizing his continued > contributions to the > project. > > Ple

Re: [DISCUSS] Hadoop 3.3.0 Release include ARM binary

YARN-10314 also seems to be a blocker. https://issues.apache.org/jira/browse/YARN-10314 We should wait for that as well, should get concluded in a day or two. -Ayush > On 15-Jun-2020, at 7:21 AM, Sheng Liu wrote: > > The HADOOP-17046 has

Re: [VOTE] Release Apache Hadoop 3.1.4 (RC1)

Hi Gabor, As you are going ahead with another RC, Please include : HDFS-15323 as well if possible. https://issues.apache.org/jira/browse/HDFS-15323 Remember tagging you there but at that time RC0 was up, try if that could make into the release as well. Thanx!!! -Ayush On Wed, 24 Jun 2020 at 16:

  1   2   3   4   5   >