Hi All, we are down to two blockers issues now (YARN-10194 and YARN-9848) which are in patch available state.Hopefully we can out the RC soon.
thanks to @Prabhu Joseph <prabhujose.ga...@gmail.com> ,@masakate,@akira and @Wei-Chiu Chuang <weic...@cloudera.com> and others for helping resloving the blockers. On Tue, Apr 14, 2020 at 10:49 PM Brahma Reddy Battula <bra...@apache.org> wrote: > > @Prabhu Joseph <prabhujose.ga...@gmail.com> > >>> Have committed the YARN blocker YARN-10219 to trunk and cherry-picked > to branch-3.3. Right now, there are two blocker Jiras - YARN-10233 and > HADOOP-16982 > which i will help to review and commit. Thanks. > > Looks you committed YARN-10219. Noted YARN-10233 and HADOOP-16982 as a > blockers. (without YARN-10233 we have given so many releases,it's not newly > introduced.).. Thanks > > @Vinod Kumar Vavilapalli <vino...@hortonworks.com> ,@adam Antal, > > I noted YARN-9848 as a blocker as you mentioned above. > > @All, > > Currently following four blockers are pending for 3.3.0 RC. > > HADOOP-16963,YARN-10233,HADOOP-16982 and YARN-9848. > > > > On Tue, Apr 14, 2020 at 8:11 PM Vinod Kumar Vavilapalli < > vino...@apache.org> wrote: > >> Looks like a really bad bug to me. >> >> +1 for revert and +1 for making that a 3.3.0 blocker. I think should also >> revert it in a 3.2 maintenance release too. >> >> Thanks >> +Vinod >> >> > On Apr 14, 2020, at 5:03 PM, Adam Antal <adam.an...@cloudera.com.INVALID> >> wrote: >> > >> > Hi everyone, >> > >> > Sorry for coming a bit late with this, but there's also one jira that >> can >> > have potential impact on clusters and we should talk about it. >> > >> > Steven Rand found this problem earlier and commented to >> > https://issues.apache.org/jira/browse/YARN-4946. >> > The bug has impact on the RM state store: the RM does not delete apps - >> see >> > more details in his comment here: >> > >> https://issues.apache.org/jira/browse/YARN-4946?focusedCommentId=16898599&page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel#comment-16898599 >> > . >> > (FYI He also created https://issues.apache.org/jira/browse/YARN-9848 >> with >> > the revert task). >> > >> > It might not be an actual blocker, but since there wasn't any consensus >> > about a follow up action, I thought we should decide how to proceed >> before >> > release 3.3.0. >> > >> > Regards, >> > Adam >> > >> > On Tue, Apr 14, 2020 at 9:35 AM Prabhu Joseph < >> prabhujose.ga...@gmail.com> >> > wrote: >> > >> >> Thanks Brahma for the update. >> >> >> >> Have committed the YARN blocker YARN-10219 to trunk and cherry-picked >> to >> >> branch-3.3. Right now, there are two blocker Jiras - YARN-10233 and >> >> HADOOP-16982 >> >> which i will help to review and commit. Thanks. >> >> >> >> [image: Screen Shot 2020-04-14 at 1.01.51 PM.png] >> >> >> >> project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, >> >> Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 >> ORDER >> >> BY priority DESC >> >> >> >> >> >> On Sun, Apr 12, 2020 at 12:19 AM Brahma Reddy Battula < >> bra...@apache.org> >> >> wrote: >> >> >> >>> *Pending for 3.3.0 Release:* >> >>> >> >>> One Blocker(HADOOP-16963) confirmation and following jira's are open >> as >> >>> these needs to merged to other branches(I am tracking the same, >> Ideally >> >>> this can be closed and can raise seperate jira's to track). >> >>> >> >>> >> >>> 1–4 of 4Refresh results >> >>> < >> >>> >> https://issues.apache.org/jira/issues/?jql=project%20in%20(%22Hadoop%20HDFS%22)%20AND%20resolution%20%3D%20Unresolved%20AND%20(cf%5B12310320%5D%20%3D%203.3.0%20OR%20fixVersion%20%3D%203.3.0)%20ORDER%20BY%20priority%20DESC# >> >>>> >> >>> Columns >> >>> Patch InfoKeyTSummaryAssigneeReporterP >> StatusResolutionUpdatedDueCreated >> >>> <https://issues.apache.org/jira/browse/HDFS-14353> HDFS-14353 >> >>> <https://issues.apache.org/jira/browse/HDFS-14353> [image: Sub-task] >> >>> <https://issues.apache.org/jira/browse/HDFS-14353> >> >>> >> >>> HDFS-8031 <https://issues.apache.org/jira/browse/HDFS-8031> Erasure >> >>> Coding: >> >>> metrics xmitsInProgress become to negative. >> >>> <https://issues.apache.org/jira/browse/HDFS-14353> >> >>> maobaolong >> >>> < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=maobaolong> >> >>> maobaolong >> >>> < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=maobaolong> >> >>> [image: >> >>> Major] REOPENED *Unresolved* 11/Apr/20 11/Mar/19 Actions >> >>> < >> >>> >> https://issues.apache.org/jira/rest/api/1.0/issues/13220750/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> >>>> >> >>> <https://issues.apache.org/jira/browse/HDFS-14788> HDFS-14788 >> >>> <https://issues.apache.org/jira/browse/HDFS-14788> [image: >> Improvement] >> >>> <https://issues.apache.org/jira/browse/HDFS-14788> >> >>> >> >>> Use dynamic regex filter to ignore copy of source files in Distcp >> >>> <https://issues.apache.org/jira/browse/HDFS-14788> >> >>> Mukund Thakur >> >>> < >> >>> >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mukund-thakur >> >>>> >> >>> Mukund >> >>> Thakur >> >>> < >> >>> >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=mukund-thakur >> >>>> >> >>> [image: >> >>> Major] OPEN *Unresolved* 11/Apr/20 28/Aug/19 Actions >> >>> < >> >>> >> https://issues.apache.org/jira/rest/api/1.0/issues/13253437/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> >>>> >> >>> <https://issues.apache.org/jira/browse/HDFS-12862> HDFS-12862 >> >>> <https://issues.apache.org/jira/browse/HDFS-12862> [image: Bug] >> >>> <https://issues.apache.org/jira/browse/HDFS-12862> >> >>> >> >>> CacheDirective becomes invalid when NN restart or failover >> >>> <https://issues.apache.org/jira/browse/HDFS-12862> >> >>> Wang XL >> >>> < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=Wang%20XL> >> >>> Wang >> >>> XL < >> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=Wang%20XL >> >>>> >> >>> [image: >> >>> Major] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/17 Actions >> >>> < >> >>> >> https://issues.apache.org/jira/rest/api/1.0/issues/13121225/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> >>>> >> >>> <https://issues.apache.org/jira/browse/HDFS-14476> HDFS-14476 >> >>> <https://issues.apache.org/jira/browse/HDFS-14476> [image: >> Improvement] >> >>> <https://issues.apache.org/jira/browse/HDFS-14476> >> >>> >> >>> lock too long when fix inconsistent blocks between disk and in-memory >> >>> <https://issues.apache.org/jira/browse/HDFS-14476> >> >>> Sean Chow >> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=seanlook >> > >> >>> Sean >> >>> Chow < >> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=seanlook> >> >>> [image: >> >>> Major] PATCH AVAILABLE *Unresolved* 12/Apr/20 07/May/19 Actions >> >>> < >> >>> >> https://issues.apache.org/jira/rest/api/1.0/issues/13231926/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> >>>> >> >>> >> >>> >> >>> 1–5 of 5Refresh results >> >>> < >> >>> >> https://issues.apache.org/jira/issues/?jql=project%20in%20(%22Hadoop%20YARN%22)%20AND%20resolution%20%3D%20Unresolved%20AND%20(cf%5B12310320%5D%20%3D%203.3.0%20OR%20fixVersion%20%3D%203.3.0)%20ORDER%20BY%20priority%20DESC# >> >>>> >> >>> Columns >> >>> Patch InfoKeyTSummaryAssigneeReporterP >> StatusResolutionUpdatedDueCreated >> >>> <https://issues.apache.org/jira/browse/YARN-10001> YARN-10001 >> >>> <https://issues.apache.org/jira/browse/YARN-10001> [image: >> Improvement] >> >>> <https://issues.apache.org/jira/browse/YARN-10001> >> >>> >> >>> Add explanation of unimplemented methods in InMemoryConfigurationStore >> >>> <https://issues.apache.org/jira/browse/YARN-10001> >> >>> Siddharth Ahuja >> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=sahuja> >> >>> Szilard >> >>> Nemeth < >> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >> >>> [image: >> >>> Major] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >> >>> < >> >>> >> https://issues.apache.org/jira/rest/api/1.0/issues/13271213/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> >>>> >> >>> <https://issues.apache.org/jira/browse/YARN-9997> YARN-9997 >> >>> <https://issues.apache.org/jira/browse/YARN-9997> [image: >> Improvement] >> >>> <https://issues.apache.org/jira/browse/YARN-9997> >> >>> >> >>> Code cleanup in ZKConfigurationStore >> >>> <https://issues.apache.org/jira/browse/YARN-9997> >> >>> Andras Gyori >> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=gandras> >> >>> Szilard >> >>> Nemeth < >> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >> >>> [image: >> >>> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >> >>> < >> >>> >> https://issues.apache.org/jira/rest/api/1.0/issues/13271201/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> >>>> >> >>> <https://issues.apache.org/jira/browse/YARN-10002> YARN-10002 >> >>> <https://issues.apache.org/jira/browse/YARN-10002> [image: >> Improvement] >> >>> <https://issues.apache.org/jira/browse/YARN-10002> >> >>> >> >>> Code cleanup and improvements in ConfigurationStoreBaseTest >> >>> <https://issues.apache.org/jira/browse/YARN-10002> >> >>> Benjamin Teke >> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=bteke> >> >>> Szilard >> >>> Nemeth < >> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >> >>> [image: >> >>> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >> >>> < >> >>> >> https://issues.apache.org/jira/rest/api/1.0/issues/13271215/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> >>>> >> >>> <https://issues.apache.org/jira/browse/YARN-9998> YARN-9998 >> >>> <https://issues.apache.org/jira/browse/YARN-9998> [image: >> Improvement] >> >>> <https://issues.apache.org/jira/browse/YARN-9998> >> >>> >> >>> Code cleanup in LeveldbConfigurationStore >> >>> <https://issues.apache.org/jira/browse/YARN-9998> >> >>> Benjamin Teke >> >>> <https://issues.apache.org/jira/secure/ViewProfile.jspa?name=bteke> >> >>> Szilard >> >>> Nemeth < >> >>> https://issues.apache.org/jira/secure/ViewProfile.jspa?name=snemeth> >> >>> [image: >> >>> Minor] PATCH AVAILABLE *Unresolved* 11/Apr/20 28/Nov/19 Actions >> >>> < >> >>> >> https://issues.apache.org/jira/rest/api/1.0/issues/13271202/ActionsAndOperations?atl_token=A5KQ-2QAV-T4JA-FDED_194e108bac53dceebb1b88ae92ef65a9eba913b0_lin >> >>>> >> >>> <https://issues.apache.org/jira/browse/YARN-9354> YARN-9354 >> >>> <https://issues.apache.org/jira/browse/YARN-9354> [image: >> Improvement] >> >>> <https://issues.apache.org/jira/browse/YARN-9354> >> >>> >> >>> Resources sh <https://issues.apache.org/jira/browse/YARN-9354> >> >>> >> >>> On Thu, Apr 9, 2020 at 11:41 PM Brahma Reddy Battula < >> bra...@apache.org> >> >>> wrote: >> >>> >> >>>> thanks a lot Akira and Prabhu for ping. >> >>>> >> >>>> All the blockers/critical issues are fixed. Recently two are reported >> >>>> again like HADOOP-16955 and HADOOP-16963 waiting for confirmation. >> >>>> >> >>>> @prabhu, Those 156 jira's are non-blocker issues which needs to >> moved to >> >>>> 3.4.0. and filter for blocker/critical is following. >> >>>> >> >>>> project in (YARN, HADOOP, MAPREDUCE, HDFS) AND priority in (Blocker, >> >>>> Critical) AND resolution = Unresolved AND "Target Version/s" = 3.3.0 >> >>> ORDER >> >>>> BY priority DESC >> >>>> >> >>>> >> >>>> On Thu, Apr 9, 2020 at 12:09 PM Prabhu Joseph < >> >>> prabhujose.ga...@gmail.com> >> >>>> wrote: >> >>>> >> >>>>> Hi Brahma, >> >>>>> >> >>>>> Please let me know if i can be of any help in review and commit >> / >> >>>>> clear the pending issues in YARN and MapReduce targeted for 3.3.0. >> >>>>> I see there are 156 YARN + MapReduce Unresolved Jiras which are >> either >> >>>>> with >> >>>>> target or fix version set to 3.3.0. >> >>>>> >> >>>>> project in (YARN, MAPREDUCE) AND resolution = Unresolved AND >> >>> (cf[12310320] >> >>>>> = 3.3.0 OR fixVersion = 3.3.0) ORDER BY priority DESC >> >>>>> >> >>>>> Thanks, >> >>>>> Prabhu Joseph >> >>>>> >> >>>>> On Tue, Apr 7, 2020 at 1:27 PM Akira Ajisaka <aajis...@apache.org> >> >>> wrote: >> >>>>> >> >>>>>> Hi Brahma, >> >>>>>> >> >>>>>> How is this issue going? >> >>>>>> If there are some blockers, I can help you. >> >>>>>> >> >>>>>> -Akira >> >>>>>> >> >>>>>> On Mon, Mar 30, 2020 at 3:50 AM Brahma Reddy Battula < >> >>> bra...@apache.org >> >>>>>> >> >>>>>> wrote: >> >>>>>> >> >>>>>>> Hi All, >> >>>>>>> >> >>>>>>> branch-3.3 created[1] and trunk set to 3.4.0-SNAPSHOT. >> >>>>>>> >> >>>>>>> while committing jira's please set the proper fix version and if >> >>>>> there is >> >>>>>>> any blocker/critical please commit to branch-3.3 or let me know. >> >>>>>>> >> >>>>>>> Planning start 3.3.0 RC0 voting on April-4th,2020(as per previous >> >>>>>>> communication in another thread[2]). >> >>>>>>> >> >>>>>>> >> >>>>>>> 1.https://github.com/apache/hadoop/commits/branch-3.3 >> >>>>>>> 2. >> >>>>> >> https://lists.apache.org/list.html?common-dev@hadoop.apache.org:2020-3 >> >>>>>>> >> >>>>>>> >> >>>>>>> >> >>>>>>> >> >>>>>>> --Brahma Reddy Battula >> >>>>>>> >> >>>>>> >> >>>>> >> >>>> >> >>>> >> >>>> -- >> >>>> >> >>>> >> >>>> >> >>>> --Brahma Reddy Battula >> >>>> >> >>> >> >>> >> >>> -- >> >>> >> >>> >> >>> >> >>> --Brahma Reddy Battula >> >>> >> >> >> >> > > -- > > > > --Brahma Reddy Battula > -- --Brahma Reddy Battula
