Hi Brahma, The feature 'BPServiceActor processes commands from NameNode asynchronously' has been ready for both branch-3.2 and branch-3.2.3. While cherry-picking there is only minor conflict, So I checked in directly. BTW, run some unit tests and build pseudo cluster to verify, it seems to work fine. FYI.
Regards, - He Xiaoqiao On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula <bra...@apache.org> wrote: > Please go ahead. Let me know any help required on review. > > On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2...@gmail.com> wrote: > >> Hi Brahma, >> >> I plan to involve HDFS-14997 and related JIRAs if possible. I have >> resolved the conflict and verified them locally. >> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113. >> I would like to hear some more response that if we have enough time to >> wait for it to be ready. >> Thanks. >> >> Best Regards, >> - He Xiaoqiao >> >> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2...@gmail.com> wrote: >> >>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI. >>> >>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula <bra...@apache.org> >>> wrote: >>> >>>> Hi All, >>>> >>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly this >>>> can >>>> be done by this week,then I will try to create the RC next if there is >>>> no >>>> objection. >>>> >>>> https://issues.apache.org/jira/browse/HDFS-15160 >>>> >>>> >>>> >>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula <bra...@apache.org >>>> > >>>> wrote: >>>> >>>> > @Akira Ajisaka <aajis...@apache.org> and @Masatake Iwasaki >>>> > <iwasak...@oss.nttdata.co.jp> >>>> > Looks all are build related issues when you try with bigtop. We can >>>> > discuss and prioritize this.. Will connect with you guys. >>>> > >>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki < >>>> > iwasak...@oss.nttdata.co.jp> wrote: >>>> > >>>> >> >> - >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff >>>> >> > >>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14. >>>> >> > we do not see the issue usually since branch-3.2 uses >>>> zooekeper-3.4.13, >>>> >> > while it would be harmless to add the exclusion even for >>>> >> zooekeeper-3.4.13. >>>> >> >>>> >> I filed HADOOP-17849 for this. >>>> >> >>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote: >>>> >> > Thanks for bringing this up, Akira. Let me explain some background. >>>> >> > >>>> >> > >>>> >> >> - >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff >>>> >> > >>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14. >>>> >> > we do not see the issue usually since branch-3.2 uses >>>> zooekeper-3.4.13, >>>> >> > while it would be harmless to add the exclusion even for >>>> >> zooekeeper-3.4.13. >>>> >> > >>>> >> > >>>> >> >> - >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff >>>> >> >> - >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff >>>> >> >> - >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff >>>> >> > >>>> >> > These are relevant to directory structure used by Bigtop package. >>>> >> > If the fix does not break the tarball dist, >>>> >> > it would be nice to have these on Hadoop too. >>>> >> > >>>> >> > >>>> >> >> - >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff >>>> >> > >>>> >> > This is for aarch64 and ppe64le lacking required phantomjs. >>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 on >>>> >> packaging. >>>> >> > Hadoop needs the phantomjs for testing YARN-UI2. >>>> >> > >>>> >> > >>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote: >>>> >> >> Thanks, I'll check them out. >>>> >> >> >>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka < >>>> aajis...@apache.org> >>>> >> wrote: >>>> >> >> >>>> >> >>> Thanks Brahma for cutting branch-3.2.3. >>>> >> >>> >>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop 3.2.2. >>>> >> >>> >>>> >> >>> >>>> >> >>>> https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop >>>> >> >>> >>>> >> >>> In these patches, how about backporting the following issues to >>>> >> >>> branch-3.2 and branch-3.2.3? >>>> >> >>> - HADOOP-14922 >>>> >> >>> - HADOOP-15939 >>>> >> >>> - HADOOP-17569 >>>> >> >>> >>>> >> >>> In addition, there are some patches that don't have JIRA issue >>>> ID. >>>> >> >>> Maybe we need to create JIRAs and fix those. >>>> >> >>> - >>>> >> >>> >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff >>>> >> >>> - >>>> >> >>> >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff >>>> >> >>> - >>>> >> >>> >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff >>>> >> >>> - >>>> >> >>> >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff >>>> >> >>> - >>>> >> >>> >>>> >> >>>> https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff >>>> >> >>> >>>> >> >>> Thanks and regards, >>>> >> >>> Akira >>>> >> >>> >>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He < >>>> hexiaoq...@apache.org> >>>> >> >>> wrote: >>>> >> >>>> >>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 >>>> release >>>> >> happen. >>>> >> >>>> >>>> >> >>>> I would like to validate the HBase project (both the latest >>>> release >>>> >> and >>>> >> >>>> trunk branch). >>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with Chao >>>> >> >>> already). >>>> >> >>>> once RC is out. >>>> >> >>>> >>>> >> >>>> Thanks and Regards, >>>> >> >>>> - He Xiaoqiao >>>> >> >>>> >>>> >> >>>> >>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula < >>>> >> bra...@apache.org> >>>> >> >>>> wrote: >>>> >> >>>> >>>> >> >>>>> Hi All, >>>> >> >>>>> >>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please commit >>>> to >>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go. >>>> >> >>>>> >>>> >> >>>>> *This time I am thinking of having downstream projects and >>>> >> companies' >>>> >> >>>>> voices,let's know how this can go. * >>>> >> >>>>> >>>> >> >>>>> - Planning to check with downstream projects like >>>> Spark,HBase >>>> >> and >>>> >> >>> Hive >>>> >> >>>>> if they can help on validation(Or running their UT on this >>>> >> branch) >>>> >> >>>>> - Collecting info from Companies who are already deployed >>>> and >>>> >> using >>>> >> >>> the >>>> >> >>>>> branch-3.2 >>>> >> >>>>> >>>> >> >>>>> >>>> >> >>>>> so that we can make a more stable release on 3.2 (so that >>>> features >>>> >> >>> released >>>> >> >>>>> on this branch impact can be known) ,please let me know >>>> anybody from >>>> >> >>> these >>>> >> >>>>> communities who can help on this. >>>> >> >>>>> >>>> >> >>>>> >>>> >> >>>>> Planning to create RC by this month end. Any suggestions are >>>> >> welcome. >>>> >> >>>>> >>>> >> >>>>> >>>> >> >>>>> >>>> >> >>>>> --Brahma Reddy Battula >>>> >> >>>>> >>>> >> >>> >>>> >> > >>>> >> > >>>> --------------------------------------------------------------------- >>>> >> > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org >>>> >> > For additional commands, e-mail: common-dev-h...@hadoop.apache.org >>>> >> > >>>> >> >>>> > >>>> > >>>> > -- >>>> > >>>> > >>>> > >>>> > --Brahma Reddy Battula >>>> > >>>> >>>> >>>> -- >>>> >>>> >>>> >>>> --Brahma Reddy Battula >>>> >>> > > -- > > > > --Brahma Reddy Battula >
