Hi to raise the awareness, it looks like reverting the FoldedTreeSet HDFS-13671 <https://issues.apache.org/jira/browse/HDFS-13671> breaks TestBlockManager in branch-3.2. Branch-3.3 is good.
tracking jira: HDFS-16258 <https://issues.apache.org/jira/browse/HDFS-16258> On Tue, Oct 5, 2021 at 8:45 PM Brahma Reddy Battula <bra...@apache.org> wrote: > Hi Akira, > > Thanks for your email!! > > I am evaluating the CVE’s which needs to go for this release.. > > Will update soon!! > > > On Tue, 5 Oct 2021 at 1:46 PM, Akira Ajisaka <aajis...@apache.org> wrote: > > > Hi Brahma, > > > > What is the release process going on? Is there any blocker for the RC? > > > > -Akira > > > > On Wed, Sep 22, 2021 at 7:37 PM Xiaoqiao He <xq.he2...@gmail.com> wrote: > > > > > Hi Brahma, > > > > > > The feature 'BPServiceActor processes commands from NameNode > > > asynchronously' has been ready for both branch-3.2 and branch-3.2.3. > > While > > > cherry-picking there is only minor conflict, So I checked in directly. > > BTW, > > > run some unit tests and build pseudo cluster to verify, it seems to > work > > > fine. > > > FYI. > > > > > > Regards, > > > - He Xiaoqiao > > > > > > On Thu, Sep 16, 2021 at 10:52 PM Brahma Reddy Battula < > bra...@apache.org > > > > > > wrote: > > > > > >> Please go ahead. Let me know any help required on review. > > >> > > >> On Tue, Sep 14, 2021 at 6:57 PM Xiaoqiao He <xq.he2...@gmail.com> > > wrote: > > >> > > >>> Hi Brahma, > > >>> > > >>> I plan to involve HDFS-14997 and related JIRAs if possible. I have > > >>> resolved the conflict and verified them locally. > > >>> It will include: HDFS-14997 HDFS-15075 HDFS-15651 HDFS-15113. > > >>> I would like to hear some more response that if we have enough time > to > > >>> wait for it to be ready. > > >>> Thanks. > > >>> > > >>> Best Regards, > > >>> - He Xiaoqiao > > >>> > > >>> On Tue, Sep 14, 2021 at 3:39 PM Xiaoqiao He <xq.he2...@gmail.com> > > wrote: > > >>> > > >>>> Hi Brahma, HDFS-15160 has checked in branch-3.2 & branch-3.2.3. FYI. > > >>>> > > >>>> On Tue, Sep 14, 2021 at 3:52 AM Brahma Reddy Battula < > > bra...@apache.org> > > >>>> wrote: > > >>>> > > >>>>> Hi All, > > >>>>> > > >>>>> Waiting for the following jira to commit to hadoop-3.2.3 , mostly > > this > > >>>>> can > > >>>>> be done by this week,then I will try to create the RC next if there > > is > > >>>>> no > > >>>>> objection. > > >>>>> > > >>>>> https://issues.apache.org/jira/browse/HDFS-15160 > > >>>>> > > >>>>> > > >>>>> > > >>>>> On Mon, Aug 16, 2021 at 2:22 PM Brahma Reddy Battula < > > >>>>> bra...@apache.org> > > >>>>> wrote: > > >>>>> > > >>>>> > @Akira Ajisaka <aajis...@apache.org> and @Masatake Iwasaki > > >>>>> > <iwasak...@oss.nttdata.co.jp> > > >>>>> > Looks all are build related issues when you try with bigtop. We > can > > >>>>> > discuss and prioritize this.. Will connect with you guys. > > >>>>> > > > >>>>> > On Mon, Aug 16, 2021 at 1:43 PM Masatake Iwasaki < > > >>>>> > iwasak...@oss.nttdata.co.jp> wrote: > > >>>>> > > > >>>>> >> >> - > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff > > >>>>> >> > > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14. > > >>>>> >> > we do not see the issue usually since branch-3.2 uses > > >>>>> zooekeper-3.4.13, > > >>>>> >> > while it would be harmless to add the exclusion even for > > >>>>> >> zooekeeper-3.4.13. > > >>>>> >> > > >>>>> >> I filed HADOOP-17849 for this. > > >>>>> >> > > >>>>> >> On 2021/08/16 12:02, Masatake Iwasaki wrote: > > >>>>> >> > Thanks for bringing this up, Akira. Let me explain some > > >>>>> background. > > >>>>> >> > > > >>>>> >> > > > >>>>> >> >> - > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff > > >>>>> >> > > > >>>>> >> > This is for building hadoop-3.2.2 against zookeeper-3.4.14. > > >>>>> >> > we do not see the issue usually since branch-3.2 uses > > >>>>> zooekeper-3.4.13, > > >>>>> >> > while it would be harmless to add the exclusion even for > > >>>>> >> zooekeeper-3.4.13. > > >>>>> >> > > > >>>>> >> > > > >>>>> >> >> - > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff > > >>>>> >> >> - > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff > > >>>>> >> >> - > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff > > >>>>> >> > > > >>>>> >> > These are relevant to directory structure used by Bigtop > > package. > > >>>>> >> > If the fix does not break the tarball dist, > > >>>>> >> > it would be nice to have these on Hadoop too. > > >>>>> >> > > > >>>>> >> > > > >>>>> >> >> - > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff > > >>>>> >> > > > >>>>> >> > This is for aarch64 and ppe64le lacking required phantomjs. > > >>>>> >> > It is only acceptable for Bigtop not running tests of YARN-UI2 > > on > > >>>>> >> packaging. > > >>>>> >> > Hadoop needs the phantomjs for testing YARN-UI2. > > >>>>> >> > > > >>>>> >> > > > >>>>> >> > On 2021/08/16 2:59, Brahma Reddy Battula wrote: > > >>>>> >> >> Thanks, I'll check them out. > > >>>>> >> >> > > >>>>> >> >> On Sun, 15 Aug 2021 at 11:22 PM, Akira Ajisaka < > > >>>>> aajis...@apache.org> > > >>>>> >> wrote: > > >>>>> >> >> > > >>>>> >> >>> Thanks Brahma for cutting branch-3.2.3. > > >>>>> >> >>> > > >>>>> >> >>> In Apache Bigtop, there are some patches applied to Hadoop > > >>>>> 3.2.2. > > >>>>> >> >>> > > >>>>> >> >>> > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/tree/master/bigtop-packages/src/common/hadoop > > >>>>> >> >>> > > >>>>> >> >>> In these patches, how about backporting the following issues > > to > > >>>>> >> >>> branch-3.2 and branch-3.2.3? > > >>>>> >> >>> - HADOOP-14922 > > >>>>> >> >>> - HADOOP-15939 > > >>>>> >> >>> - HADOOP-17569 > > >>>>> >> >>> > > >>>>> >> >>> In addition, there are some patches that don't have JIRA > issue > > >>>>> ID. > > >>>>> >> >>> Maybe we need to create JIRAs and fix those. > > >>>>> >> >>> - > > >>>>> >> >>> > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch2-exclude-spotbugs-annotations.diff > > >>>>> >> >>> - > > >>>>> >> >>> > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch3-fix-broken-dir-detection.diff > > >>>>> >> >>> - > > >>>>> >> >>> > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch5-fix-kms-shellprofile.diff > > >>>>> >> >>> - > > >>>>> >> >>> > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch6-fix-httpfs-sh.diff > > >>>>> >> >>> - > > >>>>> >> >>> > > >>>>> >> > > >>>>> > > > https://github.com/apache/bigtop/blob/master/bigtop-packages/src/common/hadoop/patch7-remove-phantomjs-in-yarn-ui.diff > > >>>>> >> >>> > > >>>>> >> >>> Thanks and regards, > > >>>>> >> >>> Akira > > >>>>> >> >>> > > >>>>> >> >>> On Wed, Aug 11, 2021 at 12:31 PM Xiaoqiao He < > > >>>>> hexiaoq...@apache.org> > > >>>>> >> >>> wrote: > > >>>>> >> >>>> > > >>>>> >> >>>> Thanks Brahma for initiating this and making hadoop-3.2.3 > > >>>>> release > > >>>>> >> happen. > > >>>>> >> >>>> > > >>>>> >> >>>> I would like to validate the HBase project (both the latest > > >>>>> release > > >>>>> >> and > > >>>>> >> >>>> trunk branch). > > >>>>> >> >>>> Chao Sun will validate the Spark Project (Got in touch with > > >>>>> Chao > > >>>>> >> >>> already). > > >>>>> >> >>>> once RC is out. > > >>>>> >> >>>> > > >>>>> >> >>>> Thanks and Regards, > > >>>>> >> >>>> - He Xiaoqiao > > >>>>> >> >>>> > > >>>>> >> >>>> > > >>>>> >> >>>> On Tue, Aug 10, 2021 at 5:54 PM Brahma Reddy Battula < > > >>>>> >> bra...@apache.org> > > >>>>> >> >>>> wrote: > > >>>>> >> >>>> > > >>>>> >> >>>>> Hi All, > > >>>>> >> >>>>> > > >>>>> >> >>>>> I cut branch-3.2.3 and it is ready for release. Please > > commit > > >>>>> to > > >>>>> >> >>>>> branch-3.2.3 if any critical/blocker issues need to go. > > >>>>> >> >>>>> > > >>>>> >> >>>>> *This time I am thinking of having downstream projects and > > >>>>> >> companies' > > >>>>> >> >>>>> voices,let's know how this can go. * > > >>>>> >> >>>>> > > >>>>> >> >>>>> - Planning to check with downstream projects like > > >>>>> Spark,HBase > > >>>>> >> and > > >>>>> >> >>> Hive > > >>>>> >> >>>>> if they can help on validation(Or running their UT on > > this > > >>>>> >> branch) > > >>>>> >> >>>>> - Collecting info from Companies who are already > > deployed > > >>>>> and > > >>>>> >> using > > >>>>> >> >>> the > > >>>>> >> >>>>> branch-3.2 > > >>>>> >> >>>>> > > >>>>> >> >>>>> > > >>>>> >> >>>>> so that we can make a more stable release on 3.2 (so that > > >>>>> features > > >>>>> >> >>> released > > >>>>> >> >>>>> on this branch impact can be known) ,please let me know > > >>>>> anybody from > > >>>>> >> >>> these > > >>>>> >> >>>>> communities who can help on this. > > >>>>> >> >>>>> > > >>>>> >> >>>>> > > >>>>> >> >>>>> Planning to create RC by this month end. Any suggestions > are > > >>>>> >> welcome. > > >>>>> >> >>>>> > > >>>>> >> >>>>> > > >>>>> >> >>>>> > > >>>>> >> >>>>> --Brahma Reddy Battula > > >>>>> >> >>>>> > > >>>>> >> >>> > > >>>>> >> > > > >>>>> >> > > > >>>>> > --------------------------------------------------------------------- > > >>>>> >> > To unsubscribe, e-mail: > > common-dev-unsubscr...@hadoop.apache.org > > >>>>> >> > For additional commands, e-mail: > > >>>>> common-dev-h...@hadoop.apache.org > > >>>>> >> > > > >>>>> >> > > >>>>> > > > >>>>> > > > >>>>> > -- > > >>>>> > > > >>>>> > > > >>>>> > > > >>>>> > --Brahma Reddy Battula > > >>>>> > > > >>>>> > > >>>>> > > >>>>> -- > > >>>>> > > >>>>> > > >>>>> > > >>>>> --Brahma Reddy Battula > > >>>>> > > >>>> > > >> > > >> -- > > >> > > >> > > >> > > >> --Brahma Reddy Battula > > >> > > > > > > -- > > > > --Brahma Reddy Battula >
