**Important update** Hadoop-3.2.3 Release progress.
I cut branch-3.2.3 and it is ready for release. Please commit to branch-3.2.3 if any critical/blocker issues need to go. As previously communicated,Planning to create RC by this month end. Any suggestions are welcome. On Thu, Aug 5, 2021 at 10:15 PM Jason Wen <zhenshan....@workday.com> wrote: > Hi Steve, > > Which aws-java-sdk-bundle version did you test and encounter the following > test failures? > > Thanks, > Jason > > On 8/4/21, 7:51 AM, "Steve Loughran" <ste...@cloudera.com.INVALID> wrote: > > it didn't take, so don't worry about it. Test failures > > java.lang.IllegalArgumentException: Input is expected to be encoded in > multiple of 4 bytes but found: 75 > at com.amazonaws.util.Base64Codec.decode(Base64Codec.java:198) > at com.amazonaws.util.Base64.decode(Base64.java:116) > at > > com.amazonaws.services.s3.AmazonS3Client.populateSSE_C(AmazonS3Client.java:4620) > at > > com.amazonaws.services.s3.AmazonS3Client.putObject(AmazonS3Client.java:1806) > at > > org.apache.hadoop.fs.s3a.S3AFileSystem.putObjectDirect(S3AFileSystem.java:1603) > at > > org.apache.hadoop.fs.s3a.S3AFileSystem.lambda$createEmptyObject$13(S3AFileSystem.java:2828) > at org.apache.hadoop.fs.s3a.Invoker.once(Invoker.java:109) > at org.apache.hadoop.fs.s3a.Invoker.lambda$retry$3(Invoker.java:265) > at org.apache.hadoop.fs.s3a.Invoker.retryUntranslated(Invoker.java:322) > at org.apache.hadoop.fs.s3a.Invoker.retry(Invoker.java:261) > at org.apache.hadoop.fs.s3a.Invoker.retry(Invoker.java:236) > at > > org.apache.hadoop.fs.s3a.S3AFileSystem.createEmptyObject(S3AFileSystem.java:2826) > at > > org.apache.hadoop.fs.s3a.S3AFileSystem.createFakeDirectory(S3AFileSystem.java:2801) > at > > org.apache.hadoop.fs.s3a.S3AFileSystem.innerMkdirs(S3AFileSystem.java:2146) > at > org.apache.hadoop.fs.s3a.S3AFileSystem.mkdirs(S3AFileSystem.java:2079) > at org.apache.hadoop.fs.FileSystem.mkdirs(FileSystem.java:2304) > at > > org.apache.hadoop.fs.contract.AbstractFSContractTestBase.mkdirs(AbstractFSContractTestBase.java:338) > at > > org.apache.hadoop.fs.contract.AbstractFSContractTestBase.setup(AbstractFSContractTestBase.java:193) > > On Tue, 3 Aug 2021 at 19:41, Brahma Reddy Battula <bra...@apache.org> > wrote: > > > Hi Steve, > > > > Is there any jira for this ?? > > > > > > > > On Tue, 3 Aug 2021 at 4:05 PM, Steve Loughran > <ste...@cloudera.com.invalid > > > > > wrote: > > > > > I'm testing how well a backport of the latest AWS SDK goes; if all > is > > > docile there then I'll merge that. Due diligence more than anything > > > else....one of the shaded netty JARs (never used by our code) has > a CVE > > in > > > older versions > > > > > > On Mon, 2 Aug 2021 at 08:07, Akira Ajisaka <aajis...@apache.org> > wrote: > > > > > > > Hi Steven, > > > > > > > > Marked YARN-8990 and YARN-8992 as release-blocker. In addition, I > > > > opened a PR to backport YARN-8990: > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__github.com_apache_hadoop_pull_3254&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=tLml0Gisl-xPsd4B67BNBZtPsz1T0qBPppHYRzLLl_0&e= > > > > > > > > Thanks, > > > > Akira > > > > > > > > On Thu, Jul 29, 2021 at 10:36 AM Steven Rand < > stevenjr...@gmail.com> > > > > wrote: > > > > > > > > > > I think it would be helpful if we could include YARN-8990 and > > YARN-8992 > > > > in the 3.2.3 release. Both are important fixes which were > included in > > > > 3.2.0, but never made their way to branch-3.2, so were omitted > from > > both > > > > 3.2.1 and 3.2.2. > > > > > > > > > > Best, > > > > > Steve > > > > > > > > > > On Wed, Jul 28, 2021 at 5:14 AM Xiaoqiao He < > xq.he2...@gmail.com> > > > wrote: > > > > >> > > > > >> cc @dev mail-list. > > > > >> > > > > >> On Wed, Jul 28, 2021 at 5:11 PM Xiaoqiao He < > xq.he2...@gmail.com> > > > > wrote: > > > > >> > > > > >> > Hi Brahma, > > > > >> > > > > > >> > I just created version 3.2.4, and changed all unresolved > issues > > > > (target > > > > >> > version/s: 3.2.3) to 3.2.4 after checking both of them are > not > > > blocker > > > > >> > issues. Dashboard[1] is clean now. > > > > >> > > > > > >> > Regards, > > > > >> > - He Xiaoqiao > > > > >> > > > > > >> > [1] > > > > >> > > > > > > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_Dashboard.jspa-3FselectPageId-3D12336167&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=VeVkQq1tQiHaXN3SEUQXC8L3HMLuaePTXxb2iqlSvKo&e= > > > > >> > > > > > >> > On Sun, Jul 25, 2021 at 7:45 PM Brahma Reddy Battula < > > > > bra...@apache.org> > > > > >> > wrote: > > > > >> > > > > > >> >> Hi Xiaoqiao, > > > > >> >> > > > > >> >> Thanks for creating the Dashboard, we need to change the > filters > > > and > > > > >> >> target versions in the jira. > > > > >> >> > > > > >> >> On Sun, Jul 25, 2021 at 2:05 PM Xiaoqiao He < > xq.he2...@gmail.com > > > > > > > wrote: > > > > >> >> > > > > >> >>> Thanks Brahma for volunteering and driving this release > plan. I > > > just > > > > >> >>> created a dashboard for 3.2.3 release[1]. > > > > >> >>> I would like to support for this release line if need. (cc > > Brahma) > > > > >> >>> > > > > >> >>> Thanks. Regards, > > > > >> >>> - He Xiaoqiao > > > > >> >>> > > > > >> >>> [1] > > > > >> >>> > > > > >> >>> > > > > > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_secure_Dashboard.jspa-3FselectPageId-3D12336167&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=VeVkQq1tQiHaXN3SEUQXC8L3HMLuaePTXxb2iqlSvKo&e= > > > > >> >>> > > > > >> >>> > > > > >> >>> On Sat, Jul 24, 2021 at 1:16 AM Akira Ajisaka < > > > aajis...@apache.org> > > > > >> >>> wrote: > > > > >> >>> > > > > >> >>> > Hi Brahma, > > > > >> >>> > > > > > >> >>> > Thank you for volunteering! > > > > >> >>> > > > > > >> >>> > -Akira > > > > >> >>> > > > > > >> >>> > On Fri, Jul 23, 2021 at 5:57 PM Brahma Reddy Battula < > > > > >> >>> bra...@apache.org> > > > > >> >>> > wrote: > > > > >> >>> > > > > > > >> >>> > > Hi Akira, > > > > >> >>> > > > > > > >> >>> > > Thanks for bringing this.. > > > > >> >>> > > > > > > >> >>> > > I want to drive this if nobody already plan to do > this.. > > > > >> >>> > > > > > > >> >>> > > > > > > >> >>> > > On Thu, 22 Jul 2021 at 8:48 AM, Akira Ajisaka < > > > > aajis...@apache.org> > > > > >> >>> > wrote: > > > > >> >>> > > > > > > >> >>> > > > Hi all, > > > > >> >>> > > > > > > > >> >>> > > > Hadoop 3.2.2 was released half a year ago, and now, > we > > have > > > > >> >>> > > > accumulated more than 230 commits [1]. Therefore I > want to > > > > start > > > > >> >>> the > > > > >> >>> > > > release work for 3.2.3. > > > > >> >>> > > > > > > > >> >>> > > > There is one blocker for 3.2.3 [2]. > > > > >> >>> > > > - > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_browse_HDFS-2D12920&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=cLCuDw5WX1rSf1Mi96H60HNBRIC6HHZHvZc__Dt1cVU&e= > > > > >> >>> > > > > > > > >> >>> > > > Is there anyone who would volunteer to be the 3.2.3 > > release > > > > >> >>> manager? > > > > >> >>> > > > Are there any other blockers? If any, please file an > > issue, > > > > raise > > > > >> >>> the > > > > >> >>> > > > blocker, and add the target version. > > > > >> >>> > > > > > > > >> >>> > > > [1] > > > > >> >>> > > > > > > > >> >>> > > > > > >> >>> > > > > > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_issues_-3Fjql-3Dproject-2520in-2520-28HADOOP-252C-2520HDFS-252C-2520YARN-252C-2520MAPREDUCE-29-2520AND-2520fixVersion-2520-253D-25203.2.3&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=ZxoohH5FSfHaUmkC0tO3oet0m9eaWXalALcon1KrljA&e= > > > > >> >>> > > > [2] > > > > >> >>> > > > > > > > >> >>> > > > > > >> >>> > > > > > > > > > > https://urldefense.proofpoint.com/v2/url?u=https-3A__issues.apache.org_jira_issues_-3Fjql-3Dproject-2520in-2520-28HADOOP-252C-2520HDFS-252C-2520YARN-252C-2520MAPREDUCE-29-2520AND-2520priority-2520in-2520-28Blocker-252C-2520Critical-29-2520AND-2520resolution-2520-253D-2520Unresolved-2520AND-2520cf-255B12310320-255D-2520-253D-25203.2.3&d=DwIBaQ&c=DS6PUFBBr_KiLo7Sjt3ljp5jaW5k2i9ijVXllEdOozc&r=UflFQf1BWcrVtfjfN1LUqWWh-UBP5XtRGMdcDC-0P7o&m=dXWDhhZW6SZQt-9oQONYtGPMFTrUL4225rMKK-494YA&s=Q10Fi_NA0ieWt53zYJucf_VqrrJ7vS1_uP642EJTWKI&e= > > > > >> >>> > > > > > > > >> >>> > > > Regards, > > > > >> >>> > > > Akira > > > > >> >>> > > > > > > > >> >>> > > > > > > > >> >>> > > > > > --------------------------------------------------------------------- > > > > >> >>> > > > To unsubscribe, e-mail: > > > > >> >>> mapreduce-dev-unsubscr...@hadoop.apache.org > > > > >> >>> > > > For additional commands, e-mail: > > > > >> >>> mapreduce-dev-h...@hadoop.apache.org > > > > >> >>> > > > > > > > >> >>> > > > -- > > > > >> >>> > > > > > > >> >>> > > > > > > >> >>> > > > > > > >> >>> > > --Brahma Reddy Battula > > > > >> >>> > > > > > >> >>> > > > > > > --------------------------------------------------------------------- > > > > >> >>> > To unsubscribe, e-mail: > > > common-dev-unsubscr...@hadoop.apache.org > > > > >> >>> > For additional commands, e-mail: > > > > common-dev-h...@hadoop.apache.org > > > > >> >>> > > > > > >> >>> > > > > > >> >>> > > > > >> >> > > > > >> >> > > > > >> >> -- > > > > >> >> > > > > >> >> > > > > >> >> > > > > >> >> --Brahma Reddy Battula > > > > >> >> > > > > >> > > > > > > > > > > --------------------------------------------------------------------- > > > > To unsubscribe, e-mail: > mapreduce-dev-unsubscr...@hadoop.apache.org > > > > For additional commands, e-mail: > mapreduce-dev-h...@hadoop.apache.org > > > > > > > > > > > > > -- > > > > > > > > --Brahma Reddy Battula > > > > -- --Brahma Reddy Battula
