aah. if there something killing the hive/tez upgrade then that's major...they are trying to move up from hadoop 3.1 as a dependency and it will be a significant improvement for everything (for example, you can't build iceberg on hadoop 3.2+. I will start getting everything else ready while they are looking at that
On Fri, 17 Jun 2022 at 12:45, Cheng Pan <pan3...@gmail.com> wrote: > Thanks for the explanation, look forward to the upcoming 3.3.4. > > BTW, I found HADOOP-18033 may corrupt Hadoop Shaded Client[1], could > the release manager confirm that? If so, hopes we can fix it in 3.3.4. > > [1] https://github.com/apache/incubator-kyuubi/issues/2904 > > Thanks, > Cheng Pan > > On Fri, Jun 17, 2022 at 7:44 PM Cheng Pan <pan3...@gmail.com> wrote: > > > > Thanks for the explanation, look forward to the upcoming 3.3.4. > > > > BTW, I found HADOOP-18033 may corrupt Hadoop Shaded Client[1], could > > the release manager confirm that? If so, hopes we can fix it in 3.3.4. > > > > [1] https://github.com/apache/incubator-kyuubi/issues/2904 > > > > Thanks, > > Cheng Pan > > > > On Fri, Jun 17, 2022 at 5:55 PM Wei-Chiu Chuang <weic...@cloudera.com> > wrote: > > > > > > I think only the tarball needs to be uploaded. The Maven repository > doesn't (the jars would be the same?) At least that's what I did before. > > > > > > On Thu, Jun 16, 2022 at 6:04 PM Ayush Saxena <ayush...@gmail.com> > wrote: > > >> > > >> > > > >> > I'm assuming that the arm docker image can do the build, either on > my > > >> > macbook or more likely an arm linux vm in someones cloud > infrastructure? > > >> > > >> Yes, it would be the same release script but should be run on an ARM > > >> machine. The create-release script handles it here: > > >> > https://github.com/apache/hadoop/blob/1b25851ad9ca5d1fc12b67089bb5adaa53641245/dev-support/bin/create-release#L207-L210 > > >> > > >> if that's true, how do i get its artifacts into the release? is the > idea I > > >> > just upload a whole new binary .tar.gz file with a suffix to make > clear its > > >> > arm, while the rest of release (source, maven artifacts etc) comes > from the > > >> > main one? > > >> > > >> > > >> Uploading the .tar.gz, the signature and the checksum files suffixed > with > > >> -aarch64.tar.gz and so should do. Can check this commit, just upload > files > > >> in a way that they get recognized by this code: > > >> > https://github.com/apache/hadoop-site/commit/7487c909e835c10f6fe24aeb52d9784c4f06bdea > > >> > > >> > > >> for example > > >> if 3.3.3 had arm release the paths would have looked the way here: > > >> > https://github.com/apache/hadoop-site/blob/asf-site/content/releases.html#L214-L216 > > >> > > >> -Ayush > > >> > > >> On Thu, 16 Jun 2022 at 15:03, Steve Loughran <ste...@cloudera.com> > wrote: > > >> > > >> > i'm going to cut a 3.3.4 release this week, i will try to do an arm > binary > > >> > too. > > >> > > > >> > on that topic: how do i do this? > > >> > > > >> > I'm assuming that the arm docker image can do the build, either on > my > > >> > macbook or more likely an arm linux vm in someones cloud > infrastructure? > > >> > > > >> > if that's true, how do i get its artifacts into the release? is the > idea I > > >> > just upload a whole new binary .tar.gz file with a suffix to make > clear its > > >> > arm, while the rest of release (source, maven artifacts etc) comes > from the > > >> > main one? > > >> > > > >> > On Thu, 16 Jun 2022 at 09:56, Ayush Saxena <ayush...@gmail.com> > wrote: > > >> > > > >> >> Same question here: > > >> >> > > >> >> https://lists.apache.org/thread/rjn4zhdc30zrorsyr8jcsovmbl5hq6ol > > >> >> > > >> >> -Ayush > > >> >> > > >> >> Sent from my iPhone > > >> >> > > >> >> > On 16-Jun-2022, at 10:11 AM, Cheng Pan <pan3...@gmail.com> > wrote: > > >> >> > > > >> >> > Hi community, > > >> >> > > > >> >> > I'm using Hadoop 3.3.1 to build cross-platform Docker images, > and when > > >> >> > I'm trying to upgrade to 3.3.2 or 3.3.3, I found there is no > aarch64 > > >> >> > tgz like 3.3.1[1]. Where can I get them? > > >> >> > > > >> >> > [1] > > >> >> > https://dlcdn.apache.org/hadoop/core/hadoop-3.3.1/hadoop-3.3.1-aarch64.tar.gz > > >> >> > > > >> >> > Thanks, > > >> >> > Cheng Pan > > >> >> > > > >> >> > > --------------------------------------------------------------------- > > >> >> > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > > >> >> > For additional commands, e-mail: > common-dev-h...@hadoop.apache.org > > >> >> > > > >> >> > > >> > > > --------------------------------------------------------------------- > To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org > For additional commands, e-mail: common-dev-h...@hadoop.apache.org > >