[jira] [Resolved] (HADOOP-19416) Upgrade JUnit from 4 to 5 in hadoop-kms.

[ https://issues.apache.org/jira/browse/HADOOP-19416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19416. -- Fix Version/s: 3.5.0 Resolution: Fixed > Upgrade JUnit from 4 to 5 in had

Re: HADOOP-19343 feature branch: GCS FileSystem

Chris, I'm curious is having a GCS fs implementation in the main Hadoop repo the right choice? As mentioned by Steve, Hadoop release cadence tends to be slow. There's a lot of legacy code so release work is usually a multi month effort. Have you considered having it in a separate repo? On Mon, Apr

Deleting unused 'master' branch

1. INFRA-26751 I realized the master branch appeared again. Opened an INFRA jira to assist in removing it.

[jira] [Resolved] (HADOOP-19440) Upgrade JUnit from 4 to 5 in hadoop-sls.

[ https://issues.apache.org/jira/browse/HADOOP-19440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19440. -- Fix Version/s: 3.5.0 Resolution: Fixed > Upgrade JUnit from 4 to 5 in had

[jira] [Resolved] (HADOOP-19437) Upgrade JUnit from 4 to 5 in hadoop-kafka.

[ https://issues.apache.org/jira/browse/HADOOP-19437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19437. -- Fix Version/s: 3.5.0 Resolution: Fixed > Upgrade JUnit from 4 to 5 in had

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

I am +1 too. * Verified signature. * Release notes and changelogs look good. On Fri, Mar 21, 2025 at 4:35 PM Chris Nauroth wrote: > +1 > > * Verified signatures. > * LICENSE-binary has the expected dependencies and versions. > * Site looks good too. > * Specifically confirmed inclusion of HADOO

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

> update or you need to refresh your keys. I will have a look at the keys > file tomorrow > > On Fri, 14 Mar 2025 at 21:46, Wei-Chiu Chuang wrote: > > > Looks like your GPG key expired? > > > > gpg: Signature made Fri Mar 14 08:56:00 2025 PDT > > gpg:

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Verified SHA-512 checksum, GPG signature -- all good except that the signing key expired. Confirmed git tag release-1.4.0-RC0 and branch name branch-1.4.0 both maps to commit hash 5595f1357eaad02e1cfb660bcce7fd34515197ff. Confirmed it is released as 1.4.0. Noticed HADOOP-19075

Re: [VOTE] Release Apache Hadoop Thirdparty 1.4.0

Looks like your GPG key expired? gpg: Signature made Fri Mar 14 08:56:00 2025 PDT gpg:using RSA key 38237EE425050285077DB57AD22CF846DBB162A0 gpg: Good signature from "Steve Loughran (ASF code sign key - 2018) < ste...@apache.org>" [expired] gpg: aka "[jpeg image of

Fwd: [DISCUSS] Plans for JDK22 / SecurityManager removal

FYI I think Hadoop will need to make similar moves too. Sounds like Hadoop should start the work to drop JDK8 as well. I know Steve has a patch that requires JDK17+ due to Iceberg https://github.com/apache/hadoop/pull/7316 -- Forwarded message - From: Istvan Toth Date: Sun, Mar 2,

Re: Apache Hadoop 3.4.1 docs landing page

I always forget to update the doc myself. Noted. Thank you Ayush. On Mon, Jan 27, 2025 at 10:35 AM Ayush Saxena wrote: > Hi Chris, > This page requires a manual update before the release. an update was made > for the 3.4.1 release in this commit [1], Not sure why the older links > weren't remove

[jira] [Resolved] (HADOOP-19367) Fix setting final field value on Java 17

[ https://issues.apache.org/jira/browse/HADOOP-19367?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19367. -- Resolution: Fixed > Fix setting final field value on Java

[jira] [Resolved] (HADOOP-19306) Support user defined auth Callback in SaslRpcServer

[ https://issues.apache.org/jira/browse/HADOOP-19306?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19306. -- Fix Version/s: 3.5.0 Resolution: Fixed > Support user defined auth Callb

Re: [VOTE] Release Apache Hadoop 3.4.1 RC3

+1 (binding) Ozone 2.0 test result https://github.com/jojochuang/ozone/actions/runs/11388335221 Only one issue which is protobuf update. That is known and I will be fixing that in the coming days. HBase master branch (3.0) test result https://github.com/apache/hbase/pull/6331 The one test failure

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

369#step:5:1148> at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) 1148 <https://github.com/jojochuang/ozone/actions/runs/11169844919/job/31094862369#step:5:1149> at java.base/java.lang.Thread.run(Thread.java:829) On Tue, Oct 1, 2024 at 12:53 P

[jira] [Created] (HADOOP-19302) Update rat version in the docker build.sh script

Wei-Chiu Chuang created HADOOP-19302: Summary: Update rat version in the docker build.sh script Key: HADOOP-19302 URL: https://issues.apache.org/jira/browse/HADOOP-19302 Project: Hadoop Common

Re: Re: Re [DISCUSS] Hadoop 3.3.7?

I'm not ready to do a 3.3.7 myself right now. Trying to get Ozone 2.0.0 out of the door. The soonest I can start on the 3.3.7 is probably November. Just like to get a feeling from the community whether there is enough push for another 3.3.x, or we should all just move to 3.4. On Wed, Oct 2, 2024 a

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

it.parser.AuditParser.main(AuditParser.java:54)\nlog4j:ERROR Could not instantiate appender named "EventCounter".\n1\t\n' On Wed, Oct 2, 2024 at 12:06 PM Steve Loughran wrote: > you using the hadoop thirdparty jar? there is a 1.3.0 release out > > On Wed, 2 Oct 2024

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

doop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:250) ... 82 more On Wed, Oct 2, 2024 at 7:51 AM Steve Loughran wrote: > > Please do! > > On Tue, 1 Oct 2024 at 20:54, Wei-Chiu Chuang wrote: > >> Hi I'm late to the party, but I'd like to build and test th

Re: [DISCUSS] Hadoop 3.3.7?

ect%20in%20(HADOOP%2C%20HDFS%2C%20MAPREDUCE%2C%20YARN)%20and%20fixVersion%20%3D%203.3.7 (3.3.7 and 3.3.9 should be merged together) so that's nearly 100 issues fixed. A release in the 3.3 line can help downstream applications update transitive dependencies. On Tue, Oct 1, 2024 at 1:49 PM

[DISCUSS] Hadoop 3.3.7?

Hi I'm just wondering if there has been a discussion for the 3.3.7 release? 3.3.6 was released last June. And CVE-2024-23454 isn't backported to the 3.3 release line. Best Regards, Weichiu

Re: [VOTE] Release Apache Hadoop 3.4.1 RC2

Hi I'm late to the party, but I'd like to build and test this release with Ozone and HBase. On Tue, Oct 1, 2024 at 2:12 AM Mukund Madhav Thakur wrote: > Thanks @Dongjoon Hyun for trying out the RC and > finding out this bug. This has to be fixed. > It would be great if others can give the RC a

[jira] [Resolved] (HADOOP-19261) Support force close a DomainSocket for server service

[ https://issues.apache.org/jira/browse/HADOOP-19261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19261. -- Fix Version/s: 3.5.0 Resolution: Fixed > Support force close a DomainSoc

Fwd: need help one champion who is interested to bring Solidigm CSAL cloud storage acceleration Layer into Apache Open Source SW family

Would the Hadoop cloud connector developers feel interested? -- Forwarded message - From: Wayne Gao Date: Tue, Jul 30, 2024 at 7:24 PM Subject: need help one champion who is interested to bring Solidigm CSAL cloud storage acceleration Layer into Apache Open Source SW family To: ge

[jira] [Resolved] (HADOOP-19170) Fixes compilation issues on Mac

[ https://issues.apache.org/jira/browse/HADOOP-19170?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19170. -- Fix Version/s: 3.5.0 Resolution: Fixed > Fixes compilation issues on

[jira] [Resolved] (HADOOP-17647) Release Hadoop 3.3.1

[ https://issues.apache.org/jira/browse/HADOOP-17647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-17647. -- Assignee: Wei-Chiu Chuang Resolution: Done The release was published on June

[jira] [Resolved] (HADOOP-19035) CrcUtil/CrcComposer should not throw IOException for non-IO

[ https://issues.apache.org/jira/browse/HADOOP-19035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-19035. -- Fix Version/s: 3.5.0 Resolution: Fixed > CrcUtil/CrcComposer should not th

[jira] [Resolved] (HADOOP-18956) Zookeeper SSL/TLS support in ZKDelegationTokenSecretManager and ZKSignerSecretProvider

[ https://issues.apache.org/jira/browse/HADOOP-18956?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18956. -- Fix Version/s: 3.4.0 Resolution: Fixed > Zookeeper SSL/TLS support

Re: Checksum file for 3.3.6 release slightly wrong

Hi that's a good catch The RC1 was used for official release, and instead of using the build script to create an entirely new release tarball I simply updated the file names. Probably shouldn't do so. On Fri, Oct 6, 2023 at 6:00 AM Lars Francke wrote: > Hi, > > the checksum file for the 3.3.6 re

[jira] [Created] (HADOOP-18843) Guava version 32.0.1 bump to fix CVE-2023-2976 (hadoop-thirdparty PR#23)

Wei-Chiu Chuang created HADOOP-18843: Summary: Guava version 32.0.1 bump to fix CVE-2023-2976 (hadoop-thirdparty PR#23) Key: HADOOP-18843 URL: https://issues.apache.org/jira/browse/HADOOP-18843

HADOOP-18207 hadoop-logging module about to land

Hi, I am preparing to resolve HADOOP-18207 ( https://github.com/apache/hadoop/pull/5717). This change affects all modules. With this change, it will eliminate almost all the direct log4j usage. As always, landing such a big piece is tricky. I

Re: [DISCUSS][HDFS] Add rust binding for libhdfs

Inline On Sat, Jul 15, 2023 at 5:04 AM Ayush Saxena wrote: > Forwarding from dev@hadoop to relevant ML > > Original mail: > https://lists.apache.org/thread/r5rcmc7lwwvkysj0320myxltsyokp9kq > > -Ayush > > On 2023/07/15 09:18:42 Xuanwo wrote: > > Hello, everyone. > > > > I'm the maintainer of [hdf

[jira] [Resolved] (HADOOP-18766) 3.3.6 Dependency vulnerability check

[ https://issues.apache.org/jira/browse/HADOOP-18766?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18766. -- Fix Version/s: 3.3.6 Resolution: Done > 3.3.6 Dependency vulnerability ch

[jira] [Resolved] (HADOOP-18765) Release 3.3.6

[ https://issues.apache.org/jira/browse/HADOOP-18765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18765. -- Fix Version/s: 3.3.6 Resolution: Done > Release 3.

[ANNOUNCE] Apache Hadoop 3.3.6 release

On behalf of the Apache Hadoop Project Management Committee, I am pleased to announce the release of Apache Hadoop 3.3.6. It contains 117 bug fixes, improvements and enhancements since 3.3.5. Users of Apache Hadoop 3.3.5 and earlier should upgrade to this release. https://hadoop.apache.org/releas

[jira] [Resolved] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

[ https://issues.apache.org/jira/browse/HADOOP-18769?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18769. -- Fix Version/s: 3.3.6 Resolution: Fixed > Upgrade hadoop3 docker scripts

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

> -Ayush > > > [1] https://github.com/ayushtkn/hadoop-ozone/actions/runs/5282707769 > [2] https://github.com/apache/tez/pull/285#issuecomment-1590962978 > > On Sat, 24 Jun 2023 at 09:43, Nilotpal Nandi > wrote: > >> +1 (Non-binding). >> Thanks a lot Wei-Chiu

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

Launched a pseudo distributed cluster using released binary packages, > > done some HDFS dir/file basic opeations. > > + Run grep, pi and wordcount MR tasks on the pseudo cluster. > > > > Bests, > > Sammi Chen > > > > 发件人:

Clean up old Hadoop release tarballs

https://dist.apache.org/repos/dist/release/hadoop/common/ has Hadoop release tarballs 3.3.1 ~ 3.3.5. I plan to remove the tarballs from 3.3.1 to 3.3.4 and leave only 3.3.5 (and the upcoming 3.3.6). Shout out if you have something depending on the old release tarballs (you shouldn't) Other release

DockerHub admin for Apache Hadoop

Ayush and I have acquired the DockerHub admin privilege for the Hadoop project in order to facilitate the release of Hadoop 3.3.6. Apache Infra allows only two seats per project. So if you need something, let Ayush and I know and we will make it happen for you. If you are a Docker guru and can't h

[jira] [Resolved] (HADOOP-18780) Add tags 3.3/3.3.5 to the official Hadoop docker image

[ https://issues.apache.org/jira/browse/HADOOP-18780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18780. -- Resolution: Fixed > Add tags 3.3/3.3.5 to the official Hadoop docker im

[jira] [Created] (HADOOP-18780) Add tag 3.3/3.3.5 for the official Hadoop docker image

Wei-Chiu Chuang created HADOOP-18780: Summary: Add tag 3.3/3.3.5 for the official Hadoop docker image Key: HADOOP-18780 URL: https://issues.apache.org/jira/browse/HADOOP-18780 Project: Hadoop

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

gt; > + built from the source tarball on Rocky Linux 8 (x86_64) and OpenJDK > 8 > >> > with native profile enabled. > >> >+ launched pseudo distributed cluster including kms and httpfs with > >> > Kerberos and SSL enabled. > >> >+ created

Re: [VOTE] Release Apache Hadoop 3.3.6 RC1

Bumping this thread to the top. If you are verifying the release, please vote on this thread. RC0 and RC1 are exactly the same. The only material difference is the Changelog. Thanks!! On Sun, Jun 18, 2023 at 5:52 PM Wei-Chiu Chuang wrote: > I am inviting anyone to try and vote on this rele

[VOTE] Release Apache Hadoop 3.3.6 RC1

I am inviting anyone to try and vote on this release candidate. Note: This is exactly the same as RC0, except the CHANGELOG. The RC is available at: https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-amd64/ (for amd64) https://home.apache.org/~weichiu/hadoop-3.3.6-RC1-arm64/ (for arm64) Git tag:

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

lease. The next RC will be prepared, > right? > If true, I would like to try and vote on the next RC. > Just notice that some JIRAs are not included and need to revert some PRs to > pass HBase verification which are mentioned above. > > Best Regards, > - He Xiaoqiao > &

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

ey for gs://fake-in-memory-test-b ucket/contract-test/testOpenFileApplyAsyncRead "fs.option.openfile.length" On Wed, Jun 14, 2023 at 5:01 PM Wei-Chiu Chuang wrote: > The hbase-filesystem tests passed after reverting HADOOP-18596 > <https://issues.apache.org/jira/b

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

It's branching off branch-3.3 On Thu, Jun 15, 2023 at 3:18 AM Steve Loughran wrote: > Which branch is -3.3.6 off? 3.3.5 or 3.3? > > I'm travelling for the next few days and unlikely to be able to test this; > will do my best > > On Wed, 14 Jun 2023 at 07:27, Wei-Ch

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

7;s not the end of the world. I think we can address it by adding an incompatible change flag and a release note. On Wed, Jun 14, 2023 at 3:55 PM Wei-Chiu Chuang wrote: > Cross referenced git history and jira. Changelog needs some update > > Not in the release > >1. HDFS-16858 &

Re: [VOTE] Release Apache Hadoop 3.3.6 RC0

59->AbstractContractDistCpTest.distCpUpdateDeepDirectoryStructure:334->AbstractContractDistCpTest.assertCounterInRange:294->Assert.assertTrue:41->Assert.fail:88 Files Copied value 2 above maximum 1 [INFO] [ERROR] Tests run: 240, Failures: 3, Errors: 0, Skipped: 58 Ozone test in progress. Wil

[VOTE] Release Apache Hadoop 3.3.6 RC0

I am inviting anyone to try and vote on this release candidate. Note: This is built off branch-3.3.6 plus PR#5741 (aws sdk update) and PR#5740 (LICENSE file update) The RC is available at: https://home.apache.org/~weichiu/hadoop-3.3.6-RC0-amd64/ (for amd64) https://home.apache.org/~weichiu/hadoop

Re: [DISCUSS] Hadoop 3.3.6 release planning

ace. While setSafeMode() is exposed through SafeMode interface. On Thu, Jun 8, 2023 at 11:11 AM Wei-Chiu Chuang wrote: > Thanks for comments > > Looking at jiras fixed in 3.3.6 and 3.3.9 (my bad, forgot that most > commits landing in branch-3.3 was 3.3.9), most are okay. We have about

[jira] [Resolved] (HADOOP-18761) Remove mysql-connector-java

[ https://issues.apache.org/jira/browse/HADOOP-18761?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18761. -- Fix Version/s: 3.4.0 3.3.6 Resolution: Fixed > Rem

[jira] [Resolved] (HADOOP-18459) scan detected CVE-2021-37136 and CVE-2021-37137 in netty.io_netty_codec

[ https://issues.apache.org/jira/browse/HADOOP-18459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18459. -- Resolution: Won't Fix snakeyaml is updated in 3.3.x. netty3 is removed in

[jira] [Resolved] (HADOOP-18123) Netty version 3.10.6 to be upgraded to handle CVE-2021-43797

[ https://issues.apache.org/jira/browse/HADOOP-18123?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18123. -- Resolution: Duplicate Netty3 is removed in Hadoop 3.4 in trunk. Resolve as a

[jira] [Resolved] (HADOOP-13413) Update ZooKeeper version to 3.4.9

[ https://issues.apache.org/jira/browse/HADOOP-13413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-13413. -- Resolution: Won't Fix Stale jira; clean up. > Update ZooKeeper version

Fwd: [jira] [Created] (HADOOP-18768) Integrating Apache Hadoop into OSS-Fuzz

Are there Hadoop committers who would like to help triage bug reports from OSS-Fuzz? -- Forwarded message - From: Henry Lin (Jira) Date: Mon, Jun 12, 2023 at 9:10 AM Subject: [jira] [Created] (HADOOP-18768) Integrating Apache Hadoop into OSS-Fuzz To: Henry Lin created HADOOP-18

[jira] [Created] (HADOOP-18769) Upgrade hadoop3 docker scripts to use 3.3.6

Wei-Chiu Chuang created HADOOP-18769: Summary: Upgrade hadoop3 docker scripts to use 3.3.6 Key: HADOOP-18769 URL: https://issues.apache.org/jira/browse/HADOOP-18769 Project: Hadoop Common

[jira] [Created] (HADOOP-18766) 3.3.6 Dependency vulnerability check

Wei-Chiu Chuang created HADOOP-18766: Summary: 3.3.6 Dependency vulnerability check Key: HADOOP-18766 URL: https://issues.apache.org/jira/browse/HADOOP-18766 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18765) Release 3.3.6

Wei-Chiu Chuang created HADOOP-18765: Summary: Release 3.3.6 Key: HADOOP-18765 URL: https://issues.apache.org/jira/browse/HADOOP-18765 Project: Hadoop Common Issue Type: Task

Re: [DISCUSS] Mysql-connector-java is GPL licensed; Hadoop can't use it.

ginal jira. > > .. Owen > > > On Fri, Jun 9, 2023 at 1:58 AM Wei-Chiu Chuang > > wrote: > > > Hi community, > > > > While preparing for 3.3.6 RC, I realized the mysql-connector-java > > dependency added by HADOOP-18535 > > <https://issues.ap

[jira] [Created] (HADOOP-18761) Revert HADOOP-18535 because mysql-connector-java is GPL

Wei-Chiu Chuang created HADOOP-18761: Summary: Revert HADOOP-18535 because mysql-connector-java is GPL Key: HADOOP-18761 URL: https://issues.apache.org/jira/browse/HADOOP-18761 Project: Hadoop

[DISCUSS] Mysql-connector-java is GPL licensed; Hadoop can't use it.

Hi community, While preparing for 3.3.6 RC, I realized the mysql-connector-java dependency added by HADOOP-18535 is GPL licensed. Source: https://github.com/mysql/mysql-connector-j/blob/release/8.0/LICENSE See legal discussion at Apache LEGAL-

[jira] [Created] (HADOOP-18760) 3.3.6 Release NOTICE and LICENSE file update

Wei-Chiu Chuang created HADOOP-18760: Summary: 3.3.6 Release NOTICE and LICENSE file update Key: HADOOP-18760 URL: https://issues.apache.org/jira/browse/HADOOP-18760 Project: Hadoop Common

[jira] [Resolved] (HADOOP-11219) [Umbrella] Upgrade to netty 4

[ https://issues.apache.org/jira/browse/HADOOP-11219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-11219. -- Fix Version/s: 3.4.0 Resolution: Fixed This is done. Would be nice to

Re: [DISCUSS] Hadoop 3.3.6 release planning

iu for driving this release. > > > > Cherry-pick YARN-11482 to branch-3.3 and mark 3.3.6 as the fixed > version. > > > > > > > > so far only 8 jiras were resolved in the branch-3.3 line. > > > > > > > > > > > > If we should consider bo

Re: Call for Presentations, Community Over Code 2023

There's also a call for presentation for Community over Code Asia 2023 https://www.bagevent.com/event/cocasia-2023-EN Happening Aug 18-20. CfP due by 6/6 On Tue, May 9, 2023 at 8:39 PM Ayush Saxena wrote: > Forwarding from dev@hadoop to the dev ML which we use. > > The actual mail lies here: >

[jira] [Resolved] (HADOOP-18731) Backport HADOOP-18671 to branch-3.2

[ https://issues.apache.org/jira/browse/HADOOP-18731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18731. -- Resolution: Done > Backport HADOOP-18671 to branch-

[jira] [Resolved] (HADOOP-18730) Backport HADOOP-18671 to branch-3.3

[ https://issues.apache.org/jira/browse/HADOOP-18730?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18730. -- Resolution: Done > Backport HADOOP-18671 to branch-

Re: Hadoop docker

n hadoop slack channel: [1] > > -Ayush > > [1] > https://the-asf.slack.com/archives/CDSDT7A0H/p1683197830915329?thread_ts=1683191495.595649&channel=CDSDT7A0H&message_ts=1683197830.915329 > > On Fri, 5 May 2023 at 22:41, Wei-Chiu Chuang wrote: > > > > Hi &g

Hadoop docker

Hi I'm just curious about the official Hadoop docker images at DockerHub here: https://hub.docker.com/layers/apache/hadoop/3/images/sha256-1c33d429560ebc1b4fba1d61758ff5c73a2c9027572568769f56a68c4eaadbf6?context=explore Who is maintaining it? The release howto wiki does not mention the docker imag

[DISCUSS] Hadoop 3.3.6 release planning

Hi community, I'd like to kick off the discussion around Hadoop 3.3.6 release plan. I'm being selfish but my intent for 3.3.6 is to have the new APIs in HADOOP-18671 added so we can have HBase to adopt this new API. Other than that, perhaps thi

[jira] [Created] (HADOOP-18731) Backport HADOOP-18671 to branch-3.2

Wei-Chiu Chuang created HADOOP-18731: Summary: Backport HADOOP-18671 to branch-3.2 Key: HADOOP-18731 URL: https://issues.apache.org/jira/browse/HADOOP-18731 Project: Hadoop Common Issue

[jira] [Created] (HADOOP-18730) Backport HADOOP-18671 to branch-3.3

Wei-Chiu Chuang created HADOOP-18730: Summary: Backport HADOOP-18671 to branch-3.3 Key: HADOOP-18730 URL: https://issues.apache.org/jira/browse/HADOOP-18730 Project: Hadoop Common Issue

[jira] [Resolved] (HADOOP-18702) Remove ozone mailing lists from Hadoop website

[ https://issues.apache.org/jira/browse/HADOOP-18702?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18702. -- Resolution: Fixed > Remove ozone mailing lists from Hadoop webs

[jira] [Created] (HADOOP-18702) Remove ozone mailing list from Hadoop website

Wei-Chiu Chuang created HADOOP-18702: Summary: Remove ozone mailing list from Hadoop website Key: HADOOP-18702 URL: https://issues.apache.org/jira/browse/HADOOP-18702 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18548) Hadoop Archive tool (HAR) should acquire delegation tokens from source and destination file systems

[ https://issues.apache.org/jira/browse/HADOOP-18548?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18548. -- Fix Version/s: 3.4.0 Resolution: Fixed Thanks [~sgal] for the PR and

Re: [DISCUSS] hadoop branch-3.3+ going to java11 only

My random thoughts. Probably bad takes: There are projects experimenting with JDK17 now. JDK11 active support will end in 6 months. If it's already hard to migrate from JDK8 why not retarget JDK17. On Tue, Mar 28, 2023 at 10:30 AM Ayush Saxena wrote: > I know Jersey upgrade as a blocker. Some f

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

I think moving up interfaces to FileSystem or some abstract FileSystem class has a few benefits: 1. Application can potentially be made FS-agnostic, with hasPathCapabilities() check. At least, make the code to compile. 2. We will be able to add a contract test to ensure behavior is expected. The

[jira] [Resolved] (HADOOP-18668) Path capability probe for truncate is only honored by RawLocalFileSystem

[ https://issues.apache.org/jira/browse/HADOOP-18668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18668. -- Fix Version/s: 3.4.0 Resolution: Fixed > Path capability probe for trunc

[jira] [Created] (HADOOP-18671) Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem

Wei-Chiu Chuang created HADOOP-18671: Summary: Add recoverLease(), setSafeMode(), isFileClosed() APIs to FileSystem Key: HADOOP-18671 URL: https://issues.apache.org/jira/browse/HADOOP-18671

Re: [DISCUSS] Move HDFS specific APIs to FileSystem abstration

is. Yes, those of us who can build the > entire stack can do it, but that gradually adds more divergence from the > open source libraries, reduces the test coverage overall and only increases > maintenance costs over time. > > steve > > On Thu, 16 Mar 2023 at 20:56, Wei-Chiu

[DISCUSS] Move HDFS specific APIs to FileSystem abstration

Hi, Stephen and I are working on a project to make HBase to run on Ozone. HBase, born out of the Hadoop project, depends on a number of HDFS specific APIs, including recoverLease() and isInSafeMode(). The HBase community [1] strongly voiced that they don't want the project to have direct dependen

[jira] [Resolved] (HADOOP-18648) Avoid loading kms log4j properties dynamically by KMSWebServer

[ https://issues.apache.org/jira/browse/HADOOP-18648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18648. -- Fix Version/s: 3.4.0 Resolution: Fixed > Avoid loading kms log4j propert

[jira] [Resolved] (HADOOP-18631) Migrate Async appenders to log4j properties

[ https://issues.apache.org/jira/browse/HADOOP-18631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18631. -- Fix Version/s: 3.4.0 Resolution: Fixed > Migrate Async appenders to lo

[jira] [Resolved] (HADOOP-18206) Cleanup the commons-logging references in the code base

[ https://issues.apache.org/jira/browse/HADOOP-18206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18206. -- Fix Version/s: 3.4.0 Resolution: Fixed > Cleanup the commons-logg

[jira] [Resolved] (HADOOP-18620) Avoid using grizzly-http-* APIs

[ https://issues.apache.org/jira/browse/HADOOP-18620?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18620. -- Fix Version/s: 3.4.0 Resolution: Fixed > Avoid using grizzly-http-* A

[jira] [Resolved] (HADOOP-18584) [NFS GW] Fix regression after netty4 migration

[ https://issues.apache.org/jira/browse/HADOOP-18584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18584. -- Fix Version/s: 3.4.0 Resolution: Fixed > [NFS GW] Fix regression after net

[jira] [Resolved] (HADOOP-16876) KMS delegation tokens are memory expensive

[ https://issues.apache.org/jira/browse/HADOOP-16876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-16876. -- Resolution: Cannot Reproduce > KMS delegation tokens are memory expens

[jira] [Created] (HADOOP-18584) [NFS GW] IdleStateHandler is not Shareable

Wei-Chiu Chuang created HADOOP-18584: Summary: [NFS GW] IdleStateHandler is not Shareable Key: HADOOP-18584 URL: https://issues.apache.org/jira/browse/HADOOP-18584 Project: Hadoop Common

[jira] [Created] (HADOOP-18548) Hadoop Archive tool (HAR) should acquire delegation tokens from source and destination file systems

Wei-Chiu Chuang created HADOOP-18548: Summary: Hadoop Archive tool (HAR) should acquire delegation tokens from source and destination file systems Key: HADOOP-18548 URL: https://issues.apache.org/jira/browse

Re: Code coverage report on github PRs

I believe most of them can be added by us using GitHub Workflow. There's a marketplace for these tools and most of them are free for open source projects. On Wed, Nov 23, 2022 at 11:43 AM Ayush Saxena wrote: > A simple Infra ticket I suppose should get it done for us, eg. > https://issues.apache

Re: way forward for Winutils excision from `FileSystem`

> > > > * Bare Naked Local File System v0.1.0 doesn't (yet) support symlinks > or the sticky bit. > ok to not support symlinks. The symlinks of HDFS are not being maintained and I am not aware of anything relying on it. So I assume people don't need it. Sticky bit would be useful, I guess.

[jira] [Resolved] (HADOOP-18489) Cherrypick HADOOP-11245 to branch-3.2

[ https://issues.apache.org/jira/browse/HADOOP-18489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18489. -- Fix Version/s: 3.2.5 Resolution: Fixed > Cherrypick HADOOP-11245 to bra

[jira] [Created] (HADOOP-18489) Cherrypick HADOOP-11245 to branch-3.2

Wei-Chiu Chuang created HADOOP-18489: Summary: Cherrypick HADOOP-11245 to branch-3.2 Key: HADOOP-18489 URL: https://issues.apache.org/jira/browse/HADOOP-18489 Project: Hadoop Common

[jira] [Resolved] (HADOOP-18488) Cherrypick HADOOP-11245 to branch-3.3

[ https://issues.apache.org/jira/browse/HADOOP-18488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang resolved HADOOP-18488. -- Fix Version/s: 3.3.9 Resolution: Fixed > Cherrypick HADOOP-11245 to bra

[jira] [Created] (HADOOP-18488) Cherrypick HADOOP-11245 to branch-3.3

Wei-Chiu Chuang created HADOOP-18488: Summary: Cherrypick HADOOP-11245 to branch-3.3 Key: HADOOP-18488 URL: https://issues.apache.org/jira/browse/HADOOP-18488 Project: Hadoop Common

[DISCUSS] Supporting partial file rewrite/compose

There were a number of discussions that happened during ApacheCon. In the spirit of the Apache Way, I am taking the conversation online, sharing with the larger community and also capturing requirements. Credits to Owen who started this discussion. There are a number of scenarios where users want

[DISCUSS] Hadoop 3.3.5 release planning

Bumping this up. Adding the [DISCUSS] text to make this message stand out of your inbox. I certainly missed this message and only realized 3.3.5 has more than just security updates. What was the issue with the ARM64 build? I was able to publish ARM64 build for 3.3.1 release without problems. On

Re: Hadoop BoF at ApacheCon NA'22

t; On Sat, Sep 24, 2022 at 8:52 PM 俊平堵 wrote: > > > > > Yes. It should be a short talk and I can only present remotely for this > > > time. That would be great if you help to coordinate. :) > > > > > > Thanks, > > > > > > Junping &g

  1   2   3   4   5   6   7   8   >