Apache Hadoop qbt Report: branch-2.10+JDK7 on Linux/x86_64

2025-05-28 Thread Apache Jenkins Server 
For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/

No changes




-1 overall


The following subsystems voted -1:
asflicense hadolint mvnsite pathlen unit


The following subsystems voted -1 but
were configured to be filtered/ignored:
cc checkstyle javac javadoc pylint shellcheck whitespace


The following subsystems are considered long running:
(runtime bigger than 1h  0m  0s)
unit


Specific tests:

Failed junit tests :

   hadoop.ipc.TestIPC 
   hadoop.fs.TestFileUtil 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.hdfs.TestLeaseRecovery2 
   
hadoop.hdfs.server.blockmanagement.TestReplicationPolicyWithUpgradeDomain 
   hadoop.hdfs.server.namenode.snapshot.TestSnapshotDeletion 
   hadoop.hdfs.TestFileLengthOnClusterRestart 
   hadoop.hdfs.server.namenode.ha.TestPipelinesFailover 
   hadoop.hdfs.TestDFSInotifyEventInputStream 
   hadoop.hdfs.server.namenode.snapshot.TestSnapshotBlocksMap 
   hadoop.hdfs.qjournal.server.TestJournalNodeRespectsBindHostKeys 
   hadoop.hdfs.TestMultipleNNPortQOP 
   hadoop.hdfs.server.federation.router.TestRouterQuota 
   hadoop.hdfs.server.federation.router.TestRouterNamenodeHeartbeat 
   hadoop.hdfs.server.federation.resolver.order.TestLocalResolver 
   hadoop.hdfs.server.federation.resolver.TestMultipleDestinationResolver 
   hadoop.contrib.bkjournal.TestBookKeeperHACheckpoints 
   hadoop.mapreduce.v2.app.TestRuntimeEstimators 
   hadoop.mapreduce.lib.input.TestLineRecordReader 
   hadoop.mapred.TestLineRecordReader 
   hadoop.mapreduce.jobhistory.TestHistoryViewerPrinter 
   hadoop.resourceestimator.service.TestResourceEstimatorService 
   hadoop.resourceestimator.solver.impl.TestLpSolver 
   hadoop.yarn.sls.TestSLSRunner 
   
hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestNumaResourceAllocator
 
   
hadoop.yarn.server.nodemanager.containermanager.linux.resources.TestNumaResourceHandlerImpl
 
   hadoop.yarn.server.resourcemanager.TestClientRMService 
   hadoop.yarn.server.resourcemanager.recovery.TestFSRMStateStore 
   
hadoop.yarn.server.resourcemanager.monitor.invariants.TestMetricsInvariantChecker
 
  

   cc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/diff-compile-cc-root.txt
  [4.0K]

   javac:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/diff-compile-javac-root.txt
  [488K]

   checkstyle:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/diff-checkstyle-root.txt
  [14M]

   hadolint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/diff-patch-hadolint.txt
  [4.0K]

   mvnsite:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/patch-mvnsite-root.txt
  [588K]

   pathlen:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/pathlen.txt
  [12K]

   pylint:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/diff-patch-pylint.txt
  [20K]

   shellcheck:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/diff-patch-shellcheck.txt
  [72K]

   whitespace:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/whitespace-eol.txt
  [12M]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/whitespace-tabs.txt
  [1.3M]

   javadoc:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/patch-javadoc-root.txt
  [36K]

   unit:

   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/patch-unit-hadoop-common-project_hadoop-common.txt
  [224K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
  [460K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs-rbf.txt
  [36K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs_src_contrib_bkjournal.txt
  [16K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-app.txt
  [44K]
   
https://ci-hadoop.apache.org/job/hadoop-qbt-branch-2.10-java7-linux-x86_64/1770/artifact/out/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-core.txt
  [104K]
   
https://ci-hadoop.a

[VOTE] Release Apache Hadoop 3.4.2

2025-05-28 Thread Ahmar Suhail 
Hey all,

The first release candidate for Hadoop 3.4.2 is now available for voting.

There are a couple of things to note:

1/ No Arm64 artifacts. This is due to previously reported issues:
https://issues.apache.org/jira/projects/YARN/issues/YARN-11712 and
ttps://issues.apache.org/jira/projects/YARN/issues/YARN-11713
, which
mean that the build fails on arm64.

2/ Relevant for anyone testing S3A: We've removed the AWS SDK bundle
from hadoop-3.4.2.tar.gz. This is because the SDK bundle is now ~600MB,
which makes the size of tar > 1GB, and it can no longer be uploaded to SVN.
For S3A, download SDK bundle v2.29.52 from:
https://mvnrepository.com/artifact/software.amazon.awssdk/bundle/2.29.52,
and drop it into /share/hadoop/common/lib. Release notes will be updated
with these instructions.


The RC is available at:

https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.2-RC1/

The git tag is release-3.4.2-RC1, commit
09870840ec35b48cd107972eb24d25e8aece04c9

The maven artifacts are staged at:

https://repository.apache.org/content/repositories/orgapachehadoop-1437


You can find my public key (02085AFB652F796A3B01D11FD737A6F52281FA98) at:

https://dist.apache.org/repos/dist/release/hadoop/common/KEYS


This release has been created off of branch-3.4. Key changes include:

* S3A: Integration with S3 Analytics Accelerator input stream
* S3A: Support for S3 conditional writes
* ABFS: Deprecation of WASB driver
* ABFS: Support for Non-Heirarchical Namespace Accounts on ABFS Driver


This is my first attempt at managing a release, please do test the release
and let me know in case of any issues.

Thanks,
Ahmar

Apache Hadoop qbt Report: trunk+JDK8 on Linux/x86_64

2025-05-28 Thread Apache Jenkins Server 
For more details, see 
https://ci-hadoop.apache.org/job/hadoop-qbt-trunk-java8-linux-x86_64/1955/

[May 27, 2025, 11:02:35 AM] (github) HDFS-17788. [ARR] getFileInfo not handle 
exception rightly which may cause FileNotFoundException in 
DistributedFileSystem. (#7703). Contributed by hfutatzhanghb.

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

Re: [VOTE] Release Apache Hadoop 3.4.2

2025-05-28 Thread Xiaoqiao He 
Thanks Ahmar for your work. Will try to verify and give feedback here.

Best Regards,
- He Xiaoqiao

On Wed, May 28, 2025 at 8:56 PM Ahmar Suhail  wrote:
>
> Hey all,
>
> The first release candidate for Hadoop 3.4.2 is now available for voting.
>
> There are a couple of things to note:
>
> 1/ No Arm64 artifacts. This is due to previously reported issues:
> https://issues.apache.org/jira/projects/YARN/issues/YARN-11712 and
> ttps://issues.apache.org/jira/projects/YARN/issues/YARN-11713
> , which
> mean that the build fails on arm64.
>
> 2/ Relevant for anyone testing S3A: We've removed the AWS SDK bundle
> from hadoop-3.4.2.tar.gz. This is because the SDK bundle is now ~600MB,
> which makes the size of tar > 1GB, and it can no longer be uploaded to SVN.
> For S3A, download SDK bundle v2.29.52 from:
> https://mvnrepository.com/artifact/software.amazon.awssdk/bundle/2.29.52,
> and drop it into /share/hadoop/common/lib. Release notes will be updated
> with these instructions.
>
>
> The RC is available at:
>
> https://dist.apache.org/repos/dist/dev/hadoop/hadoop-3.4.2-RC1/
>
> The git tag is release-3.4.2-RC1, commit
> 09870840ec35b48cd107972eb24d25e8aece04c9
>
> The maven artifacts are staged at:
>
> https://repository.apache.org/content/repositories/orgapachehadoop-1437
>
>
> You can find my public key (02085AFB652F796A3B01D11FD737A6F52281FA98) at:
>
> https://dist.apache.org/repos/dist/release/hadoop/common/KEYS
>
>
> This release has been created off of branch-3.4. Key changes include:
>
> * S3A: Integration with S3 Analytics Accelerator input stream
> * S3A: Support for S3 conditional writes
> * ABFS: Deprecation of WASB driver
> * ABFS: Support for Non-Heirarchical Namespace Accounts on ABFS Driver
>
>
> This is my first attempt at managing a release, please do test the release
> and let me know in case of any issues.
>
> Thanks,
> Ahmar

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org

[jira] [Created] (HADOOP-19580) ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check should loop on listing using updated continuation token

2025-05-28 Thread Anuj Modi (Jira) 
Anuj Modi created HADOOP-19580:
--

 Summary: ABFS: [FnsOverBlob][BugFix] IsNonEmptyDirectory Check 
should loop on listing using updated continuation token
 Key: HADOOP-19580
 URL: https://issues.apache.org/jira/browse/HADOOP-19580
 Project: Hadoop Common
  Issue Type: Sub-task
  Components: fs/azure
Affects Versions: 3.5.0, 3.4.2, 3.4.3
Reporter: Anuj Modi
Assignee: Anuj Modi


As part of recent change, loop over listing was added when checking if a 
directory is empty or not.
Continuation token was not getting updated in subsequent listblob calls leading 
to infinite loop of list calls.

Caused by: https://issues.apache.org/jira/browse/HADOOP-19572



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

-
To unsubscribe, e-mail: common-dev-unsubscr...@hadoop.apache.org
For additional commands, e-mail: common-dev-h...@hadoop.apache.org