Re: [PR] HADOOP-18717. Move CodecPool logs to DEBUG scope [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6445: URL: https://github.com/apache/hadoop/pull/6445#issuecomment-3363698055 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19036. Standardize Maven Initialization Across Operating Systems. [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6444: URL: https://github.com/apache/hadoop/pull/6444#issuecomment-3363698133 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19043. S3A: Regression: ITestS3AOpenCost fails on prefetch test runs [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6460: URL: https://github.com/apache/hadoop/pull/6460#issuecomment-3363698023 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19048. ITestCustomSigner failures [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6471: URL: https://github.com/apache/hadoop/pull/6471#issuecomment-3363697929 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] TEST [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6477: URL: https://github.com/apache/hadoop/pull/6477#issuecomment-3363697897 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

[PR] HDFS-17844. Fix the incorrect collision detection logic that causes nondeterministic behavior of testViewFsMultipleExportPoint() [hadoop]

2025-10-02 Thread via GitHub
Wang-Benjamin opened a new pull request, #8009: URL: https://github.com/apache/hadoop/pull/8009 ## Problem There could be a race condition in generating namenode ID. What is problematic is that different URIs resolve to the same namenode ID, which leads to data integrity issues and secur

Re: [PR] [HDFS-16064] backporting HDFS-16064. Determine when to invalidate corrupt replicas based on number of usable replicas (#4410) [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6437: URL: https://github.com/apache/hadoop/pull/6437#issuecomment-3363698188 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] MAPREDUCE-7470: multi-thread mapreduce committer [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6469: URL: https://github.com/apache/hadoop/pull/6469#issuecomment-3363697965 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] YARN-11649. [Federation] Create Override for Maximum Resource Capability in getNewApplication [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6481: URL: https://github.com/apache/hadoop/pull/6481#issuecomment-3363697801 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6530: HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command URL: https://github.com/apache/hadoop/pull/6530 -- This is an automated message from the Apache Git Service

Re: [PR] MAPREDUCE-7472. Decode value of hive.query.string for the job Confguration which was encoded by hive [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6520: MAPREDUCE-7472. Decode value of hive.query.string for the job Confguration which was encoded by hive URL: https://github.com/apache/hadoop/pull/6520 -- This is an automated message from the Apache Git Service. To respond to the message, please lo

Re: [PR] HADOOP-19037. AWS SDK v2: ITestS3AConfiguration failing with region problems [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6486: HADOOP-19037. AWS SDK v2: ITestS3AConfiguration failing with region problems URL: https://github.com/apache/hadoop/pull/6486 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] HDFS-17360. Record the number of times a block is read during a certain time period. [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6505: HDFS-17360. Record the number of times a block is read during a certain time period. URL: https://github.com/apache/hadoop/pull/6505 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [PR] HDFS-17364. EC: Configurably use WeakReferencedElasticByteBufferPool in DFSStripedInputStream. [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6514: HDFS-17364. EC: Configurably use WeakReferencedElasticByteBufferPool in DFSStripedInputStream. URL: https://github.com/apache/hadoop/pull/6514 -- This is an automated message from the Apache Git Service. To respond to the message, please log on t

Re: [PR] YARN-11654. [JDK17] TestLinuxContainerExecutorWithMocks.testStartLoca… [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6528: YARN-11654. [JDK17] TestLinuxContainerExecutorWithMocks.testStartLoca… URL: https://github.com/apache/hadoop/pull/6528 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] HDFS-17374. EC: StripedBlockReader#newConnectedPeer should set SO_TIMEOUT and SO_KEEPALIVE [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6536: HDFS-17374. EC: StripedBlockReader#newConnectedPeer should set SO_TIMEOUT and SO_KEEPALIVE URL: https://github.com/apache/hadoop/pull/6536 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Gi

Re: [PR] HADOOP-19012. Use CRC tables to speed up galoisFieldMultiply in CrcUtil. [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6542: HADOOP-19012. Use CRC tables to speed up galoisFieldMultiply in CrcUtil. URL: https://github.com/apache/hadoop/pull/6542 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] HDFS-17382. Add Apache Log4j Extras Library to Hadoop 3.4 for Enhance… [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6584: HDFS-17382. Add Apache Log4j Extras Library to Hadoop 3.4 for Enhance… URL: https://github.com/apache/hadoop/pull/6584 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] HADOOP-19654. Upgrade AWS SDK to 2.32.23 [hadoop]

2025-10-02 Thread via GitHub
steveloughran commented on PR #7882: URL: https://github.com/apache/hadoop/pull/7882#issuecomment-3353451859 @ahmarsuhail is there a public sdk issue for this for me to link/track? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] HADOOP-19158. S3A: Support ByteBufferPositionedReadable through vector IO [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6773: HADOOP-19158. S3A: Support ByteBufferPositionedReadable through vector IO URL: https://github.com/apache/hadoop/pull/6773 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [hadoop]

2025-10-02 Thread via GitHub
steveloughran commented on PR #7966: URL: https://github.com/apache/hadoop/pull/7966#issuecomment-3362514141 @LDVSOFT the reason we use the big jar is just that historically it's been so brittle to things like the version of jackson, httpclient and more -so using the unshaded artifacts woul

Re: [PR] HDFS-17352. Add configuration to control whether DN delete this replica from disk when client requests a missing block [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] closed pull request #6559: HDFS-17352. Add configuration to control whether DN delete this replica from disk when client requests a missing block URL: https://github.com/apache/hadoop/pull/6559 -- This is an automated message from the Apache Git Service. To respond to the

Re: [PR] YARN-11863. [JDK17] Remove JUnit4 NoExitSecurityManager. [hadoop]

2025-10-02 Thread via GitHub
slfan1989 commented on PR #7986: URL: https://github.com/apache/hadoop/pull/7986#issuecomment-3322490312 > I observed a `SurefireBooterForkException` on Jenkins, with the error focused on `TestAppManager` (process exited with code 255, likely due to a forked JVM crash or a System.exit call)

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [branch 3.4] [hadoop]

2025-10-02 Thread via GitHub
hadoop-yetus commented on PR #8008: URL: https://github.com/apache/hadoop/pull/8008#issuecomment-3362606541 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] Bump com.nimbusds:nimbus-jose-jwt from 9.37.2 to 9.37.4 in /hadoop-project [hadoop]

2025-10-02 Thread via GitHub
dependabot[bot] commented on PR #7973: URL: https://github.com/apache/hadoop/pull/7973#issuecomment-3324552581 Looks like com.nimbusds:nimbus-jose-jwt is up-to-date now, so this is no longer needed. -- This is an automated message from the Apache Git Service. To respond to the message, pl

Re: [PR] HADOOP-19707: Add quiet-surefire profile for tests [hadoop]

2025-10-02 Thread via GitHub
steveloughran merged PR #7998: URL: https://github.com/apache/hadoop/pull/7998 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [branch 3.4] [hadoop]

2025-10-02 Thread via GitHub
steveloughran merged PR #8008: URL: https://github.com/apache/hadoop/pull/8008 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

[PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [branch 3.4] [hadoop]

2025-10-02 Thread via GitHub
LDVSOFT opened a new pull request, #8008: URL: https://github.com/apache/hadoop/pull/8008 > This is a cherry-pick from _trunk_ MR #7966 to _branch-3.4_ ### Description of PR `URIBuilder` was used from the AWS SDK for Java v2, to be precise from the shaded Apache HTTP Client. It

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [hadoop]

2025-10-02 Thread via GitHub
LDVSOFT commented on PR #7966: URL: https://github.com/apache/hadoop/pull/7966#issuecomment-3361509054 @steveloughran You're welcome! About leaner classpath: there are pros and cons. S3A, as far as I see, really only needs AWS SDK modules for s3, s3-manager, sts and whatever those wo

Re: [PR] HADOOP-19364. IoStats support for AAL [DRAFT] [hadoop]

2025-10-02 Thread via GitHub
hadoop-yetus commented on PR #8007: URL: https://github.com/apache/hadoop/pull/8007#issuecomment-3361245321 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[PR] HADOOP-19364. IoStats support for AAL [DRAFT] [hadoop]

2025-10-02 Thread via GitHub
ahmarsuhail opened a new pull request, #8007: URL: https://github.com/apache/hadoop/pull/8007 ### Description of PR Based off of https://github.com/apache/hadoop/pull/7763 ### How was this patch tested? ### For code changes: - [ ] Does the title or this

Re: [PR] HADOOP-19711. Upgrade hadoop3 docker scripts to 3.4.2. [hadoop]

2025-10-02 Thread via GitHub
ahmarsuhail commented on code in PR #8005: URL: https://github.com/apache/hadoop/pull/8005#discussion_r2398213215 ## Dockerfile: ## @@ -14,7 +14,7 @@ # limitations under the License. FROM apache/hadoop-runner -ARG HADOOP_URL=https://dlcdn.apache.org/hadoop/common/hadoop-3.4

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-10-02 Thread via GitHub
hadoop-yetus commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3360239893 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-10-02 Thread via GitHub
stoty commented on code in PR #7892: URL: https://github.com/apache/hadoop/pull/7892#discussion_r2397492789 ## hadoop-common-project/hadoop-auth/src/main/java/org/apache/hadoop/security/authentication/util/SubjectUtil.java: ## @@ -71,6 +78,23 @@ private static MethodHandle looku

Re: [PR] HADOOP-19365. AAL support for auditing. [hadoop]

2025-10-02 Thread via GitHub
hadoop-yetus commented on PR #7723: URL: https://github.com/apache/hadoop/pull/7723#issuecomment-3359920463 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19365. AAL support for auditing. [hadoop]

2025-10-02 Thread via GitHub
ahmarsuhail merged PR #7723: URL: https://github.com/apache/hadoop/pull/7723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@h

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-10-02 Thread via GitHub
stoty commented on PR #7892: URL: https://github.com/apache/hadoop/pull/7892#issuecomment-3359676121 > wow, this is a big patch. but we need it, don't we? Yes. IMO the Java language development process has really dropped the ball here. Changing the Subject APIs while providing repl

Re: [PR] HDFS-17372. CommandProcessingThread#queue should use LinkedBlockingDeque to prevent high priority command blocked by low priority command [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6530: URL: https://github.com/apache/hadoop/pull/6530#issuecomment-3358594384 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17360. Record the number of times a block is read during a certain time period. [hadoop]

2025-10-02 Thread via GitHub
github-actions[bot] commented on PR #6505: URL: https://github.com/apache/hadoop/pull/6505#issuecomment-3358594580 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17839. Rename skips path without valid 'DirectoryWithQuotaFeature' in FSDirRenameOp [hadoop]

2025-10-02 Thread via GitHub
hadoop-yetus commented on PR #7989: URL: https://github.com/apache/hadoop/pull/7989#issuecomment-3359893219 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-10-02 Thread via GitHub
stoty commented on code in PR #7892: URL: https://github.com/apache/hadoop/pull/7892#discussion_r2397515970 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/concurrent/SubjectInheritingThread.java: ## @@ -0,0 +1,212 @@ +/** + * Licensed to the Apache S

[PR] HADOOP-19027. S3A: S3AInputStream doesn't recover from HTTP/channel exceptions [hadoop]

2025-10-01 Thread via GitHub
steveloughran opened a new pull request, #8003: URL: https://github.com/apache/hadoop/pull/8003 This is a fraction of #6425 backported to the V1 SDK, which does a lot of V2-specific translation/unwinding. 416 responses are mapped to RangeNotSatisfiableEOFException, whose retry

Re: [PR] HDFS-17364. EC: Configurably use WeakReferencedElasticByteBufferPool in DFSStripedInputStream. [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] commented on PR #6514: URL: https://github.com/apache/hadoop/pull/6514#issuecomment-3358594524 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17839. Rename skips path without valid 'DirectoryWithQuotaFeature' in FSDirRenameOp [hadoop]

2025-10-01 Thread via GitHub
hadoop-yetus commented on PR #7989: URL: https://github.com/apache/hadoop/pull/7989#issuecomment-3358919898 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-17374. EC: StripedBlockReader#newConnectedPeer should set SO_TIMEOUT and SO_KEEPALIVE [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] commented on PR #6536: URL: https://github.com/apache/hadoop/pull/6536#issuecomment-3358594329 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] Commit to remove vulnerabilities raised for: HADOOP-19074 [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] closed pull request #6586: Commit to remove vulnerabilities raised for: HADOOP-19074 URL: https://github.com/apache/hadoop/pull/6586 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

Re: [PR] HADOOP-19711. Upgrade hadoop3 docker scripts to 3.4.2. [hadoop]

2025-10-01 Thread via GitHub
slfan1989 commented on PR #8005: URL: https://github.com/apache/hadoop/pull/8005#issuecomment-3358754054 > Thanks @slfan1989 for the patch. > > ``` > $ docker run -it --rm ghcr.io/slfan1989/hadoop:3.4.2 hadoop version > ... > Hadoop 3.4.2 > Source code repository https://gi

Re: [PR] HADOOP-19711. Upgrade hadoop3 docker scripts to 3.4.2. [hadoop]

2025-10-01 Thread via GitHub
slfan1989 commented on code in PR #8005: URL: https://github.com/apache/hadoop/pull/8005#discussion_r2396443322 ## Dockerfile: ## @@ -14,7 +14,7 @@ # limitations under the License. FROM apache/hadoop-runner -ARG HADOOP_URL=https://dlcdn.apache.org/hadoop/common/hadoop-3.4.1

Re: [PR] HDFS-17357. NioInetPeer.close() should close socket connection. [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] commented on PR #6502: URL: https://github.com/apache/hadoop/pull/6502#issuecomment-3358594624 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] YARN-11654. [JDK17] TestLinuxContainerExecutorWithMocks.testStartLoca… [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] commented on PR #6528: URL: https://github.com/apache/hadoop/pull/6528#issuecomment-3358594431 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19158. S3A: Support ByteBufferPositionedReadable through vector IO [hadoop]

2025-10-01 Thread via GitHub
github-actions[bot] closed pull request #6773: HADOOP-19158. S3A: Support ByteBufferPositionedReadable through vector IO URL: https://github.com/apache/hadoop/pull/6773 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] HADOOP-19365. AAL support for auditing. [hadoop]

2025-10-01 Thread via GitHub
hadoop-yetus commented on PR #7723: URL: https://github.com/apache/hadoop/pull/7723#issuecomment-3358062914 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on PR #7966: URL: https://github.com/apache/hadoop/pull/7966#issuecomment-3357668716 @LDVSOFT thanks for this -we never want to make those shaded libraries mandatory. If you can sort out the classpath of a leaner deployment -well done! Those test failures show

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [hadoop]

2025-10-01 Thread via GitHub
steveloughran merged PR #7966: URL: https://github.com/apache/hadoop/pull/7966 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...

Re: [PR] HADOOP-19282. S3A: STSClientFactory: do not use URIBuilder [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on PR #7966: URL: https://github.com/apache/hadoop/pull/7966#issuecomment-3357675340 also, have you an asf JIRA ID to assign the fix to you there? If not: request one and tell me what it is. -- This is an automated message from the Apache Git Service. To respond t

Re: [PR] HADOOP-19574. Restore Subject propagation semantics for Java 22+ [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on code in PR #7892: URL: https://github.com/apache/hadoop/pull/7892#discussion_r2395491126 ## hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/util/Shell.java: ## @@ -36,6 +36,7 @@ import java.util.concurrent.atomic.AtomicBoolean;

[PR] HADOOP-19158. S3A: Support ByteBufferPositionedReadable through vector IO [hadoop]

2025-10-01 Thread via GitHub
steveloughran opened a new pull request, #6773: URL: https://github.com/apache/hadoop/pull/6773 HADOOP-19158. ### How was this patch tested? no tests; would need to move the hdfs one up to a contract test. ### For code changes: - [X] Does the title or t

Re: [PR] HADOOP-19559: S3A Analytics-Accelerator Add IoStatistics support [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on code in PR #7763: URL: https://github.com/apache/hadoop/pull/7763#discussion_r2395468392 ## hadoop-tools/hadoop-aws/src/test/java/org/apache/hadoop/fs/s3a/ITestS3AAnalyticsAcceleratorStreamReading.java: ## @@ -194,4 +223,96 @@ public void testInvalidCo

Re: [PR] HADOOP-19712 S3A: Deadlock in EvaluatingStatisticsMap.entryset() [hadoop]

2025-10-01 Thread via GitHub
steveloughran commented on PR #8006: URL: https://github.com/apache/hadoop/pull/8006#issuecomment-3357467095 tested s3 london args ` -Dparallel-tests -DtestsThreadCount=8 -Dscale` ``` [ERROR] Failures: [ERROR] ITestS3APrefetchingInputStream.testReadLargeFileFully:130 [Maxiumum na

[PR] HADOOP-19712 S3A: Deadlock in EvaluatingStatisticsMap.entryset() [hadoop]

2025-10-01 Thread via GitHub
steveloughran opened a new pull request, #8006: URL: https://github.com/apache/hadoop/pull/8006 Reworked how entrySet() and values() work, using .forEach() iterators after reviewing what ConcurrentHashMap does internally; it does a (safe) traverse. Add EvaluatingStatisticsMap.forE

Re: [PR] HDFS-17378: Add missing operationType for some operations in authorizer [hadoop]

2025-10-01 Thread via GitHub
hadoop-yetus commented on PR #6553: URL: https://github.com/apache/hadoop/pull/6553#issuecomment-3356601711 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[PR] HADOOP-19711. Upgrade hadoop3 docker scripts to 3.4.2. [hadoop]

2025-10-01 Thread via GitHub
slfan1989 opened a new pull request, #8005: URL: https://github.com/apache/hadoop/pull/8005 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOO

Re: [PR] HADOOP-19654. Upgrade AWS SDK to 2.32.23 [hadoop]

2025-10-01 Thread via GitHub
ahmarsuhail commented on PR #7882: URL: https://github.com/apache/hadoop/pull/7882#issuecomment-3355348352 Just created https://github.com/aws/aws-sdk-java-v2/issues/6459 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

Re: [PR] HDFS-17378: Add missing operationType for some operations in authorizer [hadoop]

2025-10-01 Thread via GitHub
sbernauer closed pull request #6553: HDFS-17378: Add missing operationType for some operations in authorizer URL: https://github.com/apache/hadoop/pull/6553 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [PR] HADOOP-19672 Nework switchover when apache client throw error [hadoop]

2025-09-30 Thread via GitHub
bhattmanish98 commented on code in PR #7967: URL: https://github.com/apache/hadoop/pull/7967#discussion_r2393522594 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsBlobClient.java: ## @@ -188,7 +189,7 @@ public AbfsBlobClient(final URL baseU

Re: [PR] HADOOP-19672 Nework switchover when apache client throw error [hadoop]

2025-09-30 Thread via GitHub
bhattmanish98 commented on code in PR #7967: URL: https://github.com/apache/hadoop/pull/7967#discussion_r2393517614 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -254,7 +259,8 @@ private AbfsClient(final URL baseUrl,

Re: [PR] HADOOP-19672 Nework switchover when apache client throw error [hadoop]

2025-09-30 Thread via GitHub
bhattmanish98 commented on code in PR #7967: URL: https://github.com/apache/hadoop/pull/7967#discussion_r2393517614 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -254,7 +259,8 @@ private AbfsClient(final URL baseUrl,

Re: [PR] HDFS-17438. RBF: The newest STANDBY and UNAVAILABLE nn should be the lowest priority. [hadoop]

2025-09-30 Thread via GitHub
github-actions[bot] closed pull request #6655: HDFS-17438. RBF: The newest STANDBY and UNAVAILABLE nn should be the lowest priority. URL: https://github.com/apache/hadoop/pull/6655 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [PR] YARN-11655. modify default value of Allocated GPUs and Reserved GPUs in yarn scheduler webui from -1 to 0 [hadoop]

2025-09-30 Thread via GitHub
github-actions[bot] commented on PR #6564: URL: https://github.com/apache/hadoop/pull/6564#issuecomment-3354231941 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17397. Choose another DN as soon as possible, when encountering network issues [hadoop]

2025-09-30 Thread via GitHub
github-actions[bot] commented on PR #6591: URL: https://github.com/apache/hadoop/pull/6591#issuecomment-3354231176 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19085 Add hadoop-compat-bench [hadoop]

2025-09-30 Thread via GitHub
github-actions[bot] closed pull request #6602: HADOOP-19085 Add hadoop-compat-bench URL: https://github.com/apache/hadoop/pull/6602 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] HDFS-17446. The DataNode adds a log to report its progress during addToReplicasMap execution. [hadoop]

2025-09-30 Thread via GitHub
github-actions[bot] closed pull request #6685: HDFS-17446. The DataNode adds a log to report its progress during addToReplicasMap execution. URL: https://github.com/apache/hadoop/pull/6685 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

Re: [PR] HADOOP-19081. Move some hadoop-common code to new hadoop-ftp module [hadoop]

2025-09-30 Thread via GitHub
github-actions[bot] closed pull request #6693: HADOOP-19081. Move some hadoop-common code to new hadoop-ftp module URL: https://github.com/apache/hadoop/pull/6693 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] HADOOP-19672 Nework switchover when apache client throw error [hadoop]

2025-09-30 Thread via GitHub
manika137 commented on code in PR #7967: URL: https://github.com/apache/hadoop/pull/7967#discussion_r2390726345 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/FileSystemConfigurations.java: ## @@ -214,7 +214,7 @@ public final class FileSystemC

Re: [PR] HADOOP-19365. AAL support for auditing. [hadoop]

2025-09-30 Thread via GitHub
ahmarsuhail commented on code in PR #7723: URL: https://github.com/apache/hadoop/pull/7723#discussion_r2391123428 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/audit/AWSRequestAnalyzer.java: ## @@ -50,6 +51,8 @@ import static org.apache.hadoop.fs.statistics

Re: [PR] HADOOP-19085 Add hadoop-compat-bench [hadoop]

2025-09-29 Thread via GitHub
github-actions[bot] commented on PR #6602: URL: https://github.com/apache/hadoop/pull/6602#issuecomment-3349480120 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19145. Add software architecture document [hadoop]

2025-09-29 Thread via GitHub
github-actions[bot] closed pull request #6712: HADOOP-19145. Add software architecture document URL: https://github.com/apache/hadoop/pull/6712 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] HDFS-17402. StartupSafeMode should not exit when resources are from l… [hadoop]

2025-09-29 Thread via GitHub
github-actions[bot] commented on PR #6618: URL: https://github.com/apache/hadoop/pull/6618#issuecomment-3349480039 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19027. S3A: S3AInputStream doesn't recover from channel exceptions [hadoop]

2025-09-29 Thread via GitHub
hadoop-yetus commented on PR #8003: URL: https://github.com/apache/hadoop/pull/8003#issuecomment-3348764384 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[PR] HADOOP-17629. TestRPC#testAuthorization fails. [hadoop]

2025-09-29 Thread via GitHub
szetszwo opened a new pull request, #8004: URL: https://github.com/apache/hadoop/pull/8004 ### Description of PR TestRPC#testAuthorization fails with below IOException. It was using WritableRpcEngine to run TestProtobufRpcProto. ``` java.io.IOException: protocolClass interface

Re: [PR] HADOOP-19672 Nework switchover when apache client throw error [hadoop]

2025-09-29 Thread via GitHub
manika137 commented on code in PR #7967: URL: https://github.com/apache/hadoop/pull/7967#discussion_r2387212747 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/constants/FileSystemConfigurations.java: ## @@ -214,7 +214,7 @@ public final class FileSystemC

Re: [PR] YARN-11871. Make client retry when no active sub-cluster available. [hadoop]

2025-09-28 Thread via GitHub
hadoop-yetus commented on PR #7997: URL: https://github.com/apache/hadoop/pull/7997#issuecomment-3344956153 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-17467. IncrementalBlockReportManager#getPerStorageIBR may throw NPE when remove volumes. [hadoop]

2025-09-28 Thread via GitHub
github-actions[bot] commented on PR #6730: URL: https://github.com/apache/hadoop/pull/6730#issuecomment-336577 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19145. Add software architecture document [hadoop]

2025-09-28 Thread via GitHub
github-actions[bot] commented on PR #6712: URL: https://github.com/apache/hadoop/pull/6712#issuecomment-336650 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17444. Add getJournalSyncerStarted jmx metrics, to Indicates whether the JournalSyncer thread has been started. [hadoop]

2025-09-28 Thread via GitHub
github-actions[bot] commented on PR #6694: URL: https://github.com/apache/hadoop/pull/6694#issuecomment-336767 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17462. RBF: Fix NPE in Router concat when trg is an empty file. [hadoop]

2025-09-28 Thread via GitHub
github-actions[bot] commented on PR #6722: URL: https://github.com/apache/hadoop/pull/6722#issuecomment-336626 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HADOOP-19147. Update ISA-L to 2.31.0 in the build image. [hadoop]

2025-09-28 Thread via GitHub
github-actions[bot] commented on PR #6729: URL: https://github.com/apache/hadoop/pull/6729#issuecomment-336604 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17798. Fixed the issue where bad replicas in the mini cluster could not be automatically replicated [hadoop]

2025-09-28 Thread via GitHub
github-actions[bot] closed pull request #7749: HDFS-17798. Fixed the issue where bad replicas in the mini cluster could not be automatically replicated URL: https://github.com/apache/hadoop/pull/7749 -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] HDFS-17839. Rename skips path without valid 'DirectoryWithQuotaFeature' in FSDirRenameOp [hadoop]

2025-09-28 Thread via GitHub
hadoop-yetus commented on PR #7989: URL: https://github.com/apache/hadoop/pull/7989#issuecomment-3344086034 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] YARN-11871. Make client retry when no active sub-cluster available. [hadoop]

2025-09-28 Thread via GitHub
hadoop-yetus commented on PR #7997: URL: https://github.com/apache/hadoop/pull/7997#issuecomment-3342776702 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

Re: [PR] HDFS-17839. Rename skips path without valid 'DirectoryWithQuotaFeature' in FSDirRenameOp [hadoop]

2025-09-28 Thread via GitHub
hadoop-yetus commented on PR #7989: URL: https://github.com/apache/hadoop/pull/7989#issuecomment-3342748604 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

Re: [PR] HDFS-17839. Rename skips path without valid 'DirectoryWithQuotaFeature' in FSDirRenameOp [hadoop]

2025-09-28 Thread via GitHub
huangzhaobo99 commented on code in PR #7989: URL: https://github.com/apache/hadoop/pull/7989#discussion_r2384534011 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java: ## @@ -1379,16 +1398,22 @@ public INodesInPath addLastINo

Re: [PR] HDFS-17839. Rename skips path without valid 'DirectoryWithQuotaFeature' in FSDirRenameOp [hadoop]

2025-09-27 Thread via GitHub
huangzhaobo99 commented on code in PR #7989: URL: https://github.com/apache/hadoop/pull/7989#discussion_r2384498624 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java: ## @@ -1379,16 +1398,22 @@ public INodesInPath addLastINo

Re: [PR] HDFS-17839. Rename skips path without valid 'DirectoryWithQuotaFeature' in FSDirRenameOp [hadoop]

2025-09-27 Thread via GitHub
zhtttylz commented on code in PR #7989: URL: https://github.com/apache/hadoop/pull/7989#discussion_r2384445570 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java: ## @@ -1379,16 +1398,22 @@ public INodesInPath addLastINode(IN

Re: [PR] HADOOP-19709. [JDK17] Add debian:12 and debian:13 as a build platform with JDK-17 as default [hadoop]

2025-09-27 Thread via GitHub
pan3793 commented on PR #8001: URL: https://github.com/apache/hadoop/pull/8001#issuecomment-3342170970 Previously, there were concerns about having many versions of Linux dist Dockerfiles, how about upgrading Debian 10 to 13 directly? -- This is an automated message from the Apache Git Se

Re: [PR] YARN-11694. Fixed non-idempotent unit tests in the Yarn Module [hadoop]

2025-09-27 Thread via GitHub
github-actions[bot] closed pull request #6793: YARN-11694. Fixed non-idempotent unit tests in the Yarn Module URL: https://github.com/apache/hadoop/pull/6793 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] HDFS-17484. Introduce redundancy.considerLoad.minLoad to avoiding excluding nodes when they are not busy actually. [hadoop]

2025-09-27 Thread via GitHub
github-actions[bot] commented on PR #6758: URL: https://github.com/apache/hadoop/pull/6758#issuecomment-3342139967 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

Re: [PR] HDFS-17504. DN process should exit when BPServiceActor exit [hadoop]

2025-09-27 Thread via GitHub
github-actions[bot] closed pull request #6792: HDFS-17504. DN process should exit when BPServiceActor exit URL: https://github.com/apache/hadoop/pull/6792 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] HDFS-17452 : DfsRouterAdmin RefreshCallQueue fails when authorization is enabled [hadoop]

2025-09-27 Thread via GitHub
github-actions[bot] closed pull request #6779: HDFS-17452 : DfsRouterAdmin RefreshCallQueue fails when authorization is enabled URL: https://github.com/apache/hadoop/pull/6779 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

Re: [PR] HDFS-17463. Support the switch StringTable Split ID feature [hadoop]

2025-09-27 Thread via GitHub
github-actions[bot] commented on PR #6736: URL: https://github.com/apache/hadoop/pull/6736#issuecomment-3342140007 We're closing this stale PR because it has been open for 100 days with no activity. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR

  1   2   3   4   5   6   7   8   9   10   >