[GitHub] [hadoop] ayushtkn commented on pull request #5825: HDFS-17072. DFSAdmin: add a triggerDirectoryScanner command.

2023-09-28 Thread via GitHub
ayushtkn commented on PR #5825: URL: https://github.com/apache/hadoop/pull/5825#issuecomment-1740387388 There is a test failure for directory scanner itself, can you check? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [hadoop] ayushtkn merged pull request #6079: HDFS-17133. TestFsDatasetImpl missing null check when cleaning up

2023-09-28 Thread via GitHub
ayushtkn merged PR #6079: URL: https://github.com/apache/hadoop/pull/6079 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hado

[GitHub] [hadoop] ayushtkn merged pull request #6124: HDFS-17211. RBF: The comments in the RemoteParam class are incorrect.

2023-09-28 Thread via GitHub
ayushtkn merged PR #6124: URL: https://github.com/apache/hadoop/pull/6124 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@hado

[jira] [Commented] (HADOOP-18257) Analyzing S3A Audit Logs

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18257?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770306#comment-17770306 ] ASF GitHub Bot commented on HADOOP-18257: - mehakmeet commented on code in PR #6

[GitHub] [hadoop] mehakmeet commented on a diff in pull request #6000: HADOOP-18257. Merging and Parsing S3A audit logs into Avro format for analysis.

2023-09-28 Thread via GitHub
mehakmeet commented on code in PR #6000: URL: https://github.com/apache/hadoop/pull/6000#discussion_r1340942956 ## hadoop-tools/hadoop-aws/src/main/java/org/apache/hadoop/fs/s3a/audit/AuditTool.java: ## @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Software Foundation (ASF) u

[GitHub] [hadoop] hadoop-yetus commented on pull request #6127: YARN-11580. YARN Router Web supports displaying information for Non-Federation.

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6127: URL: https://github.com/apache/hadoop/pull/6127#issuecomment-1740368803 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] virajjasani commented on pull request #6102: MAPREDUCE-7453. Container logs are missing when yarn.app.container.log.filesize is set to default value 0.

2023-09-28 Thread via GitHub
virajjasani commented on PR #6102: URL: https://github.com/apache/hadoop/pull/6102#issuecomment-1740286321 Thank you for reporting this @zhengchenyu! We used to have `log4j.appender.CLA.totalLogFileSize=${yarn.app.container.log.filesize}` which would be set by: ``` /**

[GitHub] [hadoop] slfan1989 opened a new pull request, #6127: YARN-11580. YARN Router Web supports displaying information for Non-Federation.

2023-09-28 Thread via GitHub
slfan1989 opened a new pull request, #6127: URL: https://github.com/apache/hadoop/pull/6127 ### Description of PR JIRA: YARN-11580. YARN Router Web supports displaying information for Non-Federation. ### How was this patch tested? ### For code changes:

[GitHub] [hadoop] ted12138 opened a new pull request, #6126: HDFS-16966. Add threshold to avoid hot disk in AvailableSpaceVolumeCh…

2023-09-28 Thread via GitHub
ted12138 opened a new pull request, #6126: URL: https://github.com/apache/hadoop/pull/6126 …oosingPolicy ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA is

[GitHub] [hadoop] hadoop-yetus commented on pull request #6123: YARN-11579. Fix 'Physical Mem Used' and 'Physical VCores Used' are not displaying data.

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6123: URL: https://github.com/apache/hadoop/pull/6123#issuecomment-1740266487 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #6063: YARN-11498 backport jettison exclusions

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6063: URL: https://github.com/apache/hadoop/pull/6063#issuecomment-1740132404 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] slfan1989 commented on pull request #6083: YARN-8862. [BackPort] [GPG] Add Yarn Registry cleanup in ApplicationCleaner.

2023-09-28 Thread via GitHub
slfan1989 commented on PR #6083: URL: https://github.com/apache/hadoop/pull/6083#issuecomment-1740113893 @goiri Thank you very much for your help in reviewing the code! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [hadoop] slfan1989 merged pull request #6083: YARN-8862. [BackPort] [GPG] Add Yarn Registry cleanup in ApplicationCleaner.

2023-09-28 Thread via GitHub
slfan1989 merged PR #6083: URL: https://github.com/apache/hadoop/pull/6083 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: common-issues-unsubscr...@had

[GitHub] [hadoop] hadoop-yetus commented on pull request #6113: HDFS-17210. Optimize AvailableSpaceBlockPlacementPolicy.

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6113: URL: https://github.com/apache/hadoop/pull/6113#issuecomment-1739942138 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[GitHub] [hadoop] hadoop-yetus commented on pull request #6123: YARN-11579. Fix 'Physical Mem Used' and 'Physical VCores Used' are not displaying data.

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6123: URL: https://github.com/apache/hadoop/pull/6123#issuecomment-1739832090 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Created] (HADOOP-18914) use http simple auth only for Web UIs and not for webhdfs

2023-09-28 Thread Anup Ahire (Jira)
Anup Ahire created HADOOP-18914: --- Summary: use http simple auth only for Web UIs and not for webhdfs Key: HADOOP-18914 URL: https://issues.apache.org/jira/browse/HADOOP-18914 Project: Hadoop Common

[jira] [Assigned] (HADOOP-18857) AWS v2 SDK: fail meaningfully if legacy v2 signing requested

2023-09-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran reassigned HADOOP-18857: --- Assignee: Steve Loughran > AWS v2 SDK: fail meaningfully if legacy v2 signing requ

[GitHub] [hadoop] pjfanning commented on pull request #6063: YARN-11498 backport jettison exclusions

2023-09-28 Thread via GitHub
pjfanning commented on PR #6063: URL: https://github.com/apache/hadoop/pull/6063#issuecomment-1739725240 > TestFSConfigToCSConfigConverterMain crashed in the last run. I've restarted the build to see if it was a one-off. This test is still crashing - an OutOfMemory issue last time out

[GitHub] [hadoop] hadoop-yetus commented on pull request #6121: YARN-11537. [Addendum][Federation] Router CLI Supports List SubClusterPolicyConfiguration Of Queues.

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6121: URL: https://github.com/apache/hadoop/pull/6121#issuecomment-1739703709 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18890) remove okhttp usage

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770163#comment-17770163 ] ASF GitHub Bot commented on HADOOP-18890: - pjfanning commented on PR #6101: URL

[GitHub] [hadoop] pjfanning commented on pull request #6101: HADOOP-18890. Remove use of okhttp in runtime code (#6057)

2023-09-28 Thread via GitHub
pjfanning commented on PR #6101: URL: https://github.com/apache/hadoop/pull/6101#issuecomment-1739692531 @steveloughran I don't know what to do about the maven-shade-plugin. I've tried so many changes to try to get rid of the module-info classes. Some of them seem to work on my laptop but i

[jira] [Commented] (HADOOP-18890) remove okhttp usage

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18890?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770160#comment-17770160 ] ASF GitHub Bot commented on HADOOP-18890: - hadoop-yetus commented on PR #6101:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6101: HADOOP-18890. Remove use of okhttp in runtime code (#6057)

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6101: URL: https://github.com/apache/hadoop/pull/6101#issuecomment-1739664486 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #6112: HDFS-17205. HdfsServerConstants.MIN_BLOCKS_FOR_WRITE should be configurable

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6112: URL: https://github.com/apache/hadoop/pull/6112#issuecomment-1739540820 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770104#comment-17770104 ] ASF GitHub Bot commented on HADOOP-18910: - hadoop-yetus commented on PR #6069:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1739474822 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reex

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770094#comment-17770094 ] ASF GitHub Bot commented on HADOOP-18910: - hadoop-yetus commented on PR #6069:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1739446892 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] slfan1989 commented on a diff in pull request #6121: YARN-11537. [Addendum][Federation] Router CLI Supports List SubClusterPolicyConfiguration Of Queues.

2023-09-28 Thread via GitHub
slfan1989 commented on code in PR #6121: URL: https://github.com/apache/hadoop/pull/6121#discussion_r1340283125 ## hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-router/src/main/java/org/apache/hadoop/yarn/server/router/rmadmin/FederationRMAdminInterceptor.java: #

[GitHub] [hadoop-thirdparty] saeidN commented on pull request #22: HADOOP-18721. Upgrade guava to 31.1

2023-09-28 Thread via GitHub
saeidN commented on PR #22: URL: https://github.com/apache/hadoop-thirdparty/pull/22#issuecomment-1739335143 Is this version of `hadoop-shaded-guava` library released to public yet? I can't find it in maven repo -- This is an automated message from the Apache Git Service. To respond to

[GitHub] [hadoop] hadoop-yetus commented on pull request #6125: HDFS-16968. Recover two replicas when 2-replication write pipepine fails

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6125: URL: https://github.com/apache/hadoop/pull/6125#issuecomment-1739299914 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] hadoop-yetus commented on pull request #6125: HDFS-16968. Recover two replicas when 2-replication write pipepine fails

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6125: URL: https://github.com/apache/hadoop/pull/6125#issuecomment-1739276400 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] haiyang1987 commented on pull request #6094: HDFS-17194. Enhance the log message for striped block recovery

2023-09-28 Thread via GitHub
haiyang1987 commented on PR #6094: URL: https://github.com/apache/hadoop/pull/6094#issuecomment-1739132680 > @goiri I am bit curious on removing the isDebugEnabled checks. Like here > > ``` > - if (LOG.isDebugEnabled()) { > -LOG.debug("syncBlock replicaInfo:

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770047#comment-17770047 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on PR #6069:

[GitHub] [hadoop] anujmodi2021 commented on pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1739110837 @steveloughran We found a way to avoid doing explicit array copies in MD5 computation in case of non-zero offsets. MessageDigest class of java allows us to do so using update and

[GitHub] [hadoop] hadoop-yetus commented on pull request #6113: HDFS-17210. Optimize AvailableSpaceBlockPlacementPolicy.

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6113: URL: https://github.com/apache/hadoop/pull/6113#issuecomment-1739067262 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17770020#comment-17770020 ] ASF GitHub Bot commented on HADOOP-18910: - hadoop-yetus commented on PR #6069:

[GitHub] [hadoop] hadoop-yetus commented on pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
hadoop-yetus commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1738998559 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Logfile | Comment | |::|--:|:|::|:---:| | +0 :ok: | reexe

[GitHub] [hadoop] haiyang1987 commented on a diff in pull request #6109: HDFS-17208. Add the metrics PendingAsyncDiskOperations in datanode

2023-09-28 Thread via GitHub
haiyang1987 commented on code in PR #6109: URL: https://github.com/apache/hadoop/pull/6109#discussion_r1339962508 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java: ## @@ -3822,5 +3822,10 @@ public long getL

[GitHub] [hadoop] haiyang1987 commented on a diff in pull request #6109: HDFS-17208. Add the metrics PendingAsyncDiskOperations in datanode

2023-09-28 Thread via GitHub
haiyang1987 commented on code in PR #6109: URL: https://github.com/apache/hadoop/pull/6109#discussion_r1339962508 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java: ## @@ -3822,5 +3822,10 @@ public long getL

[GitHub] [hadoop] haiyang1987 commented on pull request #6112: HDFS-17205. HdfsServerConstants.MIN_BLOCKS_FOR_WRITE should be configurable

2023-09-28 Thread via GitHub
haiyang1987 commented on PR #6112: URL: https://github.com/apache/hadoop/pull/6112#issuecomment-1738903124 Update PR. Hi @Hexiaoqiao @ayushtkn sirs please help me review it agagin when you have free time. Thanks a lot~ -- This is an automated message from the Apache Git Service. To res

[GitHub] [hadoop] haiyang1987 commented on a diff in pull request #6112: HDFS-17205. HdfsServerConstants.MIN_BLOCKS_FOR_WRITE should be configurable

2023-09-28 Thread via GitHub
haiyang1987 commented on code in PR #6112: URL: https://github.com/apache/hadoop/pull/6112#discussion_r1339892905 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/namenode/NameNode.java: ## @@ -2671,6 +2676,18 @@ private String reconfigureDecommiss

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769980#comment-17769980 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on code in PR

[GitHub] [hadoop] anujmodi2021 commented on a diff in pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on code in PR #6069: URL: https://github.com/apache/hadoop/pull/6069#discussion_r1339883668 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -875,10 +873,15 @@ private boolean checkUserError(int respo

[GitHub] [hadoop] haiyang1987 commented on a diff in pull request #6109: HDFS-17208. Add the metrics PendingAsyncDiskOperations in datanode

2023-09-28 Thread via GitHub
haiyang1987 commented on code in PR #6109: URL: https://github.com/apache/hadoop/pull/6109#discussion_r1339876416 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java: ## @@ -3822,5 +3822,10 @@ public long getL

[GitHub] [hadoop] haiyang1987 commented on a diff in pull request #6109: HDFS-17208. Add the metrics PendingAsyncDiskOperations in datanode

2023-09-28 Thread via GitHub
haiyang1987 commented on code in PR #6109: URL: https://github.com/apache/hadoop/pull/6109#discussion_r1339876416 ## hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/server/datanode/fsdataset/impl/FsDatasetImpl.java: ## @@ -3822,5 +3822,10 @@ public long getL

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769973#comment-17769973 ] ASF GitHub Bot commented on HADOOP-18910: - anmolanmol1234 commented on code in

[GitHub] [hadoop] anmolanmol1234 commented on a diff in pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anmolanmol1234 commented on code in PR #6069: URL: https://github.com/apache/hadoop/pull/6069#discussion_r1339863566 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -875,10 +873,15 @@ private boolean checkUserError(int res

[GitHub] [hadoop] anujmodi2021 commented on pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on PR #6069: URL: https://github.com/apache/hadoop/pull/6069#issuecomment-1738835515 > I've actually been thinking of adding a similar option to the s3a client for third party non-https support. > > In my head though, the generation of the upload MD5 hash could

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769970#comment-17769970 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on PR #6069:

[jira] [Resolved] (HADOOP-18758) build/release a shaded version of the AWS SDK

2023-09-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18758. - Resolution: Won't Fix let's not try this, it'll only add extra work and introduce libra

[jira] [Commented] (HADOOP-18857) AWS v2 SDK: fail meaningfully if legacy v2 signing requested

2023-09-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18857?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769969#comment-17769969 ] Steve Loughran commented on HADOOP-18857: - fixed in HADOOP-18889 though i need

[jira] [Resolved] (HADOOP-18871) S3ARetryPolicy to use sdk exception retryable() if it is valid

2023-09-28 Thread Steve Loughran (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran resolved HADOOP-18871. - Resolution: Won't Fix no, wontfix. sdk thinks things like UnknownHostException are retr

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769964#comment-17769964 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on code in PR

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769965#comment-17769965 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on code in PR

[GitHub] [hadoop] anujmodi2021 commented on a diff in pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on code in PR #6069: URL: https://github.com/apache/hadoop/pull/6069#discussion_r1339835737 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1412,6 +1444,102 @@ private void appendIfNotEmpty(StringBu

[GitHub] [hadoop] anujmodi2021 commented on a diff in pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on code in PR #6069: URL: https://github.com/apache/hadoop/pull/6069#discussion_r1339833668 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -88,7 +91,8 @@ public class AbfsClient implements Closeabl

[GitHub] [hadoop] anujmodi2021 commented on a diff in pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on code in PR #6069: URL: https://github.com/apache/hadoop/pull/6069#discussion_r1339816363 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -861,6 +875,12 @@ private boolean checkUserError(int respon

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769963#comment-17769963 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on code in PR

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769962#comment-17769962 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on code in PR

[GitHub] [hadoop] anujmodi2021 commented on a diff in pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on code in PR #6069: URL: https://github.com/apache/hadoop/pull/6069#discussion_r1339816363 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -861,6 +875,12 @@ private boolean checkUserError(int respon

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769961#comment-17769961 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on code in PR

[GitHub] [hadoop] anujmodi2021 commented on a diff in pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on code in PR #6069: URL: https://github.com/apache/hadoop/pull/6069#discussion_r1339814115 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -1412,6 +1444,102 @@ private void appendIfNotEmpty(StringBu

[GitHub] [hadoop] steveloughran commented on pull request #6063: YARN-11498 backport jettison exclusions

2023-09-28 Thread via GitHub
steveloughran commented on PR #6063: URL: https://github.com/apache/hadoop/pull/6063#issuecomment-1738798050 your diligence is appreciated. tracking the other PR -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[jira] [Commented] (HADOOP-18910) ABFS: Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HADOOP-18910?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17769960#comment-17769960 ] ASF GitHub Bot commented on HADOOP-18910: - anujmodi2021 commented on code in PR

[GitHub] [hadoop] anujmodi2021 commented on a diff in pull request #6069: HADOOP-18910: [ABFS] Adding Support for MD5 Hash based integrity verification of the request content during transport

2023-09-28 Thread via GitHub
anujmodi2021 commented on code in PR #6069: URL: https://github.com/apache/hadoop/pull/6069#discussion_r1339814907 ## hadoop-tools/hadoop-azure/src/main/java/org/apache/hadoop/fs/azurebfs/services/AbfsClient.java: ## @@ -761,6 +764,11 @@ public AbfsRestOperation append(final Str

[GitHub] [hadoop] ted12138 opened a new pull request, #6125: HDFS-16968. Recover two replicas when 2-replication write pipepine fails

2023-09-28 Thread via GitHub
ted12138 opened a new pull request, #6125: URL: https://github.com/apache/hadoop/pull/6125 ### Description of PR ### How was this patch tested? ### For code changes: - [ ] Does the title or this PR starts with the corresponding JIRA issue id (e.g. 'HADOOP