(hudi) branch master updated: [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back (#13046)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 0d2877631a2 [HUDI-8409] Fixing merge mode confi

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2763082356 ## CI report: * b2934f721306a6d045fdfbfe20acde9d55c6b4be Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4534)

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2763008197 ## CI report: * b2934f721306a6d045fdfbfe20acde9d55c6b4be Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4534)

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

nsivabalan merged PR #13046: URL: https://github.com/apache/hudi/pull/13046 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apa

hudi.git: Error while running github feature from master:.asf.yaml

An error occurred while processing the github feature in .asf.yaml: GitHub discussions can only be enabled if a mailing list target exists for it. --- With regards, ASF Infra.

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2763189147 ## CI report: * 4aa64d2e5998193334a759ec55e0a6b98806a080 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4540)

Re: [PR] [HUDI-8635] Support numWrites metric for compaction [hudi]

hudi-bot commented on PR #13047: URL: https://github.com/apache/hudi/pull/13047#issuecomment-2763153430 ## CI report: * 7b446c67365ea8073d4ee9a268bc446e6b5a0335 UNKNOWN * 81e9e5c456416b45e254407b9ac2660114124fc0 UNKNOWN * ef730f2f3e2bff9e4946b260b956500fcb4e8f51 Azure: [CANC

Re: [PR] [HUDI-8635] Support numWrites metric for compaction [hudi]

hudi-bot commented on PR #13047: URL: https://github.com/apache/hudi/pull/13047#issuecomment-2763144877 ## CI report: * 7b446c67365ea8073d4ee9a268bc446e6b5a0335 UNKNOWN * 81e9e5c456416b45e254407b9ac2660114124fc0 UNKNOWN * a1243dc67b0348ef481b64b635441185bf40f936 Azure: [SUCC

Re: [PR] [HUDI-8635] Fixing few stats in FG reader for compaction [hudi]

nsivabalan closed pull request #13055: [HUDI-8635] Fixing few stats in FG reader for compaction URL: https://github.com/apache/hudi/pull/13055 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

linliu-code commented on PR #13008: URL: https://github.com/apache/hudi/pull/13008#issuecomment-2763138499 Another one #13047 contains this change. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

Re: [PR] [HUDI-8635] Support numWrites metric for compaction [hudi]

yihua commented on code in PR #13047: URL: https://github.com/apache/hudi/pull/13047#discussion_r2019727386 ## hudi-common/src/main/java/org/apache/hudi/common/table/read/PositionBasedFileGroupRecordBuffer.java: ## @@ -246,14 +245,22 @@ protected boolean hasNextBaseRecord(T base

Re: [PR] [HUDI-8635] Support numWrites metric for compaction [hudi]

hudi-bot commented on PR #13047: URL: https://github.com/apache/hudi/pull/13047#issuecomment-2763140636 ## CI report: * 7b446c67365ea8073d4ee9a268bc446e6b5a0335 UNKNOWN * 81e9e5c456416b45e254407b9ac2660114124fc0 UNKNOWN * a1243dc67b0348ef481b64b635441185bf40f936 Azure: [SUCC

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2763109195 ## CI report: * ddbebd44b2625407f83235dd275c554c58964a72 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4538)

Re: [PR] [HUDI-8635] Fixing few stats in FG reader for compaction [hudi]

hudi-bot commented on PR #13055: URL: https://github.com/apache/hudi/pull/13055#issuecomment-2763127283 ## CI report: * ef730f2f3e2bff9e4946b260b956500fcb4e8f51 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4541)

Re: [PR] [HUDI-8635] Fixing few stats in FG reader for compaction [hudi]

hudi-bot commented on PR #13055: URL: https://github.com/apache/hudi/pull/13055#issuecomment-2763126800 ## CI report: * ef730f2f3e2bff9e4946b260b956500fcb4e8f51 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[PR] [HUDI-8635] Support numWrites metric for compaction [hudi]

nsivabalan opened a new pull request, #13055: URL: https://github.com/apache/hudi/pull/13055 ### Change Logs This number was not properly added since by default the position-based buffer does not collect these metrics properly. ### Impact Fixed it. ### Risk level

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762790298 ## CI report: * 11143b846cad69b33087dbf83f257816ee805d39 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4530)

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2763108723 ## CI report: * ddbebd44b2625407f83235dd275c554c58964a72 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4538)

(hudi) branch master updated (ee50661db20 -> 666eb312acd)

This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from ee50661db20 [HUDI-9231] Show complete DAG for one single query in spark web ui while inserting into hudi table (#13044)

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2763107765 ## CI report: * ddbebd44b2625407f83235dd275c554c58964a72 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4538)

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

yihua merged PR #13007: URL: https://github.com/apache/hudi/pull/13007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

hudi.git: Error while running github feature from master:.asf.yaml

An error occurred while processing the github feature in .asf.yaml: GitHub discussions can only be enabled if a mailing list target exists for it. --- With regards, ASF Infra.

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2763097429 ## CI report: * f9d81b43c1bc255cefaf9c9fc1f09a42b2e8719d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4537)

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

nsivabalan commented on code in PR #13046: URL: https://github.com/apache/hudi/pull/13046#discussion_r2019628427 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/EightToSevenDowngradeHandler.java: ## @@ -161,19 +166,27 @@ static void unsetInitialVers

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2763068358 ## CI report: * f9d81b43c1bc255cefaf9c9fc1f09a42b2e8719d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Assigned] (HUDI-9231) Show complete DAG for one single query in spark web ui while inserting into hudi table

[ https://issues.apache.org/jira/browse/HUDI-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen reassigned HUDI-9231: Assignee: Yinsheng Wang > Show complete DAG for one single query in spark web ui while inserting in

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2763068809 ## CI report: * f9d81b43c1bc255cefaf9c9fc1f09a42b2e8719d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4537)

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762950964 ## CI report: * 11143b846cad69b33087dbf83f257816ee805d39 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4530)

Re: [PR] [HUDI-9228] Support rowdata writing for MOR table with consistent buc… [hudi]

danny0405 merged PR #13043: URL: https://github.com/apache/hudi/pull/13043 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

[jira] [Updated] (HUDI-9231) Show complete DAG for one single query in spark web ui while inserting into hudi table

[ https://issues.apache.org/jira/browse/HUDI-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-9231: - Fix Version/s: 1.0.2 > Show complete DAG for one single query in spark web ui while inserting into > hudi

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

danny0405 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019642745 ## hudi-common/src/test/java/org/apache/hudi/common/testutils/FileCreateUtils.java: ## @@ -98,6 +98,22 @@ private static void createMetaFile(HoodieTableMetaClient me

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2763024996 ## CI report: * 15ad8f7c2f24e34c73a0d7499bc9914626c74a92 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4532)

[jira] [Updated] (HUDI-9244) Revisit marker tests with APPEND

[ https://issues.apache.org/jira/browse/HUDI-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9244: -- Fix Version/s: 1.1.0 > Revisit marker tests with APPEND > > >

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019411075 ## hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java: ## @@ -1029,4 +1179,37 @@ private HoodieWr

[jira] [Closed] (HUDI-9231) Show complete DAG for one single query in spark web ui while inserting into hudi table

[ https://issues.apache.org/jira/browse/HUDI-9231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9231. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch: ee50661db20ff412127be068bafc2466bd0584

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

yihua commented on code in PR #13046: URL: https://github.com/apache/hudi/pull/13046#discussion_r2019616518 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/SevenToEightUpgradeHandler.java: ## @@ -178,23 +179,68 @@ static void upgradePartitionFields(

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762994218 ## CI report: * 15ad8f7c2f24e34c73a0d7499bc9914626c74a92 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4532)

Re: [PR] [HUDI-9211] Fix bug with config in DataHubSyncTool [hudi]

hudi-bot commented on PR #13018: URL: https://github.com/apache/hudi/pull/13018#issuecomment-2746383485 ## CI report: * 336e6f8bff9f8f98004800c2c14ce79bbca3ebc0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762646599 ## CI report: * 671bd61150ab6aa2fb88c56142e8e6ad482943ae Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4528)

[jira] [Updated] (HUDI-9244) Revisit marker tests with APPEND

[ https://issues.apache.org/jira/browse/HUDI-9244?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9244: -- Description: APPEND markers are only used by table version 6 and below.  We should revisit and improve t

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019651767 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestMarkerBasedRollbackStrategy.java: ## @@ -118,7 +118,7 @@ public void testMarkerBasedRol

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762643874 ## CI report: * 671bd61150ab6aa2fb88c56142e8e6ad482943ae Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4528)

[jira] [Updated] (HUDI-9228) [RFC-87] Support rowdata writing for MOR table with consistent hashing

[ https://issues.apache.org/jira/browse/HUDI-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-9228: - Summary: [RFC-87] Support rowdata writing for MOR table with consistent hashing (was: [RFC-87] Support ro

[jira] [Created] (HUDI-9244) Revisit marker tests with APPEND

Y Ethan Guo created HUDI-9244: - Summary: Revisit marker tests with APPEND Key: HUDI-9244 URL: https://issues.apache.org/jira/browse/HUDI-9244 Project: Apache Hudi Issue Type: Improvement

hudi.git: Error while running github feature from master:.asf.yaml

An error occurred while processing the github feature in .asf.yaml: GitHub discussions can only be enabled if a mailing list target exists for it. --- With regards, ASF Infra.

Re: [PR] [HUDI-9231]Show complete DAG for one single query in spark web ui while inserting into hudi table [hudi]

danny0405 merged PR #13044: URL: https://github.com/apache/hudi/pull/13044 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762972141 ## CI report: * 15ad8f7c2f24e34c73a0d7499bc9914626c74a92 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

(hudi) branch master updated (bec60f2f6ae -> 9cd1b610ffe)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from bec60f2f6ae [HUDI-9240] Bump spark 35 version to 3.5.5 (#13053) add 9cd1b610ffe [HUDI-9228] Support rowdata writ

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

nsivabalan commented on code in PR #13046: URL: https://github.com/apache/hudi/pull/13046#discussion_r2019645784 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/SevenToEightUpgradeHandler.java: ## @@ -178,23 +179,68 @@ static void upgradePartitionFi

[jira] [Updated] (HUDI-9228) [RFC-87] Support rowdata writing for MOR table with consistent hashing

[ https://issues.apache.org/jira/browse/HUDI-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-9228: - Status: Open (was: In Progress) > [RFC-87] Support rowdata writing for MOR table with consistent hashing

[jira] [Closed] (HUDI-9228) [RFC-87] Support rowdata writing for MOR table with consistent hashing

[ https://issues.apache.org/jira/browse/HUDI-9228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9228. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch: 9cd1b610ffe2a6fb15c8597c6fa59e29b8bf47

hudi.git: Error while running github feature from master:.asf.yaml

An error occurred while processing the github feature in .asf.yaml: GitHub discussions can only be enabled if a mailing list target exists for it. --- With regards, ASF Infra.

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

danny0405 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019636137 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestMarkerBasedRollbackStrategy.java: ## @@ -118,7 +118,7 @@ public void testMarkerBase

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

danny0405 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019636137 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestMarkerBasedRollbackStrategy.java: ## @@ -118,7 +118,7 @@ public void testMarkerBase

Re: [PR] [HUDI-9236] Handle markers for log files in table version 6 [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762952252 ## CI report: * 500c9a7e44d16b0348a1164b9e5a00d95862570e UNKNOWN * fd114e6987fcf9c77a87cb94220faafb7bfad539 UNKNOWN * 6b162b32290f9cdeee3df1a98cd6520a81e80a74 UNKNOWN *

Re: [PR] [HUDI-9240] Bump spark 35 version to 3.5.5 [hudi]

yihua merged PR #13053: URL: https://github.com/apache/hudi/pull/13053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

(hudi) branch master updated (5a5117c98d8 -> bec60f2f6ae)

This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 5a5117c98d8 [HUDI-9133] Fallback to legacy schema fetching in case of IllegalAccessError from schema registry client (#1

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762950044 ## CI report: * 11143b846cad69b33087dbf83f257816ee805d39 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4530)

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

nsivabalan commented on code in PR #13046: URL: https://github.com/apache/hudi/pull/13046#discussion_r2019628251 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/EightToSevenDowngradeHandler.java: ## @@ -161,19 +166,27 @@ static void unsetInitialVers

Re: [PR] [HUDI-9240] Bump spark 35 version to 3.5.5 [hudi]

hudi-bot commented on PR #13053: URL: https://github.com/apache/hudi/pull/13053#issuecomment-2762892762 ## CI report: * 33c8049239c862965357bc0a38e42ab18cf3d08e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762828154 ## CI report: * 500c9a7e44d16b0348a1164b9e5a00d95862570e UNKNOWN * fd114e6987fcf9c77a87cb94220faafb7bfad539 UNKNOWN * 6b162b32290f9cdeee3df1a98cd6520a81e80a74 UNKNOWN *

hudi.git: Error while running github feature from master:.asf.yaml

An error occurred while processing the github feature in .asf.yaml: GitHub discussions can only be enabled if a mailing list target exists for it. --- With regards, ASF Infra.

Re: [PR] [HUDI-9240] Bump spark 35 version to 3.5.5 [hudi]

hudi-bot commented on PR #13053: URL: https://github.com/apache/hudi/pull/13053#issuecomment-2762894165 ## CI report: * 33c8049239c862965357bc0a38e42ab18cf3d08e Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4524)

Re: [PR] [HUDI-8635] Support numWrites metric for compaction [hudi]

linliu-code commented on PR #13047: URL: https://github.com/apache/hudi/pull/13047#issuecomment-2762833288 0.15.0 stats: `{"partitionToWriteStats": {"map": {"san_francisco": [{"fileId": {"string": "a8f36eff-d8d1-44ca-8644-a36ae51224a3-0"}, "path": {"string": "san_francisco/a8f36eff-d

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762873639 ## CI report: * 500c9a7e44d16b0348a1164b9e5a00d95862570e UNKNOWN * fd114e6987fcf9c77a87cb94220faafb7bfad539 UNKNOWN * 6b162b32290f9cdeee3df1a98cd6520a81e80a74 UNKNOWN *

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762853099 ## CI report: * 500c9a7e44d16b0348a1164b9e5a00d95862570e UNKNOWN * fd114e6987fcf9c77a87cb94220faafb7bfad539 UNKNOWN * 6b162b32290f9cdeee3df1a98cd6520a81e80a74 UNKNOWN *

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762818484 ## CI report: * 671bd61150ab6aa2fb88c56142e8e6ad482943ae Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4528)

[PR] [Weekly Docs] Blog updates and title updates [hudi]

ckonehouse opened a new pull request, #13054: URL: https://github.com/apache/hudi/pull/13054 ….mdx ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change o

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762761176 ## CI report: * 671bd61150ab6aa2fb88c56142e8e6ad482943ae Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4528)

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762712528 ## CI report: * 671bd61150ab6aa2fb88c56142e8e6ad482943ae Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4528)

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762622681 ## CI report: * 671bd61150ab6aa2fb88c56142e8e6ad482943ae Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4528)

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

nsivabalan commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019489653 ## hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkCopyOnWriteTableRollbackTableVersionSix.java: ## @@ -0,0 +1,63 @@ +/

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

nsivabalan commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019484428 ## hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkCopyOnWriteTableRollbackTableVersionSix.java: ## @@ -0,0 +1,63 @@ +/

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762679615 ## CI report: * 468cab51373d3abd07b82a5fb7d89a127f4fb1e6 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4529)

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019455801 ## hudi-common/src/main/java/org/apache/hudi/common/data/HoodieListPairData.java: ## @@ -199,6 +201,31 @@ public HoodiePairData union(HoodiePairData other) { return

Re: [PR] [HUDI-8635] Support numWrites metric for compaction [hudi]

linliu-code commented on PR #13047: URL: https://github.com/apache/hudi/pull/13047#issuecomment-2762672215 > hey can you post comparison of compaction commit metadata from 0.15.0 and w/ this patch side by side. I am concerned on how we missed "numWrites" in the previous round. Sure.

[jira] [Updated] (HUDI-9243) Honor lazy config for join operation in HoodieListPairData

[ https://issues.apache.org/jira/browse/HUDI-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9243: -- Fix Version/s: 1.1.0 > Honor lazy config for join operation in HoodieListPairData >

[jira] [Updated] (HUDI-9243) Honor lazy config for join operation in HoodieListPairData

[ https://issues.apache.org/jira/browse/HUDI-9243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9243: -- Priority: Critical (was: Major) > Honor lazy config for join operation in HoodieListPairData >

[jira] [Created] (HUDI-9243) Honor lazy config for join operation in HoodieListPairData

Y Ethan Guo created HUDI-9243: - Summary: Honor lazy config for join operation in HoodieListPairData Key: HUDI-9243 URL: https://issues.apache.org/jira/browse/HUDI-9243 Project: Apache Hudi Issue

[jira] [Created] (HUDI-9242) Simplify test table generation in MOR rollback testing with MDT

Y Ethan Guo created HUDI-9242: - Summary: Simplify test table generation in MOR rollback testing with MDT Key: HUDI-9242 URL: https://issues.apache.org/jira/browse/HUDI-9242 Project: Apache Hudi

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762617544 ## CI report: * 3c27146ac482b476f0737a976e0b288c36b25b86 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4527)

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019386700 ## hudi-io/src/main/java/org/apache/hudi/storage/StorageSchemes.java: ## @@ -86,6 +88,11 @@ public enum StorageSchemes { // Hopsworks File System HOPSFS("hopsfs", fa

[jira] [Updated] (HUDI-9242) Simplify test table generation in MOR rollback testing with MDT

[ https://issues.apache.org/jira/browse/HUDI-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9242: -- Fix Version/s: 1.1.0 (was: 1.0.0) > Simplify test table generation in MOR rollbac

[jira] [Updated] (HUDI-9242) Simplify test table generation in MOR rollback testing with MDT

[ https://issues.apache.org/jira/browse/HUDI-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9242: -- Description: https://github.com/apache/hudi/pull/13007#discussion_r2019411075 > Simplify test table gen

[jira] [Updated] (HUDI-9242) Simplify test table generation in MOR rollback testing with MDT

[ https://issues.apache.org/jira/browse/HUDI-9242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9242: -- Fix Version/s: 1.0.0 > Simplify test table generation in MOR rollback testing with MDT > ---

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019411075 ## hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java: ## @@ -1029,4 +1179,37 @@ private HoodieWr

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762506066 ## CI report: * d2c5bdc17907721b513410f1a37c77a8f9c01e82 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4525)

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019400034 ## hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableRollback.java: ## @@ -218,6 +235,8 @@ void testRollbackWi

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019394972 ## hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/table/functional/TestHoodieSparkMergeOnReadTableCompaction.java: ## @@ -200,11 +221,190 @@ public void te

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762521343 ## CI report: * d2c5bdc17907721b513410f1a37c77a8f9c01e82 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4525)

Re: [PR] [HUDI-8409] Fixing merge mode config during upgrade and downgrade from version 7 to 8 and back [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762525385 ## CI report: * 468cab51373d3abd07b82a5fb7d89a127f4fb1e6 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4529)

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762451858 ## CI report: * 3c27146ac482b476f0737a976e0b288c36b25b86 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4527)

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762511385 ## CI report: * d2c5bdc17907721b513410f1a37c77a8f9c01e82 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4525)

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019353876 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/utils/CommitMetadataUtils.java: ## @@ -0,0 +1,258 @@ +/* + * Licensed to the Apache Software Foundat

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019337327 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/marker/WriteMarkers.java: ## @@ -209,6 +209,15 @@ protected StoragePath getMarkerPath(String partitio

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762442994 ## CI report: * 3c27146ac482b476f0737a976e0b288c36b25b86 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4527)

Re: [PR] [HUDI-9236] create marker file for every log file [hudi]

yihua commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2019109430 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieWriteHandle.java: ## @@ -290,7 +290,8 @@ protected LogFileCreationCallback getLogCreationCallback(

Re: [PR] [HUDI-9236] Create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2762373431 ## CI report: * 3c27146ac482b476f0737a976e0b288c36b25b86 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4527)

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13046: URL: https://github.com/apache/hudi/pull/13046#issuecomment-2762311577 ## CI report: * d2c5bdc17907721b513410f1a37c77a8f9c01e82 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4525)

Re: [PR] [HUDI-9236] create marker file for every log file [hudi]

lokeshj1703 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2018366560 ## hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/functional/TestMarkerBasedRollbackStrategy.java: ## @@ -165,10 +238,11 @@ public void testCopyOn

  1   2   >