Re: [PR] [RFC-92] Pluggable Table Format Support [hudi]

bvaradar commented on code in PR #12998: URL: https://github.com/apache/hudi/pull/12998#discussion_r2008515148 ## rfc/rfc-92/rfc-92.md: ## @@ -0,0 +1,102 @@ + +# RFC-92: Pluggable Table Formats in Hudi + +## Proposers + +* Balaji Varadarajan + +## Approvers + +* Vinoth Chand

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744762979 ## CI report: * 0de0635c2d0ff50b2cf333b898227f615363d5a4 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4322)

Re: [PR] [HUDI-9198] Support rate limit for append mode [hudi]

danny0405 merged PR #12999: URL: https://github.com/apache/hudi/pull/12999 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

(hudi) branch master updated: [HUDI-9198] Support rate limit for append mode (#12999)

This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 53216051b1c [HUDI-9198] Support rate limit for

[jira] [Updated] (HUDI-9198) Support rate limit for append mode

[ https://issues.apache.org/jira/browse/HUDI-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-9198: - Fix Version/s: 1.1.0 > Support rate limit for append mode > -- > >

[jira] [Closed] (HUDI-9198) Support rate limit for append mode

[ https://issues.apache.org/jira/browse/HUDI-9198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9198. Resolution: Fixed Fixed via master branch: 53216051b1c96f4944c7bbaf07c8cbb6c9b65398 > Support rate limit fo

hudi.git: Error while running github feature from master:.asf.yaml

An error occurred while processing the github feature in .asf.yaml: GitHub discussions can only be enabled if a mailing list target exists for it. --- With regards, ASF Infra.

Re: [I] [SUPPORT] Hudi DELETE operation in Flink scans all partitions despite partition predicate [hudi]

danny0405 commented on issue #12988: URL: https://github.com/apache/hudi/issues/12988#issuecomment-2744811799 Close it now, feel free to fire new ones it if there are other issues. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

linliu-code commented on code in PR #13008: URL: https://github.com/apache/hudi/pull/13008#discussion_r2008527592 ## hudi-common/src/test/java/org/apache/hudi/common/table/read/TestHoodieFileGroupReaderBase.java: ## @@ -250,6 +285,28 @@ private Map getCommonConfigs(RecordMergeM

Re: [PR] [HUDI-9117] Replace usage of *LogScanner with FileGroupReader [hudi]

hudi-bot commented on PR #13016: URL: https://github.com/apache/hudi/pull/13016#issuecomment-2744465421 ## CI report: * d0d5af0e5f4686c2b15d7d4bd6e98304e30e595e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744947152 ## CI report: * ee7f8e8c9de12fb5740350ada7c17151c1fa87de Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4326)

[jira] [Updated] (HUDI-9117) Reduce usage of *LogScanner and standardize on *LogReader..

[ https://issues.apache.org/jira/browse/HUDI-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9117: - Labels: pull-request-available (was: ) > Reduce usage of *LogScanner and standardize on *LogReade

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744893710 ## CI report: * 7348332b882134d2914e87f076e60fdcfb0cc6ec Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4323)

Re: [I] [SUPPORT] Hudi DELETE operation in Flink scans all partitions despite partition predicate [hudi]

danny0405 closed issue #12988: [SUPPORT] Hudi DELETE operation in Flink scans all partitions despite partition predicate URL: https://github.com/apache/hudi/issues/12988 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [PR] [HUDI-9198] Support rate limit for append mode [hudi]

hudi-bot commented on PR #12999: URL: https://github.com/apache/hudi/pull/12999#issuecomment-2744818821 ## CI report: * e24f8854aed4877142e2278e9344be4fb206675d Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4302)

Re: [PR] [HUDI-9198] Support rate limit for append mode [hudi]

hudi-bot commented on PR #12999: URL: https://github.com/apache/hudi/pull/12999#issuecomment-2744808609 ## CI report: * e24f8854aed4877142e2278e9344be4fb206675d Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4302)

Re: [PR] [RFC-92] Pluggable Table Format Support [hudi]

bvaradar commented on code in PR #12998: URL: https://github.com/apache/hudi/pull/12998#discussion_r2008517288 ## rfc/rfc-92/rfc-92.md: ## @@ -0,0 +1,102 @@ + +# RFC-92: Pluggable Table Formats in Hudi + +## Proposers + +* Balaji Varadarajan + +## Approvers + +* Vinoth Chand

Re: [PR] [HUDI-9207] Spark Insert Overwrite Support Row Writer [hudi]

zhangyue19921010 commented on PR #13014: URL: https://github.com/apache/hudi/pull/13014#issuecomment-2744783955 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744774666 ## CI report: * 0de0635c2d0ff50b2cf333b898227f615363d5a4 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4322)

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744780452 ## CI report: * 7348332b882134d2914e87f076e60fdcfb0cc6ec Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4323)

Re: [PR] [RFC-92] Pluggable Table Format Support [hudi]

bvaradar commented on code in PR #12998: URL: https://github.com/apache/hudi/pull/12998#discussion_r2008523025 ## rfc/rfc-92/rfc-92.md: ## @@ -0,0 +1,102 @@ + +# RFC-92: Pluggable Table Formats in Hudi + +## Proposers + +* Balaji Varadarajan + +## Approvers + +* Vinoth Chand

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744758125 ## CI report: * 36f6e3ae1cadadb198fab4ae4d10935c70f16f01 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4321)

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

linliu-code commented on code in PR #13009: URL: https://github.com/apache/hudi/pull/13009#discussion_r2008536586 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestMergeModeDuringUpgradeDowngrade.scala: ## @@ -0,0 +1,302 @@ +/* + * Licensed to the

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

linliu-code commented on code in PR #13009: URL: https://github.com/apache/hudi/pull/13009#discussion_r2008532883 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/SevenToEightUpgradeHandler.java: ## @@ -178,19 +178,28 @@ static void upgradePartitionF

[jira] [Created] (HUDI-9209) Verify if Hudi iterators have been closed properly

Lin Liu created HUDI-9209: - Summary: Verify if Hudi iterators have been closed properly Key: HUDI-9209 URL: https://issues.apache.org/jira/browse/HUDI-9209 Project: Apache Hudi Issue Type: Bug Af

[jira] [Assigned] (HUDI-9209) Verify if Hudi iterators have been closed properly

[ https://issues.apache.org/jira/browse/HUDI-9209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu reassigned HUDI-9209: - Assignee: (was: Lin Liu) > Verify if Hudi iterators have been closed properly > -

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744693639 ## CI report: * 2ed300a65e546f9166fd899150d81eb560b23ec5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4292)

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744694686 ## CI report: * 36f6e3ae1cadadb198fab4ae4d10935c70f16f01 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4321)

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

hudi-bot commented on PR #13008: URL: https://github.com/apache/hudi/pull/13008#issuecomment-2742571272 ## CI report: * b00d2c37e80b3e2ebfde8400a39d62cda7028a6d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4298)

Re: [PR] [HUDI-9208] Add file system view storage configs to MDT [hudi]

hudi-bot commented on PR #13015: URL: https://github.com/apache/hudi/pull/13015#issuecomment-2744385743 ## CI report: * 6d0211ab1ff8363d7eac65dfa6ccefa356aaf82a Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4319)

Re: [PR] [HUDI-8409] Add test to ensure merge mode during upgrade and downgrade [hudi]

hudi-bot commented on PR #13009: URL: https://github.com/apache/hudi/pull/13009#issuecomment-2744618990 ## CI report: * 2ed300a65e546f9166fd899150d81eb560b23ec5 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4292)

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

nsivabalan commented on code in PR #13008: URL: https://github.com/apache/hudi/pull/13008#discussion_r2008434375 ## hudi-common/src/test/java/org/apache/hudi/common/table/read/TestHoodieFileGroupReaderBase.java: ## @@ -250,6 +285,28 @@ private Map getCommonConfigs(RecordMergeMo

Re: [PR] [HUDI-9117] Replace usage of *LogScanner with FileGroupReader [hudi]

hudi-bot commented on PR #13016: URL: https://github.com/apache/hudi/pull/13016#issuecomment-2744593222 ## CI report: * d0d5af0e5f4686c2b15d7d4bd6e98304e30e595e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4320)

Re: [PR] [HUDI-9198] Support rate limit for append mode [hudi]

zhangyue19921010 commented on code in PR #12999: URL: https://github.com/apache/hudi/pull/12999#discussion_r2007240248 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/append/AppendWriteFunctionWithRateLimit.java: ## @@ -0,0 +1,62 @@ +/* + * Licensed to the

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

hudi-bot commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2743067190 ## CI report: * c645eb4e67959fc37bf2b907fbed53d84dffe971 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4312)

Re: [PR] [HUDI-9208] Add file system view storage configs to MDT [hudi]

hudi-bot commented on PR #13015: URL: https://github.com/apache/hudi/pull/13015#issuecomment-2744539324 ## CI report: * 6d0211ab1ff8363d7eac65dfa6ccefa356aaf82a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4319)

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

hudi-bot commented on PR #13008: URL: https://github.com/apache/hudi/pull/13008#issuecomment-2742274834 ## CI report: * b00d2c37e80b3e2ebfde8400a39d62cda7028a6d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4298)

Re: [PR] [HUDI-9117] Replace usage of *LogScanner with FileGroupReader [hudi]

hudi-bot commented on PR #13016: URL: https://github.com/apache/hudi/pull/13016#issuecomment-2744467716 ## CI report: * d0d5af0e5f4686c2b15d7d4bd6e98304e30e595e Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4320)

[jira] [Updated] (HUDI-9208) Add file system view storage configs to MDT

[ https://issues.apache.org/jira/browse/HUDI-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9208: - Labels: pull-request-available (was: ) > Add file system view storage configs to MDT > --

Re: [PR] [HUDI-9208] Add file system view storage configs to MDT [hudi]

hudi-bot commented on PR #13015: URL: https://github.com/apache/hudi/pull/13015#issuecomment-2744383386 ## CI report: * 6d0211ab1ff8363d7eac65dfa6ccefa356aaf82a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[PR] [HUDI-9208] Add file system view storage configs to MDT [hudi]

yihua opened a new pull request, #13015: URL: https://github.com/apache/hudi/pull/13015 ### Change Logs This PR adds the configs to change the file system view used by the metadata table writer. ### Impact Allows metadata table writer to use `SPILLABLE_DISK` view type to

[jira] [Updated] (HUDI-9208) Add file system view storage configs to MDT

[ https://issues.apache.org/jira/browse/HUDI-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9208: -- Priority: Blocker (was: Major) > Add file system view storage configs to MDT >

[jira] [Updated] (HUDI-9208) Add file system view storage configs to MDT

[ https://issues.apache.org/jira/browse/HUDI-9208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9208: -- Fix Version/s: 1.1.0 > Add file system view storage configs to MDT > ---

[jira] [Created] (HUDI-9208) Add file system view storage configs to MDT

Y Ethan Guo created HUDI-9208: - Summary: Add file system view storage configs to MDT Key: HUDI-9208 URL: https://issues.apache.org/jira/browse/HUDI-9208 Project: Apache Hudi Issue Type: Improveme

(hudi) 02/06: finish hashing_config initial && related UT

This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a commit to branch HUDI-8990 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 60de489d9a925d4f681894fc310081ffc3f27555 Author: YueZhang AuthorDate: Mon Mar 17 20:04:40 2025 +0800 fin

Re: [PR] [HUDI-9022] Handle records with custom delete markers for MOR [hudi]

hudi-bot commented on PR #12843: URL: https://github.com/apache/hudi/pull/12843#issuecomment-2744340348 ## CI report: * 9c54e6402544f2b5d3614469121927a6f824c1d5 UNKNOWN * 0314fa60c38070be1e9a04da9591acaecf34d4f9 UNKNOWN * 3e9f3d89f2985c41a0c0bd84fcbd1ebc2b5ce616 UNKNOWN *

Re: [PR] [HUDI-9022] Handle records with custom delete markers for MOR [hudi]

hudi-bot commented on PR #12843: URL: https://github.com/apache/hudi/pull/12843#issuecomment-2744155837 ## CI report: * 9c54e6402544f2b5d3614469121927a6f824c1d5 UNKNOWN * 0314fa60c38070be1e9a04da9591acaecf34d4f9 UNKNOWN * 3e9f3d89f2985c41a0c0bd84fcbd1ebc2b5ce616 UNKNOWN *

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

hudi-bot commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2743853879 ## CI report: * 9f7b65d34c472dc0e14316dd798a0385cef1f914 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4314) Azu

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

hudi-bot commented on PR #13008: URL: https://github.com/apache/hudi/pull/13008#issuecomment-2744021110 ## CI report: * b34e459d238dfaaad5c3babedca08bd2587a5334 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4304)

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

hudi-bot commented on PR #13008: URL: https://github.com/apache/hudi/pull/13008#issuecomment-2744018047 ## CI report: * b34e459d238dfaaad5c3babedca08bd2587a5334 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4304)

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

hudi-bot commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2742926844 ## CI report: * aa9ed6ce12c49d9c79034453a9bba3bfaf16a9d2 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4307)

Re: [PR] test validating flink bundle [hudi]

hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2743083948 ## CI report: * a8589a985904d7774b5631550a38ac1140bb790c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4311)

(hudi) branch HUDI-8990 updated (3458a75e620 -> c645eb4e679)

This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a change to branch HUDI-8990 in repository https://gitbox.apache.org/repos/asf/hudi.git from 3458a75e620 fix checkstyle add c645eb4e679 fix checkstyle No new revisions were added by this update.

Re: [PR] [HUDI-9144] Flink writer for MOR table supports writing RowData … [hudi]

hudi-bot commented on PR #12967: URL: https://github.com/apache/hudi/pull/12967#issuecomment-2741974435 ## CI report: * 78d1abf5376039c96456f1140c32b67de87cb9c7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4268)

Re: [I] [SUPPORT] HoodieCompactionException on hoodie metadata causing upserts to fail. [hudi]

nsivabalan commented on issue #13002: URL: https://github.com/apache/hudi/issues/13002#issuecomment-2743761630 can you post entire stacktrace. we could not gauge much from the screenshot. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] Adopt OpenDAL for accessing storage layer [hudi-rs]

xushiyan commented on issue #131: URL: https://github.com/apache/hudi-rs/issues/131#issuecomment-2743938076 Waiting for https://github.com/apache/opendal/pull/5482 and a new release that includes it. -- This is an automated message from the Apache Git Service. To respond to the message, p

(hudi) branch HUDI-8990 updated (c645eb4e679 -> 9f7b65d34c4)

This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a change to branch HUDI-8990 in repository https://gitbox.apache.org/repos/asf/hudi.git from c645eb4e679 fix checkstyle add 9f7b65d34c4 fix checkstyle No new revisions were added by this update.

[I] Add Table and Timeline APIs to support basic info retrieval [hudi-rs]

xushiyan opened a new issue, #314: URL: https://github.com/apache/hudi-rs/issues/314 ### Feature Description Table APIs to return table name, type, etc. Timeline APIs to fetch instants and commit metadata. ### Additional context _No response_ -- This is an autom

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

hudi-bot commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2743669034 ## CI report: * 9f7b65d34c472dc0e14316dd798a0385cef1f914 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4314) Azu

Re: [I] [SUPPORT] Hard Delete Operation Fails for Tables with Single Record Key and Partitioning [hudi]

nsivabalan commented on issue #13013: URL: https://github.com/apache/hudi/issues/13013#issuecomment-2743860521 for non partitioned, you can't use custom key gen. also, the property you are using for key gen class is wrong. Here is the script for mutliple record keys, non partitioned

Re: [PR] [HUDI-9207] Spark Insert Overwrite Support Row Writer [hudi]

hudi-bot commented on PR #13014: URL: https://github.com/apache/hudi/pull/13014#issuecomment-2743010269 ## CI report: * 44bf019a0ee76212d2f8e0293995824214264c33 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-9207] Spark Insert Overwrite Support Row Writer [hudi]

hudi-bot commented on PR #13014: URL: https://github.com/apache/hudi/pull/13014#issuecomment-2743669334 ## CI report: * 44bf019a0ee76212d2f8e0293995824214264c33 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4313) Azu

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

zhangyue19921010 commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2743666984 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] [HUDI-9207] Spark Insert Overwrite Support Row Writer [hudi]

zhangyue19921010 commented on PR #13014: URL: https://github.com/apache/hudi/pull/13014#issuecomment-2743666244 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [I] [SUPPORT] Hudi DELETE operation in Flink scans all partitions despite partition predicate [hudi]

maheshguptags commented on issue #12988: URL: https://github.com/apache/hudi/issues/12988#issuecomment-2743216536 Hi @danny0405 I tried your suggestion and implemented the index like ingestion job and it worked. So summary is : we will need to enable concurrency to delete the dat

Re: [I] [SUPPORT] Hard Delete Operation Fails for Tables with Single Record Key and Partitioning [hudi]

rangareddy commented on issue #13013: URL: https://github.com/apache/hudi/issues/13013#issuecomment-2743255605 Hi @mapdata-solutions Let me try to reproduce this issue, and I will get back to you with the next action items. -- This is an automated message from the Apache Git Servi

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

hudi-bot commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2743016749 ## CI report: * c645eb4e67959fc37bf2b907fbed53d84dffe971 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4312)

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

hudi-bot commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2743013512 ## CI report: * 3458a75e6209bc484c038e3705d1c059d018fc1d Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4309)

[PR] [HUDI-9207] Spark Insert Overwrite Support Row Writer [hudi]

zhangyue19921010 opened a new pull request, #13014: URL: https://github.com/apache/hudi/pull/13014 ### Change Logs Spark Insert Overwrite Support Row Writer ### Impact Spark Insert Overwrite Support Row Writer ### Risk level (write none, low medium or high below)

(hudi) branch HUDI-9207 created (now 2e77c75eab2)

This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a change to branch HUDI-9207 in repository https://gitbox.apache.org/repos/asf/hudi.git at 2e77c75eab2 Spark Insert Overwrite Support Row Writer This branch includes the following new commits:

[jira] [Created] (HUDI-9207) Spark Insert Overwrite Support Row Writer

Yue Zhang created HUDI-9207: --- Summary: Spark Insert Overwrite Support Row Writer Key: HUDI-9207 URL: https://issues.apache.org/jira/browse/HUDI-9207 Project: Apache Hudi Issue Type: New Feature

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

hudi-bot commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2742930248 ## CI report: * 3458a75e6209bc484c038e3705d1c059d018fc1d Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4309)

Re: [PR] test validating flink bundle [hudi]

hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2742910617 ## CI report: * db359506fe53b825a9ed23ceaf9cb680d6fdd3ad Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4308)

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

hudi-bot commented on PR #13008: URL: https://github.com/apache/hudi/pull/13008#issuecomment-2742800882 ## CI report: * b34e459d238dfaaad5c3babedca08bd2587a5334 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4304)

Re: [PR] [HUDI-9144] Flink writer for MOR table supports writing RowData … [hudi]

cshuo commented on code in PR #12967: URL: https://github.com/apache/hudi/pull/12967#discussion_r2007214858 ## hudi-hadoop-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java: ## @@ -267,35 +268,42 @@ public List> readColumnStatsFromMetadata(H

Re: [PR] [HUDI-9144] Flink writer for MOR table supports writing RowData … [hudi]

hudi-bot commented on PR #12967: URL: https://github.com/apache/hudi/pull/12967#issuecomment-2742610430 ## CI report: * 27bf56019b6b5d30022131498290dd8cf1ba7b5f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4301)

Re: [PR] [HUDI-8990] Partition Level Bucket Index [hudi]

hudi-bot commented on PR #13012: URL: https://github.com/apache/hudi/pull/13012#issuecomment-2742762285 ## CI report: * aa9ed6ce12c49d9c79034453a9bba3bfaf16a9d2 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4307)

Re: [PR] test validating flink bundle [hudi]

hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2742755083 ## CI report: * dd0ffb4ee8bf8eb1ebab8cb50fbb6f50becdcdcf Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4306)

Re: [PR] [HUDI-9198] Support rate limit for append mode [hudi]

hudi-bot commented on PR #12999: URL: https://github.com/apache/hudi/pull/12999#issuecomment-2742651211 ## CI report: * e24f8854aed4877142e2278e9344be4fb206675d Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4302)

(hudi) branch HUDI-8990 created (now aa9ed6ce12c)

This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a change to branch HUDI-8990 in repository https://gitbox.apache.org/repos/asf/hudi.git at aa9ed6ce12c finish Spark related conding and test This branch includes the following new commits: ne

Re: [PR] test validating flink bundle [hudi]

hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2742621179 ## CI report: * dd0ffb4ee8bf8eb1ebab8cb50fbb6f50becdcdcf Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4306)

(hudi) 04/06: finish Flink related coding and UT && Spark partitioner and index without test

This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a commit to branch HUDI-8990 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 97bf409a5ad2cb939bc941f2b94432960c17a945 Author: YueZhang AuthorDate: Wed Mar 19 20:28:17 2025 +0800 fin

(hudi) 05/06: finish Spark call update hashing config need more test

This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a commit to branch HUDI-8990 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 184231de7b02e33baad0d6ee5b08f2075f0e7f9c Author: YueZhang AuthorDate: Thu Mar 20 16:58:36 2025 +0800 fin

Re: [PR] test validating flink bundle [hudi]

hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2742618426 ## CI report: * dd0ffb4ee8bf8eb1ebab8cb50fbb6f50becdcdcf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-9206] Support reading inflight instants with HoodieLogRecordReader [hudi]

hudi-bot commented on PR #13010: URL: https://github.com/apache/hudi/pull/13010#issuecomment-2742528053 ## CI report: * c9bb24320873e0e814a8b152b541ea091d564981 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4303)

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2742589721 ## CI report: * 9f0ce6ad5539fc0983dfbd9dbd3424ff11bb9d30 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4300)

Re: [PR] [HUDI-9206] Support reading inflight instants with HoodieLogRecordReader [hudi]

hudi-bot commented on PR #13010: URL: https://github.com/apache/hudi/pull/13010#issuecomment-2742525920 ## CI report: * c9bb24320873e0e814a8b152b541ea091d564981 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

hudi-bot commented on PR #13007: URL: https://github.com/apache/hudi/pull/13007#issuecomment-2742571209 ## CI report: * 9f0ce6ad5539fc0983dfbd9dbd3424ff11bb9d30 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4300)

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

hudi-bot commented on PR #13008: URL: https://github.com/apache/hudi/pull/13008#issuecomment-2742568799 ## CI report: * b00d2c37e80b3e2ebfde8400a39d62cda7028a6d Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4298)

[jira] [Commented] (HUDI-8779) Compaction is triggered on COW table

[ https://issues.apache.org/jira/browse/HUDI-8779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17937298#comment-17937298 ] Lin Liu commented on HUDI-8779: --- I reproduced the problem, which is that the table type is C

Re: [PR] [HUDI-9198] Support rate limit for append mode [hudi]

hudi-bot commented on PR #12999: URL: https://github.com/apache/hudi/pull/12999#issuecomment-2742519885 ## CI report: * ac5b1ea3a5c0dff0bf02f6e67b80abfcd7bb8322 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4260)

[jira] [Updated] (HUDI-9206) Support reading inflight instants with HoodieLogRecordReader

[ https://issues.apache.org/jira/browse/HUDI-9206?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9206: - Labels: pull-request-available (was: ) > Support reading inflight instants with HoodieLogRecordRe

Re: [PR] [HUDI-9198] Support rate limit for append mode [hudi]

hudi-bot commented on PR #12999: URL: https://github.com/apache/hudi/pull/12999#issuecomment-2742522501 ## CI report: * ac5b1ea3a5c0dff0bf02f6e67b80abfcd7bb8322 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4260)

[jira] [Created] (HUDI-9206) Support reading inflight instants with HoodieLogRecordReader

Lokesh Jain created HUDI-9206: - Summary: Support reading inflight instants with HoodieLogRecordReader Key: HUDI-9206 URL: https://issues.apache.org/jira/browse/HUDI-9206 Project: Apache Hudi Iss

Re: [PR] [HUDI-9198] Support rate limit for append mode [hudi]

danny0405 commented on code in PR #12999: URL: https://github.com/apache/hudi/pull/12999#discussion_r2006966605 ## hudi-flink-datasource/hudi-flink/src/main/java/org/apache/hudi/sink/append/AppendWriteFunctions.java: ## @@ -0,0 +1,43 @@ +/* + * Licensed to the Apache Software Fo