Re: [PR] [MINOR] Improve CI to parallelize tests more and reduce completion time [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13031: URL: https://github.com/apache/hudi/pull/13031#issuecomment-2753404416 ## CI report: * c42fd0d0e7d343023b161025e81fa3c861f5da91 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4412)

Re: [PR] [HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13033: URL: https://github.com/apache/hudi/pull/13033#issuecomment-2753350866 ## CI report: * b29e8ffcb73ff7fd65c85cd278c072f8dbe648b3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4414)

Re: [PR] [MINOR] Improve CI to parallelize tests more and reduce completion time [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13031: URL: https://github.com/apache/hudi/pull/13031#issuecomment-2753401900 ## CI report: * c42fd0d0e7d343023b161025e81fa3c861f5da91 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4412)

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

2025-03-25 Thread via GitHub
lokeshj1703 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2013468586 ## hudi-hadoop-common/src/test/java/org/apache/hudi/common/testutils/HoodieTestTable.java: ## @@ -754,6 +754,11 @@ public HoodieTestTable withLogMarkerFile(String p

Re: [PR] [HUDI-9154] Allow bootstrap to complete without updating col stats [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12952: URL: https://github.com/apache/hudi/pull/12952#issuecomment-2753392616 ## CI report: * c2ad1e287ff2a544d8ea09ab4ff10fe0cbd4033b UNKNOWN * d29bc45097ba835b54acda1fb9e4af4a8c2dc856 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] [HUDI-6895] Change default timeline timezone from local to UTC [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #9794: URL: https://github.com/apache/hudi/pull/9794#issuecomment-2742001721 ## CI report: * f24d8f29bb176d458485642a56e124b1294b65be Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4284)

Re: [PR] [HUDI-9212] Fix metadata compaction failure post downgrade [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13022: URL: https://github.com/apache/hudi/pull/13022#issuecomment-2752249968 ## CI report: * c4bd5b8e7e8e0a56767918999e23883b3c687021 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4396)

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

2025-03-25 Thread via GitHub
lokeshj1703 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2013470234 ## hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/client/functional/TestHoodieBackedMetadata.java: ## @@ -258,6 +259,7 @@ public void testMetadataTab

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

2025-03-25 Thread via GitHub
lokeshj1703 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2013469349 ## hudi-client/hudi-client-common/src/test/java/org/apache/hudi/table/action/rollback/TestMarkerBasedRollbackStrategy.java: ## @@ -141,7 +141,7 @@ private Map creat

Re: [PR] [HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13033: URL: https://github.com/apache/hudi/pull/13033#issuecomment-2753353131 ## CI report: * b29e8ffcb73ff7fd65c85cd278c072f8dbe648b3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4414)

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12866: URL: https://github.com/apache/hudi/pull/12866#discussion_r2013458378 ## hudi-io/src/main/java/org/apache/hudi/io/hfile/KeyValueEntry.java: ## @@ -0,0 +1,38 @@ +/* + * Licensed to the Apache Software Foundation (ASF) under one + * or mor

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12866: URL: https://github.com/apache/hudi/pull/12866#discussion_r2013457490 ## hudi-io/src/main/java/org/apache/hudi/io/hfile/HFileRootIndexBlock.java: ## @@ -50,16 +54,16 @@ public HFileRootIndexBlock(HFileContext context, */ public Tr

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12866: URL: https://github.com/apache/hudi/pull/12866#discussion_r2013456622 ## hudi-io/src/main/java/org/apache/hudi/io/hfile/HFileMetaBlock.java: ## @@ -34,6 +36,44 @@ protected HFileMetaBlock(HFileContext context, public ByteBuffer readCo

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12866: URL: https://github.com/apache/hudi/pull/12866#discussion_r2013442305 ## hudi-hadoop-common/src/main/java/org/apache/hudi/common/util/HFileUtils.java: ## @@ -207,25 +194,21 @@ public byte[] serializeRecordsToLogBlock(HoodieStorage stora

Re: [PR] [MINOR]Follow up HUDI-8803, optimize vectorized reader by cache 'batchIdxField' [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13023: URL: https://github.com/apache/hudi/pull/13023#issuecomment-2753327853 ## CI report: * bf921b1b036356db2ec83d07725febe4c0bbe46f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4374) Azu

Re: [I] [SUPPORT] Hard Delete Operation Fails for Tables with Single Record Key and Partitioning [hudi]

2025-03-25 Thread via GitHub
mapdata-solutions commented on issue #13013: URL: https://github.com/apache/hudi/issues/13013#issuecomment-2753314036 Hi, I'm trying to delete records from a Hudi table with multi-level Hive-style partitioning. Here's my table structure and configuration: Table Schema: ```sq

Re: [PR] [MINOR]Follow up HUDI-8803, optimize vectorized reader by cache 'batchIdxField' [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13023: URL: https://github.com/apache/hudi/pull/13023#issuecomment-2753325776 ## CI report: * bf921b1b036356db2ec83d07725febe4c0bbe46f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4374) Azu

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12866: URL: https://github.com/apache/hudi/pull/12866#discussion_r2013442305 ## hudi-hadoop-common/src/main/java/org/apache/hudi/common/util/HFileUtils.java: ## @@ -207,25 +194,21 @@ public byte[] serializeRecordsToLogBlock(HoodieStorage stora

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2753323706 ## CI report: * c471de0ed1a28a503575e1f2d997257ba4a144d7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4418)

Re: [PR] [HUDI-9205] Refactor Flink tests to avoid sleeping for data results [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #13027: URL: https://github.com/apache/hudi/pull/13027#discussion_r2013101456 ## hudi-flink-datasource/hudi-flink/src/test/java/org/apache/hudi/table/ITTestHoodieDataSource.java: ## @@ -2189,7 +2182,7 @@ void testReadMetaFields(HoodieTableType t

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12866: URL: https://github.com/apache/hudi/pull/12866#discussion_r2013439214 ## hudi-common/src/main/java/org/apache/hudi/common/bootstrap/index/hfile/HFileBootstrapIndexWriter.java: ## @@ -196,15 +189,11 @@ public void close() { @Override

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12866: URL: https://github.com/apache/hudi/pull/12866#discussion_r2013435415 ## hudi-common/src/main/java/org/apache/hudi/common/bootstrap/index/hfile/HFileBootstrapIndex.java: ## @@ -144,7 +144,7 @@ public BootstrapIndex.IndexReader createRead

Re: [PR] [HUDI-7037] Fix colstats reading for Decimal field [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12993: URL: https://github.com/apache/hudi/pull/12993#issuecomment-2753295570 ## CI report: * a445e14784cd47da29a25c2a4d2ada305c806a2c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4416)

Re: [PR] [HUDI-9154] Allow bootstrap to complete without updating col stats [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12952: URL: https://github.com/apache/hudi/pull/12952#issuecomment-2753209565 ## CI report: * 315f64382fee128858d3b502d6395b57c56071e3 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4417)

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2013422464 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/BaseCommitActionExecutor.java: ## @@ -226,6 +226,7 @@ protected void commit(HoodieW

Re: [PR] [HUDI-6895] Change default timeline timezone from local to UTC [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #9794: URL: https://github.com/apache/hudi/pull/9794#issuecomment-2753247523 ## CI report: * 10b69b62ee63f391d2f7e269a92d20b6fbeb117f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4394) *

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2013422824 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/rollback/RollbackUtils.java: ## @@ -96,6 +96,21 @@ static HoodieRollbackStat mergeRollbac

Re: [PR] [HUDI-9216] Fallback to spark.catalog.currentDatabase if tableConfig.databaseName is null or empty [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13026: URL: https://github.com/apache/hudi/pull/13026#issuecomment-2752619064 ## CI report: * 2e3b3451506bbc4b29c85bf3da7af34a3d3ba12e Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4400)

Re: [PR] [HUDI-9154] Allow bootstrap to complete without updating col stats [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12952: URL: https://github.com/apache/hudi/pull/12952#issuecomment-2753197490 ## CI report: * 315f64382fee128858d3b502d6395b57c56071e3 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4417)

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2013411057 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/marker/DirectWriteMarkers.java: ## @@ -115,15 +108,64 @@ public Set createdAndMergedDataPaths(Ho

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2013079596 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/rollback/MarkerBasedRollbackStrategy.java: ## @@ -173,11 +173,34 @@ protected HoodieRollba

Re: [PR] [HUDI-6895] Change default timeline timezone from local to UTC [hudi]

2025-03-25 Thread via GitHub
codope commented on code in PR #9794: URL: https://github.com/apache/hudi/pull/9794#discussion_r2013395953 ## hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java: ## @@ -1471,6 +1473,7 @@ public Properties build() { } if (null != commi

Re: [PR] [MINOR] Fix flaky test testCreateNewInstantTimes [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13032: URL: https://github.com/apache/hudi/pull/13032#issuecomment-2753176069 ## CI report: * 77bdaf1a11f8daf414deeb8f211d22183416e5e2 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4407)

Re: [PR] [HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13033: URL: https://github.com/apache/hudi/pull/13033#issuecomment-2753238058 ## CI report: * b29e8ffcb73ff7fd65c85cd278c072f8dbe648b3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4414)

Re: [PR] [HUDI-9154] Allow bootstrap to complete without updating col stats [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12952: URL: https://github.com/apache/hudi/pull/12952#issuecomment-2753256582 ## CI report: * 315f64382fee128858d3b502d6395b57c56071e3 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4417)

Re: [PR] [MINOR] Fix flaky test testCreateNewInstantTimes [hudi]

2025-03-25 Thread via GitHub
codope commented on code in PR #13032: URL: https://github.com/apache/hudi/pull/13032#discussion_r2013392565 ## hudi-hadoop-common/src/test/java/org/apache/hudi/common/table/TestHoodieTableMetaClient.java: ## @@ -147,7 +147,9 @@ public void testCreateNewInstantTimes() throws IOE

Re: [PR] [HUDI-6895] Change default timeline timezone from local to UTC [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #9794: URL: https://github.com/apache/hudi/pull/9794#issuecomment-2753245466 ## CI report: * 10b69b62ee63f391d2f7e269a92d20b6fbeb117f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4394) *

Re: [PR] [MINOR] Fix flaky test testCreateNewInstantTimes [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13032: URL: https://github.com/apache/hudi/pull/13032#issuecomment-2753236432 ## CI report: * 77bdaf1a11f8daf414deeb8f211d22183416e5e2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4407)

Re: [PR] [MINOR] Improve CI to parallelize tests more and reduce completion time [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13031: URL: https://github.com/apache/hudi/pull/13031#issuecomment-2753068368 ## CI report: * 75f759a43b7823097fb2bdeaa7059b46bc88abd2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4401)

Re: [PR] [HUDI-9154] Allow bootstrap to complete without updating col stats [hudi]

2025-03-25 Thread via GitHub
CTTY commented on PR #12952: URL: https://github.com/apache/hudi/pull/12952#issuecomment-2753224368 #12977 seems to be able to fix this issue, I have not tested it yet. I'll test it later -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2753203713 ## CI report: * 679dacb53d5a26195e5d626756caee4052218ebe Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4415)

Re: [PR] [HUDI-9212] Fix metadata compaction failure post downgrade [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13022: URL: https://github.com/apache/hudi/pull/13022#issuecomment-2753206771 ## CI report: * b588511bff75dbf929a6e0e8b3f22ee752a36efc Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4413)

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2753202211 ## CI report: * 6be1de1bee0948d5651c7bf948cce33712b0c960 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4411)

Re: [PR] [HUDI-9154] Allow bootstrap to complete without updating col stats [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12952: URL: https://github.com/apache/hudi/pull/12952#issuecomment-2753194003 ## CI report: * 236c29bd89b8b6927e7a492fb8f1c081507ab905 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4140)

Re: [PR] [MINOR] Fix flaky test testCreateNewInstantTimes [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13032: URL: https://github.com/apache/hudi/pull/13032#issuecomment-2753174467 ## CI report: * 77bdaf1a11f8daf414deeb8f211d22183416e5e2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] [HUDI-9154] Allow bootstrap to complete without updating col stats [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12952: URL: https://github.com/apache/hudi/pull/12952#issuecomment-2753185859 ## CI report: * 236c29bd89b8b6927e7a492fb8f1c081507ab905 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4140)

Re: [PR] [HUDI-9154] Allow bootstrap to complete without updating col stats [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12952: URL: https://github.com/apache/hudi/pull/12952#issuecomment-2753187521 ## CI report: * 236c29bd89b8b6927e7a492fb8f1c081507ab905 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4140)

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2753137483 ## CI report: * eab2ec52ab0af906c2ceaac05e6b376ac76d755e Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4409)

[jira] [Closed] (HUDI-8840) Support custom delete marker in EVENT_TIME_ORDERING merge mode

2025-03-25 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu closed HUDI-8840. - Resolution: Fixed > Support custom delete marker in EVENT_TIME_ORDERING merge mode > -

[jira] [Commented] (HUDI-8840) Support custom delete marker in EVENT_TIME_ORDERING merge mode

2025-03-25 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938414#comment-17938414 ] Lin Liu commented on HUDI-8840: --- Delete marker for MOR has been done as a sub-task. Delete

[jira] [Comment Edited] (HUDI-8840) Support custom delete marker in EVENT_TIME_ORDERING merge mode

2025-03-25 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938414#comment-17938414 ] Lin Liu edited comment on HUDI-8840 at 3/26/25 3:47 AM: Delete mar

[jira] [Comment Edited] (HUDI-8840) Support custom delete marker in EVENT_TIME_ORDERING merge mode

2025-03-25 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938414#comment-17938414 ] Lin Liu edited comment on HUDI-8840 at 3/26/25 3:47 AM: Delete mar

Re: [PR] [MINOR] Improve CI to parallelize tests more and reduce completion time [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13031: URL: https://github.com/apache/hudi/pull/13031#issuecomment-2753161854 ## CI report: * c42fd0d0e7d343023b161025e81fa3c861f5da91 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4412)

Re: [PR] [HUDI-6895] Change default timeline timezone from local to UTC [hudi]

2025-03-25 Thread via GitHub
codope commented on code in PR #9794: URL: https://github.com/apache/hudi/pull/9794#discussion_r2013332367 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/upgrade/UpgradeDowngradeUtils.java: ## @@ -211,4 +211,11 @@ static void rollbackFailedWritesAndCompact

Re: [PR] [HUDI-7037] Fix colstats reading for Decimal field [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12993: URL: https://github.com/apache/hudi/pull/12993#issuecomment-2753142294 ## CI report: * d4e5d2bfa01259fb3680a12b0ed500b3d739991c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4283)

Re: [PR] [HUDI-7037] Fix colstats reading for Decimal field [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12993: URL: https://github.com/apache/hudi/pull/12993#issuecomment-2753140609 ## CI report: * d4e5d2bfa01259fb3680a12b0ed500b3d739991c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4283)

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2753139092 ## CI report: * 6be1de1bee0948d5651c7bf948cce33712b0c960 Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4411)

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2752861180 ## CI report: * 9205b9846cd121f76fbafb47089e8ba5b3b0955c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4393)

Re: [I] flink_sql create table and to save hive [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on issue #12553: URL: https://github.com/apache/hudi/issues/12553#issuecomment-2753126255 > Hi [@danny0405](https://github.com/danny0405) > > Are you able to check the attached logs to find out the cause? I can not even see the hive sync procedure in the JM l

Re: [PR] [HUDI-9212] Fix metadata compaction failure post downgrade [hudi]

2025-03-25 Thread via GitHub
codope commented on code in PR #13022: URL: https://github.com/apache/hudi/pull/13022#discussion_r2013314499 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestSevenToEightUpgrade.scala: ## @@ -102,4 +110,260 @@ class TestSevenToEightUpgrade extend

Re: [PR] [MINOR] Fix flaky test testCreateNewInstantTimes [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13032: URL: https://github.com/apache/hudi/pull/13032#issuecomment-2753078744 ## CI report: * 77bdaf1a11f8daf414deeb8f211d22183416e5e2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4407)

Re: [PR] [MINOR] Improve CI to parallelize tests more and reduce completion time [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13031: URL: https://github.com/apache/hudi/pull/13031#issuecomment-2753066729 ## CI report: * 75f759a43b7823097fb2bdeaa7059b46bc88abd2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4401)

Re: [PR] [HUDI-8409] Fix inconsistency between merge mode and merge strategy id [hudi]

2025-03-25 Thread via GitHub
linliu-code closed pull request #13024: [HUDI-8409] Fix inconsistency between merge mode and merge strategy id URL: https://github.com/apache/hudi/pull/13024 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

Re: [PR] [HUDI-8934] [RFC-87] Avro elimination in Flink writer [hudi]

2025-03-25 Thread via GitHub
cshuo commented on PR #12960: URL: https://github.com/apache/hudi/pull/12960#issuecomment-2753101686 @Alowator Would you be able to update this PR when you have time? BTW, I've created some sub-tasks for RFC-87 in JIRA: https://issues.apache.org/jira/browse/HUDI-9075, you can check there wh

Re: [PR] [HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient [hudi]

2025-03-25 Thread via GitHub
vinishjail97 commented on PR #13033: URL: https://github.com/apache/hudi/pull/13033#issuecomment-2753095750 There are test failures looking into them. ``` Error: Tests run: 18, Failures: 1, Errors: 0, Skipped: 1, Time elapsed: 5.096 s <<< FAILURE! - in org.apache.hudi.hadoop.TestGlo

[jira] [Updated] (HUDI-9219) Follow up on all usages of Closeable iterator in spark tasks

2025-03-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9219: - Labels: pull-request-available (was: ) > Follow up on all usages of Closeable iterator in spark t

[PR] [WIP] [HUDI-9219] Fixing .close() calls for ClosableIterator [hudi]

2025-03-25 Thread via GitHub
vinothchandar opened a new pull request, #13034: URL: https://github.com/apache/hudi/pull/13034 ### Change Logs - Added try-with-resources style handling uniformly - Tests and tools are the main places - Audited almost all of the transitive calls Todo: - Bunch of FI

[jira] [Commented] (HUDI-8915) COW MIT delete operations does not honer event time based ordering

2025-03-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938404#comment-17938404 ] sivabalan narayanan commented on HUDI-8915: --- Essentially, ExpressionPayload comb

Re: [PR] [HUDI-9212] Fix metadata compaction failure post downgrade [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13022: URL: https://github.com/apache/hudi/pull/13022#issuecomment-2753080350 ## CI report: * c4bd5b8e7e8e0a56767918999e23883b3c687021 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4396)

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12866: URL: https://github.com/apache/hudi/pull/12866#issuecomment-2753089646 ## CI report: * 180b65dd680bf029888057648b10bb4c9f480a97 UNKNOWN * e229e3a1b793a97339602dfc61ce0eae3668ade7 UNKNOWN * 7c9e1fbbb52ae47d26daa0e25fc3d02569c79545 UNKNOWN *

Re: [PR] [HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13033: URL: https://github.com/apache/hudi/pull/13033#issuecomment-2753083632 ## CI report: * b29e8ffcb73ff7fd65c85cd278c072f8dbe648b3 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4414)

Re: [PR] [HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13033: URL: https://github.com/apache/hudi/pull/13033#issuecomment-2753082029 ## CI report: * b29e8ffcb73ff7fd65c85cd278c072f8dbe648b3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[PR] [HUDI-9216] Ignore validation of empty databaseName in HoodieTableMetaClient [hudi]

2025-03-25 Thread via GitHub
vinishjail97 opened a new pull request, #13033: URL: https://github.com/apache/hudi/pull/13033 ### Change Logs If user passes a different value of `hoodie.database.name` in properties, the validation can be ignored if tableConfig (content in hoodie.properties) contains null/empty str

[jira] [Commented] (HUDI-8915) COW MIT delete operations does not honer event time based ordering

2025-03-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8915?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17938403#comment-17938403 ] sivabalan narayanan commented on HUDI-8915: --- Nope, we still have the issue.  he

Re: [PR] [HUDI-9212] Fix metadata compaction failure post downgrade [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13022: URL: https://github.com/apache/hudi/pull/13022#issuecomment-2753078678 ## CI report: * c4bd5b8e7e8e0a56767918999e23883b3c687021 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4396)

Re: [I] [SUPPORT] HoodieCompactionException on hoodie metadata causing upserts to fail. [hudi]

2025-03-25 Thread via GitHub
gbcoder2020 commented on issue #13002: URL: https://github.com/apache/hudi/issues/13002#issuecomment-2753050973 Any update on the above? @nsivabalan thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2753048877 ## CI report: * eab2ec52ab0af906c2ceaac05e6b376ac76d755e Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4409)

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2753047439 ## CI report: * 9205b9846cd121f76fbafb47089e8ba5b3b0955c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4393)

Re: [PR] hudi0.13.1 [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on PR #13021: URL: https://github.com/apache/hudi/pull/13021#issuecomment-2752909452 @hanleiit Did you apply the new fix then https://github.com/apache/hudi/pull/8935/files? Can you share with use the full error stacktrace? -- This is an automated message from the Apa

Re: [I] flink_sql create table and to save hive [hudi]

2025-03-25 Thread via GitHub
804e commented on issue #12553: URL: https://github.com/apache/hudi/issues/12553#issuecomment-2753039381 > Can you check the Flink JM log to see what errors are thrown there? I used the sql client for testing, the following file is my log [flink--kubernetes-session-0-flink-sess

Re: [PR] [DNM] test validating flink bundle [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13011: URL: https://github.com/apache/hudi/pull/13011#issuecomment-2752855790 ## CI report: * 9205b9846cd121f76fbafb47089e8ba5b3b0955c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4393)

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12866: URL: https://github.com/apache/hudi/pull/12866#issuecomment-2752809417 ## CI report: * 180b65dd680bf029888057648b10bb4c9f480a97 UNKNOWN * e229e3a1b793a97339602dfc61ce0eae3668ade7 UNKNOWN * 7c9e1fbbb52ae47d26daa0e25fc3d02569c79545 UNKNOWN *

Re: [PR] [MINOR] Fix flaky test testCreateNewInstantTimes [hudi]

2025-03-25 Thread via GitHub
yihua commented on PR #13032: URL: https://github.com/apache/hudi/pull/13032#issuecomment-2752901452 > 10 sec is not sufficient is it? :( Seems like it. I've added logs also in case it fails again so we know the exact instant times from the test. -- This is an automated message fr

hudi.git: Error while running github feature from master:.asf.yaml

2025-03-25 Thread Apache Infrastructure
An error occurred while processing the github feature in .asf.yaml: GitHub discussions can only be enabled if a mailing list target exists for it. --- With regards, ASF Infra.

Re: [PR] [HUDI-9012] Implement and utilize native writer for HFile [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #12866: URL: https://github.com/apache/hudi/pull/12866#issuecomment-2752900512 ## CI report: * 180b65dd680bf029888057648b10bb4c9f480a97 UNKNOWN * e229e3a1b793a97339602dfc61ce0eae3668ade7 UNKNOWN * 7c9e1fbbb52ae47d26daa0e25fc3d02569c79545 UNKNOWN *

Re: [PR] hudi0.13.1 [hudi]

2025-03-25 Thread via GitHub
hanleiit commented on PR #13021: URL: https://github.com/apache/hudi/pull/13021#issuecomment-2752898169 > > Maybe this fix is what you need: #8935, see the issue: #8932 > > I have read the fix problem you gave me, but the same bug still appears, get () is empty ![Uploading 1742

Re: [I] [SUPPORT] Flinksql:select count(*) from table; No value present in Option [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on issue #13019: URL: https://github.com/apache/hudi/issues/13019#issuecomment-2752898872 Can you share the full error stack trace? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

Re: [PR] hudi0.13.1 [hudi]

2025-03-25 Thread via GitHub
hanleiit commented on PR #13021: URL: https://github.com/apache/hudi/pull/13021#issuecomment-2752889785 > Maybe this fix is what you need: #8935, see the issue: #8932 I have read the fix problem you gave me, but the same bug still appears, get () is empty -- This is an automated me

Re: [PR] [HUDI-8635] Support totalLogRecord metric for FG reader based compaction [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13008: URL: https://github.com/apache/hudi/pull/13008#issuecomment-2752876583 ## CI report: * c6195191246eddf09e5e8a0034c4056522e7dcdc Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4403)

Re: [PR] [MINOR] Improve CI to parallelize tests more and reduce completion time [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13031: URL: https://github.com/apache/hudi/pull/13031#issuecomment-2752872095 ## CI report: * 75f759a43b7823097fb2bdeaa7059b46bc88abd2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4401)

Re: [PR] [HUDI-1517] create marker file for every log file [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #13007: URL: https://github.com/apache/hudi/pull/13007#discussion_r2013079596 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/rollback/MarkerBasedRollbackStrategy.java: ## @@ -173,11 +173,34 @@ protected HoodieRollba

Re: [PR] [RFC-92] Pluggable Table Format Support [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12998: URL: https://github.com/apache/hudi/pull/12998#discussion_r2011190071 ## rfc/rfc-92/rfc-92.md: ## @@ -0,0 +1,102 @@ + +# RFC-92: Pluggable Table Formats in Hudi + +## Proposers + +* Balaji Varadarajan + +## Approvers + +* Vinoth Chan

Re: [PR] [RFC-92] Pluggable Table Format Support [hudi]

2025-03-25 Thread via GitHub
danny0405 commented on code in PR #12998: URL: https://github.com/apache/hudi/pull/12998#discussion_r2013119087 ## rfc/rfc-92/rfc-92.md: ## @@ -0,0 +1,200 @@ + +# RFC-92: Pluggable Table Formats in Hudi + +## Proposers + +* Balaji Varadarajan + +## Approvers + +* Vinoth Chan

[jira] [Assigned] (HUDI-9219) Follow up on all usages of Closeable iterator in spark tasks

2025-03-25 Thread Vinoth Chandar (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-9219: Assignee: Vinoth Chandar (was: sivabalan narayanan) > Follow up on all usages of Closeable

Re: [PR] [RFC-92] Pluggable Table Format Support [hudi]

2025-03-25 Thread via GitHub
vinothchandar commented on code in PR #12998: URL: https://github.com/apache/hudi/pull/12998#discussion_r2013081942 ## rfc/rfc-92/rfc-92.md: ## @@ -0,0 +1,200 @@ + +# RFC-92: Pluggable Table Formats in Hudi + +## Proposers + +* Balaji Varadarajan + +## Approvers + +* Vinoth

Re: [PR] [MINOR] Improve CI to parallelize tests more and reduce completion time [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13031: URL: https://github.com/apache/hudi/pull/13031#issuecomment-2752832724 ## CI report: * 75f759a43b7823097fb2bdeaa7059b46bc88abd2 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4401)

Re: [PR] [MINOR] Fix flaky test testCreateNewInstantTimes [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13032: URL: https://github.com/apache/hudi/pull/13032#issuecomment-2752825400 ## CI report: * 77bdaf1a11f8daf414deeb8f211d22183416e5e2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Closed] (HUDI-9220) Cannot find write operation type if run inline log compaction

2025-03-25 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9220. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch: fb77b1da41149ca9055ad909e421163efa94b5

(hudi) branch master updated: [HUDI-9220] Cannot find write operation type if run inline log compaction (#13029)

2025-03-25 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new fb77b1da411 [HUDI-9220] Cannot find write opera

Re: [PR] [MINOR] Fix flaky test testCreateNewInstantTimes [hudi]

2025-03-25 Thread via GitHub
hudi-bot commented on PR #13032: URL: https://github.com/apache/hudi/pull/13032#issuecomment-2752827051 ## CI report: * 77bdaf1a11f8daf414deeb8f211d22183416e5e2 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=4407)

  1   2   3   >