[PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
ktblsva opened a new pull request, #12649: URL: https://github.com/apache/hudi/pull/12649 ### Change Logs _Describe context and summary for this change. Highlight if any code was copied._ ### Impact _Describe any public API or user-facing feature change or any performanc

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2594901039 ## CI report: * 60c2b5a1b01b772f6c25706a35caafeb0e97389d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Updated] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-8872: Description: Current list for       ||*Class Name*||*Problem Description*|| |{{HiveCatalogConsta

[jira] [Created] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
Geser Dugarov created HUDI-8872: --- Summary: Fix javadoc comments Key: HUDI-8872 URL: https://issues.apache.org/jira/browse/HUDI-8872 Project: Apache Hudi Issue Type: Wish Reporter: G

[jira] [Updated] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-8872: Priority: Minor (was: Major) > Fix javadoc comments > > > Key:

[jira] [Updated] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-8872: Description: Current list for   *| Class Name | Problem Description |* ||--

[jira] [Updated] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-8872: Description: Current list for master, commit 1f6d55723d88fa9881464e94610eb15f245bea52, is below. |

[jira] [Updated] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-8872: Description: Current list for master, commit 1f6d55723d88fa9881464e94610eb15f245bea52, is below.  

[jira] [Updated] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-8872: Description: Current list for master, commit 1f6d55723d88fa9881464e94610eb15f245bea52, is below.

[jira] [Updated] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-8872: Description: Current list for master, commit 1f6d55723d88fa9881464e94610eb15f245bea52, is below.  

[jira] [Updated] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Geser Dugarov updated HUDI-8872: Description: Current list for master, commit 1f6d55723d88fa9881464e94610eb15f245bea52, is below.

Re: [PR] [MINOR] Fixed run of `javadoc:aggregate` [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12650: URL: https://github.com/apache/hudi/pull/12650#issuecomment-2595240723 ## CI report: * 0d3a5bdafb61f949fcab5458926e81a3d4196170 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Comment Edited] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913680#comment-17913680 ] Geser Dugarov edited comment on HUDI-8872 at 1/16/25 11:12 AM: -

[jira] [Commented] (HUDI-8872) Fix javadoc comments

2025-01-16 Thread Geser Dugarov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8872?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17913680#comment-17913680 ] Geser Dugarov commented on HUDI-8872: - To run javadoc PR https://github.com/apache/hud

Re: [PR] [MINOR] Fixed run of `javadoc:aggregate` [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12650: URL: https://github.com/apache/hudi/pull/12650#issuecomment-2595243349 ## CI report: * 0d3a5bdafb61f949fcab5458926e81a3d4196170 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2897)

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
wombatu-kun commented on code in PR #12649: URL: https://github.com/apache/hudi/pull/12649#discussion_r1918123862 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestClusteringProcedure.scala: ## @@ -774,6 +774,50 @@ class TestClusteringPro

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2595091819 ## CI report: * 60c2b5a1b01b772f6c25706a35caafeb0e97389d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2895)

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
ktblsva commented on code in PR #12649: URL: https://github.com/apache/hudi/pull/12649#discussion_r1918173778 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestClusteringProcedure.scala: ## @@ -774,6 +774,50 @@ class TestClusteringProcedu

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
ktblsva commented on code in PR #12649: URL: https://github.com/apache/hudi/pull/12649#discussion_r1918173087 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestClusteringProcedure.scala: ## @@ -774,6 +774,50 @@ class TestClusteringProcedu

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2595095210 ## CI report: * 60c2b5a1b01b772f6c25706a35caafeb0e97389d Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2895)

Re: [PR] [HUDI-8746] Support multi base file formats [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12622: URL: https://github.com/apache/hudi/pull/12622#issuecomment-2595057367 ## CI report: * 4a9523fb3aff19bb346aa96d411ddab814e262ee UNKNOWN * e8bc010fa97e5efc72352dd5f7e5e4cfe0f5dd10 UNKNOWN * 2916dddc7ed31245ee73ebce0f3a83a998292db8 Azure: [FAIL

[jira] [Updated] (HUDI-8806) Hudi "show_clustering" procedure is not working as expected

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-8806: - Labels: pull-request-available (was: ) > Hudi "show_clustering" procedure is not working as expec

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2594903791 ## CI report: * 60c2b5a1b01b772f6c25706a35caafeb0e97389d Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2895)

[I] [SUPPORT] 0.11 hudi upgraded to 1.0. [hudi]

2025-01-16 Thread via GitHub
liujinhui1994 opened a new issue, #12651: URL: https://github.com/apache/hudi/issues/12651 I read the official information and can't seem to find out how to upgrade lower versions of hudi to 1.0. We currently have 7,000 hudi tables in version 0.11. Can you guide me? I'm worried about the bi

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2595311365 ## CI report: * b67cf72b46ede37364efb75a6847b6bea0305155 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2896)

[jira] [Updated] (HUDI-6631) RLI integration with SQL queries followup

2025-01-16 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HUDI-6631: -- Priority: Critical (was: Major) > RLI integration with SQL queries followup > -

[jira] [Updated] (HUDI-6631) RLI integration with SQL queries followup

2025-01-16 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HUDI-6631: -- Fix Version/s: 1.1.0 > RLI integration with SQL queries followup > -

[jira] [Created] (HUDI-8873) Data Skipping with Secondary index for queries containing LIKE , < , >

2025-01-16 Thread Aditya Goenka (Jira)
Aditya Goenka created HUDI-8873: --- Summary: Data Skipping with Secondary index for queries containing LIKE , < , > Key: HUDI-8873 URL: https://issues.apache.org/jira/browse/HUDI-8873 Project: Apache Hudi

Re: [PR] [HUDI-6304] Handle cases when inflight compaction files are removed and job failed leaving pending rollback files [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12644: URL: https://github.com/apache/hudi/pull/12644#issuecomment-2594773372 ## CI report: * b9f5d1a5af82b06551bfb40c9eacdb512784ace1 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2891)

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
wombatu-kun commented on code in PR #12649: URL: https://github.com/apache/hudi/pull/12649#discussion_r1918129199 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/procedure/TestClusteringProcedure.scala: ## @@ -774,6 +774,50 @@ class TestClusteringPro

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2596174353 ## CI report: * b67cf72b46ede37364efb75a6847b6bea0305155 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2896) Azu

Re: [PR] [HUDI-8679] Enabling cols stats by default for spark engine [hudi]

2025-01-16 Thread via GitHub
nsivabalan closed pull request #12479: [HUDI-8679] Enabling cols stats by default for spark engine URL: https://github.com/apache/hudi/pull/12479 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [PR] [HUDI-8582] Adding support for nested fields with col stats [hudi]

2025-01-16 Thread via GitHub
nsivabalan commented on code in PR #12623: URL: https://github.com/apache/hudi/pull/12623#discussion_r1918874397 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/io/HoodieAppendHandle.java: ## @@ -438,9 +438,8 @@ private void processAppendResult(AppendResult resul

Re: [PR] [HUDI-8766][DNM] Enabling cols stats by default with writer [hudi]

2025-01-16 Thread via GitHub
nsivabalan closed pull request #12595: [HUDI-8766][DNM] Enabling cols stats by default with writer URL: https://github.com/apache/hudi/pull/12595 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] chore: update codecov-action to v5 [hudi-rs]

2025-01-16 Thread via GitHub
K-dash opened a new pull request, #248: URL: https://github.com/apache/hudi-rs/pull/248 ## Description Update Codecov Action from v4 to v5. Closes https://github.com/apache/hudi-rs/issues/241 ## How are the changes test-covered - [ ] N/A

[I] [SUPPORT] Remote filesystem view only works on the first micro-batch in Spark Structured Streaming [hudi]

2025-01-16 Thread via GitHub
psendyk opened a new issue, #12652: URL: https://github.com/apache/hudi/issues/12652 **Describe the problem you faced** After enabling timeline server and using `REMOTE_ONLY` file system view, Spark Structured Streaming ingestion into Hudi fails on the second microbatch with `org.apa

Re: [PR] [HUDI-8746] Support multi base file formats [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12622: URL: https://github.com/apache/hudi/pull/12622#issuecomment-2596360055 ## CI report: * 4a9523fb3aff19bb346aa96d411ddab814e262ee UNKNOWN * e8bc010fa97e5efc72352dd5f7e5e4cfe0f5dd10 UNKNOWN * 2916dddc7ed31245ee73ebce0f3a83a998292db8 Azure: [FAIL

Re: [PR] [HUDI-8746] Support multi base file formats [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12622: URL: https://github.com/apache/hudi/pull/12622#issuecomment-2596369891 ## CI report: * 4a9523fb3aff19bb346aa96d411ddab814e262ee UNKNOWN * e8bc010fa97e5efc72352dd5f7e5e4cfe0f5dd10 UNKNOWN * 2916dddc7ed31245ee73ebce0f3a83a998292db8 Azure: [FAIL

Re: [PR] [HUDI-8844] Support secondary and expression index creation through async indexer and write configs [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12653: URL: https://github.com/apache/hudi/pull/12653#issuecomment-2596406810 ## CI report: * 8021eba2422ec333d66bbf1e677524e7191be14c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Updated] (HUDI-8844) Async indexer should support creation of secondary or expression index

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-8844: - Labels: pull-request-available (was: ) > Async indexer should support creation of secondary or ex

Re: [PR] [HUDI-8840] Support custom delete marker in fg reader [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12597: URL: https://github.com/apache/hudi/pull/12597#issuecomment-2596401627 ## CI report: * 2d370d7355618595877d9551d7575c1179e6f1b2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2886)

Re: [PR] [HUDI-8840] Support custom delete marker in fg reader [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12597: URL: https://github.com/apache/hudi/pull/12597#issuecomment-2596404050 ## CI report: * 2d370d7355618595877d9551d7575c1179e6f1b2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2886)

[PR] [HUDI-8844] Support secondary and expression index creation through async indexer and write configs [hudi]

2025-01-16 Thread via GitHub
codope opened a new pull request, #12653: URL: https://github.com/apache/hudi/pull/12653 ### Change Logs - Added new write configs for secondary index (SI) and expression index (EI) conformant to sql syntax for create index. - Use those configs to check if we need to update new SI/

Re: [PR] [HUDI-8844] Support secondary and expression index creation through async indexer and write configs [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12653: URL: https://github.com/apache/hudi/pull/12653#issuecomment-2596409183 ## CI report: * 8021eba2422ec333d66bbf1e677524e7191be14c Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2902)

[jira] [Updated] (HUDI-8844) Async indexer should support creation of secondary or expression index

2025-01-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8844?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-8844: -- Status: Patch Available (was: In Progress) > Async indexer should support creation of secondary or expr

[jira] [Updated] (HUDI-8874) Fix flaky test: TestStructuredStreaming.testStructuredStreaming

2025-01-16 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-8874: -- Fix Version/s: 1.0.1 > Fix flaky test: TestStructuredStreaming.testStructuredStreaming > ---

[jira] [Created] (HUDI-8874) Fix flaky test: TestStructuredStreaming.testStructuredStreaming

2025-01-16 Thread Lin Liu (Jira)
Lin Liu created HUDI-8874: - Summary: Fix flaky test: TestStructuredStreaming.testStructuredStreaming Key: HUDI-8874 URL: https://issues.apache.org/jira/browse/HUDI-8874 Project: Apache Hudi Issue Ty

[jira] [Updated] (HUDI-8696) Re-enable TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-8696: - Labels: pull-request-available (was: ) > Re-enable TestHoodieMultiTableDeltaStreamer#testInvalidI

[jira] [Updated] (HUDI-8696) Re-enable TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps

2025-01-16 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HUDI-8696: -- Status: Patch Available (was: In Progress) > Re-enable TestHoodieMultiTableDeltaStreamer#testInvalidIng

[PR] [HUDI-8696] Remove TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps [hudi]

2025-01-16 Thread via GitHub
lokeshj1703 opened a new pull request, #12654: URL: https://github.com/apache/hudi/pull/12654 ### Change Logs The test was added in HUDI-288 but has always been in Ignored state. I have checked that the string being asserted `Please provide valid table config arguments` never existed

[jira] [Updated] (HUDI-8696) Re-enable TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps

2025-01-16 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8696?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HUDI-8696: -- Status: In Progress (was: Open) > Re-enable TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps

[jira] [Updated] (HUDI-8689) Re-enable TestSecondaryIndexPruning#testSecondaryIndexWithClusteringAndCleaning

2025-01-16 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HUDI-8689: -- Status: In Progress (was: Open) > Re-enable > TestSecondaryIndexPruning#testSecondaryIndexWithClusteri

Re: [PR] [HUDI-8696] Remove TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12654: URL: https://github.com/apache/hudi/pull/12654#issuecomment-2596419065 ## CI report: * fa2064e38d21b019658180da82accca91679977f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2903)

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
wombatu-kun commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2595899786 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2595885380 ## CI report: * b67cf72b46ede37364efb75a6847b6bea0305155 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2896) Azu

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2595902619 ## CI report: * b67cf72b46ede37364efb75a6847b6bea0305155 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2896) Azu

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
wombatu-kun commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2595466397 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] [HUDI-8806] Fix "No value present in Option" in show_clustering procedure [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12649: URL: https://github.com/apache/hudi/pull/12649#issuecomment-2595466747 ## CI report: * b67cf72b46ede37364efb75a6847b6bea0305155 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2896) Azu

Re: [PR] [MINOR] Fixed run of `javadoc:aggregate` [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12650: URL: https://github.com/apache/hudi/pull/12650#issuecomment-2595466896 ## CI report: * 0d3a5bdafb61f949fcab5458926e81a3d4196170 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2897)

[jira] [Updated] (HUDI-8864) [Flaky test] org.apache.hudi.functional.TestStructuredStreaming

2025-01-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8864: -- Priority: Blocker (was: Major) > [Flaky test] org.apache.hudi.functional.TestStructured

Re: [PR] [HUDI-8696] Remove TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12654: URL: https://github.com/apache/hudi/pull/12654#issuecomment-2596416583 ## CI report: * fa2064e38d21b019658180da82accca91679977f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Updated] (HUDI-8686) Re-enable TestClusteringUtils#testClusteringPlanInflight

2025-01-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8686?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8686: -- Priority: Critical (was: Blocker) > Re-enable TestClusteringUtils#testClusteringPlanInf

[PR] [HUDI-7656] Fix a flaky test for concurrent writes [hudi]

2025-01-16 Thread via GitHub
linliu-code opened a new pull request, #12655: URL: https://github.com/apache/hudi/pull/12655 ### Change Logs Make sure the conflict happens. ### Impact Fix a flaky test ### Risk level (write none, low medium or high below) None. ### Documentation Upd

Re: [PR] [HUDI-7656] Fix a flaky test for concurrent writes [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12655: URL: https://github.com/apache/hudi/pull/12655#issuecomment-2596571951 ## CI report: * 15901e2018f75583c1a7640c1f1484338ac4cb38 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2904)

Re: [PR] [HUDI-7656] Fix a flaky test for concurrent writes [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12655: URL: https://github.com/apache/hudi/pull/12655#issuecomment-2596565652 ## CI report: * 15901e2018f75583c1a7640c1f1484338ac4cb38 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Updated] (HUDI-7656) Fix flaky TestCOWDataSource.testCopyOnWriteConcurrentUpdates

2025-01-16 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-7656: -- Status: In Progress (was: Open) > Fix flaky TestCOWDataSource.testCopyOnWriteConcurrentUpdates > --

[jira] [Updated] (HUDI-7656) Fix flaky TestCOWDataSource.testCopyOnWriteConcurrentUpdates

2025-01-16 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-7656: -- Status: Patch Available (was: In Progress) > Fix flaky TestCOWDataSource.testCopyOnWriteConcurrentUpdates > ---

[jira] [Assigned] (HUDI-7656) Fix flaky TestCOWDataSource.testCopyOnWriteConcurrentUpdates

2025-01-16 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu reassigned HUDI-7656: - Assignee: Lin Liu (was: Lokesh Jain) > Fix flaky TestCOWDataSource.testCopyOnWriteConcurrentUpdates > --

Re: [PR] [HUDI-8746] Support multi base file formats [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12622: URL: https://github.com/apache/hudi/pull/12622#issuecomment-2596753243 ## CI report: * 4a9523fb3aff19bb346aa96d411ddab814e262ee UNKNOWN * e8bc010fa97e5efc72352dd5f7e5e4cfe0f5dd10 UNKNOWN * d2f1d356124deeb3f4134a652b08a8b83aa1d718 Azure: [SUCC

(hudi) branch master updated: [HUDI-8866] Unified the file naming rules in NBCC mode (#12627)

2025-01-16 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a93c6eec678 [HUDI-8866] Unified the file naming

Re: [PR] [HUDI-8866] Unified the file naming rules in NBCC mode [hudi]

2025-01-16 Thread via GitHub
danny0405 merged PR #12627: URL: https://github.com/apache/hudi/pull/12627 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apac

[jira] [Updated] (HUDI-8866) Unified the file naming rules in NBCC mode

2025-01-16 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-8866: - Fix Version/s: 1.0.1 > Unified the file naming rules in NBCC mode > --

[jira] [Closed] (HUDI-8866) Unified the file naming rules in NBCC mode

2025-01-16 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-8866. Resolution: Fixed Fixed via master branch: a93c6eec6788c4a984eb93a875d97f25211e4509 > Unified the file nami

[jira] [Updated] (HUDI-8744) Improve expression index config experience

2025-01-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8744?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-8744: -- Status: Patch Available (was: In Progress) > Improve expression index config experience > -

[jira] [Updated] (HUDI-8810) Allow secondary index to be created through write configs

2025-01-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8810?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-8810: -- Status: Patch Available (was: In Progress) > Allow secondary index to be created through write configs

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597411681 ## CI report: * 0a0be89fd6e79531a39125bb4679ba3f4ec47ab7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2917)

[jira] [Updated] (HUDI-8839) [Ethan pls check worklog] CDC query: The beforeImageRecords and afterImageRecords are both in-memory hash map, they should be changes to spillable map.

2025-01-16 Thread Davis Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8839?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Zhang updated HUDI-8839: -- Reviewers: Y Ethan Guo > [Ethan pls check worklog] CDC query: The beforeImageRecords and  > afterImageRe

[jira] [Updated] (HUDI-8820) Hudi 1.0 Spark SQL failed to query all rows written by Backward Writer

2025-01-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8820?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8820: -- Status: Open (was: Patch Available) > Hudi 1.0 Spark SQL failed to query all rows writt

[jira] [Updated] (HUDI-8628) Merge Into is pulling in additional fields which are not set as per the condition

2025-01-16 Thread Davis Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8628?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Zhang updated HUDI-8628: -- Reviewers: Y Ethan Guo > Merge Into is pulling in additional fields which are not set as per the > cond

[jira] [Updated] (HUDI-8880) Fix hive scan exception after new column is added

2025-01-16 Thread Kate Huber (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kate Huber updated HUDI-8880: - Status: Patch Available (was: In Progress) > Fix hive scan exception after new column is added >

[jira] [Updated] (HUDI-8880) Fix hive scan exception after new column is added

2025-01-16 Thread Kate Huber (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kate Huber updated HUDI-8880: - Reviewers: Danny Chen > Fix hive scan exception after new column is added > --

Re: [PR] [HUDI-8628] Table Service writer config hard wired to table schema [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12646: URL: https://github.com/apache/hudi/pull/12646#issuecomment-2597438467 ## CI report: * cd1fa812b16dd919c4c7ee7d4260aaeadc2c01be UNKNOWN * 7a7f6943be507571346c0e8f8db23691e0caf4e1 UNKNOWN * 3c4f823cb64304f5e98b8cf2dbd20a28d8d65e11 Azure: [FAIL

[jira] [Updated] (HUDI-8297) See if we can get rid of HoodieIdentifier

2025-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-8297: - Labels: newbie pull-request-available starter (was: newbie starter) > See if we can get rid of Ho

[jira] [Updated] (HUDI-6631) RLI integration with SQL queries followup

2025-01-16 Thread Lokesh Jain (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6631?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain updated HUDI-6631: -- Priority: Blocker (was: Critical) > RLI integration with SQL queries followup > ---

(hudi) branch incremental-TableService updated (6262f4baabd -> 16143bcc252)

2025-01-16 Thread zhangyue19921010
This is an automated email from the ASF dual-hosted git repository. zhangyue19921010 pushed a change to branch incremental-TableService in repository https://gitbox.apache.org/repos/asf/hudi.git from 6262f4baabd code review and fix ut add 16143bcc252 fix ut and code review No new revis

[jira] [Created] (HUDI-8883) Add ability to provide custom implementation of BaseHoodieCompactionPlanGenerator

2025-01-16 Thread Vinish Reddy (Jira)
Vinish Reddy created HUDI-8883: -- Summary: Add ability to provide custom implementation of BaseHoodieCompactionPlanGenerator Key: HUDI-8883 URL: https://issues.apache.org/jira/browse/HUDI-8883 Project: Ap

Re: [PR] [HUDI-8696] Remove TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps [hudi]

2025-01-16 Thread via GitHub
lokeshj1703 commented on PR #12654: URL: https://github.com/apache/hudi/pull/12654#issuecomment-2597583540 There is no exception thrown with the code being tested. Other exceptions are already covered in tests - `testInvalidPropsFilePath` and `testInvalidTableConfigFilePath`. The

Re: [PR] [HUDI-8696] Remove TestHoodieMultiTableDeltaStreamer#testInvalidIngestionProps [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12654: URL: https://github.com/apache/hudi/pull/12654#issuecomment-2597585630 ## CI report: * fa2064e38d21b019658180da82accca91679977f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2903)

Re: [PR] [HUDI-7374] Fix flaky test concurrent compaction test [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12657: URL: https://github.com/apache/hudi/pull/12657#issuecomment-2597339858 ## CI report: * c6c6a47672916be8bdd7850dbb42a6453ae3118f Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2912)

[jira] [Assigned] (HUDI-8881) Potentail dataloss in Flink hudi sink

2025-01-16 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang reassigned HUDI-8881: --- Assignee: Zhenqiu Huang > Potentail dataloss in Flink hudi sink > ---

[jira] [Created] (HUDI-8881) Potentail dataloss in Flink hudi sink

2025-01-16 Thread Zhenqiu Huang (Jira)
Zhenqiu Huang created HUDI-8881: --- Summary: Potentail dataloss in Flink hudi sink Key: HUDI-8881 URL: https://issues.apache.org/jira/browse/HUDI-8881 Project: Apache Hudi Issue Type: Improvement

[jira] [Updated] (HUDI-8881) Potential dataloss in Flink hudi sink

2025-01-16 Thread Zhenqiu Huang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhenqiu Huang updated HUDI-8881: Summary: Potential dataloss in Flink hudi sink (was: Potentail dataloss in Flink hudi sink) > Pote

Re: [PR] [HUDI-8880] Fix hive scan exception after new column is added [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12659: URL: https://github.com/apache/hudi/pull/12659#issuecomment-2597343317 ## CI report: * 0a0be89fd6e79531a39125bb4679ba3f4ec47ab7 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2917)

Re: [PR] [HUDI-7656] Fix a flaky test for concurrent writes [hudi]

2025-01-16 Thread via GitHub
hudi-bot commented on PR #12655: URL: https://github.com/apache/hudi/pull/12655#issuecomment-2597365317 ## CI report: * 15901e2018f75583c1a7640c1f1484338ac4cb38 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2904)

Re: [PR] [HUDI-8582] Adding support for nested fields with col stats [hudi]

2025-01-16 Thread via GitHub
nsivabalan commented on code in PR #12623: URL: https://github.com/apache/hudi/pull/12623#discussion_r1919531138 ## hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java: ## @@ -1541,39 +1533,38 @@ private static List getColumnsToIndex(HoodieTableConfi

[jira] [Updated] (HUDI-8654) Support correct merging results with record positions in log blocks generated during pending compaction

2025-01-16 Thread Kate Huber (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8654?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kate Huber updated HUDI-8654: - Status: In Progress (was: Patch Available) > Support correct merging results with record positions in log

[jira] [Updated] (HUDI-8656) Re-enable position-based merging by default

2025-01-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8656?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8656: -- Status: In Progress (was: Patch Available) > Re-enable position-based merging by defaul

[jira] [Updated] (HUDI-8880) Fix hive scan exception after new column is added

2025-01-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-8880: -- Priority: Blocker (was: Major) > Fix hive scan exception after new column is added > --

[jira] [Updated] (HUDI-8880) Fix hive scan exception after new column is added

2025-01-16 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-8880: -- Sprint: Hudi 1.0.1 Sprint #2 (Jan) > Fix hive scan exception after new column is added > ---

[jira] [Updated] (HUDI-8682) Simplify precombine and ordering field value handling in the file group reader

2025-01-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8682: -- Status: In Progress (was: Patch Available) > Simplify precombine and ordering field val

  1   2   3   >