Re: [PR] [HUDI-8173] Default value of hoodie.avro.schema.validate silently getting updated if not passed explicitly [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12606: URL: https://github.com/apache/hudi/pull/12606#issuecomment-2579796817 ## CI report: * 49b5fcc0abc4a608fa36e00efb74ff2d6f1f68e8 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2760)

Re: [PR] [HUDI-8800] Introduce SingleSparkConsistentBucketClusteringExecutionStrategy to improve performance [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12537: URL: https://github.com/apache/hudi/pull/12537#issuecomment-2580014666 ## CI report: * 34e41613300f619cf8c2d797f80c43df4ee8ea73 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2761)

Re: [PR] [HUDI-8800] Introduce SingleSparkConsistentBucketClusteringExecutionStrategy to improve performance [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12537: URL: https://github.com/apache/hudi/pull/12537#issuecomment-2580017859 ## CI report: * 34e41613300f619cf8c2d797f80c43df4ee8ea73 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2761)

[jira] [Updated] (HUDI-8173) Defualt value of hoodie.avro.schema.validate silently getting updated if not passed explicitly

2025-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-8173: - Labels: pull-request-available schema-evolution (was: schema-evolution) > Defualt value of hoodie

[PR] [HUDI-8173] Default value of hoodie.avro.schema.validate silently getting updated if not passed explicitly [hudi]

2025-01-09 Thread via GitHub
wombatu-kun opened a new pull request, #12606: URL: https://github.com/apache/hudi/pull/12606 ### Change Logs Addressing this comment https://github.com/apache/hudi/issues/11865#issuecomment-2330174420 ### Impact No need to explicitly set hoodie.avro.schema.validate to f

Re: [PR] [HUDI-8173] Default value of hoodie.avro.schema.validate silently getting updated if not passed explicitly [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12606: URL: https://github.com/apache/hudi/pull/12606#issuecomment-2579550642 ## CI report: * 49b5fcc0abc4a608fa36e00efb74ff2d6f1f68e8 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Assigned] (HUDI-8173) Defualt value of hoodie.avro.schema.validate silently getting updated if not passed explicitly

2025-01-09 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov reassigned HUDI-8173: --- Assignee: Vova Kolmakov > Defualt value of hoodie.avro.schema.validate silently getting updat

[jira] [Updated] (HUDI-8173) Defualt value of hoodie.avro.schema.validate silently getting updated if not passed explicitly

2025-01-09 Thread Vova Kolmakov (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vova Kolmakov updated HUDI-8173: Status: In Progress (was: Open) > Defualt value of hoodie.avro.schema.validate silently getting upd

Re: [PR] [HUDI-8173] Default value of hoodie.avro.schema.validate silently getting updated if not passed explicitly [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12606: URL: https://github.com/apache/hudi/pull/12606#issuecomment-2579554201 ## CI report: * 49b5fcc0abc4a608fa36e00efb74ff2d6f1f68e8 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2760)

Re: [PR] [HUDI-8841] Fix schema validating exception during flink async cluste… [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12598: URL: https://github.com/apache/hudi/pull/12598#issuecomment-2579697225 ## CI report: * a77e69e63f0770d7176b1da335ec6f07cfa814b1 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2759)

Re: [PR] [HUDI-8775] Expression index on a column should get tracked at partition level if partition stats index is turned on [hudi]

2025-01-09 Thread via GitHub
lokeshj1703 commented on code in PR #12558: URL: https://github.com/apache/hudi/pull/12558#discussion_r1908495605 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkMetadataWriterUtils.java: ## @@ -226,4 +276,155 @@ private static List toRows(List

[jira] [Created] (HUDI-8848) Allow configurable storage level while computing expression index update

2025-01-09 Thread Lokesh Jain (Jira)
Lokesh Jain created HUDI-8848: - Summary: Allow configurable storage level while computing expression index update Key: HUDI-8848 URL: https://issues.apache.org/jira/browse/HUDI-8848 Project: Apache Hudi

Re: [PR] [HUDI-8775] Expression index on a column should get tracked at partition level if partition stats index is turned on [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12558: URL: https://github.com/apache/hudi/pull/12558#issuecomment-2579722300 ## CI report: * d34c77014b71dcc7a6550c86ab15eb011fe8cd18 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2762)

Re: [PR] [HUDI-8800] Introduce SingleSparkConsistentBucketClusteringExecutionStrategy to improve performance [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12537: URL: https://github.com/apache/hudi/pull/12537#issuecomment-2580180608 ## CI report: * 6198247de5d01f8edaf4976efffdffa6e6674b64 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2763)

Re: [PR] [HUDI-8824] MIT should error out for some assignment clause patterns [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12584: URL: https://github.com/apache/hudi/pull/12584#issuecomment-2581109748 ## CI report: * 3f5a5355576d9744680a4b86e146ad5e39ae244b Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2769)

Re: [PR] [HUDI-7081] Test support for AVRO enum records [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12609: URL: https://github.com/apache/hudi/pull/12609#issuecomment-2581057315 ## CI report: * 52255396615497e8063cfd2880b2cbf89a950c2c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2768)

[jira] [Comment Edited] (HUDI-7081) Hoodie FilegroupReader cannot read Enums from MOR avro log blocks

2025-01-09 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911638#comment-17911638 ] Lin Liu edited comment on HUDI-7081 at 1/9/25 8:19 PM: --- I have check

Re: [PR] [HUDI-7081] Test support for AVRO enum records [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12609: URL: https://github.com/apache/hudi/pull/12609#issuecomment-2581183852 ## CI report: * 52255396615497e8063cfd2880b2cbf89a950c2c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2768)

Re: [PR] build(deps): clean up dependencies [hudi-rs]

2025-01-09 Thread via GitHub
xushiyan merged PR #240: URL: https://github.com/apache/hudi-rs/pull/240 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

(hudi-rs) branch main updated: build(deps): clean up dependencies (#240)

2025-01-09 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/hudi-rs.git The following commit(s) were added to refs/heads/main by this push: new dbd7d87 build(deps): clean up dependencies (#240

Re: [PR] [HUDI-7081] Test support for AVRO enum records [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12609: URL: https://github.com/apache/hudi/pull/12609#issuecomment-2581186378 ## CI report: * 52255396615497e8063cfd2880b2cbf89a950c2c Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2768)

(hudi-rs) branch dependabot/cargo/arrow-json-eq-54.0.0 updated (d41e84c -> 795e110)

2025-01-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/cargo/arrow-json-eq-54.0.0 in repository https://gitbox.apache.org/repos/asf/hudi-rs.git discard d41e84c build(deps): update arrow-json requirement from = 53.3.0 to = 54.0.0

(hudi-rs) branch dependabot/cargo/parquet-eq-54.0.0 updated (8117f2e -> 2c00522)

2025-01-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/cargo/parquet-eq-54.0.0 in repository https://gitbox.apache.org/repos/asf/hudi-rs.git discard 8117f2e build(deps): update parquet requirement from = 53.3.0 to = 54.0.0 add

(hudi-rs) branch dependabot/cargo/arrow-schema-eq-54.0.0 updated (c9df2da -> 25ce377)

2025-01-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/cargo/arrow-schema-eq-54.0.0 in repository https://gitbox.apache.org/repos/asf/hudi-rs.git discard c9df2da build(deps): update arrow-schema requirement from = 53.3.0 to = 54.0.0

(hudi-rs) branch dependabot/cargo/arrow-ord-eq-54.0.0 updated (dac6e41 -> c56b213)

2025-01-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/cargo/arrow-ord-eq-54.0.0 in repository https://gitbox.apache.org/repos/asf/hudi-rs.git discard dac6e41 build(deps): update arrow-ord requirement from = 53.3.0 to = 54.0.0

[jira] [Updated] (HUDI-7081) Hoodie FilegroupReader cannot read Enums from MOR avro log blocks

2025-01-09 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-7081: -- Status: Patch Available (was: In Progress) > Hoodie FilegroupReader cannot read Enums from MOR avro log blocks

(hudi-rs) branch dependabot/cargo/arrow-row-eq-54.0.0 updated (7d967ad -> 6857ed8)

2025-01-09 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch dependabot/cargo/arrow-row-eq-54.0.0 in repository https://gitbox.apache.org/repos/asf/hudi-rs.git discard 7d967ad build(deps): update arrow-row requirement from = 53.3.0 to = 54.0.0

[jira] [Closed] (HUDI-8451) Followup to fix all callers to HoodieLogRecordReader to set the right value for max instant time

2025-01-09 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu closed HUDI-8451. - Resolution: Fixed The code has been inspected to confirm the correct behavior of fg reader. > Followup to fix all

[jira] [Commented] (HUDI-8451) Followup to fix all callers to HoodieLogRecordReader to set the right value for max instant time

2025-01-09 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911660#comment-17911660 ] Lin Liu commented on HUDI-8451: --- [~shivnarayan] and I have gone over the code of fg reader,

Re: [PR] [HUDI-8775] Expression index on a column should get tracked at partition level if partition stats index is turned on [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12558: URL: https://github.com/apache/hudi/pull/12558#issuecomment-2581036201 ## CI report: * c5912b6788b23621a4dcc609a4d5b4e6ae0af6da Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2767)

Re: [PR] feat: improve partition pruning during file listing [hudi-rs]

2025-01-09 Thread via GitHub
xushiyan commented on PR #238: URL: https://github.com/apache/hudi-rs/pull/238#issuecomment-2581051397 thanks @TheR1sing3un will go through this over the weekend. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] [HUDI-8766] Enabling cols stats by default with writer [hudi]

2025-01-09 Thread via GitHub
nsivabalan commented on code in PR #12596: URL: https://github.com/apache/hudi/pull/12596#discussion_r1909368791 ## hudi-common/src/test/java/org/apache/hudi/avro/TestHoodieAvroUtils.java: ## @@ -700,11 +700,11 @@ public void testWrapAndUnwrapJavaValues(Comparable value, Class

[jira] [Commented] (HUDI-7081) Hoodie FilegroupReader cannot read Enums from MOR avro log blocks

2025-01-09 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7081?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911638#comment-17911638 ] Lin Liu commented on HUDI-7081: --- I have checked our existing test `TestEventTimeMerging`, we

[PR] build(deps): clean up dependencies [hudi-rs]

2025-01-09 Thread via GitHub
xushiyan opened a new pull request, #240: URL: https://github.com/apache/hudi-rs/pull/240 ## Description - Minor version upgrade - Clean up unused dependencies - Use better version numbers ## How are the changes test-covered - [ ] N/A - [

[PR] [HUDI-8832] Add merge mode test coverage for DML [hudi]

2025-01-09 Thread via GitHub
Davis-Zhang-Onehouse opened a new pull request, #12610: URL: https://github.com/apache/hudi/pull/12610 ### Change Logs test coverage for DML with various merge mode. ### Impact more test coverage over supported cases. ### Risk level (write none, low medium or high

[jira] [Updated] (HUDI-8832) Manual testing all DML meets requirement

2025-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-8832: - Labels: pull-request-available (was: ) > Manual testing all DML meets requirement > -

Re: [PR] [HUDI-8832] Add merge mode test coverage for DML [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12610: URL: https://github.com/apache/hudi/pull/12610#issuecomment-2581213364 ## CI report: * 4c14c955871ea88e3ff6ccfab667fe434a16a833 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[jira] [Commented] (HUDI-8321) SQL insert mode needs to set merger as well to support non avro records

2025-01-09 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17911662#comment-17911662 ] Lin Liu commented on HUDI-8321: --- This is a duplicated task; after ticket HUDI-8758 is fixed,

[jira] [Closed] (HUDI-8321) SQL insert mode needs to set merger as well to support non avro records

2025-01-09 Thread Lin Liu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu closed HUDI-8321. - Resolution: Fixed > SQL insert mode needs to set merger as well to support non avro records >

[jira] [Updated] (HUDI-8832) Manual testing all DML meets requirement

2025-01-09 Thread Davis Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Davis Zhang updated HUDI-8832: -- Status: Patch Available (was: In Progress) > Manual testing all DML meets requirement > ---

Re: [PR] [HUDI-8832] Add merge mode test coverage for DML [hudi]

2025-01-09 Thread via GitHub
hudi-bot commented on PR #12610: URL: https://github.com/apache/hudi/pull/12610#issuecomment-2581216123 ## CI report: * 4c14c955871ea88e3ff6ccfab667fe434a16a833 Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=2772)

<    1   2   3