Re: [PR] Spark Schema on read fix [hudi]

hudi-bot commented on PR #14075: URL: https://github.com/apache/hudi/pull/14075#issuecomment-3391499953 ## CI report: * d1fd7fd096cb937e24fabddc805656b3c95c515f Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9123)

Re: [PR] Spark Schema on read fix [hudi]

hudi-bot commented on PR #14075: URL: https://github.com/apache/hudi/pull/14075#issuecomment-3391327537 ## CI report: * d1fd7fd096cb937e24fabddc805656b3c95c515f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9123)

Re: [PR] chore: Exclude hudi-trino-plugin from RAT checks [hudi]

yihua commented on code in PR #14067: URL: https://github.com/apache/hudi/pull/14067#discussion_r2418383800 ## pom.xml: ## @@ -614,6 +614,7 @@ **/*.iml .mvn/** + hudi-trino-plugin/** Review Comment: Got it. Then let

Re: [I] df operation in Append mode for a MANAGED table results in "location already exists" error [hudi]

mansipp commented on issue #13931: URL: https://github.com/apache/hudi/issues/13931#issuecomment-3387729174 @yihua any update? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

Re: [PR] chore: Fixing info to debug log for most commonly logged statements [hudi]

nsivabalan closed pull request #14071: chore: Fixing info to debug log for most commonly logged statements URL: https://github.com/apache/hudi/pull/14071 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[PR] feat: add filter transformation for `TimestampBasedKeyGenerator` partition pruning [hudi-rs]

yunchipang opened a new pull request, #462: URL: https://github.com/apache/hudi-rs/pull/462 ## Description Implements filter transformation for `TimestampBasedKeyGenerator` to enable partition pruning when user filters use timestamp columns but partitions are organized by date co

Re: [PR] fix: Fix output type extracting for key selector in flink stream read [hudi]

hudi-bot commented on PR #14065: URL: https://github.com/apache/hudi/pull/14065#issuecomment-3385940351 ## CI report: * fa0afe982010277552876a0135f73d1079d2f6b4 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9117)

Re: [PR] fix: Persist RLI index bootstrap records only if estimation is required and add unpersist [hudi]

hudi-bot commented on PR #14069: URL: https://github.com/apache/hudi/pull/14069#issuecomment-3385413033 ## CI report: * ba3eb74cce8719c9dd70497d65e14b7ca72819c1 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

[PR] fix: Fix output type extracting for key selector in flink stream read [hudi]

cshuo opened a new pull request, #14065: URL: https://github.com/apache/hudi/pull/14065 ### Describe the issue this Pull Request addresses Fix issue: https://github.com/apache/hudi/issues/14064 ### Summary and Changelog Flink has problem to extract output type of lambda b

Re: [PR] [DO NOT MERGE] refactor(spark): Remove spark datasource relations [hudi]

hudi-bot commented on PR #14063: URL: https://github.com/apache/hudi/pull/14063#issuecomment-3383825442 ## CI report: * 53818c266a926167472958d952582a290f9e51f2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9111)

Re: [PR] [DO NOT MERGE] refactor(spark): Remove spark datasource relations [hudi]

hudi-bot commented on PR #14063: URL: https://github.com/apache/hudi/pull/14063#issuecomment-3383773739 ## CI report: * 53818c266a926167472958d952582a290f9e51f2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9111)

Re: [PR] [DO NOT MERGE] refactor(spark): Remove spark datasource relations [hudi]

hudi-bot commented on PR #14063: URL: https://github.com/apache/hudi/pull/14063#issuecomment-3383730801 ## CI report: * 53818c266a926167472958d952582a290f9e51f2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9111)

Re: [PR] refactor(spark): remove glob paths and deprecate read paths support [hudi]

hudi-bot commented on PR #14060: URL: https://github.com/apache/hudi/pull/14060#issuecomment-3383134242 ## CI report: * f0ff74df675f8be6a18a9621e33bd90a9af72a2a UNKNOWN * dd865faef08e386da2bbe480a943ec32f7730102 UNKNOWN * 693e5a187c43afe94fe93a37c92ead929a3fd99a Azure: [SUCC

Re: [PR] refactor(spark): remove glob paths and deprecate read paths support [hudi]

hudi-bot commented on PR #14060: URL: https://github.com/apache/hudi/pull/14060#issuecomment-3382825662 ## CI report: * f0ff74df675f8be6a18a9621e33bd90a9af72a2a UNKNOWN * 46d9e7266ed1fc2331a1d0c68db8679fd4110246 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] refactor(spark): Rework tests that disable FileGroup Reader in Spark [hudi]

hudi-bot commented on PR #14061: URL: https://github.com/apache/hudi/pull/14061#issuecomment-3382639341 ## CI report: * 0fa87a0b00e9344952061d07b0f55e00ae87df9a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9103)

Re: [I] Hudi-1.0.2 (tv=6) creates significantly more files per commit than hudi-0.14 - with HUDI-7429 applied [hudi]

mgstahl-sophos closed issue #13995: Hudi-1.0.2 (tv=6) creates significantly more files per commit than hudi-0.14 - with HUDI-7429 applied URL: https://github.com/apache/hudi/issues/13995 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

Re: [I] Hudi-1.0.2 (tv=6) creates significantly more files per commit than hudi-0.14 - with HUDI-7429 applied [hudi]

nsivabalan commented on issue #13995: URL: https://github.com/apache/hudi/issues/13995#issuecomment-3379810358 We have fixed the issue with this patch https://github.com/apache/hudi/commit/0148b0a81e7669725b1bbdcabd2584ddad180c99 -- This is an automated message from the Apache Git Se

Re: [PR] [HUDI-9730] RFC-99 Hudi Type System [hudi]

rahil-c commented on code in PR #13743: URL: https://github.com/apache/hudi/pull/13743#discussion_r2412139222 ## rfc/rfc-99/rfc-99.md: ## @@ -0,0 +1,219 @@ + + +# RFC-99: Hudi Type System + +## Proposers + +- @bvaradar + +## Approvers + +- @vinothchandar + + +## Status + +Umbrel

Re: [PR] [HUDI-9560][RFC-97] Deprecate Hudi Payload Class Usage [hudi]

linliu-code commented on code in PR #13499: URL: https://github.com/apache/hudi/pull/13499#discussion_r2411860717 ## rfc/rfc-97/rfc-97.md: ## @@ -0,0 +1,184 @@ + +# RFC-97: Deprecate Hudi Payload Class Usage + +## Proposers + +* Lin Liu + +## Approvers + +* Ethan Guo +* Si

[PR] chore: Moving to 1.2.0-SNAPSHOT on master branch [hudi]

yihua opened a new pull request, #14055: URL: https://github.com/apache/hudi/pull/14055 ### Describe the issue this Pull Request addresses This PR moves master branch to `1.2.0-SNAPSHOT` after cutting 1.1.0 RC1. ### Summary and Changelog As above ### Impact

Re: [PR] build(deps): bump actions/setup-node from 4 to 5 [hudi-rs]

xushiyan merged PR #442: URL: https://github.com/apache/hudi-rs/pull/442 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

Re: [PR] chore: [DNM] Release 1.1.0 bundle testing [hudi]

hudi-bot commented on PR #14054: URL: https://github.com/apache/hudi/pull/14054#issuecomment-3372536702 ## CI report: * d60f074f2425e39d15907bfa422f13975b9fee65 UNKNOWN * 5c9786e87fa5a2116b8a3362ddde7760a4f525d4 UNKNOWN Bot commands @hudi-bot supports the followi

Re: [PR] chore: [DNM] Release 1.1.0 bundle testing [hudi]

hudi-bot commented on PR #14054: URL: https://github.com/apache/hudi/pull/14054#issuecomment-3372470748 ## CI report: * d60f074f2425e39d15907bfa422f13975b9fee65 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

yihua merged PR #14052: URL: https://github.com/apache/hudi/pull/14052 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367964439 ## CI report: * bc8a8075009fd2da7dfa92287974e295eb469be2 UNKNOWN * 2a38b9cbc918c0f667ec5749823a375d2702d2cc Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367909735 ## CI report: * bc8a8075009fd2da7dfa92287974e295eb469be2 UNKNOWN * 424d1fbaf2a7172a81a7404d98910931d6a08b28 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367893425 ## CI report: * bc8a8075009fd2da7dfa92287974e295eb469be2 UNKNOWN * 424d1fbaf2a7172a81a7404d98910931d6a08b28 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367822421 ## CI report: * a42dca74ff554ba8280df496c91cbe1333e222f0 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9087)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367845922 ## CI report: * 978e19f420b9fe64766a8c658c5e7e5d25e16d1a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9088)

Re: [PR] fix: Fix record generation to avoid file system based listing for expression index [hudi]

yihua merged PR #14048: URL: https://github.com/apache/hudi/pull/14048 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

Re: [PR] perf: Fixing file listing with partition stats index [hudi]

yihua closed pull request #14050: perf: Fixing file listing with partition stats index URL: https://github.com/apache/hudi/pull/14050 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

Re: [PR] fix: Fix record generation to avoid file system based listing and incorrect stats for expression index [hudi]

yihua commented on code in PR #14048: URL: https://github.com/apache/hudi/pull/14048#discussion_r2403029439 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/utils/SparkMetadataWriterUtils.java: ## @@ -406,22 +408,25 @@ public static HoodiePairData>

Re: [PR] refactor: replace custom `.to::()` with `into()` for `HudiConfig` conversions [hudi-rs]

xushiyan merged PR #432: URL: https://github.com/apache/hudi-rs/pull/432 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3366842671 ## CI report: * f744944e42a9e40bf80fe953389719cc3801f56f Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9075)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367749140 ## CI report: * 7dbf6077326d7b12f9c50c4f59cbe4a8acf15cb7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9086)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

nsivabalan commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367353911 PR description please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

nsivabalan commented on code in PR #14052: URL: https://github.com/apache/hudi/pull/14052#discussion_r2403480128 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/dml/insert/TestInsertTable.scala: ## @@ -1695,6 +1695,99 @@ class TestInsertTable extends

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367751539 ## CI report: * a42dca74ff554ba8280df496c91cbe1333e222f0 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9087)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367731085 ## CI report: * 7dbf6077326d7b12f9c50c4f59cbe4a8acf15cb7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9086)

Re: [PR] refactor: ignore `.crc` files at storage level [hudi-rs]

xushiyan merged PR #458: URL: https://github.com/apache/hudi-rs/pull/458 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache

Re: [PR] fix: Log info keygen missing [hudi]

hudi-bot commented on PR #14053: URL: https://github.com/apache/hudi/pull/14053#issuecomment-3367231857 ## CI report: * 9384563019bcac4d8d3d0cfb35af740c9d2aa851 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] fix: Fix record generation to avoid file system based listing for expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3366872157 ## CI report: * f9c72e5e86ab04ea66e5f4e1e2f192056b234691 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9061)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367703052 ## CI report: * 7dbf6077326d7b12f9c50c4f59cbe4a8acf15cb7 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9086)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3366838993 ## CI report: * f744944e42a9e40bf80fe953389719cc3801f56f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run th

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367685351 ## CI report: * d7fbb60075faa1378c032d437c8e85359f122164 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9083)

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

yihua commented on code in PR #14045: URL: https://github.com/apache/hudi/pull/14045#discussion_r2402894762 ## hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/functional/TestCOWDataSource.scala: ## @@ -763,6 +763,8 @@ class TestCOWDataSource extends HoodieSparkCl

Re: [PR] perf: Fixing file listing with partition stats index [hudi]

yihua commented on PR #14050: URL: https://github.com/apache/hudi/pull/14050#issuecomment-3367569090 Closing this as #14031 containing the same changes is merged. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [PR] ci: run rust-tests on windows [hudi-rs]

codecov[bot] commented on PR #92: URL: https://github.com/apache/hudi-rs/pull/92#issuecomment-3367481697 ## [Codecov](https://app.codecov.io/gh/apache/hudi-rs/pull/92?dropdown=coverage&src=pr&el=h1&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=ap

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367423128 ## CI report: * d7fbb60075faa1378c032d437c8e85359f122164 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9083)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367408534 ## CI report: * aa7c1a254c9fad33f3781a42691f16fd30094aa1 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9080)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

nsivabalan commented on code in PR #14052: URL: https://github.com/apache/hudi/pull/14052#discussion_r2403477973 ## hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala: ## @@ -612,11 +612,11 @@ object DataSourceWriteOptions { .mark

Re: [PR] fix: Log info keygen missing [hudi]

nsivabalan merged PR #14053: URL: https://github.com/apache/hudi/pull/14053 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apa

Re: [PR] test: Add lowering order and higher ordering values to payloads [hudi]

hudi-bot commented on PR #14001: URL: https://github.com/apache/hudi/pull/14001#issuecomment-3345575791 ## CI report: * 67204ffe65b7dd9c90fc6d40f5b5a8af3cf9b56a Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=8911)

Re: [PR] Perf mdt expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3366643262 ## CI report: * f9c72e5e86ab04ea66e5f4e1e2f192056b234691 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9061)

Re: [PR] perf: Remove file system based file listing when building records of indexes [hudi]

hudi-bot commented on PR #14031: URL: https://github.com/apache/hudi/pull/14031#issuecomment-3366221127 ## CI report: * 413d8fe64791290766f6a92a3ade80cc28775e12 UNKNOWN * db4854b7cdb97412abc0e5f9bb2b25a7db700928 UNKNOWN * 85d84a4ac72fd3ecd17b172c42e6bc28bfd20bc2 UNKNOWN *

Re: [PR] fix: Fix record generation to avoid file system based listing for expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3367162307 ## CI report: * 36511af05242e2251f216841b6a56a8aa78b40a3 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9079)

Re: [PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

hudi-bot commented on PR #14052: URL: https://github.com/apache/hudi/pull/14052#issuecomment-3367099448 ## CI report: * aa7c1a254c9fad33f3781a42691f16fd30094aa1 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9080)

Re: [PR] test: add functional payload test cases for v6 (OverwriteWithLatestAvroPayload, DefaultHoodieRecordPayload) [hudi]

hudi-bot commented on PR #14041: URL: https://github.com/apache/hudi/pull/14041#issuecomment-3366354891 ## CI report: * c1b8e05bff877a98cc75473318c0f38c29ecfdc2 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9043)

Re: [PR] fix: Fix record generation to avoid file system based listing for expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3366926306 ## CI report: * 8882623a9f7795ce9b567533bab35cbfa26c894b Azure: [CANCELED](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9078)

Re: [PR] fix: Fix record generation to avoid file system based listing for expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3366879745 ## CI report: * 4f345134e9ef83e7f38c25ac1c2b8b183f6d7e3b Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9073)

[PR] fix: Allow INSERT INTO sql to preserve duplicates values by default [hudi]

rahil-c opened a new pull request, #14052: URL: https://github.com/apache/hudi/pull/14052 ### Describe the issue this Pull Request addresses ### Summary and Changelog ### Impact ### Risk Level ### Documentation Update

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

yihua merged PR #14045: URL: https://github.com/apache/hudi/pull/14045 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.o

Re: [I] INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

nsivabalan closed issue #14049: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert URL: https://github.com/apache/hudi/issues/14049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

Re: [PR] Perf mdt expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3366635875 ## CI report: * f9c72e5e86ab04ea66e5f4e1e2f192056b234691 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9061)

Re: [PR] test: Add coverage for with OverwriteWithLatestAvroPayload with ordering fields set [hudi]

hudi-bot commented on PR #14051: URL: https://github.com/apache/hudi/pull/14051#issuecomment-3366657905 ## CI report: * 31eccf68c5bc42ccc5c6755b0f693280af6f1817 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9069)

Re: [PR] test: Add coverage for with OverwriteWithLatestAvroPayload with ordering fields set [hudi]

rahil-c commented on code in PR #14051: URL: https://github.com/apache/hudi/pull/14051#discussion_r2402589631 ## hudi-spark-datasource/hudi-spark/src/test/java/org/apache/hudi/table/upgrade/TestUpgradeDowngrade.java: ## @@ -535,14 +535,12 @@ private static Stream testArgsUpgrad

[PR] test: Add coverage for with OverwriteWithLatestAvroPayload with ordering fields set [hudi]

rahil-c opened a new pull request, #14051: URL: https://github.com/apache/hudi/pull/14051 ### Describe the issue this Pull Request addresses ### Summary and Changelog ### Impact ### Risk Level ### Documentation Update

Re: [PR] [perf] : Fixing file listing with partition stats index [hudi]

hudi-bot commented on PR #14050: URL: https://github.com/apache/hudi/pull/14050#issuecomment-3366250769 ## CI report: * 28f94ed13d59cfe6ab3c3168c69327e90965 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9063) Azu

Re: [PR] perf: Remove file system based file listing when building records of indexes [hudi]

hudi-bot commented on PR #14031: URL: https://github.com/apache/hudi/pull/14031#issuecomment-3366171188 ## CI report: * 413d8fe64791290766f6a92a3ade80cc28775e12 UNKNOWN * db4854b7cdb97412abc0e5f9bb2b25a7db700928 UNKNOWN * 85d84a4ac72fd3ecd17b172c42e6bc28bfd20bc2 UNKNOWN *

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

nsivabalan merged PR #14046: URL: https://github.com/apache/hudi/pull/14046 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apa

Re: [PR] perf: Remove file system based file listing when building records of indexes [hudi]

hudi-bot commented on PR #14031: URL: https://github.com/apache/hudi/pull/14031#issuecomment-3365088812 ## CI report: * 413d8fe64791290766f6a92a3ade80cc28775e12 UNKNOWN * db4854b7cdb97412abc0e5f9bb2b25a7db700928 UNKNOWN * 7de5bf44a2282bf19d81036ec5eb3f944a5d0407 Azure: [FAIL

Re: [PR] fix: tracking partition names correctly during secondary index [hudi]

hudi-bot commented on PR #14042: URL: https://github.com/apache/hudi/pull/14042#issuecomment-3364565331 ## CI report: * 612a2194ed89ad6dd42d38e8ee05ca0ba83a03f6 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9053)

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3364466598 ## CI report: * 7abf92a4d4ebce2248f09e80cbbc2ad4dbdb5e03 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9054)

Re: [PR] Perf mdt expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3365254465 ## CI report: * f9c72e5e86ab04ea66e5f4e1e2f192056b234691 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9061)

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

hudi-bot commented on PR #14045: URL: https://github.com/apache/hudi/pull/14045#issuecomment-3365297912 ## CI report: * b8a31b3f90b92982a6983ebaa7997df5714147fc Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9062)

Re: [PR] perf: Remove file system based file listing when building records of indexes [hudi]

hudi-bot commented on PR #14031: URL: https://github.com/apache/hudi/pull/14031#issuecomment-3365297668 ## CI report: * 413d8fe64791290766f6a92a3ade80cc28775e12 UNKNOWN * db4854b7cdb97412abc0e5f9bb2b25a7db700928 UNKNOWN * 28f94ed13d59cfe6ab3c3168c69327e90965 Azure: [SUCC

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3365123058 ## CI report: * 99dd9eb02597d3651842b6563c6af9367513dd93 UNKNOWN * 5be1481b20dfba4718864cdbe9690fe668678c7b Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3364585584 ## CI report: * c8ea31089d7bd97fdcb3c281266e44a921177daa Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9055)

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3365047747 ## CI report: * 99dd9eb02597d3651842b6563c6af9367513dd93 UNKNOWN * 5be1481b20dfba4718864cdbe9690fe668678c7b Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

hudi-bot commented on PR #14045: URL: https://github.com/apache/hudi/pull/14045#issuecomment-3365009160 ## CI report: * 0d73226099ab977c8da5fa1d0dc85410a5019eec Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9058)

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

hudi-bot commented on PR #14045: URL: https://github.com/apache/hudi/pull/14045#issuecomment-3364998995 ## CI report: * 0d73226099ab977c8da5fa1d0dc85410a5019eec Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9058)

Re: [PR] Perf mdt expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3364949730 ## CI report: * 63af2290e014250070f73990fe5c4cda196c77da Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9049)

Re: [PR] Perf mdt expression index [hudi]

hudi-bot commented on PR #14048: URL: https://github.com/apache/hudi/pull/14048#issuecomment-3364945173 ## CI report: * 63af2290e014250070f73990fe5c4cda196c77da Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9049)

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3364935933 ## CI report: * 99dd9eb02597d3651842b6563c6af9367513dd93 UNKNOWN * 5be1481b20dfba4718864cdbe9690fe668678c7b Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] perf: Remove file system based file listing when building records of indexes [hudi]

hudi-bot commented on PR #14031: URL: https://github.com/apache/hudi/pull/14031#issuecomment-3364877248 ## CI report: * 413d8fe64791290766f6a92a3ade80cc28775e12 UNKNOWN * db4854b7cdb97412abc0e5f9bb2b25a7db700928 UNKNOWN * 7de5bf44a2282bf19d81036ec5eb3f944a5d0407 Azure: [FAIL

Re: [PR] perf: Remove file system based file listing when building records of indexes [hudi]

hudi-bot commented on PR #14031: URL: https://github.com/apache/hudi/pull/14031#issuecomment-3364854295 ## CI report: * 413d8fe64791290766f6a92a3ade80cc28775e12 UNKNOWN * dfb771fd1781b21adae727ac32fa4552bcca259c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] perf: Remove file system based file listing when building records of indexes [hudi]

nsivabalan commented on code in PR #14031: URL: https://github.com/apache/hudi/pull/14031#discussion_r2401202570 ## hudi-common/src/main/java/org/apache/hudi/common/table/view/AbstractTableFileSystemView.java: ## @@ -1552,13 +1565,27 @@ private static FileSlice mergeCompactionP

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3364839554 ## CI report: * 99dd9eb02597d3651842b6563c6af9367513dd93 UNKNOWN * 5be1481b20dfba4718864cdbe9690fe668678c7b Azure: [PENDING](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3364832751 ## CI report: * 99dd9eb02597d3651842b6563c6af9367513dd93 UNKNOWN * 5be1481b20dfba4718864cdbe9690fe668678c7b Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

vamshikrishnakyatham commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3364829271 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

hudi-bot commented on PR #14045: URL: https://github.com/apache/hudi/pull/14045#issuecomment-3364683750 ## CI report: * 6ff707a3b97efb0e08787ca1e30a762671a7aed2 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9044)

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

hudi-bot commented on PR #14045: URL: https://github.com/apache/hudi/pull/14045#issuecomment-3364693616 ## CI report: * 0d73226099ab977c8da5fa1d0dc85410a5019eec Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9058)

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

hudi-bot commented on PR #14045: URL: https://github.com/apache/hudi/pull/14045#issuecomment-3364679065 ## CI report: * 6ff707a3b97efb0e08787ca1e30a762671a7aed2 Azure: [SUCCESS](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9044)

Re: [PR] perf: Remove file system based file listing when building records of indexes [hudi]

hudi-bot commented on PR #14031: URL: https://github.com/apache/hudi/pull/14031#issuecomment-3364656605 ## CI report: * 413d8fe64791290766f6a92a3ade80cc28775e12 UNKNOWN * dfb771fd1781b21adae727ac32fa4552bcca259c Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

nsivabalan commented on code in PR #14045: URL: https://github.com/apache/hudi/pull/14045#discussion_r2401122831 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/SecondaryIndexRecordGenerationUtils.java: ## @@ -114,21 +124,60 @@ public static HoodieData

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3364646880 ## CI report: * c8ea31089d7bd97fdcb3c281266e44a921177daa Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9055)

Re: [PR] fix: tracking partition names correctly during secondary index [hudi]

vamshikrishnakyatham commented on PR #14042: URL: https://github.com/apache/hudi/pull/14042#issuecomment-3364559129 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

nsivabalan commented on code in PR #14045: URL: https://github.com/apache/hudi/pull/14045#discussion_r2401005845 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/SecondaryIndexRecordGenerationUtils.java: ## @@ -114,21 +124,60 @@ public static HoodieData

Re: [PR] fix: Fixing secondary record generation for MDT [hudi]

nsivabalan commented on code in PR #14045: URL: https://github.com/apache/hudi/pull/14045#discussion_r2401003522 ## hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/SecondaryIndexRecordGenerationUtils.java: ## @@ -114,21 +124,60 @@ public static HoodieData

Re: [PR] fix: INSERT INTO should preserve duplication with hoodie.spark.sql.insert.into.operation=insert [hudi]

hudi-bot commented on PR #14046: URL: https://github.com/apache/hudi/pull/14046#issuecomment-3364525214 ## CI report: * 7abf92a4d4ebce2248f09e80cbbc2ad4dbdb5e03 Azure: [FAILURE](https://dev.azure.com/apachehudi/a1a51da7-8592-47d4-88dc-fd67bed336bb/_build/results?buildId=9054)

  1   2   3   4   5   6   7   8   9   10   >