[GitHub] [hudi] xushiyan commented on a change in pull request #4916: Update roadmap page to reflect latest state

xushiyan commented on a change in pull request #4916: URL: https://github.com/apache/hudi/pull/4916#discussion_r816527774 ## File path: website/src/pages/roadmap.md ## @@ -62,11 +62,11 @@ Next major release : [0.11.0](https://issues.apache.org/jira/projects/HUDI/versi |--

[GitHub] [hudi] leesf merged pull request #4922: [HUDI-3441] Add support for "marker delete" in hudi-cli

leesf merged pull request #4922: URL: https://github.com/apache/hudi/pull/4922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[hudi] branch master updated (f7088a9 -> a81a632)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from f7088a9 [HUDI-3497] Adding Datatable validator tool (#4902) add a81a632 [HUDI-3441] Add support for "marker delet

[GitHub] [hudi] garyli1019 commented on a change in pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

garyli1019 commented on a change in pull request #4679: URL: https://github.com/apache/hudi/pull/4679#discussion_r816530295 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/utils/Pipelines.java ## @@ -189,21 +191,32 @@ } public static DataStream hoodieStreamW

[jira] [Resolved] (HUDI-3441) Clean up markers of completed commits in .hoodie/.temp folder

[ https://issues.apache.org/jira/browse/HUDI-3441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Forward Xu resolved HUDI-3441. -- > Clean up markers of completed commits in .hoodie/.temp folder > --

[GitHub] [hudi] hudi-bot commented on pull request #4686: [HUDI-3232] auto-reload active timeline incrementally

hudi-bot commented on pull request #4686: URL: https://github.com/apache/hudi/pull/4686#issuecomment-1055135932 ## CI report: * b40ab2952d3eefa8e373968b11db4df4b6611fcc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1055136089 ## CI report: * 0f9e39b14a31e8fd62f9267552de857b92cb5b34 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1055051537 ## CI report: * 0f9e39b14a31e8fd62f9267552de857b92cb5b34 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4686: [HUDI-3232] auto-reload active timeline incrementally

hudi-bot removed a comment on pull request #4686: URL: https://github.com/apache/hudi/pull/4686#issuecomment-1049954163 ## CI report: * b40ab2952d3eefa8e373968b11db4df4b6611fcc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4686: [HUDI-3232] auto-reload active timeline incrementally

hudi-bot removed a comment on pull request #4686: URL: https://github.com/apache/hudi/pull/4686#issuecomment-1055135932 ## CI report: * b40ab2952d3eefa8e373968b11db4df4b6611fcc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4686: [HUDI-3232] auto-reload active timeline incrementally

hudi-bot commented on pull request #4686: URL: https://github.com/apache/hudi/pull/4686#issuecomment-1055138919 ## CI report: * b40ab2952d3eefa8e373968b11db4df4b6611fcc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] garyli1019 commented on a change in pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

garyli1019 commented on a change in pull request #4679: URL: https://github.com/apache/hudi/pull/4679#discussion_r816534775 ## File path: hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java ## @@ -310,6 +318,20 @@ private FlinkOptions() { + "Act

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055140799 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1054915585 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1055141455 ## CI report: * 8120f64681ac4e42a075d2cc04b036f737622ccd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1054303011 ## CI report: * 8120f64681ac4e42a075d2cc04b036f737622ccd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] prashantwason commented on a change in pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

prashantwason commented on a change in pull request #4821: URL: https://github.com/apache/hudi/pull/4821#discussion_r816537071 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java ## @@ -429,25 +428,21 @@ public void mer

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1055141455 ## CI report: * 8120f64681ac4e42a075d2cc04b036f737622ccd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1055143664 ## CI report: * 8120f64681ac4e42a075d2cc04b036f737622ccd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055147705 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055140799 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055149905 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055147705 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] cdzryou commented on issue #4882: [SUPPORT]How to clean action files theses are not used with flink task?

cdzryou commented on issue #4882: URL: https://github.com/apache/hudi/issues/4882#issuecomment-1055152064 > These files should be archived then, did your job have pending compactions on the timeline ? thanks for your comment. have no pending compactions, i run a job for a long tim

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055152211 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055149905 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

xiarixiaoyao commented on a change in pull request #3808: URL: https://github.com/apache/hudi/pull/3808#discussion_r816546703 ## File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/io/FileBasedInternalSchemaStorageManager.java ## @@ -0,0 +1,169 @@ +/* + * Lice

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

xiarixiaoyao commented on a change in pull request #3808: URL: https://github.com/apache/hudi/pull/3808#discussion_r816546815 ## File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/action/SchemaMerger.java ## @@ -0,0 +1,133 @@ +/* + * Licensed to the Apache So

[GitHub] [hudi] xiarixiaoyao commented on pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

xiarixiaoyao commented on pull request #3808: URL: https://github.com/apache/hudi/pull/3808#issuecomment-1055154248 @bvaradar we stored history schemas into .schema for the reason that we want track the lineage of schema changes Later, we can use the incremental method to synchronize

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055154709 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055152211 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] danny0405 commented on a change in pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

danny0405 commented on a change in pull request #4909: URL: https://github.com/apache/hudi/pull/4909#discussion_r816548129 ## File path: hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieHFileReader.java ## @@ -227,6 +261,40 @@ public BloomFilter readBloomFilter() {

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

xiarixiaoyao commented on a change in pull request #3808: URL: https://github.com/apache/hudi/pull/3808#discussion_r816548292 ## File path: hudi-common/src/main/java/org/apache/hudi/internal/schema/action/SchemaMerger.java ## @@ -0,0 +1,133 @@ +/* + * Licensed to the Apache So

[GitHub] [hudi] bhasudha commented on a change in pull request #4916: Update roadmap page to reflect latest state

bhasudha commented on a change in pull request #4916: URL: https://github.com/apache/hudi/pull/4916#discussion_r816559766 ## File path: website/src/pages/roadmap.md ## @@ -62,11 +62,11 @@ Next major release : [0.11.0](https://issues.apache.org/jira/projects/HUDI/versi |--

[GitHub] [hudi] bhasudha merged pull request #4916: Update roadmap page to reflect latest state

bhasudha merged pull request #4916: URL: https://github.com/apache/hudi/pull/4916 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[hudi] branch asf-site updated: Update roadmap page to reflect latest state (#4916)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 7181f18 Update roadmap page to reflect

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055169466 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 66be3d9a844bb0ea99aaa61642f9a35371e9cf61 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055084862 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 455953353c2d193a00578bcb11b2ae47035bf

[GitHub] [hudi] codope commented on a change in pull request #4916: Update roadmap page to reflect latest state

codope commented on a change in pull request #4916: URL: https://github.com/apache/hudi/pull/4916#discussion_r816561632 ## File path: website/src/pages/roadmap.md ## @@ -62,11 +62,11 @@ Next major release : [0.11.0](https://issues.apache.org/jira/projects/HUDI/versi |

[GitHub] [hudi] cuibo01 commented on a change in pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

cuibo01 commented on a change in pull request #4909: URL: https://github.com/apache/hudi/pull/4909#discussion_r816563490 ## File path: hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieHFileReader.java ## @@ -227,6 +261,40 @@ public BloomFilter readBloomFilter() {

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055169466 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 66be3d9a844bb0ea99aaa61642f9a35371e9c

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055174216 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 66be3d9a844bb0ea99aaa61642f9a35371e9cf61 Azur

[GitHub] [hudi] danny0405 commented on issue #4882: [SUPPORT]How to clean action files theses are not used with flink task?

danny0405 commented on issue #4882: URL: https://github.com/apache/hudi/issues/4882#issuecomment-1055174981 For flink option, it is `archive.min_commits` default 20 and `archive.max_commits` 30, i would suggest you keep the default value as it is to avoid weird problem. Because in hoodie,

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055174216 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 66be3d9a844bb0ea99aaa61642f9a35371e9c

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055176972 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 66be3d9a844bb0ea99aaa61642f9a35371e9cf61 Azur

[GitHub] [hudi] danny0405 commented on a change in pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

danny0405 commented on a change in pull request #4821: URL: https://github.com/apache/hudi/pull/4821#discussion_r816569023 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/HoodieTimelineArchiver.java ## @@ -429,25 +428,21 @@ public void mergeAr

[GitHub] [hudi] hudi-bot removed a comment on pull request #4489: [HUDI-3135] Fix Delete partitions with metadata table and fix show partitions in spark sql

hudi-bot removed a comment on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1055108107 ## CI report: * 31bca2b35905b3a1207af4099d4d06b99059dc2f Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4489: [HUDI-3135] Fix Delete partitions with metadata table and fix show partitions in spark sql

hudi-bot commented on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1055179038 ## CI report: * 8b1319f8b60ace55f84d98022dd11c13c83fa562 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055179578 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 51b2f8fc4c57b179f77e92dfd95b028bd98b54a7 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055176972 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 66be3d9a844bb0ea99aaa61642f9a35371e9c

[GitHub] [hudi] danny0405 commented on a change in pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

danny0405 commented on a change in pull request #4909: URL: https://github.com/apache/hudi/pull/4909#discussion_r816572284 ## File path: hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieHFileReader.java ## @@ -227,6 +261,40 @@ public BloomFilter readBloomFilter() {

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055185677 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055154709 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055185677 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055189083 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] cuibo01 commented on a change in pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

cuibo01 commented on a change in pull request #4909: URL: https://github.com/apache/hudi/pull/4909#discussion_r816580335 ## File path: hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieHFileReader.java ## @@ -227,6 +261,40 @@ public BloomFilter readBloomFilter() {

[GitHub] [hudi] cuibo01 commented on a change in pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

cuibo01 commented on a change in pull request #4909: URL: https://github.com/apache/hudi/pull/4909#discussion_r816580335 ## File path: hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieHFileReader.java ## @@ -227,6 +261,40 @@ public BloomFilter readBloomFilter() {

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055206117 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055189083 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] danny0405 commented on a change in pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

danny0405 commented on a change in pull request #4909: URL: https://github.com/apache/hudi/pull/4909#discussion_r816591019 ## File path: hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieHFileReader.java ## @@ -227,6 +261,40 @@ public BloomFilter readBloomFilter() {

[GitHub] [hudi] pratyakshsharma commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

pratyakshsharma commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1055209599 One high level question, is there any limitation or pre requisite in terms of different schemas from different source topics that users should be aware of when using this

[GitHub] [hudi] pmgod8922 commented on issue #4876: Atomic overwrite of multiple files

pmgod8922 commented on issue #4876: URL: https://github.com/apache/hudi/issues/4876#issuecomment-1055231174 > hello ask a question： 1、I create sparksession SparkSession sparkSession = SparkSession.builder().enableHiveSupport().appName("HudiTest") .config("spark.serializer

[jira] [Updated] (HUDI-1862) Handle inconsistent views of source table and Hudi dataset

[ https://issues.apache.org/jira/browse/HUDI-1862?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1862: - Fix Version/s: 0.12.0 (was: 0.11.0) > Handle inconsistent views of source table and

[jira] [Updated] (HUDI-1859) [UMBRELLA] RFC - 14 : JDBC incremental puller

[ https://issues.apache.org/jira/browse/HUDI-1859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1859: - Fix Version/s: 0.12.0 (was: 0.11.0) > [UMBRELLA] RFC - 14 : JDBC incremental puller

[GitHub] [hudi] hudi-bot removed a comment on pull request #4686: [HUDI-3232] auto-reload active timeline incrementally

hudi-bot removed a comment on pull request #4686: URL: https://github.com/apache/hudi/pull/4686#issuecomment-1055138919 ## CI report: * b40ab2952d3eefa8e373968b11db4df4b6611fcc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4686: [HUDI-3232] auto-reload active timeline incrementally

hudi-bot commented on pull request #4686: URL: https://github.com/apache/hudi/pull/4686#issuecomment-1055238664 ## CI report: * 316a57b79153f5fbd0c8fc7b635ac43e64ae4981 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055179578 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 51b2f8fc4c57b179f77e92dfd95b028bd98b5

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055244801 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 51b2f8fc4c57b179f77e92dfd95b028bd98b54a7 Azur

[GitHub] [hudi] xushiyan commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

xushiyan commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1055244794 @YannByron if you get a chance, please take a pass also. thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055254918 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 51b2f8fc4c57b179f77e92dfd95b028bd98b54a7 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055244801 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 51b2f8fc4c57b179f77e92dfd95b028bd98b5

[jira] [Created] (HUDI-3540) Improve using MERGE INTO

Raymond Xu created HUDI-3540: Summary: Improve using MERGE INTO Key: HUDI-3540 URL: https://issues.apache.org/jira/browse/HUDI-3540 Project: Apache Hudi Issue Type: Improvement Compone

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1055257720 ## CI report: * 3340d3ac9a0d00b0f217a0dffc63b24960f39904 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Part-1 Support bucket index in Flink writer

hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1055143664 ## CI report: * 8120f64681ac4e42a075d2cc04b036f737622ccd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055254918 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 51b2f8fc4c57b179f77e92dfd95b028bd98b5

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055258120 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 4089f89153626587326e301396fb6a0c262485f7 Azur

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4489: [HUDI-3135] Fix Delete partitions with metadata table and fix show partitions in spark sql

XuQianJin-Stars commented on pull request #4489: URL: https://github.com/apache/hudi/pull/4489#issuecomment-1055290081 hi @nsivabalan I have updated this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [hudi] hudi-bot removed a comment on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot removed a comment on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055206117 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c260

[GitHub] [hudi] hudi-bot commented on pull request #3312: [HUDI-648][RFC-20] Implement error log/table for Datasource/DeltaStreamer/WriteClient/Compaction writes

hudi-bot commented on pull request #3312: URL: https://github.com/apache/hudi/pull/3312#issuecomment-1055292951 ## CI report: * 58a46294a5ae693281d543a86af4785e09decd8f UNKNOWN * 3b88d82271c25fa3db151b6560e97879d27c7119 UNKNOWN * 32be2cd26dff9d8f2578e5ff9e88f32b6c2606dd UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055258120 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 4089f89153626587326e301396fb6a0c26248

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055293766 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 4089f89153626587326e301396fb6a0c262485f7 Azur

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055303546 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 4089f89153626587326e301396fb6a0c262485f7 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055293766 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 4089f89153626587326e301396fb6a0c26248

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055357981 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 696fa482351bc1cbd4124c56bae026793e5f28cb UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055303546 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 4089f89153626587326e301396fb6a0c26248

[GitHub] [hudi] cuibo01 commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

cuibo01 commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055367371 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055368576 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 696fa482351bc1cbd4124c56bae026793e5f28cb UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055357981 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 696fa482351bc1cbd4124c56bae026793e5f2

[jira] [Deleted] (HUDI-3540) Improve using MERGE INTO

[ https://issues.apache.org/jira/browse/HUDI-3540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu deleted HUDI-3540: - > Improve using MERGE INTO > - > > Key: HUDI-3540 >

[GitHub] [hudi] YuweiXiao commented on a change in pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

YuweiXiao commented on a change in pull request #4480: URL: https://github.com/apache/hudi/pull/4480#discussion_r816736220 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bucket/HoodieSparkConsistentBucketIndex.java ## @@ -0,0 +1,218 @@ +/* + *

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055426730 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 696fa482351bc1cbd4124c56bae026793e5f28cb UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055368576 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 696fa482351bc1cbd4124c56bae026793e5f2

[GitHub] [hudi] hudi-bot removed a comment on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot removed a comment on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1055106425 ## CI report: * 82f08a4b57e32d64c0beb3fb952570a23b31eda1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1055438898 ## CI report: * 82f08a4b57e32d64c0beb3fb952570a23b31eda1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1055441604 ## CI report: * 82f08a4b57e32d64c0beb3fb952570a23b31eda1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot removed a comment on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1055438898 ## CI report: * 82f08a4b57e32d64c0beb3fb952570a23b31eda1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] cuibo01 commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

cuibo01 commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055443733 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [hudi] hudi-bot removed a comment on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot removed a comment on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055426730 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 696fa482351bc1cbd4124c56bae026793e5f2

[GitHub] [hudi] hudi-bot commented on pull request #4909: [HUDI-3516] Implement record iterator for HoodieDataBlock

hudi-bot commented on pull request #4909: URL: https://github.com/apache/hudi/pull/4909#issuecomment-1055444369 ## CI report: * 4b93451c19c4f69cf04ec6139114e424a3b72f00 UNKNOWN * 9f920edbe3ed87e180b259d81a8343197080fcc1 UNKNOWN * 696fa482351bc1cbd4124c56bae026793e5f28cb UNKN

[GitHub] [hudi] watermelon12138 commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

watermelon12138 commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1055454800 > One high level question, is there any limitation or pre requisite in terms of different schemas from different source topics that users should be aware of when using thi

  1   2   3   4   >