[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4753: [HUDI-3370] The files recorded in the commit may not match the actual ones for MOR Compaction

xiarixiaoyao commented on a change in pull request #4753: URL: https://github.com/apache/hudi/pull/4753#discussion_r802360038 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieCompactor.java ## @@ -293,4 +297,17 @@ private String getSchemaFromLatestIns

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1033446067 ## CI report: * 3941ceceb507a555a80ada072afdbc7f6ad79d91 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1033441821 ## CI report: * 3941ceceb507a555a80ada072afdbc7f6ad79d91 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #4772: [HUDI-3362] Change restore to rollback pending clustering operations first

hudi-bot removed a comment on pull request #4772: URL: https://github.com/apache/hudi/pull/4772#issuecomment-1033393162 ## CI report: * 4114579e3ac4b99f16a5aeeeb3fa3047d89a310b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4772: [HUDI-3362] Change restore to rollback pending clustering operations first

hudi-bot commented on pull request #4772: URL: https://github.com/apache/hudi/pull/4772#issuecomment-1033445970 ## CI report: * 4114579e3ac4b99f16a5aeeeb3fa3047d89a310b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4753: [HUDI-3370] The files recorded in the commit may not match the actual ones for MOR Compaction

xiarixiaoyao commented on a change in pull request #4753: URL: https://github.com/apache/hudi/pull/4753#discussion_r802358131 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieCompactor.java ## @@ -293,4 +297,17 @@ private String getSchemaFromLatestIns

[GitHub] [hudi] XuQianJin-Stars removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

XuQianJin-Stars removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033440279 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033441754 ## CI report: * 36930aca272d599ced50478b032a5aa82a6b088e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1033441821 ## CI report: * 3941ceceb507a555a80ada072afdbc7f6ad79d91 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033436498 ## CI report: * 36930aca272d599ced50478b032a5aa82a6b088e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

XuQianJin-Stars commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033440279 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[jira] [Updated] (HUDI-3400) Avoid throw exception when create hudi table

[ https://issues.apache.org/jira/browse/HUDI-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3400: - Labels: pull-request-available (was: ) > Avoid throw exception when create hudi table > -

[GitHub] [hudi] HuberyLee opened a new pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

HuberyLee opened a new pull request #4773: URL: https://github.com/apache/hudi/pull/4773 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033434883 ## CI report: * aec0210cbd1b892f27f87effd11eb6fff493ac3c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033436498 ## CI report: * 36930aca272d599ced50478b032a5aa82a6b088e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033433219 ## CI report: * aec0210cbd1b892f27f87effd11eb6fff493ac3c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033434883 ## CI report: * aec0210cbd1b892f27f87effd11eb6fff493ac3c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033431492 ## CI report: * aec0210cbd1b892f27f87effd11eb6fff493ac3c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033433219 ## CI report: * aec0210cbd1b892f27f87effd11eb6fff493ac3c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033429631 ## CI report: * 29db570374ddf45daa923ecea15f60c5eaa38dd8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033431492 ## CI report: * aec0210cbd1b892f27f87effd11eb6fff493ac3c Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] wqwl611 commented on issue #4690: write hudi mor table always encounter FileNotFoundException hdfs://ns/...0220126193401513.parquet

wqwl611 commented on issue #4690: URL: https://github.com/apache/hudi/issues/4690#issuecomment-1033430210 @nsivabalan I‘m trying to reproduce the issue, but my job running over 24h, and the issue don't show. so weird. I will share the content onece I see the issue again. -- Thi

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033429631 ## CI report: * 29db570374ddf45daa923ecea15f60c5eaa38dd8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033398941 ## CI report: * 29db570374ddf45daa923ecea15f60c5eaa38dd8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4753: [HUDI-3370] The files recorded in the commit may not match the actual ones for MOR Compaction

xiarixiaoyao commented on a change in pull request #4753: URL: https://github.com/apache/hudi/pull/4753#discussion_r802329830 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/HoodieSparkCompactor.java ## @@ -43,19 +48,25 @@ public HoodieSparkCom

[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption

hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-1033423744 ## CI report: * f85aeac825205ef91e31ca4a12183c1501d12d9d UNKNOWN * a4688a962fedeeab27ce030396ce86622e6083d2 UNKNOWN * ff998e2f0455ca102fe521a53d1929e6e87cb3bd Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption

hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-1033412658 ## CI report: * f85aeac825205ef91e31ca4a12183c1501d12d9d UNKNOWN * a4688a962fedeeab27ce030396ce86622e6083d2 UNKNOWN * ff998e2f0455ca102fe521a53d1929e6e87cb

[GitHub] [hudi] hudi-bot commented on pull request #4770: [HUDI-3088] [WIP] CI test spark2

hudi-bot commented on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033418509 ## CI report: * b003185befc7e84811a450190afe5cbf082cf58e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4770: [HUDI-3088] [WIP] CI test spark2

hudi-bot removed a comment on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033382336 ## CI report: * b003185befc7e84811a450190afe5cbf082cf58e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption

hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-1033412658 ## CI report: * f85aeac825205ef91e31ca4a12183c1501d12d9d UNKNOWN * a4688a962fedeeab27ce030396ce86622e6083d2 UNKNOWN * ff998e2f0455ca102fe521a53d1929e6e87cb3bd Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption

hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-1033403935 ## CI report: * f85aeac825205ef91e31ca4a12183c1501d12d9d UNKNOWN * a4688a962fedeeab27ce030396ce86622e6083d2 UNKNOWN * ff998e2f0455ca102fe521a53d1929e6e87cb

[GitHub] [hudi] hudi-bot commented on pull request #4441: [HUDI-3085] improve bulk insert partitioner abstraction

hudi-bot commented on pull request #4441: URL: https://github.com/apache/hudi/pull/4441#issuecomment-1033411293 ## CI report: * ee74d4492baca5f4fe9caab22afa349805bd4d5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Commented] (HUDI-3347) Updating table schema fails w/ hms mode w/ schema evolution

[ https://issues.apache.org/jira/browse/HUDI-3347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17489291#comment-17489291 ] Tao Meng commented on HUDI-3347: [~shivnarayan]  This problem seems to be caused by the w

[GitHub] [hudi] hudi-bot removed a comment on pull request #4441: [HUDI-3085] improve bulk insert partitioner abstraction

hudi-bot removed a comment on pull request #4441: URL: https://github.com/apache/hudi/pull/4441#issuecomment-1033379561 ## CI report: * ee74d4492baca5f4fe9caab22afa349805bd4d5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] xushiyan commented on pull request #3614: [HUDI-2370] Supports data encryption

xushiyan commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-1033409595 @liujinhui1994 per our discussions, some points here - `hoodie.parquet.encryption.keys` can be used as the switch. default to not set. if not set, then encryption feature is di

[GitHub] [hudi] hudi-bot commented on pull request #3614: [HUDI-2370] Supports data encryption

hudi-bot commented on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-1033403935 ## CI report: * f85aeac825205ef91e31ca4a12183c1501d12d9d UNKNOWN * a4688a962fedeeab27ce030396ce86622e6083d2 UNKNOWN * ff998e2f0455ca102fe521a53d1929e6e87cb3bd Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #3614: [HUDI-2370] Supports data encryption

hudi-bot removed a comment on pull request #3614: URL: https://github.com/apache/hudi/pull/3614#issuecomment-1033225637 ## CI report: * f85aeac825205ef91e31ca4a12183c1501d12d9d UNKNOWN * a4688a962fedeeab27ce030396ce86622e6083d2 UNKNOWN * ff998e2f0455ca102fe521a53d1929e6e87cb

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033397590 ## CI report: * 29db570374ddf45daa923ecea15f60c5eaa38dd8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033398941 ## CI report: * 29db570374ddf45daa923ecea15f60c5eaa38dd8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4605: [HUDI-2432] Adding restore.requested instant and restore plan for restore action

hudi-bot removed a comment on pull request #4605: URL: https://github.com/apache/hudi/pull/4605#issuecomment-1033351159 ## CI report: * b1ec8055e09845d859b31491e91d4087b5ca172a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4605: [HUDI-2432] Adding restore.requested instant and restore plan for restore action

hudi-bot commented on pull request #4605: URL: https://github.com/apache/hudi/pull/4605#issuecomment-1033398817 ## CI report: * 4ad83d6bb3f53d539a4dfeef53d3c2f9ae065e50 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033290769 ## CI report: * 29db570374ddf45daa923ecea15f60c5eaa38dd8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1033397590 ## CI report: * 29db570374ddf45daa923ecea15f60c5eaa38dd8 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3320) Implement a validator for metadata table file listing

[ https://issues.apache.org/jira/browse/HUDI-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3320: Reviewers: Ethan Guo > Implement a validator for metadata table file listing > -

[jira] [Updated] (HUDI-3370) The files recorded in the commit do not match the actual ones for MOR Compaction

[ https://issues.apache.org/jira/browse/HUDI-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3370: Reviewers: Ethan Guo (was: Y Ethan Guo) > The files recorded in the commit do not match the actual ones for

[jira] [Updated] (HUDI-3370) The files recorded in the commit do not match the actual ones for MOR Compaction

[ https://issues.apache.org/jira/browse/HUDI-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3370: Reviewers: Ethan Guo > The files recorded in the commit do not match the actual ones for MOR > Compaction >

[jira] [Updated] (HUDI-3370) The files recorded in the commit do not match the actual ones for MOR Compaction

[ https://issues.apache.org/jira/browse/HUDI-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3370: Reviewers: Y Ethan Guo (was: Ethan Guo) > The files recorded in the commit do not match the actual ones for

[GitHub] [hudi] hudi-bot commented on pull request #4772: [HUDI-3362] Change restore to rollback pending clustering operations first

hudi-bot commented on pull request #4772: URL: https://github.com/apache/hudi/pull/4772#issuecomment-1033393162 ## CI report: * 4114579e3ac4b99f16a5aeeeb3fa3047d89a310b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4772: [HUDI-3362] Change restore to rollback pending clustering operations first

hudi-bot removed a comment on pull request #4772: URL: https://github.com/apache/hudi/pull/4772#issuecomment-1033391758 ## CI report: * 4114579e3ac4b99f16a5aeeeb3fa3047d89a310b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] aditiwari01 commented on a change in pull request #4468: [HUDI-3130] Fixing Hive getSchema for RT tables addressing different partitions having different schemas

aditiwari01 commented on a change in pull request #4468: URL: https://github.com/apache/hudi/pull/4468#discussion_r802299209 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/AbstractRealtimeRecordReader.java ## @@ -77,19 +74,17 @@ private boolean uses

[GitHub] [hudi] aditiwari01 commented on a change in pull request #4468: [HUDI-3130] Fixing Hive getSchema for RT tables addressing different partitions having different schemas

aditiwari01 commented on a change in pull request #4468: URL: https://github.com/apache/hudi/pull/4468#discussion_r802299209 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/AbstractRealtimeRecordReader.java ## @@ -77,19 +74,17 @@ private boolean uses

[GitHub] [hudi] hudi-bot commented on pull request #4772: [HUDI-3362] Change restore to rollback pending clustering operations first

hudi-bot commented on pull request #4772: URL: https://github.com/apache/hudi/pull/4772#issuecomment-1033391758 ## CI report: * 4114579e3ac4b99f16a5aeeeb3fa3047d89a310b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] satishkotha commented on a change in pull request #4772: [HUDI-3362] Change restore to rollback pending clustering operations first

satishkotha commented on a change in pull request #4772: URL: https://github.com/apache/hudi/pull/4772#discussion_r802298314 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ClusteringUtils.java ## @@ -215,6 +215,12 @@ public static HoodieClusteringPlan cre

[jira] [Updated] (HUDI-3362) Hudi 0.8.0 cannot restore CoW table

[ https://issues.apache.org/jira/browse/HUDI-3362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3362: - Labels: pull-request-available (was: ) > Hudi 0.8.0 cannot restore CoW table > --

[GitHub] [hudi] satishkotha opened a new pull request #4772: [HUDI-3362] Change restore to rollback pending clustering operations first

satishkotha opened a new pull request #4772: URL: https://github.com/apache/hudi/pull/4772 ## What is the purpose of the pull request As part of restore, we want to rollback pending clustering operations first. Otherwise, commit sequence validation is failing and causing problems to

[GitHub] [hudi] hudi-bot commented on pull request #4770: [HUDI-3088] [WIP] CI test spark2

hudi-bot commented on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033382336 ## CI report: * b003185befc7e84811a450190afe5cbf082cf58e Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4770: [HUDI-3088] [WIP] CI test spark2

hudi-bot removed a comment on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033381146 ## CI report: * b003185befc7e84811a450190afe5cbf082cf58e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4770: [HUDI-3088] [WIP] CI test spark2

hudi-bot commented on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033381146 ## CI report: * b003185befc7e84811a450190afe5cbf082cf58e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4770: [HUDI-3088] [WIP] CI test spark2

hudi-bot removed a comment on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033379833 ## CI report: * b003185befc7e84811a450190afe5cbf082cf58e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4770: [HUDI-3088] [WIP] CI test spark2

hudi-bot commented on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033379833 ## CI report: * b003185befc7e84811a450190afe5cbf082cf58e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4441: [HUDI-3085] improve bulk insert partitioner abstraction

hudi-bot removed a comment on pull request #4441: URL: https://github.com/apache/hudi/pull/4441#issuecomment-1033370683 ## CI report: * ee74d4492baca5f4fe9caab22afa349805bd4d5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4441: [HUDI-3085] improve bulk insert partitioner abstraction

hudi-bot commented on pull request #4441: URL: https://github.com/apache/hudi/pull/4441#issuecomment-1033379561 ## CI report: * ee74d4492baca5f4fe9caab22afa349805bd4d5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] YuweiXiao commented on pull request #4441: [HUDI-3085] improve bulk insert partitioner abstraction

YuweiXiao commented on pull request #4441: URL: https://github.com/apache/hudi/pull/4441#issuecomment-1033379206 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] xushiyan commented on pull request #4770: [HUDI-3088] [WIP] CI test spark2

xushiyan commented on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033377564 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [hudi] hudi-bot removed a comment on pull request #4770: [HUDI-3088] [WIP] CI test spark2

hudi-bot removed a comment on pull request #4770: URL: https://github.com/apache/hudi/pull/4770#issuecomment-1033240704 ## CI report: * b003185befc7e84811a450190afe5cbf082cf58e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4441: [HUDI-3085] improve bulk insert partitioner abstraction

hudi-bot commented on pull request #4441: URL: https://github.com/apache/hudi/pull/4441#issuecomment-1033370683 ## CI report: * ee74d4492baca5f4fe9caab22afa349805bd4d5f Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4441: [HUDI-3085] improve bulk insert partitioner abstraction

hudi-bot removed a comment on pull request #4441: URL: https://github.com/apache/hudi/pull/4441#issuecomment-1033273002 ## CI report: * cc446f060dc1c7ed0eb434d56de6da697b205da1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] Prasheel3001 opened a new issue #4771: [Issue]: Hudi spill path not getting cleared when containers getting killed abruptly.

Prasheel3001 opened a new issue #4771: URL: https://github.com/apache/hudi/issues/4771 **_Tips before filing an issue_** - Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)? - Join the mailing list to engage in conversations and get faster support at dev-su

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4753: [HUDI-3370] The files recorded in the commit may not match the actual ones for MOR Compaction

zhangyue19921010 commented on a change in pull request #4753: URL: https://github.com/apache/hudi/pull/4753#discussion_r802280813 ## File path: hudi-client/hudi-flink-client/src/main/java/org/apache/hudi/client/HoodieFlinkWriteClient.java ## @@ -346,23 +344,21 @@ protected voi

[GitHub] [hudi] zhangyue19921010 closed pull request #4765: [TEST] Hudi-3370 test

zhangyue19921010 closed pull request #4765: URL: https://github.com/apache/hudi/pull/4765 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-

[GitHub] [hudi] hudi-bot commented on pull request #4753: [HUDI-3370] The files recorded in the commit may not match the actual ones for MOR Compaction

hudi-bot commented on pull request #4753: URL: https://github.com/apache/hudi/pull/4753#issuecomment-1033361415 ## CI report: * 9198c17de2ea5ca7331755b8df17c8fcbe66de68 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4753: [HUDI-3370] The files recorded in the commit may not match the actual ones for MOR Compaction

hudi-bot removed a comment on pull request #4753: URL: https://github.com/apache/hudi/pull/4753#issuecomment-1033266050 ## CI report: * eeb8579b14abec0eb6f7f8df62e29a6cea8d1fd3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] soma17dec commented on issue #4729: [SUPPORT] During compaction, can I merge only modified columns in a record and leave others unchanged

soma17dec commented on issue #4729: URL: https://github.com/apache/hudi/issues/4729#issuecomment-1033360986 Hi, I am currently running my process on AWS EMR services by using Hudi configs on Hudi 0.7 version and I am submitting my jobs using CLI on EMR cluster. ``` spark-s

[GitHub] [hudi] nsivabalan commented on a change in pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

nsivabalan commented on a change in pull request #4712: URL: https://github.com/apache/hudi/pull/4712#discussion_r802272328 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java ## @@ -330,10 +360,28 @@ public static void create(FileSystem

[GitHub] [hudi] hudi-bot commented on pull request #4605: [HUDI-2432] Adding restore.requested instant and restore plan for restore action

hudi-bot commented on pull request #4605: URL: https://github.com/apache/hudi/pull/4605#issuecomment-1033351159 ## CI report: * b1ec8055e09845d859b31491e91d4087b5ca172a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4605: [HUDI-2432] Adding restore.requested instant and restore plan for restore action

hudi-bot removed a comment on pull request #4605: URL: https://github.com/apache/hudi/pull/4605#issuecomment-1033350052 ## CI report: * b1ec8055e09845d859b31491e91d4087b5ca172a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4557: [HUDI-3395] Allow pass rollbackUsingMarkers to Hudi CLI rollback command

hudi-bot commented on pull request #4557: URL: https://github.com/apache/hudi/pull/4557#issuecomment-1033351138 ## CI report: * 68dc88af9f830fb62b7afc1da2c9a72b4a27ae26 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4557: [HUDI-3395] Allow pass rollbackUsingMarkers to Hudi CLI rollback command

hudi-bot removed a comment on pull request #4557: URL: https://github.com/apache/hudi/pull/4557#issuecomment-1033350015 ## CI report: * 3b59011da87037f698e5a08baf0a9af38a87a339 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4557: [HUDI-3395] Allow pass rollbackUsingMarkers to Hudi CLI rollback command

hudi-bot removed a comment on pull request #4557: URL: https://github.com/apache/hudi/pull/4557#issuecomment-1009607766 ## CI report: * 3b59011da87037f698e5a08baf0a9af38a87a339 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4557: [HUDI-3395] Allow pass rollbackUsingMarkers to Hudi CLI rollback command

hudi-bot commented on pull request #4557: URL: https://github.com/apache/hudi/pull/4557#issuecomment-1033350015 ## CI report: * 3b59011da87037f698e5a08baf0a9af38a87a339 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4605: [HUDI-2432] Adding restore.requested instant and restore plan for restore action

hudi-bot removed a comment on pull request #4605: URL: https://github.com/apache/hudi/pull/4605#issuecomment-1018980525 ## CI report: * b1ec8055e09845d859b31491e91d4087b5ca172a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4605: [HUDI-2432] Adding restore.requested instant and restore plan for restore action

hudi-bot commented on pull request #4605: URL: https://github.com/apache/hudi/pull/4605#issuecomment-1033350052 ## CI report: * b1ec8055e09845d859b31491e91d4087b5ca172a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] nsivabalan commented on pull request #4557: [HUDI-3395] Allow pass rollbackUsingMarkers to Hudi CLI rollback command

nsivabalan commented on pull request #4557: URL: https://github.com/apache/hudi/pull/4557#issuecomment-1033349298 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] nsivabalan commented on pull request #4264: [HUDI-2875] Make HoodieParquetWriter Thread safe and memory executor …

nsivabalan commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-1033347415 Thanks @guanziyue for the fix. if I am not wrong, you have this fix already in your prod env and has been running smoothly w/o issues. -- This is an automated message from t

[GitHub] [hudi] nsivabalan commented on a change in pull request #4264: [HUDI-2875] Make HoodieParquetWriter Thread safe and memory executor …

nsivabalan commented on a change in pull request #4264: URL: https://github.com/apache/hudi/pull/4264#discussion_r802266410 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/queue/BoundedInMemoryQueue.java ## @@ -204,6 +204,7 @@ private boolean expectMoreReco

[GitHub] [hudi] hudi-bot commented on pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

hudi-bot commented on pull request #4712: URL: https://github.com/apache/hudi/pull/4712#issuecomment-1033344643 ## CI report: * 39e9fb70dfe850e98b09405942b2601c755205b2 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

hudi-bot removed a comment on pull request #4712: URL: https://github.com/apache/hudi/pull/4712#issuecomment-1033265879 ## CI report: * 952302a99143a779bbcf998812157cedc427ef60 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] harsh1231 edited a comment on issue #4745: [SUPPORT] Bulk Insert into COW table slow

harsh1231 edited a comment on issue #4745: URL: https://github.com/apache/hudi/issues/4745#issuecomment-1033341751 @harishraju-govindaraju Can you check https://hudi.apache.org/docs/0.5.0/admin_guide/ `stats filesizes - File Sizes. Display summary stats on sizes of files stats wa - W

[GitHub] [hudi] harsh1231 edited a comment on issue #4745: [SUPPORT] Bulk Insert into COW table slow

harsh1231 edited a comment on issue #4745: URL: https://github.com/apache/hudi/issues/4745#issuecomment-1033341751 @harishraju-govindaraju Can you check https://hudi.apache.org/docs/0.5.0/admin_guide/ `*stats filesizes - File Sizes. Display summary stats on sizes of files *stats wa -

[GitHub] [hudi] harsh1231 edited a comment on issue #4745: [SUPPORT] Bulk Insert into COW table slow

harsh1231 edited a comment on issue #4745: URL: https://github.com/apache/hudi/issues/4745#issuecomment-1033341751 @harishraju-govindaraju Can you check https://hudi.apache.org/docs/0.5.0/admin_guide/ `* stats filesizes - File Sizes. Display summary stats on sizes of files * stats wa

[GitHub] [hudi] hudi-bot commented on pull request #4743: [HUDI-3280][Stacked on 4669] Cleaning up Hive-related hierarchies after refactoring

hudi-bot commented on pull request #4743: URL: https://github.com/apache/hudi/pull/4743#issuecomment-1033341690 ## CI report: * 75000d7530e6414662b27fce07a9abb2c41b5870 UNKNOWN * 69659d7f696cafad4938e49e8bba0a4a3c862898 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4743: [HUDI-3280][Stacked on 4669] Cleaning up Hive-related hierarchies after refactoring

hudi-bot removed a comment on pull request #4743: URL: https://github.com/apache/hudi/pull/4743#issuecomment-1033265969 ## CI report: * 75000d7530e6414662b27fce07a9abb2c41b5870 UNKNOWN * ae870c0b8dfb17721691ec25fbc2873356e4bdd5 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] harsh1231 commented on issue #4745: [SUPPORT] Bulk Insert into COW table slow

harsh1231 commented on issue #4745: URL: https://github.com/apache/hudi/issues/4745#issuecomment-1033341751 @harishraju-govindaraju Can you check `* stats filesizes - File Sizes. Display summary stats on sizes of files * stats wa - Write Amplification. Ratio of how many records were

[jira] [Updated] (HUDI-3400) Avoid throw exception when create hudi table

[ https://issues.apache.org/jira/browse/HUDI-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei updated HUDI-3400: - Description: Now, when create a hudi table, IllegalArgumentException will be thrown because of there is no data f

[jira] [Assigned] (HUDI-3400) Avoid throw exception when create hudi table

[ https://issues.apache.org/jira/browse/HUDI-3400?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] shibei reassigned HUDI-3400: Assignee: shibei > Avoid throw exception when create hudi table > -

[jira] [Created] (HUDI-3400) Avoid throw exception when create hudi table

shibei created HUDI-3400: Summary: Avoid throw exception when create hudi table Key: HUDI-3400 URL: https://issues.apache.org/jira/browse/HUDI-3400 Project: Apache Hudi Issue Type: Improvement

[GitHub] [hudi] hudi-bot commented on pull request #4669: [HUDI-3239] Convert `BaseHoodieTableFileIndex` to Java

hudi-bot commented on pull request #4669: URL: https://github.com/apache/hudi/pull/4669#issuecomment-1033327239 ## CI report: * dd2daec9f0bead9b6e7e896e7d1faf1f9a7959e7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] nsivabalan commented on a change in pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

nsivabalan commented on a change in pull request #4739: URL: https://github.com/apache/hudi/pull/4739#discussion_r802253573 ## File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieMetadataPayload.java ## @@ -362,28 +361,33 @@ private HoodieMetadataColumnStats c

[GitHub] [hudi] VIKASPATID commented on issue #4635: [SUPPORT] Bulk write failing due to hudi timeline archive exception

VIKASPATID commented on issue #4635: URL: https://github.com/apache/hudi/issues/4635#issuecomment-1033325939 @nsivabalan I tried with "hoodie.write.markers.type" = "DIRECT" and it stopped that "Failed to delete marker directory" error with hudi 0.10.0 , but it again failed with the same er

[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1033327350 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

  1   2   3   4   5   >