[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041215482 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 6a6f03bd100becf8c1decf4aad72445f8b03e01b Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041019012 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 6a6f03bd100becf8c1decf4aad72445f8b03e

[GitHub] [hudi] YuweiXiao commented on a change in pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

YuweiXiao commented on a change in pull request #4823: URL: https://github.com/apache/hudi/pull/4823#discussion_r807650172 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/table/action/commit/UpsertPartitioner.java ## @@ -165,7 +165,7 @@ private void a

[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot removed a comment on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041209468 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * 6498d01bd48aeda771b67839b8968cf89492e

[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041222130 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * 6498d01bd48aeda771b67839b8968cf89492e139 Azur

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041224417 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 2ea93235cbd3a9b7d739616899590a26729f6174 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-or

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041190378 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 2ea93235cbd3a9b7d739616899590a26729f6174 Azure: [CANCELED](https://dev.azure.com/apache-hu

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041224488 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 6a6f03bd100becf8c1decf4aad72445f8b03e01b Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041215482 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 6a6f03bd100becf8c1decf4aad72445f8b03e

[GitHub] [hudi] gaoasi opened a new issue #4827: [SUPPORT] flink1.12.4 hudi 0.9.0 java.lang.ClassNotFoundException: org.apache.hudi.sink.StreamWriteOperatorCoordinator$Provider

gaoasi opened a new issue #4827: URL: https://github.com/apache/hudi/issues/4827 hi ! I expect to write data to hudi through flink sql-client, however, I have encountered a problem, the problem is as follows： flink version is 1.12.4 hudi version is 0.9.0 flink lib info

[GitHub] [hudi] danny0405 commented on issue #4825: [SUPPORT] flink hudi some class not found

danny0405 commented on issue #4825: URL: https://github.com/apache/hudi/issues/4825#issuecomment-1041226264 Yes, the default bundle jar does not include the hive jar but the hive class is shaded. -- This is an automated message from the Apache Git Service. To respond to the message, plea

[GitHub] [hudi] zhedoubushishi commented on issue #4456: [SUPPORT] MultiWriter w/ DynamoDB - Unable to acquire lock, lock object null

zhedoubushishi commented on issue #4456: URL: https://github.com/apache/hudi/issues/4456#issuecomment-1041228841 I couldn't reproduce this issue, this is the config I used: ``` .option("hoodie.write.concurrency.mode", "optimistic_concurrency_control") .option("hoodie.cleaner.policy

[GitHub] [hudi] zhedoubushishi edited a comment on issue #4456: [SUPPORT] MultiWriter w/ DynamoDB - Unable to acquire lock, lock object null

zhedoubushishi edited a comment on issue #4456: URL: https://github.com/apache/hudi/issues/4456#issuecomment-1041228841 I couldn't reproduce this issue, this is the config I used: ``` .option("hoodie.write.concurrency.mode", "optimistic_concurrency_control") .option("hoodie.cleaner

[jira] [Created] (HUDI-3439) Do not shade hive class for flink bundle jar with no hive profile

Danny Chen created HUDI-3439: Summary: Do not shade hive class for flink bundle jar with no hive profile Key: HUDI-3439 URL: https://issues.apache.org/jira/browse/HUDI-3439 Project: Apache Hudi

[GitHub] [hudi] YuweiXiao commented on a change in pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

YuweiXiao commented on a change in pull request #4823: URL: https://github.com/apache/hudi/pull/4823#discussion_r807658087 ## File path: hudi-client/hudi-java-client/src/main/java/org/apache/hudi/table/action/commit/JavaUpsertPartitioner.java ## @@ -205,6 +205,11 @@ private vo

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1041199224 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1041247144 ## CI report: * 1e329ebb693dfb90cdfb35128a994c7ea9f1c8b4 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041068934 ## CI report: * 47745008de1658561623c4187330e1004794d253 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041287810 ## CI report: * 47745008de1658561623c4187330e1004794d253 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041290326 ## CI report: * 47745008de1658561623c4187330e1004794d253 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041287810 ## CI report: * 47745008de1658561623c4187330e1004794d253 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041224488 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 6a6f03bd100becf8c1decf4aad72445f8b03e

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041292999 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * db5b6f3c44046131647a6b3eb631f3c73ae6eeb1 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot removed a comment on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041222130 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * 6498d01bd48aeda771b67839b8968cf89492e

[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041295531 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041224417 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 2ea93235cbd3a9b7d739616899590a26729f6174 Azure: [CANCELED](https://dev.azure.com/apache-hu

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041308305 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 65c8457ddb07ca94312168de529a2b293d40349e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

zhangyue19921010 commented on a change in pull request #4824: URL: https://github.com/apache/hudi/pull/4824#discussion_r807750993 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ## @@ -684,6 +691,7 @@ public DeltaSync

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

zhangyue19921010 commented on a change in pull request #4824: URL: https://github.com/apache/hudi/pull/4824#discussion_r807750993 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ## @@ -684,6 +691,7 @@ public DeltaSync

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041336492 ## CI report: * e0fadab437970eac2b15816d101db50586bc7d9b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041290326 ## CI report: * 47745008de1658561623c4187330e1004794d253 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] garyli1019 commented on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

garyli1019 commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1041367799 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1041368620 ## CI report: * Unknown: [CANCELED](TBD) * ddbf502d11717d800971f736fa81054afa1873b7 UNKNOWN Bot commands @hudi-bot supports the following commands:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1040347175 ## CI report: * f63a0753eb2f8f25cd1cd68bf5e6356a73438588 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041336492 ## CI report: * e0fadab437970eac2b15816d101db50586bc7d9b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041368743 ## CI report: * e0fadab437970eac2b15816d101db50586bc7d9b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1041372152 ## CI report: * Unknown: [CANCELED](TBD) * ddbf502d11717d800971f736fa81054afa1873b7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041372256 ## CI report: * e0fadab437970eac2b15816d101db50586bc7d9b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041368743 ## CI report: * e0fadab437970eac2b15816d101db50586bc7d9b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1041368620 ## CI report: * Unknown: [CANCELED](TBD) * ddbf502d11717d800971f736fa81054afa1873b7 UNKNOWN Bot commands @hudi-bot supports the following co

[GitHub] [hudi] hudi-bot commented on pull request #4761: [HUDI-3356][HUDI-3142][HUDI-1492] Metadata column stats index - handling delta writes

hudi-bot commented on pull request #4761: URL: https://github.com/apache/hudi/pull/4761#issuecomment-1041375126 ## CI report: * b0350aa89d478eedddf483214ba42024880efb27 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4761: [HUDI-3356][HUDI-3142][HUDI-1492] Metadata column stats index - handling delta writes

hudi-bot removed a comment on pull request #4761: URL: https://github.com/apache/hudi/pull/4761#issuecomment-1036369061 ## CI report: * b0350aa89d478eedddf483214ba42024880efb27 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4761: [HUDI-3356][HUDI-3142][HUDI-1492] Metadata column stats index - handling delta writes

hudi-bot removed a comment on pull request #4761: URL: https://github.com/apache/hudi/pull/4761#issuecomment-1041375126 ## CI report: * b0350aa89d478eedddf483214ba42024880efb27 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4761: [HUDI-3356][HUDI-3142][HUDI-1492] Metadata column stats index - handling delta writes

hudi-bot commented on pull request #4761: URL: https://github.com/apache/hudi/pull/4761#issuecomment-1041378118 ## CI report: * b0350aa89d478eedddf483214ba42024880efb27 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041372256 ## CI report: * e0fadab437970eac2b15816d101db50586bc7d9b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041430396 ## CI report: * 9234e97b9428e00d78724ace385200152e9af1f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] xushiyan commented on a change in pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

xushiyan commented on a change in pull request #4824: URL: https://github.com/apache/hudi/pull/4824#discussion_r807877795 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/deltastreamer/HoodieDeltaStreamer.java ## @@ -762,12 +769,12 @@ protected Boolean onI

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1041372152 ## CI report: * Unknown: [CANCELED](TBD) * ddbf502d11717d800971f736fa81054afa1873b7 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1041435375 ## CI report: * ddbf502d11717d800971f736fa81054afa1873b7 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3426) Fix out of sync Clustering config properties

[ https://issues.apache.org/jira/browse/HUDI-3426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3426: - Labels: pull-request-available (was: ) > Fix out of sync Clustering config properties >

[GitHub] [hudi] codope opened a new pull request #4828: [HUDI-3426] Sync datasource clustering config

codope opened a new pull request #4828: URL: https://github.com/apache/hudi/pull/4828 ## What is the purpose of the pull request [HoodieClusteringConfig](https://github.com/apache/hudi/blob/master/hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieClusteringCon

[GitHub] [hudi] hudi-bot commented on pull request #4828: [HUDI-3426] Sync datasource clustering config

hudi-bot commented on pull request #4828: URL: https://github.com/apache/hudi/pull/4828#issuecomment-1041456462 ## CI report: * 37b452208148d858a86b4e0e9b9db54e97c61c7d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4828: [HUDI-3426] Sync datasource clustering config

hudi-bot commented on pull request #4828: URL: https://github.com/apache/hudi/pull/4828#issuecomment-1041458774 ## CI report: * 37b452208148d858a86b4e0e9b9db54e97c61c7d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4828: [HUDI-3426] Sync datasource clustering config

hudi-bot removed a comment on pull request #4828: URL: https://github.com/apache/hudi/pull/4828#issuecomment-1041456462 ## CI report: * 37b452208148d858a86b4e0e9b9db54e97c61c7d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041430396 ## CI report: * 9234e97b9428e00d78724ace385200152e9af1f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041460996 ## CI report: * 9234e97b9428e00d78724ace385200152e9af1f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041460996 ## CI report: * 9234e97b9428e00d78724ace385200152e9af1f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041463330 ## CI report: * 9234e97b9428e00d78724ace385200152e9af1f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4761: [HUDI-3356][HUDI-3142][HUDI-1492] Metadata column stats index - handling delta writes

hudi-bot removed a comment on pull request #4761: URL: https://github.com/apache/hudi/pull/4761#issuecomment-1041378118 ## CI report: * b0350aa89d478eedddf483214ba42024880efb27 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4761: [HUDI-3356][HUDI-3142][HUDI-1492] Metadata column stats index - handling delta writes

hudi-bot commented on pull request #4761: URL: https://github.com/apache/hudi/pull/4761#issuecomment-1041465713 ## CI report: * 82c87f64c7c20e6bb718f7d491f0acccb003a71a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] danny0405 commented on issue #4184: [SUPPORT]parquet is not a Parquet file (too small length:4)

danny0405 commented on issue #4184: URL: https://github.com/apache/hudi/issues/4184#issuecomment-1041489853 I guess this is a parquet that not committed, and the cleaner has not cleaned it yet when the reader reads this file. -- This is an automated message from the Apache Git Service. T

[jira] [Closed] (HUDI-1421) Improvement of failure recovery for HoodieFlinkStreamer

[ https://issues.apache.org/jira/browse/HUDI-1421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] loukey_j closed HUDI-1421. -- Resolution: Fixed > Improvement of failure recovery for HoodieFlinkStreamer > --

[GitHub] [hudi] minihippo commented on pull request #4785: [HUDI-3408] fixed the bug that BUCKET_INDEX cannot process special ch…

minihippo commented on pull request #4785: URL: https://github.com/apache/hudi/pull/4785#issuecomment-1041505103 > > @minihippo yes will do it, but i still have some problems, [BucketIdentifier.java](https://github.com/apache/hudi/pull/4785/files#diff-cec97cf4da631039da992f4

[GitHub] [hudi] YannByron commented on a change in pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

YannByron commented on a change in pull request #4752: URL: https://github.com/apache/hudi/pull/4752#discussion_r807984316 ## File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java ## @@ -461,7 +463,7 @@ public static Object getNestedFieldVal(GenericReco

[GitHub] [hudi] minihippo edited a comment on pull request #4785: [HUDI-3408] fixed the bug that BUCKET_INDEX cannot process special ch…

minihippo edited a comment on pull request #4785: URL: https://github.com/apache/hudi/pull/4785#issuecomment-1041505103 > > @minihippo yes will do it, but i still have some problems, [BucketIdentifier.java](https://github.com/apache/hudi/pull/4785/files#diff-cec97cf4da631039

[jira] [Created] (HUDI-3440) HoodieSortedMergeHandle#close write data disorder

loukey_j created HUDI-3440: -- Summary: HoodieSortedMergeHandle#close write data disorder Key: HUDI-3440 URL: https://issues.apache.org/jira/browse/HUDI-3440 Project: Apache Hudi Issue Type: Task

[GitHub] [hudi] YannByron commented on pull request #4815: [HUDI-3423] upgrade spark to 3.2.1

YannByron commented on pull request #4815: URL: https://github.com/apache/hudi/pull/4815#issuecomment-1041516380 @xushiyan all UTs in spark-datasource and spark-client has passed in my local env, except of two UT in spark-client which will be fixed in https://github.com/apache/hudi/pull/47

[GitHub] [hudi] nloneday commented on issue #4184: [SUPPORT]parquet is not a Parquet file (too small length:4)

nloneday commented on issue #4184: URL: https://github.com/apache/hudi/issues/4184#issuecomment-1041517459 > I guess this is a parquet that not committed, and the cleaner has not cleaned it yet when the reader reads this file. it seems that cleaner does not work well. ![image](ht

[GitHub] [hudi] hudi-bot commented on pull request #4815: [HUDI-3423] upgrade spark to 3.2.1

hudi-bot commented on pull request #4815: URL: https://github.com/apache/hudi/pull/4815#issuecomment-1041518051 ## CI report: * 9146362feee1deef5da2d43547b67539bff0a2ed Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4815: [HUDI-3423] upgrade spark to 3.2.1

hudi-bot removed a comment on pull request #4815: URL: https://github.com/apache/hudi/pull/4815#issuecomment-1039243089 ## CI report: * 9146362feee1deef5da2d43547b67539bff0a2ed Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] loukey-lj opened a new pull request #4829: upstream

loukey-lj opened a new pull request #4829: URL: https://github.com/apache/hudi/pull/4829 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] loukey-lj closed pull request #4829: upstream

loukey-lj closed pull request #4829: URL: https://github.com/apache/hudi/pull/4829 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] hudi-bot commented on pull request #4815: [HUDI-3423] upgrade spark to 3.2.1

hudi-bot commented on pull request #4815: URL: https://github.com/apache/hudi/pull/4815#issuecomment-1041520945 ## CI report: * 9146362feee1deef5da2d43547b67539bff0a2ed Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4815: [HUDI-3423] upgrade spark to 3.2.1

hudi-bot removed a comment on pull request #4815: URL: https://github.com/apache/hudi/pull/4815#issuecomment-1041518051 ## CI report: * 9146362feee1deef5da2d43547b67539bff0a2ed Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4828: [HUDI-3426] Sync datasource clustering config

hudi-bot commented on pull request #4828: URL: https://github.com/apache/hudi/pull/4828#issuecomment-1041526675 ## CI report: * 37b452208148d858a86b4e0e9b9db54e97c61c7d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4828: [HUDI-3426] Sync datasource clustering config

hudi-bot removed a comment on pull request #4828: URL: https://github.com/apache/hudi/pull/4828#issuecomment-1041458774 ## CI report: * 37b452208148d858a86b4e0e9b9db54e97c61c7d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] minihippo edited a comment on pull request #4785: [HUDI-3408] fixed the bug that BUCKET_INDEX cannot process special ch…

minihippo edited a comment on pull request #4785: URL: https://github.com/apache/hudi/pull/4785#issuecomment-1041505103 > > @minihippo yes will do it, but i still have some problems, [BucketIdentifier.java](https://github.com/apache/hudi/pull/4785/files#diff-cec97cf4da631039

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041463330 ## CI report: * 9234e97b9428e00d78724ace385200152e9af1f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1041532023 ## CI report: * 9efcab8b8f103d07395badb779c875d76234717d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4815: [HUDI-3423] upgrade spark to 3.2.1

hudi-bot removed a comment on pull request #4815: URL: https://github.com/apache/hudi/pull/4815#issuecomment-1041520945 ## CI report: * 9146362feee1deef5da2d43547b67539bff0a2ed Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4815: [HUDI-3423] upgrade spark to 3.2.1

hudi-bot commented on pull request #4815: URL: https://github.com/apache/hudi/pull/4815#issuecomment-1041572386 ## CI report: * 751eb6cc364a9926d271cd1ac548c114fe7f6701 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] vinothchandar commented on a change in pull request #4743: [HUDI-3280] Cleaning up Hive-related hierarchies after refactoring

vinothchandar commented on a change in pull request #4743: URL: https://github.com/apache/hudi/pull/4743#discussion_r808143534 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/realtime/HoodieMergeOnReadTableInputFormat.java ## @@ -235,20 +258,117 @@ protected

[GitHub] [hudi] LucassLin commented on issue #4700: [SUPPORT] Adding new column to table is not propagated to Hive via HMS sync mode

LucassLin commented on issue #4700: URL: https://github.com/apache/hudi/issues/4700#issuecomment-1041824640 @xiarixiaoyao No I am testing it on Dataproc 1.5 with Spark Version 2.4.8 and hudi Version 0.10.0 -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [hudi] codope commented on a change in pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

codope commented on a change in pull request #4712: URL: https://github.com/apache/hudi/pull/4712#discussion_r808174759 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java ## @@ -228,13 +228,20 @@ public HoodieTableConfig() { privat

[GitHub] [hudi] codope commented on a change in pull request #4761: [HUDI-3356][HUDI-3142][HUDI-1492] Metadata column stats index - handling delta writes

codope commented on a change in pull request #4761: URL: https://github.com/apache/hudi/pull/4761#discussion_r808202079 ## File path: hudi-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataUtil.java ## @@ -608,82 +583,126 @@ private static void processRollbackM

[jira] [Updated] (HUDI-3175) Support INDEX action for async metadata indexing

[ https://issues.apache.org/jira/browse/HUDI-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3175: -- Status: In Progress (was: Open) > Support INDEX action for async metadata indexing > --

[jira] [Updated] (HUDI-3175) Support INDEX action for async metadata indexing

[ https://issues.apache.org/jira/browse/HUDI-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3175: -- Status: Open (was: Patch Available) > Support INDEX action for async metadata indexing > --

[GitHub] [hudi] nochimow commented on issue #4456: [SUPPORT] MultiWriter w/ DynamoDB - Unable to acquire lock, lock object null

nochimow commented on issue #4456: URL: https://github.com/apache/hudi/issues/4456#issuecomment-1041881483 Since i had to rollback to Hudi 0.9 due the Redshift Spectrum incompatibility i cannot track this issue anymore. @mainamit can you follow up this issue since you also face the same is

[GitHub] [hudi] hudi-bot commented on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

hudi-bot commented on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1041895047 ## CI report: * 7ed0a4a53aa6c83e617d1be55e497b7f15ef1d95 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

hudi-bot removed a comment on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1040861454 ## CI report: * 7ed0a4a53aa6c83e617d1be55e497b7f15ef1d95 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

hudi-bot removed a comment on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1041895047 ## CI report: * 7ed0a4a53aa6c83e617d1be55e497b7f15ef1d95 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

hudi-bot commented on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1041898147 ## CI report: * 7ed0a4a53aa6c83e617d1be55e497b7f15ef1d95 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041292999 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * db5b6f3c44046131647a6b3eb631f3c73ae6e

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041929724 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * db5b6f3c44046131647a6b3eb631f3c73ae6eeb1 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041929724 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * db5b6f3c44046131647a6b3eb631f3c73ae6e

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1041932668 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * db5b6f3c44046131647a6b3eb631f3c73ae6eeb1 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot removed a comment on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041295531 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * db249ffb501dc6a5b1b00ff698dc74196b37a

[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041939619 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * db249ffb501dc6a5b1b00ff698dc74196b37a5f7 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

hudi-bot removed a comment on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1041898147 ## CI report: * 7ed0a4a53aa6c83e617d1be55e497b7f15ef1d95 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

hudi-bot commented on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1041964246 ## CI report: * 698ed4043667b545a927c5a79fdf5f4620b3549a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

  1   2   3   4   >