[GitHub] [hudi] wangxianghu opened a new pull request #4799: [MINOR] unused import

wangxianghu opened a new pull request #4799: URL: https://github.com/apache/hudi/pull/4799 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the pur

[GitHub] [hudi] xushiyan commented on a change in pull request #4798: [HUDI-3200] deprecate hoodie.file.index.enable and unify to use BaseFileOnlyViewRelation to handle

xushiyan commented on a change in pull request #4798: URL: https://github.com/apache/hudi/pull/4798#discussion_r805129466 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala ## @@ -72,6 +72,7 @@ object DataSourceReadOpti

[jira] [Closed] (HUDI-3413) fix jackson parse error when empty message from JsonKafkaSource Using HoodieDeltaStreamer

[ https://issues.apache.org/jira/browse/HUDI-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang closed HUDI-3413. -- Fix Version/s: 0.11.0 Resolution: Fixed Fixed via master :9518f786102566398fa20001533d5d86f68deb5

[jira] [Resolved] (HUDI-3413) fix jackson parse error when empty message from JsonKafkaSource Using HoodieDeltaStreamer

[ https://issues.apache.org/jira/browse/HUDI-3413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang resolved HUDI-3413. > fix jackson parse error when empty message from JsonKafkaSource Using > HoodieDeltaStreamer > -

[hudi] branch master updated (89ed6f0 -> 9518f78)

This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 89ed6f0 [HUDI-3362] Fix restore to rollback pending clustering operations followed by other rolling back other c

[GitHub] [hudi] wangxianghu merged pull request #4794: [HUDI-3413] Fix empty message jackson parse error in JsonKafkaSource

wangxianghu merged pull request #4794: URL: https://github.com/apache/hudi/pull/4794 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [hudi] hudi-bot commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot commented on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1037037226 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fdedb7b UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot removed a comment on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1037035315 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fded

[GitHub] [hudi] melin edited a comment on issue #4797: [SUPPORT] Change Data Capture(CDC) for hudi

melin edited a comment on issue #4797: URL: https://github.com/apache/hudi/issues/4797#issuecomment-1037035377 Spark PR： https://issues.apache.org/jira/browse/HUDI-2941 See databricks delta support for Spark SQL：https://docs.databricks.com/delta/delta-change-data-feed.html ```sql -

[GitHub] [hudi] hudi-bot commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot commented on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1037035315 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fdedb7b UNKN

[GitHub] [hudi] melin commented on issue #4797: [SUPPORT] Change Data Capture(CDC) for hudi

melin commented on issue #4797: URL: https://github.com/apache/hudi/issues/4797#issuecomment-1037035377 Spark PR： https://issues.apache.org/jira/browse/HUDI-2941 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] hudi-bot removed a comment on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot removed a comment on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1036994701 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fded

[GitHub] [hudi] JorgenG commented on issue #4622: [SUPPORT] Can't query Redshift rows even after downgrade from 0.10

JorgenG commented on issue #4622: URL: https://github.com/apache/hudi/issues/4622#issuecomment-1037012212 @nsivabalan Considering that we seem to be at AWS mercy here, could there be an option to have some config flag which uses the old precision? Or is there some new features relying on t

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1037001375 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 9279fc266ad56f47dcffbd6f56b75a6072f21f35 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036984921 ## CI report: * 8c5553730559d2ee8a643042660e1750d32e3440 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4798: [HUDI-3200] deprecate hoodie.file.index.enable and unify to use BaseFileOnlyViewRelation to handle

hudi-bot removed a comment on pull request #4798: URL: https://github.com/apache/hudi/pull/4798#issuecomment-1036976984 ## CI report: * ece00acd332d1408d0113296e48b612aacfef51e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4798: [HUDI-3200] deprecate hoodie.file.index.enable and unify to use BaseFileOnlyViewRelation to handle

hudi-bot commented on pull request #4798: URL: https://github.com/apache/hudi/pull/4798#issuecomment-103739 ## CI report: * ece00acd332d1408d0113296e48b612aacfef51e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] YannByron commented on pull request #4798: [HUDI-3200] deprecate hoodie.file.index.enable and unify to use BaseFileOnlyViewRelation to handle

YannByron commented on pull request #4798: URL: https://github.com/apache/hudi/pull/4798#issuecomment-1036997523 @xushiyan please help to review this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [hudi] hudi-bot commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot commented on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1036994701 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fdedb7b UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot removed a comment on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1036970135 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fded

[GitHub] [hudi] nsivabalan commented on issue #4793: [SUPPORT] Integration test broken after upgrading from 0.10.0 to 0.10.1

nsivabalan commented on issue #4793: URL: https://github.com/apache/hudi/issues/4793#issuecomment-1036989790 may I know which hudi bundle or artifact you are using? ' with 0.10.1, for spark3, the bundle names have changed. hudi-spark3.0.3-bundle* hudi-spark3.1.2-bundle* in p

[GitHub] [hudi] nsivabalan commented on issue #4796: [SUPPORT] Cannot run HoodieDeltaStreamer the second time when using async clustering

nsivabalan commented on issue #4796: URL: https://github.com/apache/hudi/issues/4796#issuecomment-1036988345 I could not reproduce locally w/ 0.10.1. Only suspicion I have is around schema providers. I also using parquetDFS, but have provided schema provider and could able to see async clu

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1036969317 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1036985962 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6c56 UNKN

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036984921 ## CI report: * 8c5553730559d2ee8a643042660e1750d32e3440 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036984169 ## CI report: * 8c5553730559d2ee8a643042660e1750d32e3440 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036982866 ## CI report: * 8c5553730559d2ee8a643042660e1750d32e3440 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036984169 ## CI report: * 8c5553730559d2ee8a643042660e1750d32e3440 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036982866 ## CI report: * 8c5553730559d2ee8a643042660e1750d32e3440 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036982108 ## CI report: * 8c5553730559d2ee8a643042660e1750d32e3440 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

alexeykudinkin commented on a change in pull request #4789: URL: https://github.com/apache/hudi/pull/4789#discussion_r805114615 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala ## @@ -41,15 +58,91 @@ abstract class H

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036982108 ## CI report: * 8c5553730559d2ee8a643042660e1750d32e3440 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036970896 ## CI report: * 80aa7f9caceefe6f268d1e47130eb5b60b4d46e7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] YannByron commented on pull request #4619: [HUDI-3213] compaction should not change commit metadata

YannByron commented on pull request #4619: URL: https://github.com/apache/hudi/pull/4619#issuecomment-1036981010 @nsivabalan i'll try to fix this asap. if have any problems, i'll let you know. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] hudi-bot removed a comment on pull request #4798: [HUDI-3200] deprecate hoodie.file.index.enable and unify to use BaseFileOnlyViewRelation to handle

hudi-bot removed a comment on pull request #4798: URL: https://github.com/apache/hudi/pull/4798#issuecomment-1036976361 ## CI report: * ece00acd332d1408d0113296e48b612aacfef51e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4798: [HUDI-3200] deprecate hoodie.file.index.enable and unify to use BaseFileOnlyViewRelation to handle

hudi-bot commented on pull request #4798: URL: https://github.com/apache/hudi/pull/4798#issuecomment-1036976984 ## CI report: * ece00acd332d1408d0113296e48b612aacfef51e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4798: [HUDI-3200] deprecate hoodie.file.index.enable and unify to use BaseFileOnlyViewRelation to handle

hudi-bot commented on pull request #4798: URL: https://github.com/apache/hudi/pull/4798#issuecomment-1036976361 ## CI report: * ece00acd332d1408d0113296e48b612aacfef51e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036975617 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036976302 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 631437fc88735dfe92ef7072dc4efa0744816b4c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036975617 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[jira] [Updated] (HUDI-3200) File Index config affects partition fields shown in printSchema results

[ https://issues.apache.org/jira/browse/HUDI-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3200: - Labels: pull-request-available (was: ) > File Index config affects partition fields shown in prin

[GitHub] [hudi] YannByron opened a new pull request #4798: [HUDI-3200] deprecate hoodie.file.index.enable and unify to use BaseFileOnlyViewRelation to handle

YannByron opened a new pull request #4798: URL: https://github.com/apache/hudi/pull/4798 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036963133 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

hudi-bot commented on pull request #4782: URL: https://github.com/apache/hudi/pull/4782#issuecomment-1036974958 ## CI report: * d3f4e79167a0d44808b733cb9006632ede91ccc7 UNKNOWN * 7afeafeb3a7f11cbcec83fba0eb2db8192db79a7 UNKNOWN * e1a13ccdd713d2bfa19d9deb9e9d8e1b5d55271e UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

hudi-bot removed a comment on pull request #4782: URL: https://github.com/apache/hudi/pull/4782#issuecomment-1036949848 ## CI report: * d3f4e79167a0d44808b733cb9006632ede91ccc7 UNKNOWN * 7afeafeb3a7f11cbcec83fba0eb2db8192db79a7 UNKNOWN * e1a13ccdd713d2bfa19d9deb9e9d8e1b5d552

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036970896 ## CI report: * 80aa7f9caceefe6f268d1e47130eb5b60b4d46e7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036952896 ## CI report: * 80aa7f9caceefe6f268d1e47130eb5b60b4d46e7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot commented on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1036970135 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fdedb7b UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot removed a comment on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1036946872 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fded

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1036952661 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1036969317 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6c56 UNKN

[jira] [Assigned] (HUDI-3200) File Index config affects partition fields shown in printSchema results

[ https://issues.apache.org/jira/browse/HUDI-3200?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yann Byron reassigned HUDI-3200: Assignee: Yann Byron > File Index config affects partition fields shown in printSchema results > --

[GitHub] [hudi] danny0405 commented on issue #4797: [SUPPORT] Change Data Capture(CDC) for hudi

danny0405 commented on issue #4797: URL: https://github.com/apache/hudi/issues/4797#issuecomment-1036967981 Thanks for the reporting @melin , actually hoodie already implemented this feature already since release 0.9, we add a metadata field named `__hoodie_operation` to record the per-rec

[GitHub] [hudi] danny0405 commented on a change in pull request #4791: [HUDI-3412] TypedProperties no need to create new set when check key …

danny0405 commented on a change in pull request #4791: URL: https://github.com/apache/hudi/pull/4791#discussion_r805108288 ## File path: hudi-common/src/main/java/org/apache/hudi/common/config/TypedProperties.java ## @@ -44,27 +43,22 @@ public TypedProperties(Properties defaul

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036960236 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036963133 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036944270 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] XuQianJin-Stars removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

XuQianJin-Stars removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036960079 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036960236 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

XuQianJin-Stars commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036960079 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

zhangyue19921010 commented on a change in pull request #4782: URL: https://github.com/apache/hudi/pull/4782#discussion_r805105993 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestTableSchemaResolver.scala ## @@ -0,0 +1,224 @@ +/* + * Licensed t

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

zhangyue19921010 commented on a change in pull request #4782: URL: https://github.com/apache/hudi/pull/4782#discussion_r805105923 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java ## @@ -422,6 +443,55 @@ public MessageType readSchema

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

zhangyue19921010 commented on a change in pull request #4782: URL: https://github.com/apache/hudi/pull/4782#discussion_r805105894 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestTableSchemaResolver.scala ## @@ -0,0 +1,224 @@ +/* + * Licensed t

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036952896 ## CI report: * 80aa7f9caceefe6f268d1e47130eb5b60b4d46e7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036948138 ## CI report: * 80aa7f9caceefe6f268d1e47130eb5b60b4d46e7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

zhangyue19921010 commented on a change in pull request #4782: URL: https://github.com/apache/hudi/pull/4782#discussion_r805105702 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestTableSchemaResolver.scala ## @@ -0,0 +1,224 @@ +/* + * Licensed t

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

zhangyue19921010 commented on a change in pull request #4782: URL: https://github.com/apache/hudi/pull/4782#discussion_r805105681 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestTableSchemaResolver.scala ## @@ -0,0 +1,224 @@ +/* + * Licensed t

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

zhangyue19921010 commented on a change in pull request #4782: URL: https://github.com/apache/hudi/pull/4782#discussion_r805105638 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/hudi/TestTableSchemaResolver.scala ## @@ -0,0 +1,224 @@ +/* + * Licensed t

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1036950381 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1036952661 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6c56 UNKN

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on a change in pull request #3887: URL: https://github.com/apache/hudi/pull/3887#discussion_r805105304 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java ## @@ -253,7 +265,16 @@ public TimelineLayoutVersio

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

zhangyue19921010 commented on a change in pull request #4782: URL: https://github.com/apache/hudi/pull/4782#discussion_r805105044 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java ## @@ -422,6 +443,55 @@ public MessageType readSchema

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

zhangyue19921010 commented on a change in pull request #4782: URL: https://github.com/apache/hudi/pull/4782#discussion_r805104973 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java ## @@ -115,6 +121,21 @@ private MessageType getTableP

[GitHub] [hudi] zhangyue19921010 edited a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 edited a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1033694266 Hi @nsivabalan and @danny0405 Thanks a lot for you review. Now we add a property named supportsRetry each StorageScheme. And check it before retry. Also

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1033599122 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1036950381 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6c56 UNKN

[GitHub] [hudi] boneanxs commented on pull request #4791: [HUDI-3412] TypedProperties no need to create new set when check key …

boneanxs commented on pull request #4791: URL: https://github.com/apache/hudi/pull/4791#issuecomment-1036950255 @leesf @danny0405 Could you pls review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [hudi] hudi-bot removed a comment on pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

hudi-bot removed a comment on pull request #4782: URL: https://github.com/apache/hudi/pull/4782#issuecomment-1036948107 ## CI report: * d3f4e79167a0d44808b733cb9006632ede91ccc7 UNKNOWN * 7afeafeb3a7f11cbcec83fba0eb2db8192db79a7 UNKNOWN * e1a13ccdd713d2bfa19d9deb9e9d8e1b5d552

[GitHub] [hudi] hudi-bot commented on pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

hudi-bot commented on pull request #4782: URL: https://github.com/apache/hudi/pull/4782#issuecomment-1036949848 ## CI report: * d3f4e79167a0d44808b733cb9006632ede91ccc7 UNKNOWN * 7afeafeb3a7f11cbcec83fba0eb2db8192db79a7 UNKNOWN * e1a13ccdd713d2bfa19d9deb9e9d8e1b5d55271e UNKN

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036948138 ## CI report: * 80aa7f9caceefe6f268d1e47130eb5b60b4d46e7 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036947027 ## CI report: * e7dda833ea10ce8bb0d4cc13e1e9c3ccf230565c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

hudi-bot removed a comment on pull request #4782: URL: https://github.com/apache/hudi/pull/4782#issuecomment-1034788977 ## CI report: * d3f4e79167a0d44808b733cb9006632ede91ccc7 UNKNOWN * 7afeafeb3a7f11cbcec83fba0eb2db8192db79a7 UNKNOWN * e1a13ccdd713d2bfa19d9deb9e9d8e1b5d552

[GitHub] [hudi] hudi-bot commented on pull request #4782: [HUDI-3398] TableSchemaResolver may fail for metadata table

hudi-bot commented on pull request #4782: URL: https://github.com/apache/hudi/pull/4782#issuecomment-1036948107 ## CI report: * d3f4e79167a0d44808b733cb9006632ede91ccc7 UNKNOWN * 7afeafeb3a7f11cbcec83fba0eb2db8192db79a7 UNKNOWN * e1a13ccdd713d2bfa19d9deb9e9d8e1b5d55271e UNKN

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036947027 ## CI report: * e7dda833ea10ce8bb0d4cc13e1e9c3ccf230565c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot removed a comment on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1035880828 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fded

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1036839012 ## CI report: * e7dda833ea10ce8bb0d4cc13e1e9c3ccf230565c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4743: [HUDI-3280] Cleaning up Hive-related hierarchies after refactoring

hudi-bot commented on pull request #4743: URL: https://github.com/apache/hudi/pull/4743#issuecomment-1036946929 ## CI report: * 75000d7530e6414662b27fce07a9abb2c41b5870 UNKNOWN * 61705e3a112cf29812148c8394e9347157dfd940 UNKNOWN * d8beebf4cc51cc6ec6a6342c35091d1c3a3ca755 Azur

[GitHub] [hudi] hudi-bot commented on pull request #4699: [HUDI-3336][HUDI-FLINK] Support custom hadoop config options for flink

hudi-bot commented on pull request #4699: URL: https://github.com/apache/hudi/pull/4699#issuecomment-1036946872 ## CI report: * ec269f1bd56a1a8eea3b7a4334cc90777ed82980 UNKNOWN * 5085945f32350c91f3c40b4fb72259be0717da49 UNKNOWN * ccfcae2112fc0713d47ebb69c6d909e22fdedb7b UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4743: [HUDI-3280] Cleaning up Hive-related hierarchies after refactoring

hudi-bot removed a comment on pull request #4743: URL: https://github.com/apache/hudi/pull/4743#issuecomment-1036897111 ## CI report: * 75000d7530e6414662b27fce07a9abb2c41b5870 UNKNOWN * 61705e3a112cf29812148c8394e9347157dfd940 UNKNOWN * a1246304af3e587cac37779f8b2ca9e6dec49

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036944270 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1036198959 ## CI report: * d5f1fbad92cd451d5ac7cf81f5f8612ff18d85ed UNKNOWN * 42cbe5434d4b24acd24d3dca5f1ff027f5e95fcb Azure: [FAILURE](https://dev.azure.com/apache-hud

[jira] [Assigned] (HUDI-3398) Schema validation fails for metadata table base file

[ https://issues.apache.org/jira/browse/HUDI-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-3398: --- Assignee: Yue Zhang (was: Ethan Guo) > Schema validation fails for metadata table base file > --

[jira] [Updated] (HUDI-3398) Schema validation fails for metadata table base file

[ https://issues.apache.org/jira/browse/HUDI-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3398: Status: In Progress (was: Open) > Schema validation fails for metadata table base file > --

[jira] [Updated] (HUDI-3398) Schema validation fails for metadata table base file

[ https://issues.apache.org/jira/browse/HUDI-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3398: Status: Patch Available (was: In Progress) > Schema validation fails for metadata table base file > ---

[jira] [Updated] (HUDI-3398) Schema validation fails for metadata table base file

[ https://issues.apache.org/jira/browse/HUDI-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3398: Reviewers: Ethan Guo > Schema validation fails for metadata table base file > --

[jira] [Closed] (HUDI-3320) Implement a validator for metadata table file listing

[ https://issues.apache.org/jira/browse/HUDI-3320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-3320. --- Resolution: Fixed > Implement a validator for metadata table file listing > --

[GitHub] [hudi] melin closed issue #4797: [SUPPORT] Change Data Capture(CDC) for hudi

melin closed issue #4797: URL: https://github.com/apache/hudi/issues/4797 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi

[GitHub] [hudi] melin opened a new issue #4797: [SUPPORT] Change Data Capture(CDC) for hudi

melin opened a new issue #4797: URL: https://github.com/apache/hudi/issues/4797 https://docs.google.com/document/d/1bN6rdLNcYOHnT3xVBfB33BoiPO06aKBo56SZmuU9pnY/edit#heading=h.czd6l3c9xj87 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [hudi] hudi-bot removed a comment on pull request #4743: [HUDI-3280] Cleaning up Hive-related hierarchies after refactoring

hudi-bot removed a comment on pull request #4743: URL: https://github.com/apache/hudi/pull/4743#issuecomment-1036871695 ## CI report: * 75000d7530e6414662b27fce07a9abb2c41b5870 UNKNOWN * 61705e3a112cf29812148c8394e9347157dfd940 UNKNOWN * a1246304af3e587cac37779f8b2ca9e6dec49

[GitHub] [hudi] hudi-bot commented on pull request #4743: [HUDI-3280] Cleaning up Hive-related hierarchies after refactoring

hudi-bot commented on pull request #4743: URL: https://github.com/apache/hudi/pull/4743#issuecomment-1036897111 ## CI report: * 75000d7530e6414662b27fce07a9abb2c41b5870 UNKNOWN * 61705e3a112cf29812148c8394e9347157dfd940 UNKNOWN * a1246304af3e587cac37779f8b2ca9e6dec497c1 Azur

  1   2   3   4   >