[GitHub] [hudi] xushiyan commented on a change in pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

xushiyan commented on a change in pull request #4350: URL: https://github.com/apache/hudi/pull/4350#discussion_r774380361 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala ## @@ -151,9 +151,8 @@ class MergeOn

[GitHub] [hudi] xushiyan commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

xushiyan commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000116115 @leesf Only half way through.. will continue tmr...could you please also summarize the changes in the description as a high-level intro? easier to digest.. thanks! -- This is

[GitHub] [hudi] hehexiaoduantui commented on issue #4430: [SUPPORT]

hehexiaoduantui commented on issue #4430: URL: https://github.com/apache/hudi/issues/4430#issuecomment-1000116392 hive Incremental query -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [hudi] zhangyue19921010 commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000116943 > I am wondering if we can guard this behavior for each storage scheme. Hi @vinothchandar Thanks a lot for your attention. Let me explain the design of this retry w

[GitHub] [hudi] hehexiaoduantui removed a comment on issue #4430: [SUPPORT]hive Incremental query error

hehexiaoduantui removed a comment on issue #4430: URL: https://github.com/apache/hudi/issues/4430#issuecomment-1000116392 hive Incremental query -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [hudi] zhangyue19921010 edited a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 edited a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000116943 > I am wondering if we can guard this behavior for each storage scheme. Hi @vinothchandar Thanks a lot for your attention. Let me explain the design of this

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on a change in pull request #3887: URL: https://github.com/apache/hudi/pull/3887#discussion_r774389446 ## File path: hudi-common/src/main/java/org/apache/hudi/common/fs/FileSystemRetryConfig.java ## @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache So

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000118349 ## CI report: * 3e704df22d2756a2e2bff86368967235dbb8b221 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot removed a comment on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-183826 ## CI report: * 438e42e0dd139bf2afcdfe468c4bc3c7891884b3 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on a change in pull request #3887: URL: https://github.com/apache/hudi/pull/3887#discussion_r774391278 ## File path: hudi-common/src/test/java/org/apache/hudi/common/fs/TestFSUtilsWithRetryWrapperEnable.java ## @@ -0,0 +1,205 @@ +/* + * Licensed to t

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on a change in pull request #3887: URL: https://github.com/apache/hudi/pull/3887#discussion_r774391547 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieClient.java ## @@ -132,9 +132,14 @@ protected void

[GitHub] [hudi] hudi-bot commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000120189 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * fea9016d6e312456d489d318ba54c17c9269ec12 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot removed a comment on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-182961 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * fea9016d6e312456d489d318ba54c17c9269e

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on a change in pull request #3887: URL: https://github.com/apache/hudi/pull/3887#discussion_r774391778 ## File path: hudi-common/src/main/java/org/apache/hudi/common/fs/FileSystemRetryConfig.java ## @@ -0,0 +1,131 @@ +/* + * Licensed to the Apache So

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on a change in pull request #3887: URL: https://github.com/apache/hudi/pull/3887#discussion_r774391928 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/RetryHelper.java ## @@ -0,0 +1,111 @@ +/* + * Licensed to the Apache Software F

[GitHub] [hudi] hudi-bot commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000121674 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * fea9016d6e312456d489d318ba54c17c9269ec12 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot removed a comment on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000120189 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * fea9016d6e312456d489d318ba54c17c9269e

[GitHub] [hudi] zhangyue19921010 commented on a change in pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on a change in pull request #3887: URL: https://github.com/apache/hudi/pull/3887#discussion_r774394645 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java ## @@ -253,7 +265,16 @@ public TimelineLayoutVersio

[GitHub] [hudi] zhangyue19921010 commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000123975 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [hudi] zhangyue19921010 edited a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 edited a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000116943 > I am wondering if we can guard this behavior for each storage scheme. Hi @vinothchandar Thanks a lot for your attention. Let me explain the design of this

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000124692 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * 1f5392a205d4606d9e2a31ac9cd57f0f1c392aa6 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000108859 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * 1f5392a205d4606d9e2a31ac9cd57f0f1c392

[GitHub] [hudi] leesf commented on a change in pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

leesf commented on a change in pull request #4350: URL: https://github.com/apache/hudi/pull/4350#discussion_r774396525 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/MergeOnReadSnapshotRelation.scala ## @@ -151,9 +151,8 @@ class MergeOnRea

[GitHub] [hudi] leesf commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

leesf commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000126209 > @leesf Only half way through.. will continue tmr...could you please also summarize the changes in the description as a high-level intro? easier to digest.. thanks! I have e

[GitHub] [hudi] zhangyue19921010 removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000123975 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hudi] leesf commented on a change in pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

leesf commented on a change in pull request #4350: URL: https://github.com/apache/hudi/pull/4350#discussion_r774398692 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/spark/sql/hudi/HoodieSqlCommonUtils.scala ## @@ -0,0 +1,318 @@ +/* + * License

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000127666 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * 1f5392a205d4606d9e2a31ac9cd57f0f1c392aa6 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000124692 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * 1f5392a205d4606d9e2a31ac9cd57f0f1c392

[GitHub] [hudi] BruceKellan commented on issue #4247: [SUPPORT] Unsupport operation exception occur when using flink+hudi in bulk_insert mode

BruceKellan commented on issue #4247: URL: https://github.com/apache/hudi/issues/4247#issuecomment-1000127817 @danny0405 Will it be fixed in the next release version? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use th

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000129142 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * 1f5392a205d4606d9e2a31ac9cd57f0f1c392aa6 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000127666 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * 1f5392a205d4606d9e2a31ac9cd57f0f1c392

[GitHub] [hudi] leesf merged pull request #4306: [HUDI-3014] add table option to set utc timezone

leesf merged pull request #4306: URL: https://github.com/apache/hudi/pull/4306 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[hudi] branch master updated (57f43de -> 032b883)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 57f43de [MINOR] Fix DedupeSparkJob typo (#4418) add 032b883 [HUDI-3014] Add table option to set utc timezone (#43

[GitHub] [hudi] hudi-bot commented on pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

hudi-bot commented on pull request #4352: URL: https://github.com/apache/hudi/pull/4352#issuecomment-1000132457 ## CI report: * 6e5e35400e0fbff449203673ee895251f7c078ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

hudi-bot removed a comment on pull request #4352: URL: https://github.com/apache/hudi/pull/4352#issuecomment-999047007 ## CI report: * 6e5e35400e0fbff449203673ee895251f7c078ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] codejoyan opened a new issue #4433: [SUPPORT] Time travel query using Hive

codejoyan opened a new issue #4433: URL: https://github.com/apache/hudi/issues/4433 Spark - 2.4.7 Hive - 2.3.7 Hudi - 0.9.0 I am doing a point-in-time read a Hudi table by specifying begin and end time in Hive. While I get the expected result in spark, I do not get the same re

[GitHub] [hudi] hudi-bot removed a comment on pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

hudi-bot removed a comment on pull request #4352: URL: https://github.com/apache/hudi/pull/4352#issuecomment-1000132457 ## CI report: * 6e5e35400e0fbff449203673ee895251f7c078ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

hudi-bot commented on pull request #4352: URL: https://github.com/apache/hudi/pull/4352#issuecomment-1000134028 ## CI report: * 6e5e35400e0fbff449203673ee895251f7c078ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

hudi-bot commented on pull request #4352: URL: https://github.com/apache/hudi/pull/4352#issuecomment-1000135621 ## CI report: * 6e5e35400e0fbff449203673ee895251f7c078ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

hudi-bot removed a comment on pull request #4352: URL: https://github.com/apache/hudi/pull/4352#issuecomment-1000134028 ## CI report: * 6e5e35400e0fbff449203673ee895251f7c078ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] manojpec commented on a change in pull request #4427: [WIP] Enabling InProcessLockProvider for all multi-writer tests instead of FileSystemBasedLockProviderTestClass

manojpec commented on a change in pull request #4427: URL: https://github.com/apache/hudi/pull/4427#discussion_r774410513 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/InProcessLockProvider.java ## @@ -42,7 +43,7 @@ * Hood

[GitHub] [hudi] hudi-bot removed a comment on pull request #4431: Update HiveIncrementalPuller.java

hudi-bot removed a comment on pull request #4431: URL: https://github.com/apache/hudi/pull/4431#issuecomment-1000107792 ## CI report: * f6e82027a04d481c8b1e84f99de171ad092ae39c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4431: Update HiveIncrementalPuller.java

hudi-bot commented on pull request #4431: URL: https://github.com/apache/hudi/pull/4431#issuecomment-1000141570 ## CI report: * 308b2e638218791ce9f6a2778a8cf6dff40b8332 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] zhangyue19921010 commented on issue #3973: [SUPPORT]Hudi Multi-Writer with archive

zhangyue19921010 commented on issue #3973: URL: https://github.com/apache/hudi/issues/3973#issuecomment-1000142445 Hi @nsivabalan Thanks a lot for your response :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [hudi] zhangyue19921010 closed issue #3973: [SUPPORT]Hudi Multi-Writer with archive

zhangyue19921010 closed issue #3973: URL: https://github.com/apache/hudi/issues/3973 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [hudi] hudi-bot commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000147995 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * 63c6ae1ce06ddf25066f0a4d5e0fc73a3d20d6be Azur

[GitHub] [hudi] manojpec commented on a change in pull request #4406: [HUDI-3030] InProcessLockPovider as default when any async servcies enabled with no lock provider override

manojpec commented on a change in pull request #4406: URL: https://github.com/apache/hudi/pull/4406#discussion_r774420533 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AbstractHoodieWriteClient.java ## @@ -460,7 +460,7 @@ protected void post

[GitHub] [hudi] hudi-bot removed a comment on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot removed a comment on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000121674 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * fea9016d6e312456d489d318ba54c17c9269e

[GitHub] [hudi] hudi-bot commented on pull request #4406: [HUDI-3030] InProcessLockPovider as default when any async servcies enabled with no lock provider override

hudi-bot commented on pull request #4406: URL: https://github.com/apache/hudi/pull/4406#issuecomment-1000149834 ## CI report: * 16b68276d6dd7608de4f4493889e532b0919a47c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4406: [HUDI-3030] InProcessLockPovider as default when any async servcies enabled with no lock provider override

hudi-bot removed a comment on pull request #4406: URL: https://github.com/apache/hudi/pull/4406#issuecomment-998294937 ## CI report: * 16b68276d6dd7608de4f4493889e532b0919a47c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4406: [HUDI-3030] InProcessLockPovider as default when any async servcies enabled with no lock provider override

hudi-bot commented on pull request #4406: URL: https://github.com/apache/hudi/pull/4406#issuecomment-1000151660 ## CI report: * 16b68276d6dd7608de4f4493889e532b0919a47c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4406: [HUDI-3030] InProcessLockPovider as default when any async servcies enabled with no lock provider override

hudi-bot removed a comment on pull request #4406: URL: https://github.com/apache/hudi/pull/4406#issuecomment-1000149834 ## CI report: * 16b68276d6dd7608de4f4493889e532b0919a47c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] manojpec commented on a change in pull request #4406: [HUDI-3030] InProcessLockPovider as default when any async servcies enabled with no lock provider override

manojpec commented on a change in pull request #4406: URL: https://github.com/apache/hudi/pull/4406#discussion_r774427205 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/config/HoodieWriteConfig.java ## @@ -2221,11 +2236,17 @@ protected void setDefau

[jira] [Updated] (HUDI-1295) Implement: Metadata based bloom index - write path

[ https://issues.apache.org/jira/browse/HUDI-1295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-1295: - Reviewers: Vinoth Chandar > Implement: Metadata based bloom index - write path > -

[GitHub] [hudi] hudi-bot removed a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot removed a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000129142 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * 1f5392a205d4606d9e2a31ac9cd57f0f1c392

[GitHub] [hudi] hudi-bot commented on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

hudi-bot commented on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000161779 ## CI report: * 82ec7c1e3c40af686b9a4dcc5af99ebd3671913d UNKNOWN * f4a52761592b8be6b6d67ae2339aad19705a0e5c UNKNOWN * ae8b009239445f17a9f2447aa9c430c74c8d6c56 UNKN

[GitHub] [hudi] manojpec commented on a change in pull request #4067: [WIP][HUDI-2763] Metadata table records key deduplication

manojpec commented on a change in pull request #4067: URL: https://github.com/apache/hudi/pull/4067#discussion_r774439564 ## File path: hudi-common/src/main/java/org/apache/hudi/io/storage/HoodieHFileReader.java ## @@ -257,16 +275,20 @@ public Option getRecordByKey(String key,

[GitHub] [hudi] manojpec closed pull request #4293: [HUDI-2981][HUDI-2982] Metadata table - enabling virtual keys and key deduplication by default

manojpec closed pull request #4293: URL: https://github.com/apache/hudi/pull/4293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] manojpec commented on pull request #4293: [HUDI-2981][HUDI-2982] Metadata table - enabling virtual keys and key deduplication by default

manojpec commented on pull request #4293: URL: https://github.com/apache/hudi/pull/4293#issuecomment-1000167838 This will be taken care in https://github.com/apache/hudi/pull/4067 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [hudi] manojpec commented on pull request #4292: [HUDI-2763] Tests for Metadata table records key deduplication

manojpec commented on pull request #4292: URL: https://github.com/apache/hudi/pull/4292#issuecomment-1000168001 This will be taken care in https://github.com/apache/hudi/pull/4067 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [hudi] manojpec commented on pull request #4292: [HUDI-2763] Tests for Metadata table records key deduplication

manojpec commented on pull request #4292: URL: https://github.com/apache/hudi/pull/4292#issuecomment-1000168130 This will be taken care in https://github.com/apache/hudi/pull/4067 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

[GitHub] [hudi] manojpec closed pull request #4292: [HUDI-2763] Tests for Metadata table records key deduplication

manojpec closed pull request #4292: URL: https://github.com/apache/hudi/pull/4292 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] Guanpx commented on pull request #4287: [DO NOT MERGE] 0.10.0 release patch for flink

Guanpx commented on pull request #4287: URL: https://github.com/apache/hudi/pull/4287#issuecomment-1000173326 will merge to master (release-0.11) or release-0.10.1 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] hudi-bot commented on pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

hudi-bot commented on pull request #4352: URL: https://github.com/apache/hudi/pull/4352#issuecomment-1000177973 ## CI report: * 235981abd20a498a3e29e98ce0eda9de35018f99 UNKNOWN * 9ee3e622d98bc3e41ae5ca95d6f5d23b94e45720 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

hudi-bot removed a comment on pull request #4352: URL: https://github.com/apache/hudi/pull/4352#issuecomment-1000135621 ## CI report: * 6e5e35400e0fbff449203673ee895251f7c078ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] tieke1121 opened a new issue #4434: [SUPPORT]why are there many files under the Hoodie file?

tieke1121 opened a new issue #4434: URL: https://github.com/apache/hudi/issues/4434 **Expected behavior** A clear and concise description of what you expected to happen. **Environment Description** * Hudi version : 0.10.0 * Hive version : 2.3.1 * Ha

[GitHub] [hudi] tieke1121 commented on issue #4434: [SUPPORT]why are there many files under the Hoodie file?

tieke1121 commented on issue #4434: URL: https://github.com/apache/hudi/issues/4434#issuecomment-1000184665  -- This is an automated message from the Apache Git Service. To r

[GitHub] [hudi] hudi-bot commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000184844 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * 63c6ae1ce06ddf25066f0a4d5e0fc73a3d20d6be Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot removed a comment on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000147995 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * 63c6ae1ce06ddf25066f0a4d5e0fc73a3d20d

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4352: [HUDI-1295] Metadata Index - Bloom filter and Column stats index to speed up index lookups

xiarixiaoyao commented on a change in pull request #4352: URL: https://github.com/apache/hudi/pull/4352#discussion_r774457700 ## File path: hudi-common/src/main/java/org/apache/hudi/common/util/ParquetUtils.java ## @@ -380,4 +382,76 @@ public Boolean apply(String recordKey) {

[GitHub] [hudi] tieke1121 commented on issue #4434: [SUPPORT]why are there many files under the Hoodie file?

tieke1121 commented on issue #4434: URL: https://github.com/apache/hudi/issues/4434#issuecomment-1000185092  -- This is an automated message from the Apache Git Service. To r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot removed a comment on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000184844 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * 63c6ae1ce06ddf25066f0a4d5e0fc73a3d20d

[GitHub] [hudi] hudi-bot commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000193558 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * 63c6ae1ce06ddf25066f0a4d5e0fc73a3d20d6be Azur

[GitHub] [hudi] zhangyue19921010 edited a comment on pull request #3887: [HUDI-2648] Retry FileSystem action instead of failed directly.

zhangyue19921010 edited a comment on pull request #3887: URL: https://github.com/apache/hudi/pull/3887#issuecomment-1000116943 > I am wondering if we can guard this behavior for each storage scheme. Hi @vinothchandar Thanks a lot for your attention. Let me explain the framework of th

[GitHub] [hudi] xuzifu666 opened a new pull request #4435: [Minor] remove unused method in HoodieActiveTimeline

xuzifu666 opened a new pull request #4435: URL: https://github.com/apache/hudi/pull/4435 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] xuzifu666 commented on pull request #4435: [Minor] remove unused method in HoodieActiveTimeline

xuzifu666 commented on pull request #4435: URL: https://github.com/apache/hudi/pull/4435#issuecomment-1000206442 @leesf @yanghua @danny0405 have a review please, the method is not be used in global. -- This is an automated message from the Apache Git Service. To respond to the message, p

[GitHub] [hudi] hudi-bot commented on pull request #4435: [Minor] remove unused method in HoodieActiveTimeline

hudi-bot commented on pull request #4435: URL: https://github.com/apache/hudi/pull/4435#issuecomment-1000208105 ## CI report: * 191e166e02d6107290c9d12f668b08b932ac2edc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4435: [Minor] remove unused method in HoodieActiveTimeline

hudi-bot commented on pull request #4435: URL: https://github.com/apache/hudi/pull/4435#issuecomment-1000209590 ## CI report: * 191e166e02d6107290c9d12f668b08b932ac2edc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4435: [Minor] remove unused method in HoodieActiveTimeline

hudi-bot removed a comment on pull request #4435: URL: https://github.com/apache/hudi/pull/4435#issuecomment-1000208105 ## CI report: * 191e166e02d6107290c9d12f668b08b932ac2edc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #4406: [HUDI-3030] InProcessLockPovider as default when any async servcies enabled with no lock provider override

hudi-bot removed a comment on pull request #4406: URL: https://github.com/apache/hudi/pull/4406#issuecomment-1000151660 ## CI report: * 16b68276d6dd7608de4f4493889e532b0919a47c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4406: [HUDI-3030] InProcessLockPovider as default when any async servcies enabled with no lock provider override

hudi-bot commented on pull request #4406: URL: https://github.com/apache/hudi/pull/4406#issuecomment-1000210947 ## CI report: * be47309da1b063283af0365199320b9785046bf5 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot removed a comment on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000118349 ## CI report: * 3e704df22d2756a2e2bff86368967235dbb8b221 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000229699 ## CI report: * 3e704df22d2756a2e2bff86368967235dbb8b221 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000231348 ## CI report: * 3e704df22d2756a2e2bff86368967235dbb8b221 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot removed a comment on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000229699 ## CI report: * 3e704df22d2756a2e2bff86368967235dbb8b221 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Created] (HUDI-3099) Purge drop partition for spark sql

Forward Xu created HUDI-3099: Summary: Purge drop partition for spark sql Key: HUDI-3099 URL: https://issues.apache.org/jira/browse/HUDI-3099 Project: Apache Hudi Issue Type: New Feature

[GitHub] [hudi] hudi-bot commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000234937 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * 7350710328487b78eaf595d1e092411b6e5b278b Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

hudi-bot removed a comment on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1000193558 ## CI report: * 5f2bceb6f745b359ba7b5691ef1f2ab02eddde06 UNKNOWN * 3855884f4791a45fa3a973e1e540e6988e863223 UNKNOWN * 63c6ae1ce06ddf25066f0a4d5e0fc73a3d20d

[GitHub] [hudi] XuQianJin-Stars opened a new pull request #4436: [HUDI-3099] Purge drop partition for spark sql

XuQianJin-Stars opened a new pull request #4436: URL: https://github.com/apache/hudi/pull/4436 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Updated] (HUDI-3099) Purge drop partition for spark sql

[ https://issues.apache.org/jira/browse/HUDI-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3099: - Labels: pull-request-available (was: ) > Purge drop partition for spark sql > ---

[GitHub] [hudi] hudi-bot commented on pull request #4436: [HUDI-3099] Purge drop partition for spark sql

hudi-bot commented on pull request #4436: URL: https://github.com/apache/hudi/pull/4436#issuecomment-1000241596 ## CI report: * 9206ca5fdaa848ea7c7947a80c8fc418aa70fadc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4436: [HUDI-3099] Purge drop partition for spark sql

hudi-bot commented on pull request #4436: URL: https://github.com/apache/hudi/pull/4436#issuecomment-1000243090 ## CI report: * 9206ca5fdaa848ea7c7947a80c8fc418aa70fadc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4436: [HUDI-3099] Purge drop partition for spark sql

hudi-bot removed a comment on pull request #4436: URL: https://github.com/apache/hudi/pull/4436#issuecomment-1000241596 ## CI report: * 9206ca5fdaa848ea7c7947a80c8fc418aa70fadc UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[jira] [Commented] (HUDI-1387) [UMBRELLA] Support Apache Calcite for writing/querying Hudi datasets

[ https://issues.apache.org/jira/browse/HUDI-1387?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17464487#comment-17464487 ] Forward Xu commented on HUDI-1387: -- This sounds very good, I think about it, there are pr

[GitHub] [hudi] hudi-bot commented on pull request #4435: [Minor] remove unused method in HoodieActiveTimeline

hudi-bot commented on pull request #4435: URL: https://github.com/apache/hudi/pull/4435#issuecomment-1000244477 ## CI report: * 191e166e02d6107290c9d12f668b08b932ac2edc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4435: [Minor] remove unused method in HoodieActiveTimeline

hudi-bot removed a comment on pull request #4435: URL: https://github.com/apache/hudi/pull/4435#issuecomment-1000209590 ## CI report: * 191e166e02d6107290c9d12f668b08b932ac2edc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000245726 ## CI report: * 3e704df22d2756a2e2bff86368967235dbb8b221 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot removed a comment on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000231348 ## CI report: * 3e704df22d2756a2e2bff86368967235dbb8b221 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot commented on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000247211 ## CI report: * 018383c35183c590f21e494b7db6b31420bd9662 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #3957: [HUDI-2688][RFC-40] A new Hudi connector for Trino

hudi-bot removed a comment on pull request #3957: URL: https://github.com/apache/hudi/pull/3957#issuecomment-1000245726 ## CI report: * 3e704df22d2756a2e2bff86368967235dbb8b221 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

  1   2   >