[GitHub] [hudi] hudi-bot commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989596455 ## CI report: * b561916256de18ffca7093d2e8200ae02c945efc Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot removed a comment on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989571491 ## CI report: * b561916256de18ffca7093d2e8200ae02c945efc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

hudi-bot commented on pull request #4265: URL: https://github.com/apache/hudi/pull/4265#issuecomment-989592033 ## CI report: * 31c0fd46f52922816e1e023bd9b7c9873ae31fb6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

hudi-bot removed a comment on pull request #4265: URL: https://github.com/apache/hudi/pull/4265#issuecomment-989586395 ## CI report: * 31c0fd46f52922816e1e023bd9b7c9873ae31fb6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] xiarixiaoyao commented on pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

xiarixiaoyao commented on pull request #4265: URL: https://github.com/apache/hudi/pull/4265#issuecomment-989590875 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] hudi-bot removed a comment on pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

hudi-bot removed a comment on pull request #4265: URL: https://github.com/apache/hudi/pull/4265#issuecomment-989559491 ## CI report: * 31c0fd46f52922816e1e023bd9b7c9873ae31fb6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

hudi-bot commented on pull request #4265: URL: https://github.com/apache/hudi/pull/4265#issuecomment-989586395 ## CI report: * 31c0fd46f52922816e1e023bd9b7c9873ae31fb6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[jira] [Commented] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17456194#comment-17456194 ] sivabalan narayanan commented on HUDI-2323: --- There is a known bug in parquet for

[GitHub] [hudi] hudi-bot commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

hudi-bot commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-989582099 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

hudi-bot removed a comment on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-989559372 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi

[jira] [Commented] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17456189#comment-17456189 ] sivabalan narayanan commented on HUDI-864: -- [~rolandjohann] : Can you give it a tr

[jira] [Commented] (HUDI-1079) Cannot upsert on schema with Array of Record with single field

[ https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17456186#comment-17456186 ] sivabalan narayanan commented on HUDI-1079: --- Unfortunately, hudi does not do any

[GitHub] [hudi] hudi-bot commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989571491 ## CI report: * b561916256de18ffca7093d2e8200ae02c945efc Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot removed a comment on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989569735 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989569735 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot removed a comment on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989557070 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] guanziyue commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

guanziyue commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989568422 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [hudi] hudi-bot commented on pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

hudi-bot commented on pull request #4265: URL: https://github.com/apache/hudi/pull/4265#issuecomment-989559491 ## CI report: * 31c0fd46f52922816e1e023bd9b7c9873ae31fb6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

hudi-bot removed a comment on pull request #4265: URL: https://github.com/apache/hudi/pull/4265#issuecomment-989558237 ## CI report: * 31c0fd46f52922816e1e023bd9b7c9873ae31fb6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

hudi-bot commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-989559372 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

hudi-bot removed a comment on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-989556962 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

hudi-bot commented on pull request #4265: URL: https://github.com/apache/hudi/pull/4265#issuecomment-989558237 ## CI report: * 31c0fd46f52922816e1e023bd9b7c9873ae31fb6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[jira] [Updated] (HUDI-2966) Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScanner

[ https://issues.apache.org/jira/browse/HUDI-2966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2966: - Labels: pull-request-available (was: ) > Add TaskCompletionListener for HoodieMergeOnReadRDD to c

[GitHub] [hudi] xiarixiaoyao opened a new pull request #4265: [HUDI-2966] Add TaskCompletionListener for HoodieMergeOnReadRDD to close logScaner when the query finished.

xiarixiaoyao opened a new pull request #4265: URL: https://github.com/apache/hudi/pull/4265 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What i

[GitHub] [hudi] hudi-bot removed a comment on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot removed a comment on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989531356 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989557070 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

hudi-bot removed a comment on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-986559751 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4172: [HUDI-2892][BUG]Pending Clustering may stain the ActiveTimeLine and lead to incomplete query results

hudi-bot commented on pull request #4172: URL: https://github.com/apache/hudi/pull/4172#issuecomment-989556962 ## CI report: * 8740fecc1391600a836eb6158c31ab7416f57eec UNKNOWN * f65e6971ee3e9659155c6b453dec2c60e22fd29d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] danny0405 commented on a change in pull request #4252: [HUDI-2959] Fix the thread leak of cleaning service

danny0405 commented on a change in pull request #4252: URL: https://github.com/apache/hudi/pull/4252#discussion_r765464342 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/async/HoodieAsyncService.java ## @@ -141,35 +140,17 @@ public void start(Functi

[GitHub] [hudi] danny0405 commented on a change in pull request #4252: [HUDI-2959] Fix the thread leak of cleaning service

danny0405 commented on a change in pull request #4252: URL: https://github.com/apache/hudi/pull/4252#discussion_r765463984 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AsyncCleanerService.java ## @@ -73,6 +73,8 @@ public static void waitFor

[GitHub] [hudi] vinothchandar commented on a change in pull request #4252: [HUDI-2959] Fix the thread leak of cleaning service

vinothchandar commented on a change in pull request #4252: URL: https://github.com/apache/hudi/pull/4252#discussion_r765451717 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/AsyncCleanerService.java ## @@ -73,6 +73,8 @@ public static void wai

[jira] [Resolved] (HUDI-1894) NULL values in timestamp column defaulted

[ https://issues.apache.org/jira/browse/HUDI-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan resolved HUDI-1894. --- > NULL values in timestamp column defaulted > --

[jira] [Updated] (HUDI-1894) NULL values in timestamp column defaulted

[ https://issues.apache.org/jira/browse/HUDI-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1894: -- Fix Version/s: 0.9.0 > NULL values in timestamp column defaulted >

[jira] [Commented] (HUDI-1894) NULL values in timestamp column defaulted

[ https://issues.apache.org/jira/browse/HUDI-1894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17456152#comment-17456152 ] sivabalan narayanan commented on HUDI-1894: --- Since the issue is not reproducible

[GitHub] [hudi] hudi-bot commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989531356 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot removed a comment on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989529213 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989529213 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot removed a comment on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989527936 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989527936 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot removed a comment on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989526749 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

hudi-bot commented on pull request #4264: URL: https://github.com/apache/hudi/pull/4264#issuecomment-989526749 ## CI report: * c0d4c1ca673451e77a10cc3058d3a1df18ffc81b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] jaehyeon-kim commented on issue #4244: [SUPPORT] DeltaStreamer doesn't create a Glue/Hive table if deploy mode is cluster due to HiveConnection Failure

jaehyeon-kim commented on issue #4244: URL: https://github.com/apache/hudi/issues/4244#issuecomment-989526615 Found the following config is necessary. ``` hoodie.datasource.hive_sync.jdbcurl=jdbc:hive2://:1 ``` It defaults to `localhost:1` and it works with the `c

[GitHub] [hudi] jaehyeon-kim closed issue #4244: [SUPPORT] DeltaStreamer doesn't create a Glue/Hive table if deploy mode is cluster due to HiveConnection Failure

jaehyeon-kim closed issue #4244: URL: https://github.com/apache/hudi/issues/4244 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr.

[jira] [Updated] (HUDI-2785) Create Trino setup in docker demo

[ https://issues.apache.org/jira/browse/HUDI-2785?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2785: - Labels: pull-request-available (was: ) > Create Trino setup in docker demo >

[GitHub] [hudi] guanziyue opened a new pull request #4264: [HUDI-2785] Make HoodieParquetWriter Thread safe and memory executor …

guanziyue opened a new pull request #4264: URL: https://github.com/apache/hudi/pull/4264 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[hudi] branch master updated (9c8ad0f -> 5ac9ce7)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 9c8ad0f [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter (#3912) add 5ac9ce7 [MINOR] Fix Compi

[GitHub] [hudi] leesf merged pull request #4263: [MINOR] Fix Compile broken

leesf merged pull request #4263: URL: https://github.com/apache/hudi/pull/4263 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [hudi] hudi-bot commented on pull request #4263: [MINOR] Fix Compile broken

hudi-bot commented on pull request #4263: URL: https://github.com/apache/hudi/pull/4263#issuecomment-989492641 ## CI report: * 4b3807f2900ed4719457ed3738cb387006b088f6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4263: [MINOR] Fix Compile broken

hudi-bot removed a comment on pull request #4263: URL: https://github.com/apache/hudi/pull/4263#issuecomment-989474190 ## CI report: * 4b3807f2900ed4719457ed3738cb387006b088f6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot removed a comment on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

hudi-bot removed a comment on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-989459744 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

hudi-bot commented on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-989486769 ## CI report: * a085e101422d1df36b94127e75e5d60716986e69 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4253: [HUDI-2958] Automatically set spark.sql.parquet.writelegacyformat, when using bulkinsert to insert data which contains decimal

xiarixiaoyao commented on a change in pull request #4253: URL: https://github.com/apache/hudi/pull/4253#discussion_r765414682 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/storage/row/HoodieRowParquetWriteSupport.java ## @@ -46,13 +53,32 @@ pu

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

xiarixiaoyao commented on a change in pull request #4178: URL: https://github.com/apache/hudi/pull/4178#discussion_r765412301 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/clustering/run/strategy/MultipleSparkJobExecutionStrategy.java ## @@ -

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4178: [HUDI-2901] Fixed the bug clustering jobs cannot running in parallel

xiarixiaoyao commented on a change in pull request #4178: URL: https://github.com/apache/hudi/pull/4178#discussion_r765412301 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/clustering/run/strategy/MultipleSparkJobExecutionStrategy.java ## @@ -

[hudi] branch asf-site updated: updated writing pages with more details on delete and descibing the full write path (#4250)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 69e8906 updated writing pages with more

[GitHub] [hudi] bhasudha merged pull request #4250: [HUDI-2956] - Updating write docs for deletes and full write path description

bhasudha merged pull request #4250: URL: https://github.com/apache/hudi/pull/4250 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] codope commented on a change in pull request #4253: [HUDI-2958] Automatically set spark.sql.parquet.writelegacyformat, when using bulkinsert to insert data which contains decimalType

codope commented on a change in pull request #4253: URL: https://github.com/apache/hudi/pull/4253#discussion_r765408801 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/io/storage/row/HoodieRowParquetWriteSupport.java ## @@ -46,13 +53,32 @@ public H

[hudi] branch asf-site updated (6706c1c -> d22db6c)

This is an automated email from the ASF dual-hosted git repository. bhavanisudha pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git. from 6706c1c [MINOR] Updating configs to reflect dynamodb based lock configs (#4262) add d22db6c [HUDI-2827]

[GitHub] [hudi] leesf commented on pull request #4263: [MINOR] Fix Compile broken

leesf commented on pull request #4263: URL: https://github.com/apache/hudi/pull/4263#issuecomment-989477004 > +1 once CI passes And can we add a workflow to force make contributor rebase against latest master to avoid the problem ? CC @xushiyan -- This is an automated message fro

[GitHub] [hudi] manojpec commented on a change in pull request #4067: [HUDI-2763] Metadata table records key deduplication

manojpec commented on a change in pull request #4067: URL: https://github.com/apache/hudi/pull/4067#discussion_r765408100 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/block/HoodieLogBlockFactory.java ## @@ -0,0 +1,90 @@ +/* + * Licensed to the Apach

[GitHub] [hudi] yihua commented on a change in pull request #4106: [HUDI-2814] Make Z-index more generic Column-Stats Index

yihua commented on a change in pull request #4106: URL: https://github.com/apache/hudi/pull/4106#discussion_r765217559 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/sort/SpaceCurveSortingHelper.java ## @@ -0,0 +1,260 @@ +/* + * Licensed to the Apach

[GitHub] [hudi] yihua commented on a change in pull request #4106: [HUDI-2814] Make Z-index more generic Column-Stats Index

yihua commented on a change in pull request #4106: URL: https://github.com/apache/hudi/pull/4106#discussion_r765407715 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/sort/SpaceCurveSortingHelper.java ## @@ -0,0 +1,260 @@ +/* + * Licensed to the Apach

[GitHub] [hudi] bhasudha merged pull request #4235: [HUDI-2827] - Docs for DeltaStreamer SchemaProviders, Sources, and Checkpoints

bhasudha merged pull request #4235: URL: https://github.com/apache/hudi/pull/4235 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] yihua commented on a change in pull request #4106: [HUDI-2814] Make Z-index more generic Column-Stats Index

yihua commented on a change in pull request #4106: URL: https://github.com/apache/hudi/pull/4106#discussion_r765213822 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/columnstats/ColumnStatsIndexHelper.java ## @@ -621,4 +495,5 @@ public static S

[GitHub] [hudi] yihua commented on a change in pull request #4106: [HUDI-2814] Make Z-index more generic Column-Stats Index

yihua commented on a change in pull request #4106: URL: https://github.com/apache/hudi/pull/4106#discussion_r765407226 ## File path: hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/columnstats/ColumnStatsIndexHelper.java ## @@ -79,13 +71,11 @@ import java.ut

[GitHub] [hudi] hudi-bot commented on pull request #4263: [MINOR] Fix Compile broken

hudi-bot commented on pull request #4263: URL: https://github.com/apache/hudi/pull/4263#issuecomment-989474190 ## CI report: * 4b3807f2900ed4719457ed3738cb387006b088f6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4263: [MINOR] Fix Compile broken

hudi-bot removed a comment on pull request #4263: URL: https://github.com/apache/hudi/pull/4263#issuecomment-989472984 ## CI report: * 4b3807f2900ed4719457ed3738cb387006b088f6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] vinothchandar commented on pull request #4263: [MINOR] Fix Compile broken

vinothchandar commented on pull request #4263: URL: https://github.com/apache/hudi/pull/4263#issuecomment-989473251 +1 once CI passes -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #4263: [MINOR] Fix Compile broken

hudi-bot commented on pull request #4263: URL: https://github.com/apache/hudi/pull/4263#issuecomment-989472984 ## CI report: * 4b3807f2900ed4719457ed3738cb387006b088f6 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] leesf opened a new pull request #4263: [MINOR] Fix Compile broken

leesf opened a new pull request #4263: URL: https://github.com/apache/hudi/pull/4263 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose o

[jira] [Updated] (HUDI-2968) Support Delete/Update using non-pk fields

[ https://issues.apache.org/jira/browse/HUDI-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2968: - Description: Allow to delete/update using non-pk fields {code:java} create table h0 ( id int, name str

[jira] [Updated] (HUDI-2968) Support Delete/Update using non-pk fields

[ https://issues.apache.org/jira/browse/HUDI-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2968: - Priority: Blocker (was: Critical) > Support Delete/Update using non-pk fields > -

[jira] [Created] (HUDI-2968) Support Delete/Update using non-pk fields

Raymond Xu created HUDI-2968: Summary: Support Delete/Update using non-pk fields Key: HUDI-2968 URL: https://issues.apache.org/jira/browse/HUDI-2968 Project: Apache Hudi Issue Type: Sub-task

[jira] [Updated] (HUDI-2968) Support Delete/Update using non-pk fields

[ https://issues.apache.org/jira/browse/HUDI-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2968: - Fix Version/s: 0.11.0 > Support Delete/Update using non-pk fields > --

[GitHub] [hudi] hudi-bot commented on pull request #4106: [HUDI-2814] Make Z-index more generic Column-Stats Index

hudi-bot commented on pull request #4106: URL: https://github.com/apache/hudi/pull/4106#issuecomment-989469074 ## CI report: * 42210d2837e5690b12baa7a50e8a2e6cea96aec2 UNKNOWN * 4db8444e25fee92d22f0f2e06d1cdff511b05eaf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4106: [HUDI-2814] Make Z-index more generic Column-Stats Index

hudi-bot removed a comment on pull request #4106: URL: https://github.com/apache/hudi/pull/4106#issuecomment-989445501 ## CI report: * 42210d2837e5690b12baa7a50e8a2e6cea96aec2 UNKNOWN * 1b836c6b3457c9d07d0ac4cc684c5046062d5b47 Azure: [CANCELED](https://dev.azure.com/apache-hud

[jira] [Updated] (HUDI-1912) Presto defaults to GenericHiveRecordCursor for all Hudi tables

[ https://issues.apache.org/jira/browse/HUDI-1912?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rajesh Mahindra updated HUDI-1912: -- Status: Resolved (was: Patch Available) > Presto defaults to GenericHiveRecordCursor for all Hu

[hudi] branch asf-site updated: [MINOR] Updating configs to reflect dynamodb based lock configs (#4262)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 6706c1c [MINOR] Updating configs to reflec

[GitHub] [hudi] nsivabalan merged pull request #4262: [MINOR] Updating configs to reflect dynamoDB based lock configs

nsivabalan merged pull request #4262: URL: https://github.com/apache/hudi/pull/4262 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [hudi] vinothchandar commented on pull request #4260: [HUDI-2821] - Docs for Metadata Table - added reference to vc's benchmark study

vinothchandar commented on pull request #4260: URL: https://github.com/apache/hudi/pull/4260#issuecomment-989465646 this is a good start. we can keep improving this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] manojpec commented on pull request #4259: [HUDI-2962] Local process lock provider to guard single writer process with async table operations + Enabling metadata table

manojpec commented on pull request #4259: URL: https://github.com/apache/hudi/pull/4259#issuecomment-989463817 CI failed job passed in the re-run - https://dev.azure.com/apache-hudi-ci-org/apache-hudi-ci/_build/results?buildId=4106&view=results -- This is an automated message from th

[jira] [Updated] (HUDI-2467) Delete data is not working with 0.9.0 and pySpark

[ https://issues.apache.org/jira/browse/HUDI-2467?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2467: - Parent: (was: HUDI-1658) Issue Type: Bug (was: Sub-task) > Delete data is not working with 0.

[GitHub] [hudi] hudi-bot commented on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

hudi-bot commented on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-989459744 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

hudi-bot removed a comment on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-989458305 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] nsivabalan commented on issue #4055: [SUPPORT] Hudi with SqlQueryBasedTransformer fails-> spark error exit 134 or exit 143 in "isEmpty at DeltaSync.java:344" : Container from a bad no

nsivabalan commented on issue #4055: URL: https://github.com/apache/hudi/issues/4055#issuecomment-989459731 @guanlisheng : Can you please file a new github issue with all details and CC me. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-864: Fix Version/s: (was: 0.11.0) > parquet schema conflict: optional binary (UTF8) is not a group >

[jira] [Updated] (HUDI-864) parquet schema conflict: optional binary (UTF8) is not a group

[ https://issues.apache.org/jira/browse/HUDI-864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-864: Component/s: Writer Core > parquet schema conflict: optional binary (UTF8) is not a group >

[GitHub] [hudi] hudi-bot commented on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

hudi-bot commented on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-989458305 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4222: [HUDI-2849] improve SparkUI job description for write path

hudi-bot removed a comment on pull request #4222: URL: https://github.com/apache/hudi/pull/4222#issuecomment-986406347 ## CI report: * 9b30498cb6205e12cb859dd8fe4654ec952f63e0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] nsivabalan edited a comment on issue #3945: [SUPPORT] hoodie.datasource.write.drop.partition.columns not working as expected (deltastreamer)

nsivabalan edited a comment on issue #3945: URL: https://github.com/apache/hudi/issues/3945#issuecomment-989457674 Looks like the support was never added to deltastreamer only. I have filed a tracking ticket [here](https://issues.apache.org/jira/browse/HUDI-2967). If either of you are inte

[GitHub] [hudi] nsivabalan commented on issue #3945: [SUPPORT] hoodie.datasource.write.drop.partition.columns not working as expected (deltastreamer)

nsivabalan commented on issue #3945: URL: https://github.com/apache/hudi/issues/3945#issuecomment-989457674 Looks like the support was never added to deltastreamer only. I have filed a tracking ticket [here](https://issues.apache.org/jira/browse/HUDI-2967). If you are interested in working

[GitHub] [hudi] nsivabalan closed issue #3945: [SUPPORT] hoodie.datasource.write.drop.partition.columns not working as expected (deltastreamer)

nsivabalan closed issue #3945: URL: https://github.com/apache/hudi/issues/3945 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[jira] [Updated] (HUDI-2967) Support drop partition columns in deltastreamer

[ https://issues.apache.org/jira/browse/HUDI-2967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2967: -- Fix Version/s: 0.11.0 > Support drop partition columns in deltastreamer > --

[jira] [Assigned] (HUDI-2967) Support drop partition columns in deltastreamer

[ https://issues.apache.org/jira/browse/HUDI-2967?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-2967: - Assignee: sivabalan narayanan > Support drop partition columns in deltastreamer >

[jira] [Created] (HUDI-2967) Support drop partition columns in deltastreamer

sivabalan narayanan created HUDI-2967: - Summary: Support drop partition columns in deltastreamer Key: HUDI-2967 URL: https://issues.apache.org/jira/browse/HUDI-2967 Project: Apache Hudi I

[GitHub] [hudi] guanlisheng edited a comment on issue #4055: [SUPPORT] Hudi with SqlQueryBasedTransformer fails-> spark error exit 134 or exit 143 in "isEmpty at DeltaSync.java:344" : Container from

guanlisheng edited a comment on issue #4055: URL: https://github.com/apache/hudi/issues/4055#issuecomment-989456516 hey @nsivabalan , thanks for the reply. very similar and the only difference is the dataset operation vs a spark SQL. an additional clue is that the transformer wo

[hudi] branch master updated (bd08470 -> 9c8ad0f)

This is an automated email from the ASF dual-hosted git repository. leesf pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from bd08470 [HUDI-2957] Shade kryo jar for flink bundle jar (#4251) add 9c8ad0f [HUDI-2665] Fix overflow of huge log

[GitHub] [hudi] guanlisheng commented on issue #4055: [SUPPORT] Hudi with SqlQueryBasedTransformer fails-> spark error exit 134 or exit 143 in "isEmpty at DeltaSync.java:344" : Container from a bad n

guanlisheng commented on issue #4055: URL: https://github.com/apache/hudi/issues/4055#issuecomment-989456516 hey @nsivabalan , thanks for the reply. very similar and the only difference is the dataset operation vs a spark SQL. additional clue is that the transformer works well w

[GitHub] [hudi] leesf merged pull request #3912: [HUDI-2665] Fix overflow of huge log file in HoodieLogFormatWriter

leesf merged pull request #3912: URL: https://github.com/apache/hudi/pull/3912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [hudi] Limess opened a new issue #3945: [SUPPORT] hoodie.datasource.write.drop.partition.columns not working as expected (deltastreamer)

Limess opened a new issue #3945: URL: https://github.com/apache/hudi/issues/3945 **Describe the problem you faced** We're running a deltastreamer job into a new Hudi table. We have a partition column: `story_published_partition_date`, and we set `hoodie.datasource.write.drop.p

  1   2   3   4   >