[GitHub] [hudi] hudi-bot commented on pull request #4582: [MINOR] standardize HoodieSqlCommon.g4 file

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4582: URL: https://github.com/apache/hudi/pull/4582#issuecomment-1011888990 ## CI report: * 208e50cde75c9ef2e79d8550cfbc441e6e0d2ba6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4582: [MINOR] standardize HoodieSqlCommon.g4 file

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4582: URL: https://github.com/apache/hudi/pull/4582#issuecomment-1011845726 ## CI report: * 208e50cde75c9ef2e79d8550cfbc441e6e0d2ba6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] Guanpx commented on issue #4550: [QUESTION] Hudi Partial Update on COW

2022-01-13 Thread GitBox
Guanpx commented on issue #4550: URL: https://github.com/apache/hudi/issues/4550#issuecomment-1011901170 > @pankajc007 there are some examples in the quick start guide for merge into https://hudi.apache.org/docs/quick-start-guide#mergeinto > > options you can refer to the setup secti

[GitHub] [hudi] YannByron commented on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
YannByron commented on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011904053 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011905822 ## CI report: * d5c2d937f41cbf9c25703ec5b1fb14fb30c8d47b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011871610 ## CI report: * d5c2d937f41cbf9c25703ec5b1fb14fb30c8d47b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[jira] [Commented] (HUDI-64) Estimation of compression ratio & other dynamic storage knobs based on historical stats

2022-01-13 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-64?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475171#comment-17475171 ] Ethan Guo commented on HUDI-64: --- [~vinoth] [~yanghua] Based on my reading of the thread, it lo

[GitHub] [hudi] hudi-bot removed a comment on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1011874688 ## CI report: * ddc3af0c32bafef6b10c32c43132df32a5f7d83c UNKNOWN * e1ba726105dfa7ae07d802546c71a0cf1ad8b172 UNKNOWN * 306e7d462959e0249e230f60c2e9ea6602342

[GitHub] [hudi] hudi-bot commented on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1011909997 ## CI report: * ddc3af0c32bafef6b10c32c43132df32a5f7d83c UNKNOWN * e1ba726105dfa7ae07d802546c71a0cf1ad8b172 UNKNOWN * 306e7d462959e0249e230f60c2e9ea6602342e08 UNKN

[GitHub] [hudi] hudi-bot commented on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011910154 ## CI report: * d5c2d937f41cbf9c25703ec5b1fb14fb30c8d47b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011905822 ## CI report: * d5c2d937f41cbf9c25703ec5b1fb14fb30c8d47b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[jira] [Created] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
Harsha Teja Kanna created HUDI-3242: --- Summary: Partial parquet file discovery after the first commit Key: HUDI-3242 URL: https://issues.apache.org/jira/browse/HUDI-3242 Project: Apache Hudi

[GitHub] [hudi] chrischnweiss opened a new issue #4585: Target Schema cannot be set in MultiTableDeltaStreamer

2022-01-13 Thread GitBox
chrischnweiss opened a new issue #4585: URL: https://github.com/apache/hudi/issues/4585 Hi guys, we ran into a problem setting the target schema of our Hudi table using the MultiTableDeltaStreamer. Using a normal DeltaStreamer, we are able to set our source and target schemas

[jira] [Updated] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsha Teja Kanna updated HUDI-3242: Description: Hi, I am testing release branch 0.10.1 as I needed few bug fixes from it. Howe

[GitHub] [hudi] boneanxs opened a new pull request #4586: [HUDI-1558] Struct Stream Source Support Spark3

2022-01-13 Thread GitBox
boneanxs opened a new pull request #4586: URL: https://github.com/apache/hudi/pull/4586 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpos

[jira] [Updated] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsha Teja Kanna updated HUDI-3242: Description: Hi, I am testing release branch 0.10.1 as I needed few bug fixes from it. Howe

[jira] [Updated] (HUDI-1558) Struct Stream Source Support Spark3

2022-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1558?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-1558: - Labels: pull-request-available (was: ) > Struct Stream Source Support Spark3 > -

[jira] [Updated] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsha Teja Kanna updated HUDI-3242: Attachment: Screen Shot 2022-01-13 at 2.40.55 AM.png > Partial parquet file discovery after

[jira] [Updated] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsha Teja Kanna updated HUDI-3242: Attachment: (was: Screen Shot 2022-01-13 at 2.55.35 AM.png) > Partial parquet file disco

[jira] [Updated] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsha Teja Kanna updated HUDI-3242: Attachment: Screen Shot 2022-01-13 at 2.55.35 AM.png > Partial parquet file discovery after

[jira] [Updated] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsha Teja Kanna updated HUDI-3242: Attachment: (was: Screen Shot 2022-01-13 at 2.40.55 AM-2.png) > Partial parquet file dis

[jira] [Updated] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsha Teja Kanna updated HUDI-3242: Attachment: (was: Screen Shot 2022-01-13 at 2.40.55 AM.png) > Partial parquet file disco

[jira] [Updated] (HUDI-3242) Partial parquet file discovery after the first commit

2022-01-13 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Harsha Teja Kanna updated HUDI-3242: Attachment: Screen Shot 2022-01-13 at 2.40.55 AM.png Screen Shot 2022-01-13 a

[GitHub] [hudi] hudi-bot commented on pull request #4586: [HUDI-1558] Struct Stream Source Support Spark3

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4586: URL: https://github.com/apache/hudi/pull/4586#issuecomment-1011929641 ## CI report: * a0b078b0472dfdc47e221bfe8e440cc401b5100b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] dongkelun commented on pull request #4581: [MINOR] Optimize variable names and logs

2022-01-13 Thread GitBox
dongkelun commented on pull request #4581: URL: https://github.com/apache/hudi/pull/4581#issuecomment-1011929767 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #4581: [MINOR] Optimize variable names and logs

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4581: URL: https://github.com/apache/hudi/pull/4581#issuecomment-1011932115 ## CI report: * ae710dd1989a1214ff41ff4056611d71562ff692 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4581: [MINOR] Optimize variable names and logs

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4581: URL: https://github.com/apache/hudi/pull/4581#issuecomment-1011878029 ## CI report: * ae710dd1989a1214ff41ff4056611d71562ff692 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4586: [HUDI-1558] Struct Stream Source Support Spark3

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4586: URL: https://github.com/apache/hudi/pull/4586#issuecomment-1011929641 ## CI report: * a0b078b0472dfdc47e221bfe8e440cc401b5100b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4586: [HUDI-1558] Struct Stream Source Support Spark3

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4586: URL: https://github.com/apache/hudi/pull/4586#issuecomment-1011932160 ## CI report: * a0b078b0472dfdc47e221bfe8e440cc401b5100b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3237) ALTER TABLE column type change fails select query

2022-01-13 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yann Byron updated HUDI-3237: - Attachment: image-2022-01-13-17-04-09-038.png > ALTER TABLE column type change fails select query > --

[jira] [Comment Edited] (HUDI-3237) ALTER TABLE column type change fails select query

2022-01-13 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475182#comment-17475182 ] Yann Byron edited comment on HUDI-3237 at 1/13/22, 9:08 AM: Du

[jira] [Commented] (HUDI-3237) ALTER TABLE column type change fails select query

2022-01-13 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475182#comment-17475182 ] Yann Byron commented on HUDI-3237: -- Due to no open api to control the schema converting n

[GitHub] [hudi] hudi-bot removed a comment on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011910154 ## CI report: * d5c2d937f41cbf9c25703ec5b1fb14fb30c8d47b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011949618 ## CI report: * d5c2d937f41cbf9c25703ec5b1fb14fb30c8d47b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] jadireddi commented on pull request #3929: [HUDI-1881] Make multi table delta streamer to use thread pool for table sync asynchronously.

2022-01-13 Thread GitBox
jadireddi commented on pull request #3929: URL: https://github.com/apache/hudi/pull/3929#issuecomment-1011950891 > @jadireddi Gentle ping. In case you are not having bandwidth to finish this, I can drive this through. Please LMK. Hi @pratyakshsharma. I have done the testing and be av

[GitHub] [hudi] jadireddi edited a comment on pull request #3929: [HUDI-1881] Make multi table delta streamer to use thread pool for table sync asynchronously.

2022-01-13 Thread GitBox
jadireddi edited a comment on pull request #3929: URL: https://github.com/apache/hudi/pull/3929#issuecomment-1011950891 > @jadireddi Gentle ping. In case you are not having bandwidth to finish this, I can drive this through. Please LMK. Hi @pratyakshsharma. I have done the testing an

[GitHub] [hudi] hudi-bot commented on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011959705 ## CI report: * 712fb15b14fd5d2a224c0ebe7c8f2d71b933c5f5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4584: [HUDI-3198] optimize create table based on an existing hudi table

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4584: URL: https://github.com/apache/hudi/pull/4584#issuecomment-1011949618 ## CI report: * d5c2d937f41cbf9c25703ec5b1fb14fb30c8d47b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4581: [MINOR] Optimize variable names and logs

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4581: URL: https://github.com/apache/hudi/pull/4581#issuecomment-1011932115 ## CI report: * ae710dd1989a1214ff41ff4056611d71562ff692 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4581: [MINOR] Optimize variable names and logs

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4581: URL: https://github.com/apache/hudi/pull/4581#issuecomment-1011989287 ## CI report: * ae710dd1989a1214ff41ff4056611d71562ff692 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4586: [HUDI-1558] Struct Stream Source Support Spark3

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4586: URL: https://github.com/apache/hudi/pull/4586#issuecomment-1011932160 ## CI report: * a0b078b0472dfdc47e221bfe8e440cc401b5100b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4586: [HUDI-1558] Struct Stream Source Support Spark3

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4586: URL: https://github.com/apache/hudi/pull/4586#issuecomment-1011989336 ## CI report: * a0b078b0472dfdc47e221bfe8e440cc401b5100b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Comment Edited] (HUDI-3237) ALTER TABLE column type change fails select query

2022-01-13 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475182#comment-17475182 ] Yann Byron edited comment on HUDI-3237 at 1/13/22, 10:46 AM: -

[jira] [Comment Edited] (HUDI-3237) ALTER TABLE column type change fails select query

2022-01-13 Thread Yann Byron (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17475182#comment-17475182 ] Yann Byron edited comment on HUDI-3237 at 1/13/22, 10:48 AM: -

[GitHub] [hudi] YannByron opened a new pull request #4587: [HUDI-3236] use fields'comments persisted in catalog to fill in schema

2022-01-13 Thread GitBox
YannByron opened a new pull request #4587: URL: https://github.com/apache/hudi/pull/4587 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[jira] [Updated] (HUDI-3236) ALTER TABLE COMMENT old comment gets reverted

2022-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3236: - Labels: pull-request-available (was: ) > ALTER TABLE COMMENT old comment gets reverted >

[GitHub] [hudi] hudi-bot commented on pull request #4587: [HUDI-3236] use fields'comments persisted in catalog to fill in schema

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4587: URL: https://github.com/apache/hudi/pull/4587#issuecomment-1012036868 ## CI report: * 91868d624fac0af68afbc399a0ba554c1e5bce93 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4587: [HUDI-3236] use fields'comments persisted in catalog to fill in schema

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4587: URL: https://github.com/apache/hudi/pull/4587#issuecomment-1012039263 ## CI report: * 91868d624fac0af68afbc399a0ba554c1e5bce93 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4587: [HUDI-3236] use fields'comments persisted in catalog to fill in schema

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4587: URL: https://github.com/apache/hudi/pull/4587#issuecomment-1012036868 ## CI report: * 91868d624fac0af68afbc399a0ba554c1e5bce93 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] danny0405 merged pull request #4579: [minor][doc] Fix the hive sync template for flink

2022-01-13 Thread GitBox
danny0405 merged pull request #4579: URL: https://github.com/apache/hudi/pull/4579 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[hudi] branch asf-site updated: [minor][doc] Fix the hive sync template for flink (#4579)

2022-01-13 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/asf-site by this push: new 1840b59 [minor][doc] Fix the hive sync tem

[GitHub] [hudi] danny0405 commented on issue #4583: [SUPPORT] Got NoSuchElementException while using hudi 0.10.0 and Flink (COW)

2022-01-13 Thread GitBox
danny0405 commented on issue #4583: URL: https://github.com/apache/hudi/issues/4583#issuecomment-1012057541 Did you open the flink checkpoint yet, it seems that the data set was detected to be `UPSERT` but there are no parquet files under the target partition. -- This is an automated me

[GitHub] [hudi] nsivabalan opened a new pull request #4588: [HUDI-3072] Fixing conflict resolution in transaction management code path for auto commit code path

2022-01-13 Thread GitBox
nsivabalan opened a new pull request #4588: URL: https://github.com/apache/hudi/pull/4588 ## What is the purpose of the pull request Looks like conflict resolution had a bug in auto commit code path. Incidentally both spark datasource writer and deltastreamer uses non auto commit co

[GitHub] [hudi] hudi-bot removed a comment on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-104865 ## CI report: * 86716004ac41c76ed50e8728cbf06e068c9f7188 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012067411 ## CI report: * 86716004ac41c76ed50e8728cbf06e068c9f7188 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] nsivabalan commented on pull request #4588: [HUDI-3072] Fixing conflict resolution in transaction management code path for auto commit code path

2022-01-13 Thread GitBox
nsivabalan commented on pull request #4588: URL: https://github.com/apache/hudi/pull/4588#issuecomment-1012067546 @manojpec : Can you review this patch please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

[jira] [Updated] (HUDI-3072) AutoCommit misses to detect write conflicts during concurrent transactions

2022-01-13 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3072: - Labels: pull-request-available (was: ) > AutoCommit misses to detect write conflicts during concu

[GitHub] [hudi] nsivabalan merged pull request #4578: [HUDI-3010] Unbundle parquet-avro and shade other dependencies in presto bundle

2022-01-13 Thread GitBox
nsivabalan merged pull request #4578: URL: https://github.com/apache/hudi/pull/4578 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[hudi] branch release-0.10.1-rc1 updated: [HUDI-3010] Unbundle parquet-avro and shade other dependencies in prsto bundle (#4551) (#4578)

2022-01-13 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.10.1-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/release-0.10.1-rc1 by this push: new 97dab47 [HUDI-3010] U

[GitHub] [hudi] hudi-bot removed a comment on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012067411 ## CI report: * 86716004ac41c76ed50e8728cbf06e068c9f7188 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4588: [HUDI-3072] Fixing conflict resolution in transaction management code path for auto commit code path

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4588: URL: https://github.com/apache/hudi/pull/4588#issuecomment-1012069774 ## CI report: * ee0c9a377143296268d56e1402c2ab55a0980476 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012069699 ## CI report: * 86716004ac41c76ed50e8728cbf06e068c9f7188 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012069699 ## CI report: * 86716004ac41c76ed50e8728cbf06e068c9f7188 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012071972 ## CI report: * 86716004ac41c76ed50e8728cbf06e068c9f7188 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4588: [HUDI-3072] Fixing conflict resolution in transaction management code path for auto commit code path

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4588: URL: https://github.com/apache/hudi/pull/4588#issuecomment-1012069774 ## CI report: * ee0c9a377143296268d56e1402c2ab55a0980476 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4588: [HUDI-3072] Fixing conflict resolution in transaction management code path for auto commit code path

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4588: URL: https://github.com/apache/hudi/pull/4588#issuecomment-1012072048 ## CI report: * ee0c9a377143296268d56e1402c2ab55a0980476 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[hudi] branch release-0.10.1-rc1 updated (97dab47 -> 91253ef)

2022-01-13 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch release-0.10.1-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. from 97dab47 [HUDI-3010] Unbundle parquet-avro and shade other dependencies in prsto bundle (#4551) (#4578)

[hudi] 02/03: [HUDI-3024] Add explicit write handler for flink (#4329)

2022-01-13 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.10.1-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit c3fca6d6b5dea09b9581438c89fa5188ecd8f2d2 Author: WangMinChao <33626973+mincw...@users.noreply.github.com> Au

[hudi] 01/03: [HUDI-3007] Fix issues in HoodieRepairTool (#4564)

2022-01-13 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.10.1-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 59cfa4b7e4404456c26c9c8df17182ed6e68ccd1 Author: Y Ethan Guo AuthorDate: Wed Jan 12 09:03:27 2022 -0800

[hudi] 03/03: [HUDI-3120] Cache compactionPlan in buffer (#4463)

2022-01-13 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.10.1-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit 91253ef05d2af82df2d530c847cd1440956b95e8 Author: yuzhaojing <32435329+yuzhaoj...@users.noreply.github.com> A

[GitHub] [hudi] hudi-bot removed a comment on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012071972 ## CI report: * 86716004ac41c76ed50e8728cbf06e068c9f7188 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012074407 ## CI report: * 52670af75118410a14acbf4bd12c3c0201f41f79 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot commented on pull request #4065: [HUDI-2817] Sync the configuration inference for HoodieFlinkStreamer

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4065: URL: https://github.com/apache/hudi/pull/4065#issuecomment-1012078708 ## CI report: * 7b4e1a1a27e962b920e6801aa205c5a45d89ef91 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4065: [HUDI-2817] Sync the configuration inference for HoodieFlinkStreamer

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4065: URL: https://github.com/apache/hudi/pull/4065#issuecomment-977617562 ## CI report: * 7b4e1a1a27e962b920e6801aa205c5a45d89ef91 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4065: [HUDI-2817] Sync the configuration inference for HoodieFlinkStreamer

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4065: URL: https://github.com/apache/hudi/pull/4065#issuecomment-1012081096 ## CI report: * 7b4e1a1a27e962b920e6801aa205c5a45d89ef91 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4065: [HUDI-2817] Sync the configuration inference for HoodieFlinkStreamer

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4065: URL: https://github.com/apache/hudi/pull/4065#issuecomment-1012078708 ## CI report: * 7b4e1a1a27e962b920e6801aa205c5a45d89ef91 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4587: [HUDI-3236] use fields'comments persisted in catalog to fill in schema

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4587: URL: https://github.com/apache/hudi/pull/4587#issuecomment-1012039263 ## CI report: * 91868d624fac0af68afbc399a0ba554c1e5bce93 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4587: [HUDI-3236] use fields'comments persisted in catalog to fill in schema

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4587: URL: https://github.com/apache/hudi/pull/4587#issuecomment-1012086069 ## CI report: * 91868d624fac0af68afbc399a0ba554c1e5bce93 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] nsivabalan commented on a change in pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-13 Thread GitBox
nsivabalan commented on a change in pull request #4180: URL: https://github.com/apache/hudi/pull/4180#discussion_r783905124 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java ## @@ -241,6 +246,26 @@ private void deleteInstan

[GitHub] [hudi] nsivabalan commented on a change in pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-13 Thread GitBox
nsivabalan commented on a change in pull request #4180: URL: https://github.com/apache/hudi/pull/4180#discussion_r783910405 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/timeline/HoodieActiveTimeline.java ## @@ -241,6 +246,26 @@ private void deleteInstan

[GitHub] [hudi] xiaotianzhang01 opened a new pull request #4589: [MINOR] Fix the check condition in the readFromVector method to alway…

2022-01-13 Thread GitBox
xiaotianzhang01 opened a new pull request #4589: URL: https://github.com/apache/hudi/pull/4589 …s be true ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.*

[GitHub] [hudi] hudi-bot commented on pull request #4589: [MINOR] Fix the check condition in the readFromVector method to alway…

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4589: URL: https://github.com/apache/hudi/pull/4589#issuecomment-1012095471 ## CI report: * 1141cc55e5e354d5671f9d7e894b2fd85a8aa1de UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4589: [MINOR] Fix the check condition in the readFromVector method to alway…

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4589: URL: https://github.com/apache/hudi/pull/4589#issuecomment-1012095471 ## CI report: * 1141cc55e5e354d5671f9d7e894b2fd85a8aa1de UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4589: [MINOR] Fix the check condition in the readFromVector method to alway…

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4589: URL: https://github.com/apache/hudi/pull/4589#issuecomment-1012097539 ## CI report: * 1141cc55e5e354d5671f9d7e894b2fd85a8aa1de Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] xiaotianzhang01 commented on pull request #4589: [MINOR] Fix the check condition in the readFromVector method to alway…

2022-01-13 Thread GitBox
xiaotianzhang01 commented on pull request #4589: URL: https://github.com/apache/hudi/pull/4589#issuecomment-1012098491 CC: @jintaoguan @danny0405 @vinothchandar -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] nsivabalan commented on a change in pull request #4540: [HUDI-3194] fix MOR snapshot query (HIVE) during compaction

2022-01-13 Thread GitBox
nsivabalan commented on a change in pull request #4540: URL: https://github.com/apache/hudi/pull/4540#discussion_r783918083 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java ## @@ -94,16 +94,16 @@ HoodieTableMe

[jira] [Updated] (HUDI-3234) Fixing read of an empty table (with first commit failed) should return empty RDD

2022-01-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3234?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3234: -- Status: In Progress (was: Open) > Fixing read of an empty table (with first commit fail

[jira] [Updated] (HUDI-3072) AutoCommit misses to detect write conflicts during concurrent transactions

2022-01-13 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-3072: -- Status: In Progress (was: Open) > AutoCommit misses to detect write conflicts during co

[GitHub] [hudi] codope commented on a change in pull request #4563: [HUDI-3211][RFC-44] Add RFC for Hudi Connector for Presto

2022-01-13 Thread GitBox
codope commented on a change in pull request #4563: URL: https://github.com/apache/hudi/pull/4563#discussion_r783918732 ## File path: rfc/rfc-44/rfc-44.md ## @@ -0,0 +1,156 @@ + + +# RFC-44: Hudi Connector for Presto + +## Proposers + +- @7c00 + +## Approvers + +- @ + +## Statu

[hudi] branch release-0.10.1 created (now ab3f9fd)

2022-01-13 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch release-0.10.1 in repository https://gitbox.apache.org/repos/asf/hudi.git. at ab3f9fd Bumping release candidate number 1 for 0.10.1 This branch includes the following new commits:

[hudi] 01/01: Bumping release candidate number 1 for 0.10.1

2022-01-13 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a commit to branch release-0.10.1 in repository https://gitbox.apache.org/repos/asf/hudi.git commit ab3f9fde98c05a75703022de15dacd87414deb7c Author: sivabalan narayanan AuthorDate: Thu Jan 13 07:46:40 2022 -0500

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4587: [HUDI-3236] use fields'comments persisted in catalog to fill in schema

2022-01-13 Thread GitBox
xiarixiaoyao commented on a change in pull request #4587: URL: https://github.com/apache/hudi/pull/4587#discussion_r783928372 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/AlterHoodieTableChangeColumnCommand.scala ## @@ -42,24

[GitHub] [hudi] YuweiXiao commented on a change in pull request #4540: [HUDI-3194] fix MOR snapshot query (HIVE) during compaction

2022-01-13 Thread GitBox
YuweiXiao commented on a change in pull request #4540: URL: https://github.com/apache/hudi/pull/4540#discussion_r783929268 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/utils/HoodieRealtimeInputFormatUtils.java ## @@ -94,16 +94,16 @@ HoodieTableMet

[GitHub] [hudi] hudi-bot removed a comment on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012074407 ## CI report: * 52670af75118410a14acbf4bd12c3c0201f41f79 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4572: [HUDI-2943] Complete pending clustering before deltastreamer sync

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4572: URL: https://github.com/apache/hudi/pull/4572#issuecomment-1012112963 ## CI report: * 52670af75118410a14acbf4bd12c3c0201f41f79 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4587: [HUDI-3236] use fields'comments persisted in catalog to fill in schema

2022-01-13 Thread GitBox
xiarixiaoyao commented on a change in pull request #4587: URL: https://github.com/apache/hudi/pull/4587#discussion_r783934791 ## File path: hudi-spark-datasource/hudi-spark/src/test/scala/org/apache/spark/sql/hudi/TestAlterTable.scala ## @@ -53,24 +71,26 @@ class TestAlterTabl

[GitHub] [hudi] hudi-bot removed a comment on pull request #4588: [HUDI-3072] Fixing conflict resolution in transaction management code path for auto commit code path

2022-01-13 Thread GitBox
hudi-bot removed a comment on pull request #4588: URL: https://github.com/apache/hudi/pull/4588#issuecomment-1012072048 ## CI report: * ee0c9a377143296268d56e1402c2ab55a0980476 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4588: [HUDI-3072] Fixing conflict resolution in transaction management code path for auto commit code path

2022-01-13 Thread GitBox
hudi-bot commented on pull request #4588: URL: https://github.com/apache/hudi/pull/4588#issuecomment-1012125118 ## CI report: * ee0c9a377143296268d56e1402c2ab55a0980476 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

svn commit: r52060 - /dev/hudi/KEYS

2022-01-13 Thread sivabalan
Author: sivabalan Date: Thu Jan 13 13:15:10 2022 New Revision: 52060 Log: Fixing sivabalan's gpg keys Modified: dev/hudi/KEYS Modified: dev/hudi/KEYS == --- dev/hudi/KEYS (original) +++ dev/hudi/KEYS Thu Jan 13 13:15

[GitHub] [hudi] dongkelun commented on issue #4131: [SUPPORT] org.apache.hudi.exception.HoodieException: The value of can not be null

2022-01-13 Thread GitBox
dongkelun commented on issue #4131: URL: https://github.com/apache/hudi/issues/4131#issuecomment-1012136193 @nsivabalan @BenjMaq In Hudi version 0.9.0, insert takes the last field of the schema as the `PRECOMBINE_FIELD` by default. If the field is null, this exception may be thrown

  1   2   3   4   5   >