[GitHub] [hudi] hudi-bot removed a comment on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017200201 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Created] (HUDI-3284) Restore hudi-presto-bundle changes and upgrade presto version in docker setup

2022-01-20 Thread Sagar Sumit (Jira)
Sagar Sumit created HUDI-3284: - Summary: Restore hudi-presto-bundle changes and upgrade presto version in docker setup Key: HUDI-3284 URL: https://issues.apache.org/jira/browse/HUDI-3284 Project: Apache H

[GitHub] [hudi] hudi-bot commented on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017209403 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017211748 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017209403 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4646: [HUDI-3250] Upgrade Presto docker image

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4646: URL: https://github.com/apache/hudi/pull/4646#issuecomment-1017216200 ## CI report: * 097d027ebdd6cdb3246dc6dbe4aba8f00122e5e6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4646: [HUDI-3250] Upgrade Presto docker image

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4646: URL: https://github.com/apache/hudi/pull/4646#issuecomment-1017157186 ## CI report: * 097d027ebdd6cdb3246dc6dbe4aba8f00122e5e6 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] xushiyan commented on a change in pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
xushiyan commented on a change in pull request #4083: URL: https://github.com/apache/hudi/pull/4083#discussion_r788480846 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java ## @@ -76,6 +76,11 @@ public static final String HOODIE_PROP

[jira] [Updated] (HUDI-2732) Spark Datasource V2 integration RFC

2022-01-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2732: - Reviewers: Raymond Xu, Vinoth Chandar > Spark Datasource V2 integration RFC > ---

[jira] [Updated] (HUDI-3047) Basic Implementation of Spark Datasource V2

2022-01-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3047: - Reviewers: Raymond Xu, Vinoth Chandar (was: Raymond Xu) > Basic Implementation of Spark Datasource V2 > -

[jira] [Updated] (HUDI-3254) Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3254: - Reviewers: Raymond Xu, Vinoth Chandar > Introduce HoodieCatalog to manage tables for Spark Datasource V2 >

[GitHub] [hudi] xushiyan commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
xushiyan commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017219746 @leesf is this to replace https://github.com/apache/hudi/pull/4350 ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [hudi] leesf commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
leesf commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017221717 > @leesf is this to replace #4350 ? @xushiyan yes, #4350 would be closed. -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] leesf commented on pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

2022-01-20 Thread GitBox
leesf commented on pull request #4350: URL: https://github.com/apache/hudi/pull/4350#issuecomment-1017225033 closing this as have a new PR #4611 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] leesf closed pull request #4350: [HUDI-3047] Basic Implementation of Spark Datasource V2

2022-01-20 Thread GitBox
leesf closed pull request #4350: URL: https://github.com/apache/hudi/pull/4350 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [hudi] hudi-bot removed a comment on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1013887306 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 7df4b2cbf0f0e658c0508e7ca0d93725bdc48823 Azure: [SUCCESS](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017227414 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 7df4b2cbf0f0e658c0508e7ca0d93725bdc48823 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] dongkelun commented on a change in pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
dongkelun commented on a change in pull request #4083: URL: https://github.com/apache/hudi/pull/4083#discussion_r788499208 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/InputPathHandler.java ## @@ -53,25 +57,27 @@ public static final Logger LOG = LogMan

[GitHub] [hudi] hudi-bot commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017229766 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 7df4b2cbf0f0e658c0508e7ca0d93725bdc48823 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017227414 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 7df4b2cbf0f0e658c0508e7ca0d93725bdc48823 Azure: [SUCCESS](https://dev.azure.com/apache-hud

[GitHub] [hudi] wangxianghu commented on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
wangxianghu commented on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017229781 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] hudi-bot removed a comment on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017211748 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017229920 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] dongkelun commented on a change in pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
dongkelun commented on a change in pull request #4083: URL: https://github.com/apache/hudi/pull/4083#discussion_r788503959 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/InputPathHandler.java ## @@ -95,19 +101,20 @@ private void parseInputPaths(Path[] inputP

[GitHub] [hudi] hudi-bot removed a comment on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017229766 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 7df4b2cbf0f0e658c0508e7ca0d93725bdc48823 Azure: [SUCCESS](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017232114 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 1c72a58d6f34317ac4bf9ac89e0c4d3a8cb467c6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] dongkelun commented on a change in pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
dongkelun commented on a change in pull request #4083: URL: https://github.com/apache/hudi/pull/4083#discussion_r788504919 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/InputPathHandler.java ## @@ -117,9 +124,11 @@ private void parseInputPaths(Path[] inputP

[GitHub] [hudi] hudi-bot commented on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1017233954 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eefba0 UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1016083898 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eef

[GitHub] [hudi] dongkelun commented on a change in pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
dongkelun commented on a change in pull request #4083: URL: https://github.com/apache/hudi/pull/4083#discussion_r788506944 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java ## @@ -76,6 +76,11 @@ public static final String HOODIE_PRO

[GitHub] [hudi] hudi-bot commented on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017236721 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017229920 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] dongkelun commented on a change in pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
dongkelun commented on a change in pull request #4083: URL: https://github.com/apache/hudi/pull/4083#discussion_r788512894 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/InputPathHandler.java ## @@ -95,19 +101,20 @@ private void parseInputPaths(Path[] inputP

[GitHub] [hudi] dongkelun commented on a change in pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
dongkelun commented on a change in pull request #4083: URL: https://github.com/apache/hudi/pull/4083#discussion_r788512894 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/InputPathHandler.java ## @@ -95,19 +101,20 @@ private void parseInputPaths(Path[] inputP

[GitHub] [hudi] hudi-bot removed a comment on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017232114 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 1c72a58d6f34317ac4bf9ac89e0c4d3a8cb467c6 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot removed a comment on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017236721 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017239219 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017239081 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 1c72a58d6f34317ac4bf9ac89e0c4d3a8cb467c6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017241792 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017239219 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[jira] [Updated] (HUDI-3144) Make metadata table getRecordsByKeys() operations more performant by doing range reads

2022-01-20 Thread Manoj Govindassamy (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3144?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manoj Govindassamy updated HUDI-3144: - Status: Open (was: In Progress) > Make metadata table getRecordsByKeys() operations more

[GitHub] [hudi] codope commented on pull request #4628: [HUDI-2521] Add doc for hive sync modes

2022-01-20 Thread GitBox
codope commented on pull request #4628: URL: https://github.com/apache/hudi/pull/4628#issuecomment-1017264299 > LGTM. Is there any recommendation on when to use diff modes. Added a line why JDBC/HMS would be more preferable over HIVEQL. As such, between JDBC and HMS, there shouldn't

[GitHub] [hudi] XuQianJin-Stars opened a new pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
XuQianJin-Stars opened a new pull request #4649: URL: https://github.com/apache/hudi/pull/4649 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Updated] (HUDI-2941) Show _hoodie_operation in spark sql results

2022-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2941: - Labels: hudi-on-call pull-request-available sev:critical user-support-issues (was: hudi-on-call s

[GitHub] [hudi] codope commented on a change in pull request #4628: [HUDI-2521] Add doc for hive sync modes

2022-01-20 Thread GitBox
codope commented on a change in pull request #4628: URL: https://github.com/apache/hudi/pull/4628#discussion_r788544667 ## File path: website/docs/syncing_metastore.md ## @@ -22,6 +22,61 @@ cd hudi-hive [hudi-hive]$ ./run_sync_tool.sh --help ``` +## Hive Sync Configuration

[GitHub] [hudi] XuQianJin-Stars removed a comment on issue #4160: [SUPPORT] The query results of the Hive and Spark columns are different

2022-01-20 Thread GitBox
XuQianJin-Stars removed a comment on issue #4160: URL: https://github.com/apache/hudi/issues/4160#issuecomment-1016484907 hi @mincwang You are using spark2's sql query, right? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [hudi] hudi-bot commented on pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4649: URL: https://github.com/apache/hudi/pull/4649#issuecomment-1017272177 ## CI report: * b9ae619a0beadc105fcec9466f5c29b97ff3af84 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] XuQianJin-Stars commented on issue #4160: [SUPPORT] The query results of the Hive and Spark columns are different

2022-01-20 Thread GitBox
XuQianJin-Stars commented on issue #4160: URL: https://github.com/apache/hudi/issues/4160#issuecomment-1017272577 hi @mincwang I put a pr for fix this. https://github.com/apache/hudi/pull/4649 -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] hudi-bot removed a comment on pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4649: URL: https://github.com/apache/hudi/pull/4649#issuecomment-1017272177 ## CI report: * b9ae619a0beadc105fcec9466f5c29b97ff3af84 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4649: URL: https://github.com/apache/hudi/pull/4649#issuecomment-1017274881 ## CI report: * b9ae619a0beadc105fcec9466f5c29b97ff3af84 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1017280019 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eefba0 UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1017233954 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eef

[GitHub] [hudi] hudi-bot commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017280671 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 1c72a58d6f34317ac4bf9ac89e0c4d3a8cb467c6 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017239081 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 1c72a58d6f34317ac4bf9ac89e0c4d3a8cb467c6 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot removed a comment on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017241792 ## CI report: * 6e9b2bfa50f349bc68e32f890a20df2da4b9f708 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4647: URL: https://github.com/apache/hudi/pull/4647#issuecomment-1017293892 ## CI report: * f364743c4f99d1c36128efdb7029b39b8747ca70 UNKNOWN * 77c982f705d0a676fdc9b2072233214de351d708 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] YannByron commented on pull request #4565: [HUDI-3215] Solve UT for Spark 3.2

2022-01-20 Thread GitBox
YannByron commented on pull request #4565: URL: https://github.com/apache/hudi/pull/4565#issuecomment-1017316988 @xushiyan very appreciate for your explanation. I'll restore the origin logic. -- This is an automated message from the Apache Git Service. To respond to the message, please l

[GitHub] [hudi] h7kanna opened a new pull request #4650: Minor - Added log to debug checkpoint resumption when set to 0

2022-01-20 Thread GitBox
h7kanna opened a new pull request #4650: URL: https://github.com/apache/hudi/pull/4650 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose

[GitHub] [hudi] hudi-bot commented on pull request #4650: Minor - Added log to debug checkpoint resumption when set to 0

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4650: URL: https://github.com/apache/hudi/pull/4650#issuecomment-1017322614 ## CI report: * 85d5332af034c9f3e1a84436a01740fad15cc5e2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4650: Minor - Added log to debug checkpoint resumption when set to 0

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4650: URL: https://github.com/apache/hudi/pull/4650#issuecomment-1017325290 ## CI report: * 85d5332af034c9f3e1a84436a01740fad15cc5e2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4650: Minor - Added log to debug checkpoint resumption when set to 0

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4650: URL: https://github.com/apache/hudi/pull/4650#issuecomment-1017322614 ## CI report: * 85d5332af034c9f3e1a84436a01740fad15cc5e2 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[jira] [Commented] (HUDI-3242) Checkpoint 0 is ignored -Partial parquet file discovery after the first commit

2022-01-20 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479240#comment-17479240 ] Harsha Teja Kanna commented on HUDI-3242: - So what I found from further debugging

[jira] [Comment Edited] (HUDI-3242) Checkpoint 0 is ignored -Partial parquet file discovery after the first commit

2022-01-20 Thread Harsha Teja Kanna (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479240#comment-17479240 ] Harsha Teja Kanna edited comment on HUDI-3242 at 1/20/22, 10:23 AM:

[GitHub] [hudi] codope opened a new pull request #4651: [MINOR] Add a message for presto upgrade

2022-01-20 Thread GitBox
codope opened a new pull request #4651: URL: https://github.com/apache/hudi/pull/4651 ## What is the purpose of the pull request We upgraded Hudi version from 0.5.3 to 0.9.0 in Presto 0.265 but that introduced a breaking dependency change in another presto module. Since then, we hav

[GitHub] [hudi] codope commented on pull request #4651: [MINOR] Add a message for presto upgrade

2022-01-20 Thread GitBox
codope commented on pull request #4651: URL: https://github.com/apache/hudi/pull/4651#issuecomment-1017332050 @kywe665 Can you take a look at this too? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] YannByron commented on pull request #2903: [HUDI-1850][HUDI-3234] Fixing read of a empty table but with failed write

2022-01-20 Thread GitBox
YannByron commented on pull request #2903: URL: https://github.com/apache/hudi/pull/2903#issuecomment-1017332353 @nsivabalan you can merge this https://github.com/nsivabalan/hudi/pull/10 into your current branch, and re-test. >> why can't sql-dml layer intercept empty table and t

[GitHub] [hudi] codope commented on pull request #4628: [HUDI-2521] Add doc for hive sync modes

2022-01-20 Thread GitBox
codope commented on pull request #4628: URL: https://github.com/apache/hudi/pull/4628#issuecomment-1017333029 @kywe665 @nsivabalan Addressed all comments. Can you please take a look again? -- This is an automated message from the Apache Git Service. To respond to the message, please log

[jira] [Updated] (HUDI-3250) Upgrade Presto version in docker setup and integ test

2022-01-20 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3250: -- Status: Patch Available (was: In Progress) > Upgrade Presto version in docker setup and integ test > --

[jira] [Updated] (HUDI-3250) Upgrade Presto version in docker setup and integ test

2022-01-20 Thread Sagar Sumit (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3250?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sagar Sumit updated HUDI-3250: -- Reviewers: Alexey Kudinkin, Ethan Guo > Upgrade Presto version in docker setup and integ test >

[GitHub] [hudi] h7kanna commented on pull request #4650: [MINOR] Added log to debug checkpoint resumption when set to 0

2022-01-20 Thread GitBox
h7kanna commented on pull request #4650: URL: https://github.com/apache/hudi/pull/4650#issuecomment-1017340396 Added log statements to debug https://issues.apache.org/jira/browse/HUDI-3242 -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [hudi] hudi-bot commented on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1017340736 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eefba0 UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1017280019 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eef

[GitHub] [hudi] hudi-bot removed a comment on pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4649: URL: https://github.com/apache/hudi/pull/4649#issuecomment-1017274881 ## CI report: * b9ae619a0beadc105fcec9466f5c29b97ff3af84 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4649: URL: https://github.com/apache/hudi/pull/4649#issuecomment-1017341486 ## CI report: * b9ae619a0beadc105fcec9466f5c29b97ff3af84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] wangxianghu merged pull request #4647: [HUDI-3283] Bootstrap support overwrite existing table

2022-01-20 Thread GitBox
wangxianghu merged pull request #4647: URL: https://github.com/apache/hudi/pull/4647 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[hudi] branch master updated (31b57a2 -> b7a79aa)

2022-01-20 Thread wangxianghu
This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 31b57a2 [HUDI-3236] use fields'comments persisted in catalog to fill in schema (#4587) add b7a79aa [HUDI-3

[jira] [Updated] (HUDI-3283) Bootstrap support overwrite existing table

2022-01-20 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang updated HUDI-3283: --- Status: In Progress (was: Open) > Bootstrap support overwrite existing table > --

[jira] [Resolved] (HUDI-3283) Bootstrap support overwrite existing table

2022-01-20 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang resolved HUDI-3283. > Bootstrap support overwrite existing table > -- > >

[jira] [Commented] (HUDI-3283) Bootstrap support overwrite existing table

2022-01-20 Thread Xianghu Wang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17479251#comment-17479251 ] Xianghu Wang commented on HUDI-3283: Resolved via master : b7a79aa94301a80c396476878fa

[GitHub] [hudi] wangxianghu opened a new pull request #4652: [MINOR] Fix typo in the doc of BULK_INSERT_SORT_MODE

2022-01-20 Thread GitBox
wangxianghu opened a new pull request #4652: URL: https://github.com/apache/hudi/pull/4652 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the pur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017280671 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * 1c72a58d6f34317ac4bf9ac89e0c4d3a8cb467c6 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017386448 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * b6b74ca2553aab849511a37f0efd411fef068285 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #4652: [MINOR] Fix typo in the doc of BULK_INSERT_SORT_MODE

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4652: URL: https://github.com/apache/hudi/pull/4652#issuecomment-1017391378 ## CI report: * ae076c3098c2db9a660a6ecfa71c659851e08c2e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
XuQianJin-Stars commented on pull request #4649: URL: https://github.com/apache/hudi/pull/4649#issuecomment-1017392481 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] hudi-bot commented on pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4649: URL: https://github.com/apache/hudi/pull/4649#issuecomment-1017393783 ## CI report: * b9ae619a0beadc105fcec9466f5c29b97ff3af84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4649: [HUDI-2941] Show _hoodie_operation in spark sql results

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4649: URL: https://github.com/apache/hudi/pull/4649#issuecomment-1017341486 ## CI report: * b9ae619a0beadc105fcec9466f5c29b97ff3af84 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4652: [MINOR] Fix typo in the doc of BULK_INSERT_SORT_MODE

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4652: URL: https://github.com/apache/hudi/pull/4652#issuecomment-1017393829 ## CI report: * ae076c3098c2db9a660a6ecfa71c659851e08c2e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4652: [MINOR] Fix typo in the doc of BULK_INSERT_SORT_MODE

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4652: URL: https://github.com/apache/hudi/pull/4652#issuecomment-1017391378 ## CI report: * ae076c3098c2db9a660a6ecfa71c659851e08c2e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] dongkelun commented on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
dongkelun commented on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1017396360 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[jira] [Created] (HUDI-3285) Drop unused method SparkBootstrapCommitActionExecutor#handleMetadataBootstrap

2022-01-20 Thread Xianghu Wang (Jira)
Xianghu Wang created HUDI-3285: -- Summary: Drop unused method SparkBootstrapCommitActionExecutor#handleMetadataBootstrap Key: HUDI-3285 URL: https://issues.apache.org/jira/browse/HUDI-3285 Project: Apache

[GitHub] [hudi] wangxianghu opened a new pull request #4653: [HUDI-3285] Drop unused method SparkBootstrapCommitActionExecutor#han…

2022-01-20 Thread GitBox
wangxianghu opened a new pull request #4653: URL: https://github.com/apache/hudi/pull/4653 …dleMetadataBootstrap ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull reques

[GitHub] [hudi] hudi-bot removed a comment on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1017340736 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eef

[GitHub] [hudi] hudi-bot commented on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1017398136 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eefba0 UNKN

[jira] [Updated] (HUDI-3285) Drop unused method SparkBootstrapCommitActionExecutor#handleMetadataBootstrap

2022-01-20 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3285?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3285: - Labels: pull-request-available (was: ) > Drop unused method SparkBootstrapCommitActionExecutor#ha

[GitHub] [hudi] hudi-bot commented on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017400948 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * b6b74ca2553aab849511a37f0efd411fef068285 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017386448 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * b6b74ca2553aab849511a37f0efd411fef068285 Azure: [SUCCESS](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4653: [HUDI-3285] Drop unused method SparkBootstrapCommitActionExecutor#han…

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4653: URL: https://github.com/apache/hudi/pull/4653#issuecomment-1017401092 ## CI report: * 0346174460680b9cf7d23f3b7e6950d364e0a6aa UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4653: [HUDI-3285] Drop unused method SparkBootstrapCommitActionExecutor#han…

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4653: URL: https://github.com/apache/hudi/pull/4653#issuecomment-1017401092 ## CI report: * 0346174460680b9cf7d23f3b7e6950d364e0a6aa UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4653: [HUDI-3285] Drop unused method SparkBootstrapCommitActionExecutor#han…

2022-01-20 Thread GitBox
hudi-bot commented on pull request #4653: URL: https://github.com/apache/hudi/pull/4653#issuecomment-1017403543 ## CI report: * 0346174460680b9cf7d23f3b7e6950d364e0a6aa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4611: [HUDI-3254] Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-01-20 Thread GitBox
hudi-bot removed a comment on pull request #4611: URL: https://github.com/apache/hudi/pull/4611#issuecomment-1017400948 ## CI report: * 5feee50ea8accfc643e1d9fd607e9e605cd97a40 UNKNOWN * b6b74ca2553aab849511a37f0efd411fef068285 Azure: [SUCCESS](https://dev.azure.com/apache-hud

  1   2   3   4   5   >