[jira] [Created] (HUDI-2874) hudi should remove the temp file which create by HoodieMergedLogRecordScanner, when we use hive/presto

2021-11-27 Thread tao meng (Jira)
tao meng created HUDI-2874: -- Summary: hudi should remove the temp file which create by HoodieMergedLogRecordScanner, when we use hive/presto Key: HUDI-2874 URL: https://issues.apache.org/jira/browse/HUDI-2874

[jira] [Assigned] (HUDI-2875) Concurrent call to HoodieMergeHandler cause parquet corruption

2021-11-27 Thread ZiyueGuan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZiyueGuan reassigned HUDI-2875: --- Assignee: ZiyueGuan > Concurrent call to HoodieMergeHandler cause parquet corruption > --

[jira] [Created] (HUDI-2875) Concurrent call to HoodieMergeHandler cause parquet corruption

2021-11-27 Thread ZiyueGuan (Jira)
ZiyueGuan created HUDI-2875: --- Summary: Concurrent call to HoodieMergeHandler cause parquet corruption Key: HUDI-2875 URL: https://issues.apache.org/jira/browse/HUDI-2875 Project: Apache Hudi Issue

[jira] [Created] (HUDI-2876) hudi should remove the temp file which create by HoodieMergedLogRecordScanner, when we use presto

2021-11-27 Thread tao meng (Jira)
tao meng created HUDI-2876: -- Summary: hudi should remove the temp file which create by HoodieMergedLogRecordScanner, when we use presto Key: HUDI-2876 URL: https://issues.apache.org/jira/browse/HUDI-2876 Pro

[GitHub] [hudi] xiarixiaoyao opened a new pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

2021-11-27 Thread GitBox
xiarixiaoyao opened a new pull request #4139: URL: https://github.com/apache/hudi/pull/4139 …eated by HoodieMergedLogRecordSanner when the query finished. ## *Tips* RealtimeCompactedRecordReader should close deltaRecordMap when the query finished to clear tmp file。 now HoodieM

[jira] [Updated] (HUDI-2876) hudi should remove the temp file which create by HoodieMergedLogRecordScanner, when we use presto

2021-11-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2876: - Labels: pull-request-available (was: ) > hudi should remove the temp file which create by > Hood

[GitHub] [hudi] xiarixiaoyao commented on pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

2021-11-27 Thread GitBox
xiarixiaoyao commented on pull request #4139: URL: https://github.com/apache/hudi/pull/4139#issuecomment-980527764 @nsivabalan @codope could you pls help me review those code. This problem caused our production environment /tmp directory disk to overflow -- This is an automated me

[GitHub] [hudi] xiarixiaoyao edited a comment on pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

2021-11-27 Thread GitBox
xiarixiaoyao edited a comment on pull request #4139: URL: https://github.com/apache/hudi/pull/4139#issuecomment-980527764 @nsivabalan @codope @leesf could you pls help me review those code. This problem caused our production environment /tmp directory disk to overflow -- This is a

[GitHub] [hudi] hudi-bot commented on pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4139: URL: https://github.com/apache/hudi/pull/4139#issuecomment-980527972 ## CI report: * 5f56dde0dcd8dad8e2fb7c6bd367d36be636dfe5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4139: URL: https://github.com/apache/hudi/pull/4139#issuecomment-980527972 ## CI report: * 5f56dde0dcd8dad8e2fb7c6bd367d36be636dfe5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4139: URL: https://github.com/apache/hudi/pull/4139#issuecomment-980528277 ## CI report: * 5f56dde0dcd8dad8e2fb7c6bd367d36be636dfe5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[hudi] branch release-0.10.0 created (now fdddb2f)

2021-11-27 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git. at fdddb2f Create release branch for version 0.10.0. This branch includes the following new commits: ne

[hudi] branch master updated: Moving to 0.11.0-SNAPSHOT on master branch.

2021-11-27 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new a1d0ff4 Moving to 0.11.0-SNAPSHOT on master br

[hudi] 01/01: Create release branch for version 0.10.0.

2021-11-27 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch release-0.10.0 in repository https://gitbox.apache.org/repos/asf/hudi.git commit fdddb2f23428cac491f1c774f2c75f85ad6bd9d6 Author: yuzhao.cyz AuthorDate: Sat Nov 27 17:22:39 2021 +0800 Cre

[GitHub] [hudi] hudi-bot commented on pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4139: URL: https://github.com/apache/hudi/pull/4139#issuecomment-980534081 ## CI report: * 5f56dde0dcd8dad8e2fb7c6bd367d36be636dfe5 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4139: [HUDI-2876] for hive/presto hudi should remove the temp file which cr…

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4139: URL: https://github.com/apache/hudi/pull/4139#issuecomment-980528277 ## CI report: * 5f56dde0dcd8dad8e2fb7c6bd367d36be636dfe5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[hudi] annotated tag release--rc updated (fdddb2f -> d78d35b)

2021-11-27 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to annotated tag release--rc in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release--rc was modified! *** from fdddb2f (commit) to d78d35b (tag) tagging fdddb

[hudi] annotated tag release-0.10.0-rc1 updated (fdddb2f -> 9016539)

2021-11-27 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to annotated tag release-0.10.0-rc1 in repository https://gitbox.apache.org/repos/asf/hudi.git. *** WARNING: tag release-0.10.0-rc1 was modified! *** from fdddb2f (commit) to 9016539 (tag)

[GitHub] [hudi] vortual opened a new pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
vortual opened a new pull request #4140: URL: https://github.com/apache/hudi/pull/4140 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpose

[GitHub] [hudi] hudi-bot commented on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980538606 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980538606 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980538844 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot commented on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980544766 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980538844 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

svn commit: r51110 - in /dev/hudi/hudi-0.10.0-rc1: ./ hudi-0.10.0-rc1.src.tgz hudi-0.10.0-rc1.src.tgz.asc hudi-0.10.0-rc1.src.tgz.sha512

2021-11-27 Thread danny0405
Author: danny0405 Date: Sat Nov 27 12:35:19 2021 New Revision: 51110 Log: Add hudi-0.10.0-rc1 source release Added: dev/hudi/hudi-0.10.0-rc1/ dev/hudi/hudi-0.10.0-rc1/hudi-0.10.0-rc1.src.tgz (with props) dev/hudi/hudi-0.10.0-rc1/hudi-0.10.0-rc1.src.tgz.asc dev/hudi/hudi-0.10.0-r

[GitHub] [hudi] vortual commented on issue #3919: [SUPPORT]Error obtaining data file/log file grouping when spark query MOR hudi table

2021-11-27 Thread GitBox
vortual commented on issue #3919: URL: https://github.com/apache/hudi/issues/3919#issuecomment-980631682 I think #3203 solved my question -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [hudi] vortual edited a comment on issue #3919: [SUPPORT]Error obtaining data file/log file grouping when spark query MOR hudi table

2021-11-27 Thread GitBox
vortual edited a comment on issue #3919: URL: https://github.com/apache/hudi/issues/3919#issuecomment-980631682 I think #3203 has been resolved this issue -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

[jira] [Updated] (HUDI-2100) [UMBRELLA] Support Space curve for hudi

2021-11-27 Thread leesf (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2100?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] leesf updated HUDI-2100: Fix Version/s: 0.11.0 > [UMBRELLA] Support Space curve for hudi > --- > >

[GitHub] [hudi] hudi-bot removed a comment on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980544766 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980784175 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` r

[GitHub] [hudi] xushiyan closed issue #4103: [SUPPORT] StreamerUtil sets hoodie.parquet.page.size twice

2021-11-27 Thread GitBox
xushiyan closed issue #4103: URL: https://github.com/apache/hudi/issues/4103 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@h

[GitHub] [hudi] hudi-bot removed a comment on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980784175 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980784518 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot commented on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980786320 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 7870ac806a91600cf17421bf437dc999b419ff65 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980511858 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 7870ac806a91600cf17421bf437dc999b419ff65 Azure: [SUCCESS](https://dev.azure.com/apache-hudi

[GitHub] [hudi] xushiyan commented on issue #4122: [SUPPORT] UPDATE command doest not working on Spark SQL

2021-11-27 Thread GitBox
xushiyan commented on issue #4122: URL: https://github.com/apache/hudi/issues/4122#issuecomment-980786569 support for spark 3.1.2 was added in 0.10. @jasondavindev do you want to give the [RC](https://github.com/apache/hudi/tree/release-0.10.0) a try? -- This is an automated message from

[GitHub] [hudi] hudi-bot removed a comment on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980786320 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 7870ac806a91600cf17421bf437dc999b419ff65 Azure: [SUCCESS](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980789708 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 7870ac806a91600cf17421bf437dc999b419ff65 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] hudi-bot removed a comment on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980784518 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4140: [MINOR] fix typo

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4140: URL: https://github.com/apache/hudi/pull/4140#issuecomment-980790307 ## CI report: * 1383e21dfb36aeded03881ff240d5e735fc9979b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] xushiyan commented on issue #4102: [SUPPORT] What should I do if I want to delete data in certain partitions?

2021-11-27 Thread GitBox
xushiyan commented on issue #4102: URL: https://github.com/apache/hudi/issues/4102#issuecomment-980790358 @kenny-shopback Hudi write client also supports partition delete there is an example org.apache.hudi.examples.spark.HoodieWriteClientExample -- This is an automated message from

[jira] [Resolved] (HUDI-2759) extract HoodieCatalogTable as a bridge between spark catalog table and hoodie table

2021-11-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-2759. -- > extract HoodieCatalogTable as a bridge between spark catalog table and hoodie > table > -

[jira] [Updated] (HUDI-2759) extract HoodieCatalogTable as a bridge between spark catalog table and hoodie table

2021-11-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2759: - Fix Version/s: 0.10.0 (was: 0.11.0) > extract HoodieCatalogTable as a bridge betwee

[jira] [Closed] (HUDI-2759) extract HoodieCatalogTable as a bridge between spark catalog table and hoodie table

2021-11-27 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2759?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2759. > extract HoodieCatalogTable as a bridge between spark catalog table and hoodie > table > -

[jira] [Closed] (HUDI-2725) Add precommit validators doc

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2725. - > Add precommit validators doc > > > Key: HUDI-2725 >

[jira] [Closed] (HUDI-2805) Add HoodieCleaner Docs

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2805. - > Add HoodieCleaner Docs > -- > > Key: HUDI-2805 > URL: ht

[jira] [Closed] (HUDI-2726) Document snapshot exporter utility

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2726. - > Document snapshot exporter utility > -- > > Key: HUDI-2726 >

[jira] [Closed] (HUDI-2629) Improve Overview Page

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2629. - > Improve Overview Page > - > > Key: HUDI-2629 > URL: http

[jira] [Closed] (HUDI-2826) Docs for Indexes

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2826. - > Docs for Indexes > > > Key: HUDI-2826 > URL: https://issues

[jira] [Closed] (HUDI-2822) Docs for File Sizing

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2822. - > Docs for File Sizing > > > Key: HUDI-2822 > URL: https:

[jira] [Closed] (HUDI-2830) Docs for commit notifications

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2830. - > Docs for commit notifications > - > > Key: HUDI-2830 >

[jira] [Closed] (HUDI-2846) Docs for file layout concept

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2846. - > Docs for file layout concept > > > Key: HUDI-2846 >

[jira] [Closed] (HUDI-2806) Add docs for HoodieTransformer utilities

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2806?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2806. - > Add docs for HoodieTransformer utilities > > > Key:

[jira] [Updated] (HUDI-2828) Add bring your own key generator docs

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2828?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2828: -- Priority: Minor (was: Major) > Add bring your own key generator docs >

[jira] [Updated] (HUDI-2824) Improve DeltaStreamer Docs

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2824: -- Priority: Minor (was: Major) > Improve DeltaStreamer Docs > -- > >

[jira] [Updated] (HUDI-2827) Docs for schema provider

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2827?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2827: -- Priority: Minor (was: Major) > Docs for schema provider > > >

[jira] [Closed] (HUDI-2727) Add prometheus reporter docs

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2727. - > Add prometheus reporter docs > > > Key: HUDI-2727 >

[jira] [Closed] (HUDI-2728) Clean up concepts and consolidate from cwiki

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2728?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller closed HUDI-2728. - > Clean up concepts and consolidate from cwiki > > >

[jira] [Updated] (HUDI-2870) Update deprecated fields in docs

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2870: -- Priority: Minor (was: Major) > Update deprecated fields in docs > > >

[jira] [Updated] (HUDI-2823) Docs for checkpointing

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2823?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2823: -- Priority: Minor (was: Major) > Docs for checkpointing > -- > > Key:

[jira] [Updated] (HUDI-2829) Write PublicAPI doc that discusses extending the apis

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2829?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2829: -- Priority: Minor (was: Major) > Write PublicAPI doc that discusses extending the apis >

[jira] [Updated] (HUDI-2821) Docs for Hudi Metadata

2021-11-27 Thread Kyle Weller (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2821?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kyle Weller updated HUDI-2821: -- Priority: Minor (was: Major) > Docs for Hudi Metadata > -- > > Key:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980789708 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * 7870ac806a91600cf17421bf437dc999b419ff65 Azure: [SUCCESS](https://dev.azure.com/apache-hudi

[GitHub] [hudi] hudi-bot commented on pull request #4136: [DO_NOT_MERGE] [WIP] testing flaky tests in metadata

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4136: URL: https://github.com/apache/hudi/pull/4136#issuecomment-980795705 ## CI report: * 0fbb5415fde598c686f4d737fc79c3f4ac54ad3f UNKNOWN * d7417f6d12fd1977a22a3e7b721da8a2c71a7dad Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/

[GitHub] [hudi] nsivabalan commented on a change in pull request #4107: [HUDI-2825] - Docs for markers

2021-11-27 Thread GitBox
nsivabalan commented on a change in pull request #4107: URL: https://github.com/apache/hudi/pull/4107#discussion_r757817678 ## File path: website/docs/configurations.md ## @@ -1151,8 +1151,8 @@ Configurations that control write behavior on Hudi tables. These can be directly -

[GitHub] [hudi] vortual closed issue #3919: [SUPPORT]Error obtaining data file/log file grouping when spark query MOR hudi table

2021-11-27 Thread GitBox
vortual closed issue #3919: URL: https://github.com/apache/hudi/issues/3919 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hu

[GitHub] [hudi] YannByron commented on a change in pull request #3882: [HUDI-2642] Add support ignoring case in update sql operation

2021-11-27 Thread GitBox
YannByron commented on a change in pull request #3882: URL: https://github.com/apache/hudi/pull/3882#discussion_r757834193 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/UpdateHoodieTableCommand.scala ## @@ -51,7 +51,10 @@ case

[GitHub] [hudi] lsyldliu opened a new pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
lsyldliu opened a new pull request #4141: URL: https://github.com/apache/hudi/pull/4141 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpos

[GitHub] [hudi] YannByron commented on pull request #3882: [HUDI-2642] Add support ignoring case in update sql operation

2021-11-27 Thread GitBox
YannByron commented on pull request #3882: URL: https://github.com/apache/hudi/pull/3882#issuecomment-980825721 @dongkelun LGTM, just left one minor comment. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [hudi] hudi-bot commented on pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4141: URL: https://github.com/apache/hudi/pull/4141#issuecomment-980825922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscrib

[GitHub] [hudi] hudi-bot removed a comment on pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4141: URL: https://github.com/apache/hudi/pull/4141#issuecomment-980825922 ## CI report: * 4f99b623ea421cb81e5bffd17242dc09ff6281b0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[jira] [Created] (HUDI-2877) Support flink catalog to help user use flink table conveniently

2021-11-27 Thread dalongliu (Jira)
dalongliu created HUDI-2877: --- Summary: Support flink catalog to help user use flink table conveniently Key: HUDI-2877 URL: https://issues.apache.org/jira/browse/HUDI-2877 Project: Apache Hudi Issu

[jira] [Commented] (HUDI-2877) Support flink catalog to help user use flink table conveniently

2021-11-27 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17449951#comment-17449951 ] dalongliu commented on HUDI-2877: - cc [~danny0405]  > Support flink catalog to help user

[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-975016697 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * 621ac47b3c6bc2726bd3b999f4d711f600bf8d

[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-27 Thread GitBox
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-980828418 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * 621ac47b3c6bc2726bd3b999f4d711f600bf8d60 Azure

[GitHub] [hudi] hudi-bot commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-27 Thread GitBox
hudi-bot commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-980829444 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * 31dfecca04813f6dd3a1780f832bf2c428106ec6 Azure

[GitHub] [hudi] hudi-bot removed a comment on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-980828418 ## CI report: * d022aa7a5bd94492c7c3e96dc5b1288268520087 UNKNOWN * ba6a7000bdde9fa7a786a93912aa9cda05e00d21 UNKNOWN * 621ac47b3c6bc2726bd3b999f4d711f600bf8d

[jira] [Updated] (HUDI-2877) Support flink catalog to help user use flink table conveniently

2021-11-27 Thread dalongliu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] dalongliu updated HUDI-2877: Description: As the title says, we should support flink catalog which can create database/table in flink, th

[GitHub] [hudi] hudi-bot removed a comment on pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4141: URL: https://github.com/apache/hudi/pull/4141#issuecomment-980826099 ## CI report: * 4f99b623ea421cb81e5bffd17242dc09ff6281b0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4141: URL: https://github.com/apache/hudi/pull/4141#issuecomment-980834456 ## CI report: * 4f99b623ea421cb81e5bffd17242dc09ff6281b0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4141: URL: https://github.com/apache/hudi/pull/4141#issuecomment-980834456 ## CI report: * 4f99b623ea421cb81e5bffd17242dc09ff6281b0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4141: URL: https://github.com/apache/hudi/pull/4141#issuecomment-980834935 ## CI report: * 4f99b623ea421cb81e5bffd17242dc09ff6281b0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] hudi-bot removed a comment on pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
hudi-bot removed a comment on pull request #4141: URL: https://github.com/apache/hudi/pull/4141#issuecomment-980834935 ## CI report: * 4f99b623ea421cb81e5bffd17242dc09ff6281b0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4141: [HUDI-2815] Support partial update for streaming change logs

2021-11-27 Thread GitBox
hudi-bot commented on pull request #4141: URL: https://github.com/apache/hudi/pull/4141#issuecomment-980838690 ## CI report: * eac46ffdf438aa73330768656031bc251aa6003d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?bu

[GitHub] [hudi] dongkelun commented on a change in pull request #3882: [HUDI-2642] Add support ignoring case in update sql operation

2021-11-27 Thread GitBox
dongkelun commented on a change in pull request #3882: URL: https://github.com/apache/hudi/pull/3882#discussion_r757842535 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/spark/sql/hudi/command/UpdateHoodieTableCommand.scala ## @@ -51,7 +51,10 @@ case