[GitHub] [hudi] hudi-bot removed a comment on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1009673555 ## CI report: * ddc3af0c32bafef6b10c32c43132df32a5f7d83c UNKNOWN * e1ba726105dfa7ae07d802546c71a0cf1ad8b172 UNKNOWN * 306e7d462959e0249e230f60c2e9ea6602342

[GitHub] [hudi] hudi-bot commented on pull request #4514: [HUDI-3172] Refactor hudi existing modules to make more code reuse in V2 Implementation

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4514: URL: https://github.com/apache/hudi/pull/4514#issuecomment-1010744877 ## CI report: * ddc3af0c32bafef6b10c32c43132df32a5f7d83c UNKNOWN * e1ba726105dfa7ae07d802546c71a0cf1ad8b172 UNKNOWN * 306e7d462959e0249e230f60c2e9ea6602342e08 UNKN

[GitHub] [hudi] hudi-bot commented on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010742987 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010740994 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] watermelon12138 commented on pull request #3929: [HUDI-1881] Make multi table delta streamer to use thread pool for table sync asynchronously.

2022-01-11 Thread GitBox
watermelon12138 commented on pull request #3929: URL: https://github.com/apache/hudi/pull/3929#issuecomment-1010741433 > @watermelon12138 thread pool is being used since we intend to make the ingestion run in parallel for all the configured tables. I hope that answers your question.

[GitHub] [hudi] hudi-bot commented on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010740994 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010713114 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-1010734809 ## CI report: * 74699cc12fa641613dfbce4f05f7cc6b08ed631f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-1010736728 ## CI report: * 74699cc12fa641613dfbce4f05f7cc6b08ed631f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-1010734809 ## CI report: * 74699cc12fa641613dfbce4f05f7cc6b08ed631f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-1010654985 ## CI report: * 74699cc12fa641613dfbce4f05f7cc6b08ed631f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] YannByron commented on a change in pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-11 Thread GitBox
YannByron commented on a change in pull request #4180: URL: https://github.com/apache/hudi/pull/4180#discussion_r782779899 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java ## @@ -114,7 +113,7 @@ private MessageType getTableParquetSc

[jira] [Created] (HUDI-3230) Add streaming read for flink document

2022-01-11 Thread Danny Chen (Jira)
Danny Chen created HUDI-3230: Summary: Add streaming read for flink document Key: HUDI-3230 URL: https://issues.apache.org/jira/browse/HUDI-3230 Project: Apache Hudi Issue Type: Task Co

[GitHub] [hudi] hudi-bot commented on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010728262 ## CI report: * 5d62bd2fa92c39eba896a3f228806d51f83c4942 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010724325 ## CI report: * 5d62bd2fa92c39eba896a3f228806d51f83c4942 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010724325 ## CI report: * 5d62bd2fa92c39eba896a3f228806d51f83c4942 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010722141 ## CI report: * b4202962c8519b921ae11ba0a5481ee0887332f1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1010723861 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eefba0 UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4083: [HUDI-2837] Add support for using database name in incremental query

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4083: URL: https://github.com/apache/hudi/pull/4083#issuecomment-1008903587 ## CI report: * 00221c82e8b1693280fd72625eafcd503d54323c UNKNOWN * 46053bb143d1fd1274ac466197cc9361708e738b UNKNOWN * 2722bfcfd29a95f27338c1c8b026185472eef

[GitHub] [hudi] hudi-bot removed a comment on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010658011 ## CI report: * b4202962c8519b921ae11ba0a5481ee0887332f1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010722141 ## CI report: * b4202962c8519b921ae11ba0a5481ee0887332f1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3151) Docs for Spark SQL type support

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3151: - Reviewers: Raymond Xu > Docs for Spark SQL type support > --- > >

[jira] [Assigned] (HUDI-3151) Docs for Spark SQL type support

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3151?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3151: Assignee: Yann Byron > Docs for Spark SQL type support > --- > >

[hudi] branch master updated (017ddbb -> 9fe28e5)

2022-01-11 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 017ddbb [MINOR] Fix typos (#4567) add 9fe28e5 [HUDI-3045] New clustering regex match config to choose partitions

[GitHub] [hudi] yihua merged pull request #4346: [HUDI-3045] New clustering regex match config to choose partitions when building clustering plan

2022-01-11 Thread GitBox
yihua merged pull request #4346: URL: https://github.com/apache/hudi/pull/4346 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[jira] [Created] (HUDI-3229) Make file index creation in HoodieTableSource lazy

2022-01-11 Thread Danny Chen (Jira)
Danny Chen created HUDI-3229: Summary: Make file index creation in HoodieTableSource lazy Key: HUDI-3229 URL: https://issues.apache.org/jira/browse/HUDI-3229 Project: Apache Hudi Issue Type: Impr

[GitHub] [hudi] danny0405 commented on a change in pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
danny0405 commented on a change in pull request #4561: URL: https://github.com/apache/hudi/pull/4561#discussion_r782767906 ## File path: hudi-flink/src/main/java/org/apache/hudi/sink/StreamWriteOperatorCoordinator.java ## @@ -380,8 +390,8 @@ private void handleEndInputEvent(Wr

[jira] [Assigned] (HUDI-3228) DataSource V2 review + discussions

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3228: Assignee: Raymond Xu > DataSource V2 review + discussions > -- > >

[hudi] branch master updated (4b01119 -> 017ddbb)

2022-01-11 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 4b01119 [HUDI-3184] hudi-flink support timestamp-micros (#4548) add 017ddbb [MINOR] Fix typos (#4567) No new rev

[GitHub] [hudi] yihua merged pull request #4567: [MINOR] Fix typos

2022-01-11 Thread GitBox
yihua merged pull request #4567: URL: https://github.com/apache/hudi/pull/4567 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[jira] [Updated] (HUDI-3228) DataSource V2 review + discussions

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3228: - Story Points: 1.5 (was: 1) > DataSource V2 review + discussions > -- > >

[jira] [Updated] (HUDI-3228) DataSource V2 review + discussions

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3228: - Sprint: Cont' improve - 2021/01/10 > DataSource V2 review + discussions > ---

[jira] [Updated] (HUDI-3228) DataSource V2 review + discussions

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3228?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3228: - Priority: Critical (was: Major) > DataSource V2 review + discussions > --

[GitHub] [hudi] hudi-bot commented on pull request #4569: [HUDI-3225] Claim RFC-45 for async metadata indexing

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4569: URL: https://github.com/apache/hudi/pull/4569#issuecomment-1010713141 ## CI report: * fc437f3c4f72f7d02078b3d887578d7b010cca01 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4569: [HUDI-3225] Claim RFC-45 for async metadata indexing

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4569: URL: https://github.com/apache/hudi/pull/4569#issuecomment-1010710986 ## CI report: * fc437f3c4f72f7d02078b3d887578d7b010cca01 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[jira] [Created] (HUDI-3228) DataSource V2 review + discussions

2022-01-11 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3228: Summary: DataSource V2 review + discussions Key: HUDI-3228 URL: https://issues.apache.org/jira/browse/HUDI-3228 Project: Apache Hudi Issue Type: Task Rep

[GitHub] [hudi] hudi-bot removed a comment on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010650785 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010713114 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4569: [HUDI-3225] Claim RFC-45 for async metadata indexing

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4569: URL: https://github.com/apache/hudi/pull/4569#issuecomment-1010710986 ## CI report: * fc437f3c4f72f7d02078b3d887578d7b010cca01 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #4569: [HUDI-3225] Claim RFC-45 for async metadata indexing

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4569: URL: https://github.com/apache/hudi/pull/4569#issuecomment-1010686865 ## CI report: * fc437f3c4f72f7d02078b3d887578d7b010cca01 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Updated] (HUDI-2370) Supports data encryption

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2370: - Story Points: 2 > Supports data encryption > > > Key: HUDI-2370 >

[GitHub] [hudi] pratyakshsharma commented on pull request #3929: [HUDI-1881] Make multi table delta streamer to use thread pool for table sync asynchronously.

2022-01-11 Thread GitBox
pratyakshsharma commented on pull request #3929: URL: https://github.com/apache/hudi/pull/3929#issuecomment-1010709857 @watermelon12138 thread pool is being used since we intend to make the ingestion run in parallel for all the configured tables. I hope that answers your question. --

[GitHub] [hudi] hudi-bot removed a comment on pull request #4570: [HUDI-3058] Simplify Precommit file system view

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4570: URL: https://github.com/apache/hudi/pull/4570#issuecomment-1010646023 ## CI report: * 5ba7c21ea02d72999ef3d62e8b53a1ff3c0448aa Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Updated] (HUDI-2968) Support Delete/Update using non-pk fields

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2968: - Story Points: 0.25 > Support Delete/Update using non-pk fields > -

[GitHub] [hudi] hudi-bot commented on pull request #4570: [HUDI-3058] Simplify Precommit file system view

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4570: URL: https://github.com/apache/hudi/pull/4570#issuecomment-1010708772 ## CI report: * 5ba7c21ea02d72999ef3d62e8b53a1ff3c0448aa Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3223) Triage GitHub issues (Siva)

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3223?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3223: - Reporter: sivabalan narayanan (was: Raymond Xu) > Triage GitHub issues (Siva) > -

[jira] [Updated] (HUDI-2929) Spark Datasource read issue in Spark 3.2.0

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2929: - Story Points: 0.25 (was: 0.5) > Spark Datasource read issue in Spark 3.2.0 >

[jira] [Assigned] (HUDI-3226) Improve community on-call support tracker

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3226: Assignee: Raymond Xu > Improve community on-call support tracker >

[jira] [Updated] (HUDI-2987) event time not recorded in commit metadata when insert or bulk insert

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2987: - Sprint: Cont' improve - 2021/01/04 > event time not recorded in commit metadata when insert or bulk inser

[jira] [Updated] (HUDI-2987) event time not recorded in commit metadata when insert or bulk insert

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2987?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2987: - Story Points: 1 > event time not recorded in commit metadata when insert or bulk insert >

[jira] [Updated] (HUDI-3227) Setup continuous improvement grooming process

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3227: - Story Points: 0.5 > Setup continuous improvement grooming process > --

[jira] [Assigned] (HUDI-3227) Setup continuous improvement grooming process

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3227: Assignee: Raymond Xu > Setup continuous improvement grooming process >

[jira] [Created] (HUDI-3227) Design continuous improvement sprint process

2022-01-11 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3227: Summary: Design continuous improvement sprint process Key: HUDI-3227 URL: https://issues.apache.org/jira/browse/HUDI-3227 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-3227) Setup continuous improvement grooming process

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3227: - Summary: Setup continuous improvement grooming process (was: Design continuous improvement sprint process

[jira] [Updated] (HUDI-3226) Improve community on-call support tracker

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3226?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3226: - Story Points: 0.5 > Improve community on-call support tracker > -

[jira] [Created] (HUDI-3226) Improve community on-call support tracker

2022-01-11 Thread Raymond Xu (Jira)
Raymond Xu created HUDI-3226: Summary: Improve community on-call support tracker Key: HUDI-3226 URL: https://issues.apache.org/jira/browse/HUDI-3226 Project: Apache Hudi Issue Type: Task

[jira] [Updated] (HUDI-3021) HoodieAppendHandle#appendDataAndDeleteBlocks writer object occurred NPE

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3021: - Reviewers: sivabalan narayanan > HoodieAppendHandle#appendDataAndDeleteBlocks writer object occurred NPE >

[jira] [Updated] (HUDI-3222) Triage GitHub issues (raymond)

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3222?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3222: - Story Points: 3 (was: 2) > Triage GitHub issues (raymond) > -- > >

[jira] [Updated] (HUDI-2988) Add Event time configuration: latency adjustment

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2988: - Priority: Major (was: Blocker) > Add Event time configuration: latency adjustment > -

[jira] [Assigned] (HUDI-1079) Cannot upsert on schema with Array of Record with single field

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-1079: Assignee: Raymond Xu (was: sivabalan narayanan) > Cannot upsert on schema with Array of Record wit

[jira] [Updated] (HUDI-1079) Cannot upsert on schema with Array of Record with single field

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1079: - Story Points: 0.5 > Cannot upsert on schema with Array of Record with single field > -

[jira] [Updated] (HUDI-1079) Cannot upsert on schema with Array of Record with single field

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1079: - Sprint: Cont' improve - 2021/01/04 > Cannot upsert on schema with Array of Record with single field > ---

[GitHub] [hudi] agrawaldevesh commented on pull request #4563: [HUDI-3211][RFC-44] Add RFC for Hudi Connector for Presto

2022-01-11 Thread GitBox
agrawaldevesh commented on pull request #4563: URL: https://github.com/apache/hudi/pull/4563#issuecomment-1010689961 I just did a cursory glance here and I am not very familiar. But can you talk a bit more about how the flow will work for a regular Hive table to read Hudi tables work in th

[jira] [Updated] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2323: - Story Points: 0.25 > Upsert of Case Class with single field causes SchemaParseException >

[jira] [Updated] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2323: - Sprint: Cont' improve - 2021/01/04 > Upsert of Case Class with single field causes SchemaParseException >

[jira] [Assigned] (HUDI-2323) Upsert of Case Class with single field causes SchemaParseException

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-2323: Assignee: Raymond Xu (was: sivabalan narayanan) > Upsert of Case Class with single field causes Sc

[GitHub] [hudi] hudi-bot commented on pull request #4569: [HUDI-3225] Claim RFC-45 for async metadata indexing

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4569: URL: https://github.com/apache/hudi/pull/4569#issuecomment-1010686865 ## CI report: * fc437f3c4f72f7d02078b3d887578d7b010cca01 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4569: [HUDI-3225] Claim RFC-45 for async metadata indexing

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4569: URL: https://github.com/apache/hudi/pull/4569#issuecomment-1010632155 ## CI report: * fc437f3c4f72f7d02078b3d887578d7b010cca01 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4564: [HUDI-3007] Fix issues in HoodieRepairTool

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4564: URL: https://github.com/apache/hudi/pull/4564#issuecomment-1010683334 ## CI report: * 92bcb6959aca76c9945f36956c0514e1f1440659 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4564: [HUDI-3007] Fix issues in HoodieRepairTool

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4564: URL: https://github.com/apache/hudi/pull/4564#issuecomment-1010685205 ## CI report: * 92bcb6959aca76c9945f36956c0514e1f1440659 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4564: [HUDI-3007] Fix issues in HoodieRepairTool

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4564: URL: https://github.com/apache/hudi/pull/4564#issuecomment-1010628323 ## CI report: * 92bcb6959aca76c9945f36956c0514e1f1440659 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4564: [HUDI-3007] Fix issues in HoodieRepairTool

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4564: URL: https://github.com/apache/hudi/pull/4564#issuecomment-1010683334 ## CI report: * 92bcb6959aca76c9945f36956c0514e1f1440659 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-2899) Fix DataFormatter usages removed in Spark 3.2

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2899: - Story Points: 0 (was: 1) > Fix DataFormatter usages removed in Spark 3.2 > --

[jira] [Updated] (HUDI-2899) Fix DataFormatter usages removed in Spark 3.2

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2899: - Reviewers: Raymond Xu > Fix DataFormatter usages removed in Spark 3.2 > --

[jira] [Updated] (HUDI-2514) Add default hiveTableSerdeProperties for Spark SQL when sync Hive

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2514: - Story Points: 0.25 > Add default hiveTableSerdeProperties for Spark SQL when sync Hive > -

[jira] [Updated] (HUDI-2899) Fix DataFormatter usages removed in Spark 3.2

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2899: - Priority: Major (was: Blocker) > Fix DataFormatter usages removed in Spark 3.2 >

[jira] [Updated] (HUDI-2514) Add default hiveTableSerdeProperties for Spark SQL when sync Hive

2022-01-11 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2514: - Priority: Critical (was: Blocker) > Add default hiveTableSerdeProperties for Spark SQL when sync Hive > -

[GitHub] [hudi] hudi-bot commented on pull request #4531: [HUDI-3191][Stacked on 4520] Rebasing Hive's FileInputFormat onto `AbstractHoodieTableFileIndex`

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4531: URL: https://github.com/apache/hudi/pull/4531#issuecomment-1010679968 ## CI report: * 5dae550ff1a09130201561f3bd9d05970c14813e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4531: [HUDI-3191][Stacked on 4520] Rebasing Hive's FileInputFormat onto `AbstractHoodieTableFileIndex`

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4531: URL: https://github.com/apache/hudi/pull/4531#issuecomment-1010630801 ## CI report: * 5dae550ff1a09130201561f3bd9d05970c14813e Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4300: [HUDI-2785] Add Trino setup in Docker Demo

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4300: URL: https://github.com/apache/hudi/pull/4300#issuecomment-1010676346 ## CI report: * aa03fbdf8ecef97f82ab9acbcf5b227a45b785aa Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4300: [HUDI-2785] Add Trino setup in Docker Demo

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4300: URL: https://github.com/apache/hudi/pull/4300#issuecomment-1010674585 ## CI report: * 3d67017a9d8aeef63220fec9130ce04036dc7a62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4300: [HUDI-2785] Add Trino setup in Docker Demo

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4300: URL: https://github.com/apache/hudi/pull/4300#issuecomment-1010674585 ## CI report: * 3d67017a9d8aeef63220fec9130ce04036dc7a62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4300: [HUDI-2785] Add Trino setup in Docker Demo

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4300: URL: https://github.com/apache/hudi/pull/4300#issuecomment-1010647404 ## CI report: * 3d67017a9d8aeef63220fec9130ce04036dc7a62 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4566: [HUDI-3218] Upgrading avro to 1.10.2

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4566: URL: https://github.com/apache/hudi/pull/4566#issuecomment-1010665129 ## CI report: * 7ddc515ec17aa7de9585bfc30ba638ca18f89ddf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4566: [HUDI-3218] Upgrading avro to 1.10.2

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4566: URL: https://github.com/apache/hudi/pull/4566#issuecomment-1010663662 ## CI report: * 7ddc515ec17aa7de9585bfc30ba638ca18f89ddf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4566: [HUDI-3218] Upgrading avro to 1.10.2

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4566: URL: https://github.com/apache/hudi/pull/4566#issuecomment-1010663662 ## CI report: * 7ddc515ec17aa7de9585bfc30ba638ca18f89ddf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4566: [HUDI-3218] Upgrading avro to 1.10.2

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4566: URL: https://github.com/apache/hudi/pull/4566#issuecomment-1010577929 ## CI report: * 7ddc515ec17aa7de9585bfc30ba638ca18f89ddf Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4567: [MINOR] Fix typos

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4567: URL: https://github.com/apache/hudi/pull/4567#issuecomment-1010658041 ## CI report: * f491067b74d0a16029540b9101ec11caf19bedac Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010656731 ## CI report: * b4202962c8519b921ae11ba0a5481ee0887332f1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4567: [MINOR] Fix typos

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4567: URL: https://github.com/apache/hudi/pull/4567#issuecomment-1010604348 ## CI report: * f491067b74d0a16029540b9101ec11caf19bedac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010658011 ## CI report: * b4202962c8519b921ae11ba0a5481ee0887332f1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1010656731 ## CI report: * b4202962c8519b921ae11ba0a5481ee0887332f1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4561: handleEndInputEvent is executed synchronously

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4561: URL: https://github.com/apache/hudi/pull/4561#issuecomment-1009689236 ## CI report: * b4202962c8519b921ae11ba0a5481ee0887332f1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-1010654985 ## CI report: * 74699cc12fa641613dfbce4f05f7cc6b08ed631f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4180: [HUDI-2903] get table schema from the last commit with data written

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4180: URL: https://github.com/apache/hudi/pull/4180#issuecomment-1010596199 ## CI report: * 9f3823cd34b2f073cc5dd097790ff2762371880b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010650785 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010649247 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot commented on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010649247 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
hudi-bot removed a comment on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010622917 ## CI report: * a42de8afbb24a4d7e5aa821d1a7fc689b6780735 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] YannByron commented on pull request #4568: [HUDI-2968] add UT for update/delete on non-pk condition

2022-01-11 Thread GitBox
YannByron commented on pull request #4568: URL: https://github.com/apache/hudi/pull/4568#issuecomment-1010648831 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

  1   2   3   4   5   >