[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1041209468 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * 6498d01bd48aeda771b67839b8968cf89492e139 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1036897044 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * 6498d01bd48aeda771b67839b8968cf89492e

[GitHub] [hudi] boneanxs closed pull request #4826: [MINOR] Fix build with -Pspark3.1.x

2022-02-15 Thread GitBox
boneanxs closed pull request #4826: URL: https://github.com/apache/hudi/pull/4826 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] hudi-bot commented on pull request #4826: [MINOR] Fix build with -Pspark3.1.x

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4826: URL: https://github.com/apache/hudi/pull/4826#issuecomment-1041202891 ## CI report: * 798926017f501f58dfd8126c38b9e7b8b7be85bf Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4826: [MINOR] Fix build with -Pspark3.1.x

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4826: URL: https://github.com/apache/hudi/pull/4826#issuecomment-1041200938 ## CI report: * 798926017f501f58dfd8126c38b9e7b8b7be85bf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] boneanxs removed a comment on pull request #4826: [MINOR] Fix build with -Pspark3.1.x

2022-02-15 Thread GitBox
boneanxs removed a comment on pull request #4826: URL: https://github.com/apache/hudi/pull/4826#issuecomment-104116 @leesf Hi, could you review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above t

[GitHub] [hudi] hudi-bot commented on pull request #4826: [MINOR] Fix build with -Pspark3.1.x

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4826: URL: https://github.com/apache/hudi/pull/4826#issuecomment-1041200938 ## CI report: * 798926017f501f58dfd8126c38b9e7b8b7be85bf UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] boneanxs commented on pull request #4826: [MINOR] Fix build with -Pspark3.1.x

2022-02-15 Thread GitBox
boneanxs commented on pull request #4826: URL: https://github.com/apache/hudi/pull/4826#issuecomment-104116 @leesf Hi, could you review this? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1041199224 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1041197519 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] boneanxs opened a new pull request #4826: [Minor] Fix build with -Pspark3.1.x

2022-02-15 Thread GitBox
boneanxs opened a new pull request #4826: URL: https://github.com/apache/hudi/pull/4826 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpos

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1041197519 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1040042760 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] waywtdcc opened a new issue #4825: [SUPPORT] flink hudi some class not found

2022-02-15 Thread GitBox
waywtdcc opened a new issue #4825: URL: https://github.com/apache/hudi/issues/4825 Use Maven to introduce the Flink Hudi bundle package, and then run the task. report errors org.apache.hudi hudi-utilities-bundle_2.11 ${hudi.version}

[GitHub] [hudi] megha2411 commented on issue #4814: [SUPPORT] NPE thrown while archiving data table with 0.10.1

2022-02-15 Thread GitBox
megha2411 commented on issue #4814: URL: https://github.com/apache/hudi/issues/4814#issuecomment-1041192387 @nsivabalan I was not able to get Hoodie contents for the previous stack trace. So I reproduced the issue with meta disabled. Below is the trace along with the Hoodie Contents.

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041188605 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041190378 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 2ea93235cbd3a9b7d739616899590a26729f6174 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-or

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041184852 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041188605 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041186820 ## CI report: * 27f65c3f50cb2a2048ddc07ff7848d4d46fb9fa3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041144483 ## CI report: * 27f65c3f50cb2a2048ddc07ff7848d4d46fb9fa3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041183103 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041184852 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] huberylee commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
huberylee commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041184218 @YannByron I have rebased master and solved comments, please review it, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041181201 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041183103 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1034465942 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041181201 ## CI report: * 09217dbc34c15ccb5259cb4168ed9e221ac92bf1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] NiteshSK edited a comment on issue #4814: [SUPPORT] NPE thrown while archiving data table with 0.10.1

2022-02-15 Thread GitBox
NiteshSK edited a comment on issue #4814: URL: https://github.com/apache/hudi/issues/4814#issuecomment-1041127602 @nsivabalan We are running on Hudi version : 0.10.1 After upgrading to Hudi 0.10.1 this issue happening intermittently not with every case. We didn't evaluate it with

[GitHub] [hudi] hudi-bot removed a comment on pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4824: URL: https://github.com/apache/hudi/pull/4824#issuecomment-1041134141 ## CI report: * 85e61360277ea1a129ca3ea251b004e83ba436ac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4824: URL: https://github.com/apache/hudi/pull/4824#issuecomment-1041174486 ## CI report: * 85e61360277ea1a129ca3ea251b004e83ba436ac Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[hudi] branch master updated (9a05940 -> 3363c66)

2022-02-15 Thread yihua
This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 9a05940 [HUDI-3366] Remove hardcoded logic of disabling metadata table in tests (#4792) add 3363c66 [HUDI-3394]

[GitHub] [hudi] yihua merged pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
yihua merged pull request #4819: URL: https://github.com/apache/hudi/pull/4819 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [hudi] gaoasi closed issue #4790: [SUPPORT] hudi-kafka-connect data missing!

2022-02-15 Thread GitBox
gaoasi closed issue #4790: URL: https://github.com/apache/hudi/issues/4790 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hud

[jira] [Updated] (HUDI-3394) Fail to release in-process lock due to IllegalMonitorStateException

2022-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3394: Status: Patch Available (was: In Progress) > Fail to release in-process lock due to IllegalMonitorStateExce

[jira] [Updated] (HUDI-3394) Fail to release in-process lock due to IllegalMonitorStateException

2022-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3394: Status: In Progress (was: Open) > Fail to release in-process lock due to IllegalMonitorStateException > ---

[jira] [Assigned] (HUDI-3394) Fail to release in-process lock due to IllegalMonitorStateException

2022-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-3394: --- Assignee: Yue Zhang (was: Ethan Guo) > Fail to release in-process lock due to IllegalMonitorStateExc

[jira] [Updated] (HUDI-3394) Fail to release in-process lock due to IllegalMonitorStateException

2022-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3394: Story Points: 0 (was: 1) > Fail to release in-process lock due to IllegalMonitorStateException > --

[jira] [Updated] (HUDI-3430) Deltastreamer Spark app hangs in continuous mode after DeltaSync being shut down

2022-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3430: Story Points: 1 (was: 3) > Deltastreamer Spark app hangs in continuous mode after DeltaSync being shut > d

[GitHub] [hudi] hudi-bot commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041144483 ## CI report: * 27f65c3f50cb2a2048ddc07ff7848d4d46fb9fa3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041142928 ## CI report: * 27f65c3f50cb2a2048ddc07ff7848d4d46fb9fa3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] boneanxs commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
boneanxs commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041143931 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [hudi] hudi-bot commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041142928 ## CI report: * 27f65c3f50cb2a2048ddc07ff7848d4d46fb9fa3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041136742 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] YannByron commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
YannByron commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041140893 @huberylee LGTM, just leave some little suggestions. and please rebase master first. -- This is an automated message from the Apache Git Service. To respond to the message, pl

[GitHub] [hudi] YannByron commented on a change in pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
YannByron commented on a change in pull request #4773: URL: https://github.com/apache/hudi/pull/4773#discussion_r807567940 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java ## @@ -65,46 +68,39 @@ public TableSchemaResolver(HoodieTabl

[GitHub] [hudi] YannByron commented on a change in pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
YannByron commented on a change in pull request #4773: URL: https://github.com/apache/hudi/pull/4773#discussion_r807566764 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java ## @@ -477,11 +477,30 @@ public boolean isHasOperationField(

[GitHub] [hudi] hudi-bot removed a comment on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041112268 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041136742 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] YannByron commented on a change in pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
YannByron commented on a change in pull request #4773: URL: https://github.com/apache/hudi/pull/4773#discussion_r807563715 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java ## @@ -49,6 +50,8 @@ import org.apache.parquet.hadoop.metad

[GitHub] [hudi] YannByron commented on a change in pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
YannByron commented on a change in pull request #4773: URL: https://github.com/apache/hudi/pull/4773#discussion_r807563484 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/TableSchemaResolver.java ## @@ -41,6 +36,12 @@ import org.apache.hudi.common.util.co

[GitHub] [hudi] hudi-bot removed a comment on pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4824: URL: https://github.com/apache/hudi/pull/4824#issuecomment-1041132810 ## CI report: * 85e61360277ea1a129ca3ea251b004e83ba436ac UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4824: URL: https://github.com/apache/hudi/pull/4824#issuecomment-1041134141 ## CI report: * 85e61360277ea1a129ca3ea251b004e83ba436ac Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4824: URL: https://github.com/apache/hudi/pull/4824#issuecomment-1041132810 ## CI report: * 85e61360277ea1a129ca3ea251b004e83ba436ac UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Updated] (HUDI-3430) Deltastreamer Spark app hangs in continuous mode after DeltaSync being shut down

2022-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3430: - Labels: pull-request-available (was: ) > Deltastreamer Spark app hangs in continuous mode after D

[GitHub] [hudi] yihua opened a new pull request #4824: [HUDI-3430] Fix Deltastreamer to properly shut down the services upon failure

2022-02-15 Thread GitBox
yihua opened a new pull request #4824: URL: https://github.com/apache/hudi/pull/4824 ## What is the purpose of the pull request ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle rule in checkstyle.xml* ## Verify this pull request

[GitHub] [hudi] NiteshSK edited a comment on issue #4814: [SUPPORT] NPE thrown while archiving data table with 0.10.1

2022-02-15 Thread GitBox
NiteshSK edited a comment on issue #4814: URL: https://github.com/apache/hudi/issues/4814#issuecomment-1041127602 @nsivabalan We are running on Hudi version : 0.10.1 After upgrading to Hudi 0.10.1 this issue happening intermittently not with every case. We didn't evaluated it with

[GitHub] [hudi] NiteshSK edited a comment on issue #4814: [SUPPORT] NPE thrown while archiving data table with 0.10.1

2022-02-15 Thread GitBox
NiteshSK edited a comment on issue #4814: URL: https://github.com/apache/hudi/issues/4814#issuecomment-1041127602 @nsivabalan We are running on Hudi version : 0.10.1 After upgrading to Hudi 0.10.1 this issue is with intermittently not for every case. We didn't evaluated it with mu

[jira] [Updated] (HUDI-3430) Deltastreamer Spark app hangs in continuous mode after DeltaSync being shut down

2022-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3430: Status: Patch Available (was: In Progress) > Deltastreamer Spark app hangs in continuous mode after DeltaSy

[jira] [Updated] (HUDI-3430) Deltastreamer Spark app hangs in continuous mode after DeltaSync being shut down

2022-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3430: Summary: Deltastreamer Spark app hangs in continuous mode after DeltaSync being shut down (was: Deltastream

[GitHub] [hudi] NiteshSK edited a comment on issue #4814: [SUPPORT] NPE thrown while archiving data table with 0.10.1

2022-02-15 Thread GitBox
NiteshSK edited a comment on issue #4814: URL: https://github.com/apache/hudi/issues/4814#issuecomment-1041127602 @nsivabalan We are running on Hudi version : 0.10.1 After upgrading to Hudi 0.10.1 this issue is with intermittently not for every case. We didn't evaluated it with mu

[jira] [Closed] (HUDI-3366) Remove unnecessary hardcoded logic of disabling metadata table in tests

2022-02-15 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-3366. --- Resolution: Fixed > Remove unnecessary hardcoded logic of disabling metadata table in tests >

[GitHub] [hudi] NiteshSK commented on issue #4814: [SUPPORT] NPE thrown while archiving data table with 0.10.1

2022-02-15 Thread GitBox
NiteshSK commented on issue #4814: URL: https://github.com/apache/hudi/issues/4814#issuecomment-1041127602 @nsivabalan We are running on Hudi version : 0.10.1 After upgrading to Hudi 0.10.1 this issue is with intermittently not for every case. -- This is an automated message f

[GitHub] [hudi] YannByron commented on pull request #4774: [HUDI-3401] fix NPE caused by incorrect beforeKeyGenClassName validation

2022-02-15 Thread GitBox
YannByron commented on pull request #4774: URL: https://github.com/apache/hudi/pull/4774#issuecomment-1041127432 @nsivabalan if you have no other updates, please merge it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [hudi] YannByron commented on pull request #4774: [HUDI-3401] fix NPE caused by incorrect beforeKeyGenClassName validation

2022-02-15 Thread GitBox
YannByron commented on pull request #4774: URL: https://github.com/apache/hudi/pull/4774#issuecomment-1041127109 @todd5167 I know this pr can work and have no side effect. Sorry for my insistence. i'm just a little pertinacious to find a reproducible steps that cause NPE here. -- This i

[GitHub] [hudi] wqwl611 commented on issue #4690: write hudi mor table always encounter FileNotFoundException hdfs://ns/...0220126193401513.parquet

2022-02-15 Thread GitBox
wqwl611 commented on issue #4690: URL: https://github.com/apache/hudi/issues/4690#issuecomment-1041125964 ok, i would close it and reopen if i find something @nsivabalan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [hudi] wqwl611 closed issue #4690: write hudi mor table always encounter FileNotFoundException hdfs://ns/...0220126193401513.parquet

2022-02-15 Thread GitBox
wqwl611 closed issue #4690: URL: https://github.com/apache/hudi/issues/4690 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hu

[GitHub] [hudi] zhangyue19921010 commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
zhangyue19921010 commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1041123177 Thanks a lot for your review @yihua and @nsivabalan CI jobs are passed. PTAL :) -- This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [hudi] stayrascal commented on pull request #4724: [HUDI-2815] add partial overwrite payload to support partial overwrit…

2022-02-15 Thread GitBox
stayrascal commented on pull request #4724: URL: https://github.com/apache/hudi/pull/4724#issuecomment-1041115256 > CC @xushiyan @alexeykudinkin : who might be working on refactoring payload interfaces. and @xiarixiaoyao who might be working on schema evolution story. can you folks take a

[GitHub] [hudi] hudi-bot commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041112268 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041108832 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] xushiyan closed pull request #4763: [HUDI-2597] Remove HoodieRecordPayload from generics

2022-02-15 Thread GitBox
xushiyan closed pull request #4763: URL: https://github.com/apache/hudi/pull/4763 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] xushiyan commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-15 Thread GitBox
xushiyan commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041109930 @YannByron can you review this please? thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] nsivabalan commented on pull request #4480: [HUDI-3123] consistent hashing index: basic write path (upsert/insert)

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4480: URL: https://github.com/apache/hudi/pull/4480#issuecomment-1041109912 @alexeykudinkin : Can you review this PR. I will get to review as well. but thought would be good for you to ramp up on indexing part. -- This is an automated message fr

[GitHub] [hudi] nsivabalan commented on pull request #4400: [HUDI-3069] compact improve

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1041109494 @yihua : Can you follow up on the review please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the U

[GitHub] [hudi] xushiyan closed pull request #4770: [HUDI-3088] [WIP] CI test spark2

2022-02-15 Thread GitBox
xushiyan closed pull request #4770: URL: https://github.com/apache/hudi/pull/4770 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] hudi-bot removed a comment on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041107635 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041108832 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] boneanxs commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
boneanxs commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041108535 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific c

[GitHub] [hudi] nsivabalan commented on pull request #4481: [HUDI-3075] [WIP] - Docs for Debezium DeltaStreamer Source

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4481: URL: https://github.com/apache/hudi/pull/4481#issuecomment-1041107793 @kywe665 : Can we take this forward. guess its been there for sometime. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] hudi-bot commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041107635 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041079832 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1041106537 ## CI report: * 5100bcff41b8d2258cc54ff979014b544d462338 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1041065315 ## CI report: * 5100bcff41b8d2258cc54ff979014b544d462338 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] nsivabalan commented on pull request #4494: [WIP][HUDI-3127] Adjust table config for HFile bootstrap index for Trino

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4494: URL: https://github.com/apache/hudi/pull/4494#issuecomment-1041104783 @yihua : can you assign reviewers for this PR. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] xushiyan closed pull request #4335: [WIP][HUDI-2175] Temp diff for dynamic schemas

2022-02-15 Thread GitBox
xushiyan closed pull request #4335: URL: https://github.com/apache/hudi/pull/4335 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[GitHub] [hudi] nsivabalan commented on pull request #4516: [HUDI-1295][HUDI-3181] Enabling metadata table based index by default for tests

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4516: URL: https://github.com/apache/hudi/pull/4516#issuecomment-1041103664 @yihua : we can close this one right ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] nsivabalan commented on pull request #4580: [MINOR][DOCS] Impala does NOT SUPPORT mor table with hudi 0.10-release

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4580: URL: https://github.com/apache/hudi/pull/4580#issuecomment-1041103294 @bhasudha : can you please follow up on this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] nsivabalan commented on pull request #4676: [HUDI-3304] support partial update on mor table

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4676: URL: https://github.com/apache/hudi/pull/4676#issuecomment-1041100892 @codope : can you take up the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] xushiyan commented on pull request #3519: [DO NOT MERGE] 0.9.0 release patch for flink

2022-02-15 Thread GitBox
xushiyan commented on pull request #3519: URL: https://github.com/apache/hudi/pull/3519#issuecomment-1041090794 @danny0405 any plan for this PR? would it make sense for you to publish 0.9.1 release since you've already cherry picked all the patches you have here. -- This is an automated

[GitHub] [hudi] nsivabalan closed pull request #4780: [WIP] Hudi 3088 test spark3

2022-02-15 Thread GitBox
nsivabalan closed pull request #4780: URL: https://github.com/apache/hudi/pull/4780 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [hudi] nsivabalan commented on pull request #4786: [HUDI-3383] Sync column comments while syncing a hive table, especially using spark datasource

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4786: URL: https://github.com/apache/hudi/pull/4786#issuecomment-1041086368 @XuQianJin-Stars : Can you review this patch please. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[jira] (HUDI-246) Apache Pulsar data source for Hudi DeltaStreamer

2022-02-15 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-246 ] Raymond Xu deleted comment on HUDI-246: - was (Author: githubbot): hudi-bot edited a comment on pull request #3096: URL: https://github.com/apache/hudi/pull/3096#issuecomment-862527730 ## CI

[jira] (HUDI-246) Apache Pulsar data source for Hudi DeltaStreamer

2022-02-15 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-246 ] Raymond Xu deleted comment on HUDI-246: - was (Author: githubbot): hudi-bot edited a comment on pull request #3096: URL: https://github.com/apache/hudi/pull/3096#issuecomment-862527730 ## CI

[GitHub] [hudi] nsivabalan commented on pull request #4820: [HUDI-3434] Fix the unit test compile error of TestCOWDataSource

2022-02-15 Thread GitBox
nsivabalan commented on pull request #4820: URL: https://github.com/apache/hudi/pull/4820#issuecomment-1041080067 its already fixed. thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

[GitHub] [hudi] nsivabalan closed pull request #4820: [HUDI-3434] Fix the unit test compile error of TestCOWDataSource

2022-02-15 Thread GitBox
nsivabalan closed pull request #4820: URL: https://github.com/apache/hudi/pull/4820 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[GitHub] [hudi] hudi-bot commented on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041079832 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4823: [HUDI-3438] Avoid getSmallFiles if hoodie.parquet.small.file.limit is 0

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4823: URL: https://github.com/apache/hudi/pull/4823#issuecomment-1041078418 ## CI report: * 0557d89f16796f6dd1602dabc723f5f8367b177a UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4743: [HUDI-3280] Cleaning up Hive-related hierarchies after refactoring

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4743: URL: https://github.com/apache/hudi/pull/4743#issuecomment-1041079696 ## CI report: * 75000d7530e6414662b27fce07a9abb2c41b5870 UNKNOWN * 61705e3a112cf29812148c8394e9347157dfd940 UNKNOWN * 91262ed944ae04d5e4df7315d1c7cc6bd1af6b1d Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4743: [HUDI-3280] Cleaning up Hive-related hierarchies after refactoring

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4743: URL: https://github.com/apache/hudi/pull/4743#issuecomment-1041049119 ## CI report: * 75000d7530e6414662b27fce07a9abb2c41b5870 UNKNOWN * 61705e3a112cf29812148c8394e9347157dfd940 UNKNOWN * b3a526497dc10d9e39b0bc7a580a0e534e6b3

  1   2   3   4   5   6   >