[GitHub] [hudi] gaoasi commented on issue #4790: [SUPPORT] hudi-kafka-connect data missing!

2022-02-15 Thread GitBox
gaoasi commented on issue #4790: URL: https://github.com/apache/hudi/issues/4790#issuecomment-1039994066 @nsivabalan Thank you very much for your patient answer -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [hudi] zhangyue19921010 opened a new pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
zhangyue19921010 opened a new pull request #4819: URL: https://github.com/apache/hudi/pull/4819 https://issues.apache.org/jira/browse/HUDI-3394 ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log

[jira] [Updated] (HUDI-3394) Fail to release in-process lock due to IllegalMonitorStateException

2022-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3394: - Labels: HUDI-bug pull-request-available (was: HUDI-bug) > Fail to release in-process lock due to

[GitHub] [hudi] zhangyue19921010 commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
zhangyue19921010 commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040008499 CC @yihua and @manojpec would you mind to take a look? Maybe we need to check if current thread hold the lock before call unlock() api. -- This is an automated messa

[GitHub] [hudi] hudi-bot commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040009818 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040012363 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040009818 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] Gatsby-Lee closed issue #4748: [SUPPORT] Question: Does "SINGLE_WRITER" also utilize if hoodie.write.lock.* is provided?

2022-02-15 Thread GitBox
Gatsby-Lee closed issue #4748: URL: https://github.com/apache/hudi/issues/4748 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[GitHub] [hudi] Gatsby-Lee commented on issue #4748: [SUPPORT] Question: Does "SINGLE_WRITER" also utilize if hoodie.write.lock.* is provided?

2022-02-15 Thread GitBox
Gatsby-Lee commented on issue #4748: URL: https://github.com/apache/hudi/issues/4748#issuecomment-1040017002 @nsivabalan @prashantwason Thank you very much for all your answers. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[GitHub] [hudi] hudi-bot removed a comment on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040012363 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040017522 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] ljl1988com opened a new pull request #4820: Fix the unit test failed of TestCOWDataSource

2022-02-15 Thread GitBox
ljl1988com opened a new pull request #4820: URL: https://github.com/apache/hudi/pull/4820 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purp

[GitHub] [hudi] hudi-bot removed a comment on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040017522 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040020129 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot commented on pull request #4820: Fix the unit test failed of TestCOWDataSource

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4820: URL: https://github.com/apache/hudi/pull/4820#issuecomment-1040020182 ## CI report: * 131da84cadb003e350597bc1086c6d90c3b3d63e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Created] (HUDI-3434) Fix the unit test failed of TestCOWDataSource

2022-02-15 Thread L_Shen (Jira)
L_Shen created HUDI-3434: Summary: Fix the unit test failed of TestCOWDataSource Key: HUDI-3434 URL: https://issues.apache.org/jira/browse/HUDI-3434 Project: Apache Hudi Issue Type: Bug R

[GitHub] [hudi] hudi-bot commented on pull request #4820: [HUDI-3434] Fix the unit test failed of TestCOWDataSource

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4820: URL: https://github.com/apache/hudi/pull/4820#issuecomment-1040022720 ## CI report: * 131da84cadb003e350597bc1086c6d90c3b3d63e UNKNOWN * 77baf0528163e72976c32d1a1b928d5f5b20b899 UNKNOWN Bot commands @hudi-bot supports th

[GitHub] [hudi] hudi-bot removed a comment on pull request #4820: [HUDI-3434] Fix the unit test failed of TestCOWDataSource

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4820: URL: https://github.com/apache/hudi/pull/4820#issuecomment-1040020182 ## CI report: * 131da84cadb003e350597bc1086c6d90c3b3d63e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[jira] [Updated] (HUDI-3434) Fix the unit test failed of TestCOWDataSource

2022-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3434: - Labels: pull-request-available (was: ) > Fix the unit test failed of TestCOWDataSource >

[GitHub] [hudi] hudi-bot removed a comment on pull request #4820: [HUDI-3434] Fix the unit test compile error of TestCOWDataSource

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4820: URL: https://github.com/apache/hudi/pull/4820#issuecomment-1040022720 ## CI report: * 131da84cadb003e350597bc1086c6d90c3b3d63e UNKNOWN * 77baf0528163e72976c32d1a1b928d5f5b20b899 UNKNOWN Bot commands @hudi-bot sup

[GitHub] [hudi] hudi-bot commented on pull request #4820: [HUDI-3434] Fix the unit test compile error of TestCOWDataSource

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4820: URL: https://github.com/apache/hudi/pull/4820#issuecomment-1040025406 ## CI report: * 131da84cadb003e350597bc1086c6d90c3b3d63e UNKNOWN * 77baf0528163e72976c32d1a1b928d5f5b20b899 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org

[jira] [Updated] (HUDI-3434) Fix the unit test compile error of TestCOWDataSource

2022-02-15 Thread L_Shen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] L_Shen updated HUDI-3434: - Summary: Fix the unit test compile error of TestCOWDataSource (was: Fix the unit test failed of TestCOWDataSource

[jira] [Created] (HUDI-3435) Do not throw exception when instant to rollback does not exist in metadata table active timeline

2022-02-15 Thread Danny Chen (Jira)
Danny Chen created HUDI-3435: Summary: Do not throw exception when instant to rollback does not exist in metadata table active timeline Key: HUDI-3435 URL: https://issues.apache.org/jira/browse/HUDI-3435

[GitHub] [hudi] danny0405 opened a new pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
danny0405 opened a new pull request #4821: URL: https://github.com/apache/hudi/pull/4821 …exist in metadata table active timeline ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before open

[jira] [Updated] (HUDI-3435) Do not throw exception when instant to rollback does not exist in metadata table active timeline

2022-02-15 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3435: - Labels: pull-request-available (was: ) > Do not throw exception when instant to rollback does not

[jira] [Updated] (HUDI-3435) Do not throw exception when instant to rollback does not exist in metadata table active timeline

2022-02-15 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-3435: - Description: See the stacktrace: {code:xml} Caused by: org.apache.hudi.exception.HoodieMetadataException

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1040037224 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[jira] [Commented] (HUDI-3435) Do not throw exception when instant to rollback does not exist in metadata table active timeline

2022-02-15 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492468#comment-17492468 ] Danny Chen commented on HUDI-3435: -- After this change, when the compaction metadata commi

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1040037224 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1040039971 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] danny0405 commented on pull request #4714: [HUDI-3204] fix problem that spark on TimestampKeyGenerator has no re…

2022-02-15 Thread GitBox
danny0405 commented on pull request #4714: URL: https://github.com/apache/hudi/pull/4714#issuecomment-1040042258 Hello, can someone check the build cc @nsivabalan @YannByron ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

[GitHub] [hudi] hudi-bot commented on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1040042760 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4821: [HUDI-3435] Do not throw exception when instant to rollback does not …

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4821: URL: https://github.com/apache/hudi/pull/4821#issuecomment-1040039971 ## CI report: * 38f1df00ae196b21782dfd1aca39a32f5f267dc5 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] andykrk commented on issue #4604: [SUPPORT] Archive functionality fails

2022-02-15 Thread GitBox
andykrk commented on issue #4604: URL: https://github.com/apache/hudi/issues/4604#issuecomment-1040046911 @nsivabalan in the meantime we have this table running with 0.9.0 in production as we are starting to use 0.9.0 wherever it's possible but still with very high archival setting (no act

[GitHub] [hudi] xiarixiaoyao commented on issue #4700: [SUPPORT] Adding new column to table is not propagated to Hive via HMS sync mode

2022-02-15 Thread GitBox
xiarixiaoyao commented on issue #4700: URL: https://github.com/apache/hudi/issues/4700#issuecomment-1040068522 @LucassLin Do you also use local docker to produce this problem? @nsivabalan yes,i can reproduce this problem by docker. It's very strange that I can't reproduce this p

[GitHub] [hudi] YannByron opened a new pull request #4822: fix build & ci

2022-02-15 Thread GitBox
YannByron opened a new pull request #4822: URL: https://github.com/apache/hudi/pull/4822 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] xiarixiaoyao edited a comment on issue #4700: [SUPPORT] Adding new column to table is not propagated to Hive via HMS sync mode

2022-02-15 Thread GitBox
xiarixiaoyao edited a comment on issue #4700: URL: https://github.com/apache/hudi/issues/4700#issuecomment-1040068522 @LucassLin Do you also use local docker to produce this problem? @nsivabalan yes,i can reproduce this problem by docker. It's very strange that I can't reproduce

[GitHub] [hudi] hudi-bot removed a comment on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040020129 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040071057 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot commented on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040073770 ## CI report: * 7e6f468861fcd8c7872b378d76426ec1db5575d3 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4819: [HUDI-3394] Check isWriteLockedByCurrentThread before unlock for InProcessLockProvider

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4819: URL: https://github.com/apache/hudi/pull/4819#issuecomment-1040071057 ## CI report: * 0ba4fac36d3802692fff32e67ae71dff53889e8b Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4822: fix build & ci

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4822: URL: https://github.com/apache/hudi/pull/4822#issuecomment-1040073835 ## CI report: * 1339df2e74be500220875831d09c56634b9f6a5e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4822: fix build & ci

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4822: URL: https://github.com/apache/hudi/pull/4822#issuecomment-1040076463 ## CI report: * 1339df2e74be500220875831d09c56634b9f6a5e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4822: fix build & ci

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4822: URL: https://github.com/apache/hudi/pull/4822#issuecomment-1040073835 ## CI report: * 1339df2e74be500220875831d09c56634b9f6a5e UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot removed a comment on pull request #4820: [HUDI-3434] Fix the unit test compile error of TestCOWDataSource

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4820: URL: https://github.com/apache/hudi/pull/4820#issuecomment-1040025406 ## CI report: * 131da84cadb003e350597bc1086c6d90c3b3d63e UNKNOWN * 77baf0528163e72976c32d1a1b928d5f5b20b899 Azure: [PENDING](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4820: [HUDI-3434] Fix the unit test compile error of TestCOWDataSource

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4820: URL: https://github.com/apache/hudi/pull/4820#issuecomment-1040085516 ## CI report: * 131da84cadb003e350597bc1086c6d90c3b3d63e UNKNOWN * 77baf0528163e72976c32d1a1b928d5f5b20b899 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] YannByron commented on pull request #4822: fix build & ci

2022-02-15 Thread GitBox
YannByron commented on pull request #4822: URL: https://github.com/apache/hudi/pull/4822#issuecomment-1040090577 @xushiyan @danny0405 please merge this to fix the build failure when this CI succeeds. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [hudi] YannByron commented on pull request #4714: [HUDI-3204] fix problem that spark on TimestampKeyGenerator has no re…

2022-02-15 Thread GitBox
YannByron commented on pull request #4714: URL: https://github.com/apache/hudi/pull/4714#issuecomment-1040092239 > Hello, can someone check the build cc @nsivabalan @YannByron ! https://github.com/apache/hudi/pull/4822 can fix this. -- This is an automated message from the Apache G

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040103750 ## CI report: * 7af196e1c42c72816f1709dd982293045523906d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1039829883 ## CI report: * 7af196e1c42c72816f1709dd982293045523906d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040103750 ## CI report: * 7af196e1c42c72816f1709dd982293045523906d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040106705 ## CI report: * 7af196e1c42c72816f1709dd982293045523906d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4822: [MINOR] Fix constant usage

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4822: URL: https://github.com/apache/hudi/pull/4822#issuecomment-1040076463 ## CI report: * 1339df2e74be500220875831d09c56634b9f6a5e Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4822: [MINOR] Fix constant usage

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4822: URL: https://github.com/apache/hudi/pull/4822#issuecomment-1040140110 ## CI report: * 1339df2e74be500220875831d09c56634b9f6a5e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040153696 ## CI report: * 7af196e1c42c72816f1709dd982293045523906d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040106705 ## CI report: * 7af196e1c42c72816f1709dd982293045523906d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040156614 ## CI report: * 15931c0e37361afd9732f04305b8ab48ce305aac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040153696 ## CI report: * 7af196e1c42c72816f1709dd982293045523906d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040165633 ## CI report: * 15931c0e37361afd9732f04305b8ab48ce305aac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040156614 ## CI report: * 15931c0e37361afd9732f04305b8ab48ce305aac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] xushiyan merged pull request #4822: [MINOR] Fix constant usage

2022-02-15 Thread GitBox
xushiyan merged pull request #4822: URL: https://github.com/apache/hudi/pull/4822 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr

[hudi] branch master updated (cb6ca7f -> fe02c64)

2022-02-15 Thread xushiyan
This is an automated email from the ASF dual-hosted git repository. xushiyan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from cb6ca7f [HUDI-3204] fix problem that spark on TimestampKeyGenerator has no re… (#4714) add fe02c64 fix build

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
XuQianJin-Stars commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040195608 hi @fedsp well, you can use this patch to help verify it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] XuQianJin-Stars commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
XuQianJin-Stars commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040220274 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spe

[GitHub] [hudi] XuQianJin-Stars removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
XuQianJin-Stars removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040195608 hi @fedsp well, you can use this patch to help verify it. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040222786 ## CI report: * 15931c0e37361afd9732f04305b8ab48ce305aac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040165633 ## CI report: * 15931c0e37361afd9732f04305b8ab48ce305aac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040225571 ## CI report: * c9b323fc59f63b23a616d2bcf5880a5c3b7d91f2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040222786 ## CI report: * 15931c0e37361afd9732f04305b8ab48ce305aac Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] YannByron commented on issue #3965: [SUPPORT] Upserts result in truncated milliseconds from timestamps

2022-02-15 Thread GitBox
YannByron commented on issue #3965: URL: https://github.com/apache/hudi/issues/3965#issuecomment-1040294984 @Frogglet According to the steps you provide, I think it's same to https://github.com/apache/hudi/issues/3429. Can you set `hoodie.parquet.outputtimestamptype` to `TIMESTAMP_MICROS`

[GitHub] [hudi] hudi-bot commented on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040298978 ## CI report: * c9b323fc59f63b23a616d2bcf5880a5c3b7d91f2 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4720: [HUDI-3221] Support querying a table as of a savepoint

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4720: URL: https://github.com/apache/hudi/pull/4720#issuecomment-1040225571 ## CI report: * c9b323fc59f63b23a616d2bcf5880a5c3b7d91f2 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] garyli1019 commented on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

2022-02-15 Thread GitBox
garyli1019 commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1040300417 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1040301937 ## CI report: * Unknown: [CANCELED](TBD) * f63a0753eb2f8f25cd1cd68bf5e6356a73438588 UNKNOWN Bot commands @hudi-bot supports the following commands:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1022078073 ## CI report: * 4d49dbe71e689f0d56d3447bc5c4367db35c33af Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1040305097 ## CI report: * Unknown: [CANCELED](TBD) * f63a0753eb2f8f25cd1cd68bf5e6356a73438588 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1040301937 ## CI report: * Unknown: [CANCELED](TBD) * f63a0753eb2f8f25cd1cd68bf5e6356a73438588 UNKNOWN Bot commands @hudi-bot supports the following co

[GitHub] [hudi] YannByron commented on issue #4678: [SUPPORT] spark.read.format("hudi").schema(userSpecifiedSchema) doesn't work in version 0.10.0 ,but does work in 0.5.3

2022-02-15 Thread GitBox
YannByron commented on issue #4678: URL: https://github.com/apache/hudi/issues/4678#issuecomment-1040320431 @wjcwin If hudi 0.5.3 can response this codes, i believe it's a bug. And i don't think `DataFrameReader.schema` can be used like this. The description of this method as follows: `

[GitHub] [hudi] YannByron commented on pull request #4774: [HUDI-3401] fix NPE caused by incorrect beforeKeyGenClassName validation

2022-02-15 Thread GitBox
YannByron commented on pull request #4774: URL: https://github.com/apache/hudi/pull/4774#issuecomment-1040337118 @todd5167 I create a mor table, and insert some data, but i can reproduce this issues. can you give the complete sqls please? the codes that i test like this: ``` cr

[GitHub] [hudi] YannByron commented on a change in pull request #4815: [HUDI-3423] upgrade spark to 3.2.1

2022-02-15 Thread GitBox
YannByron commented on a change in pull request #4815: URL: https://github.com/apache/hudi/pull/4815#discussion_r806889048 ## File path: pom.xml ## @@ -119,7 +119,7 @@ 1.14.3 2.4.4 -3.2.0 +3.2.1 Review comment: yep. i will. -- This is an aut

[GitHub] [hudi] hudi-bot commented on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

2022-02-15 Thread GitBox
hudi-bot commented on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1040347175 ## CI report: * f63a0753eb2f8f25cd1cd68bf5e6356a73438588 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4679: [HUDI-3315] RFC-35 Make Flink writer stream friendly

2022-02-15 Thread GitBox
hudi-bot removed a comment on pull request #4679: URL: https://github.com/apache/hudi/pull/4679#issuecomment-1040305097 ## CI report: * Unknown: [CANCELED](TBD) * f63a0753eb2f8f25cd1cd68bf5e6356a73438588 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42

[GitHub] [hudi] nsivabalan merged pull request #4777: [HUDI-2931] Add config to disable table services

2022-02-15 Thread GitBox
nsivabalan merged pull request #4777: URL: https://github.com/apache/hudi/pull/4777 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[hudi] branch master updated (fe02c64 -> 538ec44)

2022-02-15 Thread sivabalan
This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from fe02c64 fix build & ci (#4822) add 538ec44 [HUDI-2931] Add config to disable table services (#4777) No new r

[jira] [Closed] (HUDI-3417) Switch AbstractTableFileSystemView#filterBaseFileAfterPendingCompaction log level to debug

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3417. - Resolution: Fixed > Switch AbstractTableFileSystemView#filterBaseFileAfterPendingCompactio

[jira] [Reopened] (HUDI-3417) Switch AbstractTableFileSystemView#filterBaseFileAfterPendingCompaction log level to debug

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3417: --- > Switch AbstractTableFileSystemView#filterBaseFileAfterPendingCompaction log > level to

[jira] [Closed] (HUDI-3389) Bump flink version to 1.14.3

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3389. - Resolution: Fixed > Bump flink version to 1.14.3 > > >

[jira] [Closed] (HUDI-3412) TypedProperties no need to create new set when check key exist or not

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3412. - Resolution: Fixed > TypedProperties no need to create new set when check key exist or not

[jira] [Reopened] (HUDI-3389) Bump flink version to 1.14.3

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3389: --- > Bump flink version to 1.14.3 > > > Key: HUD

[jira] [Reopened] (HUDI-3412) TypedProperties no need to create new set when check key exist or not

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3412: --- > TypedProperties no need to create new set when check key exist or not >

[jira] [Closed] (HUDI-3204) spark on TimestampBasedKeyGenerator has no result when query by partition column

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3204?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3204. - Resolution: Fixed > spark on TimestampBasedKeyGenerator has no result when query by partit

[jira] [Reopened] (HUDI-3254) Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3254: --- > Introduce HoodieCatalog to manage tables for Spark Datasource V2 > -

[jira] [Closed] (HUDI-1657) build failed on AArch64, Fedora 33

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-1657. - Resolution: Fixed > build failed on AArch64, Fedora 33 >

[jira] [Closed] (HUDI-3254) Introduce HoodieCatalog to manage tables for Spark Datasource V2

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3254. - Resolution: Fixed > Introduce HoodieCatalog to manage tables for Spark Datasource V2 > ---

[jira] [Updated] (HUDI-1657) build failed on AArch64, Fedora 33

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1657?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-1657: -- Status: Patch Available (was: In Progress) > build failed on AArch64, Fedora 33 >

[jira] [Reopened] (HUDI-3370) The files recorded in the commit do not match the actual ones for MOR Compaction

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-3370: --- > The files recorded in the commit do not match the actual ones for MOR > Compaction > --

[jira] [Closed] (HUDI-2413) Sql source in delta streamer does not work

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-2413. - Fix Version/s: 0.11.0 Resolution: Fixed > Sql source in delta streamer does not wor

[jira] [Updated] (HUDI-2413) Sql source in delta streamer does not work

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-2413: -- Status: Patch Available (was: In Progress) > Sql source in delta streamer does not work

[jira] [Closed] (HUDI-3370) The files recorded in the commit do not match the actual ones for MOR Compaction

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3370. - Resolution: Fixed > The files recorded in the commit do not match the actual ones for MOR

[jira] [Closed] (HUDI-3272) If `mode==ignore && tableExists`, do not execute write logic and sync hive

2022-02-15 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-3272. - Resolution: Fixed > If `mode==ignore && tableExists`, do not execute write logic and sync

  1   2   3   4   5   6   >