[GitHub] [hudi] hudi-bot removed a comment on pull request #4445: [HUDI-3102] Do not store rollback plan in inflight instant

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4445: URL: https://github.com/apache/hudi/pull/4445#issuecomment-1000984619 ## CI report: * a6e2744734fe71a4c51af11aa697f46979d10770 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4445: [HUDI-3102] Do not store rollback plan in inflight instant

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4445: URL: https://github.com/apache/hudi/pull/4445#issuecomment-1000990029 ## CI report: * a6e2744734fe71a4c51af11aa697f46979d10770 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] danny0405 commented on pull request #4445: [HUDI-3102] Do not store rollback plan in inflight instant

2021-12-25 Thread GitBox
danny0405 commented on pull request #4445: URL: https://github.com/apache/hudi/pull/4445#issuecomment-1000994233 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [hudi] hudi-bot removed a comment on pull request #4445: [HUDI-3102] Do not store rollback plan in inflight instant

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4445: URL: https://github.com/apache/hudi/pull/4445#issuecomment-1000990029 ## CI report: * a6e2744734fe71a4c51af11aa697f46979d10770 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4445: [HUDI-3102] Do not store rollback plan in inflight instant

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4445: URL: https://github.com/apache/hudi/pull/4445#issuecomment-1000994293 ## CI report: * a6e2744734fe71a4c51af11aa697f46979d10770 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Created] (HUDI-3103) Enable MultiTableDeltaStreamer to update a single target table from multiple source tables.

2021-12-25 Thread YangXuan (Jira)
YangXuan created HUDI-3103: -- Summary: Enable MultiTableDeltaStreamer to update a single target table from multiple source tables. Key: HUDI-3103 URL: https://issues.apache.org/jira/browse/HUDI-3103 Project:

[GitHub] [hudi] hudi-bot removed a comment on pull request #4445: [HUDI-3102] Do not store rollback plan in inflight instant

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4445: URL: https://github.com/apache/hudi/pull/4445#issuecomment-1000994293 ## CI report: * a6e2744734fe71a4c51af11aa697f46979d10770 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4445: [HUDI-3102] Do not store rollback plan in inflight instant

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4445: URL: https://github.com/apache/hudi/pull/4445#issuecomment-1000999848 ## CI report: * a6e2744734fe71a4c51af11aa697f46979d10770 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[hudi] branch master updated: [HUDI-3102] Do not store rollback plan in inflight instant (#4445)

2021-12-25 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new c81df99 [HUDI-3102] Do not store rollback plan

[jira] [Resolved] (HUDI-3102) Do not store rollback plan in inflight instant

2021-12-25 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-3102. -- > Do not store rollback plan in inflight instant > -- > >

[GitHub] [hudi] danny0405 merged pull request #4445: [HUDI-3102] Do not store rollback plan in inflight instant

2021-12-25 Thread GitBox
danny0405 merged pull request #4445: URL: https://github.com/apache/hudi/pull/4445 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[jira] [Commented] (HUDI-3102) Do not store rollback plan in inflight instant

2021-12-25 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17465164#comment-17465164 ] Danny Chen commented on HUDI-3102: -- Fixed via master branch: c81df99e50f2df84d85f08ff3a83

[GitHub] [hudi] leesf commented on a change in pull request #4440: [HUDI-3100] Add config for hive conditional sync

2021-12-25 Thread GitBox
leesf commented on a change in pull request #4440: URL: https://github.com/apache/hudi/pull/4440#discussion_r775142069 ## File path: hudi-spark-datasource/hudi-spark-common/src/main/java/org/apache/hudi/DataSourceUtils.java ## @@ -309,6 +309,8 @@ public static HiveSyncConfig

[GitHub] [hudi] vinothchandar commented on pull request #4281: [HUDI-2983] Remove Log4j2 transitive dependencies

2021-12-25 Thread GitBox
vinothchandar commented on pull request #4281: URL: https://github.com/apache/hudi/pull/4281#issuecomment-1001041811 @umehrot2 has confirmed this change does not cause any runtime issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] vinothchandar commented on a change in pull request #4281: [HUDI-2983] Remove Log4j2 transitive dependencies

2021-12-25 Thread GitBox
vinothchandar commented on a change in pull request #4281: URL: https://github.com/apache/hudi/pull/4281#discussion_r775152000 ## File path: packaging/hudi-integ-test-bundle/pom.xml ## @@ -380,12 +380,6 @@ ${hive.groupid} hive-exec ${hive.version} -

[GitHub] [hudi] vinothchandar commented on a change in pull request #4342: [HUDI-735] Fixing error messages on record key not found

2021-12-25 Thread GitBox
vinothchandar commented on a change in pull request #4342: URL: https://github.com/apache/hudi/pull/4342#discussion_r775163936 ## File path: hudi-spark-datasource/hudi-spark/src/main/scala/org/apache/hudi/HoodieSparkSqlWriter.scala ## @@ -229,7 +229,11 @@ object HoodieSparkSql

[GitHub] [hudi] vinothchandar commented on pull request #4300: [HUDI-2785] Add Trino setup in Docker Demo

2021-12-25 Thread GitBox
vinothchandar commented on pull request #4300: URL: https://github.com/apache/hudi/pull/4300#issuecomment-1001064604 Could we also get the docs updated -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [hudi] vinothchandar commented on pull request #3646: [HUDI-349]: Added new cleaning policy based on number of hours

2021-12-25 Thread GitBox
vinothchandar commented on pull request #3646: URL: https://github.com/apache/hudi/pull/3646#issuecomment-1001065133 Let me review this as well -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

[GitHub] [hudi] vinothchandar commented on pull request #3949: [HUID-2151] [WIP] Part2 Enabling async requests for embedded timeline server

2021-12-25 Thread GitBox
vinothchandar commented on pull request #3949: URL: https://github.com/apache/hudi/pull/3949#issuecomment-1001066762 @nsivabalan Can we revisit this and all such flips right away? Thise seem to slip away after release rush is over every time. -- This is an automated message from the

[jira] [Assigned] (HUDI-2917) Rollback may be incorrect for canIndexLogFile index

2021-12-25 Thread ZiyueGuan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ZiyueGuan reassigned HUDI-2917: --- Assignee: ZiyueGuan > Rollback may be incorrect for canIndexLogFile index > -

[GitHub] [hudi] guanziyue opened a new pull request #4446: WIP: [HUDI-2917] rollback insert data appended to log file in Hbase Index

2021-12-25 Thread GitBox
guanziyue opened a new pull request #4446: URL: https://github.com/apache/hudi/pull/4446 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[jira] [Updated] (HUDI-2917) Rollback may be incorrect for canIndexLogFile index

2021-12-25 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2917?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-2917: - Labels: pull-request-available (was: ) > Rollback may be incorrect for canIndexLogFile index > --

[GitHub] [hudi] hudi-bot commented on pull request #4446: WIP: [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001084402 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001084583 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001084402 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001091315 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001084583 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-100856 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001091315 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001112073 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-100856 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001112073 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001113039 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001113201 ## CI report: * fb42977822edf73e31efcd94c1e14e1b9c7a9f22 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4446: [WIP] [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001113039 ## CI report: * 6d2a0863a1033c6ac1c78cb15672a65bcf654698 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] xushiyan commented on issue #4442: [SUPPORT] PySpark(3.1.2) with Hudi(0.10.0) failed when querying spark sql

2021-12-25 Thread GitBox
xushiyan commented on issue #4442: URL: https://github.com/apache/hudi/issues/4442#issuecomment-1001116347 @a0x can you try put the jars in a different directory like /home/hadoop and try not to change /usr/lib/hudi . -- This is an automated message from the Apache Git Service. To respo

[GitHub] [hudi] hudi-bot commented on pull request #4446: [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot commented on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001116652 ## CI report: * fb42977822edf73e31efcd94c1e14e1b9c7a9f22 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4446: [HUDI-2917] rollback insert data appended to log file when using Hbase Index

2021-12-25 Thread GitBox
hudi-bot removed a comment on pull request #4446: URL: https://github.com/apache/hudi/pull/4446#issuecomment-1001113201 ## CI report: * fb42977822edf73e31efcd94c1e14e1b9c7a9f22 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] xushiyan closed issue #4429: [SUPPORT] Spark SQL hudi statements are not working after hudi 0.10.0 version upgrade

2021-12-25 Thread GitBox
xushiyan closed issue #4429: URL: https://github.com/apache/hudi/issues/4429 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@h

[GitHub] [hudi] xushiyan commented on issue #4429: [SUPPORT] Spark SQL hudi statements are not working after hudi 0.10.0 version upgrade

2021-12-25 Thread GitBox
xushiyan commented on issue #4429: URL: https://github.com/apache/hudi/issues/4429#issuecomment-1001117485 @vingov spark 3.2 is not supported with hudi 0.10. Put a support matrix here https://hudi.apache.org/docs/next/quick-start-guide#setup this shouldn't be a problem when the right v

[GitHub] [hudi] xushiyan closed issue #3344: [SUPPORT]Best way to ingest a large number of tables

2021-12-25 Thread GitBox
xushiyan closed issue #3344: URL: https://github.com/apache/hudi/issues/3344 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@h

[GitHub] [hudi] xushiyan commented on issue #3344: [SUPPORT]Best way to ingest a large number of tables

2021-12-25 Thread GitBox
xushiyan commented on issue #3344: URL: https://github.com/apache/hudi/issues/3344#issuecomment-1001120072 @Kavin88 Gonna close this as this is not a hudi-specific problem; it's a general orchestration decision problem for running large number of spark applications. You can look into apach

[GitHub] [hudi] xushiyan closed issue #3624: Failed to delete the partition table record from spark-sql

2021-12-25 Thread GitBox
xushiyan closed issue #3624: URL: https://github.com/apache/hudi/issues/3624 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@h

[GitHub] [hudi] xushiyan commented on issue #3624: Failed to delete the partition table record from spark-sql

2021-12-25 Thread GitBox
xushiyan commented on issue #3624: URL: https://github.com/apache/hudi/issues/3624#issuecomment-1001120416 close due to inactive -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm