[GitHub] [hudi] hudi-bot removed a comment on pull request #5049: [HUDI-3598] row data to hoodie record map operator need always use the input operator parallelism to chained with source operator

hudi-bot removed a comment on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068790096 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5049: [HUDI-3598] row data to hoodie record map operator need always use the input operator parallelism to chained with source operator

hudi-bot commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068791746 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Created] (HUDI-3643) Hive count throws exception when the table is empty and the path depth is less than 3

董可伦 created HUDI-3643: - Summary: Hive count throws exception when the table is empty and the path depth is less than 3 Key: HUDI-3643 URL: https://issues.apache.org/jira/browse/HUDI-3643 Project: Apache Hudi

[GitHub] [hudi] hudi-bot removed a comment on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

hudi-bot removed a comment on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068700735 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

hudi-bot commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068790096 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] JerryYue-M commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

JerryYue-M commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068784523 @danny0405 @wangxianghu indeed, i will follow this way thanks all -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] wangxianghu commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

wangxianghu commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068778886 > > @danny0405 in the real product scene，source operator don't use the default parallelism of job. for example, kafka source will set the parallelism mapping to partition num.

[GitHub] [hudi] hudi-bot removed a comment on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot removed a comment on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1063961282 ## CI report: * e04440e74c4b840224acd27aebd7be8b53dd20a2 UNKNOWN * 5562250d34698576802a8d77ddf70ad77dfbcd88 UNKNOWN * 935d2ad75c650d334b19d4ac1a48255fc929b

[GitHub] [hudi] hudi-bot commented on pull request #4752: [WIP][HUDI-3088] Use Spark 3.2 as default Spark version

hudi-bot commented on pull request #4752: URL: https://github.com/apache/hudi/pull/4752#issuecomment-1068778693 ## CI report: * e04440e74c4b840224acd27aebd7be8b53dd20a2 UNKNOWN * 5562250d34698576802a8d77ddf70ad77dfbcd88 UNKNOWN * 935d2ad75c650d334b19d4ac1a48255fc929bf92 UNKN

[GitHub] [hudi] wangxianghu commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

wangxianghu commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068776886 > @wangxianghu thanks for review, I had fixed the problem you pointed out Thanks @JerryYue-M, I am ok with the change. will merge as long as @danny0405 approve it -

[GitHub] [hudi] danny0405 commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

danny0405 commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068775638 > @danny0405 in the real product scene，source operator don't use the default parallelism of job. for example, kafka source will set the parallelism mapping to partition num. in

[GitHub] [hudi] wangxianghu commented on pull request #5007: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

wangxianghu commented on pull request #5007: URL: https://github.com/apache/hudi/pull/5007#issuecomment-1068774254 closing since a new one created https://github.com/apache/hudi/pull/5049 -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [hudi] wangxianghu closed pull request #5007: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

wangxianghu closed pull request #5007: URL: https://github.com/apache/hudi/pull/5007 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068772425 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * Unknown: [CANCELED](TBD) * 107dab60f6541702644f4c87b7e92ba68f2fe6ef UNKNOWN

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068774042 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * Unknown: [CANCELED](TBD) * 107dab60f6541702644f4c87b7e92ba68f2fe6ef Azure: [PENDING](https://

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068710431 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * Unknown: [CANCELED](TBD) * 107dab60f6541702644f4c87b7e92ba68f2fe6ef UNKNOWN

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068772425 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * Unknown: [CANCELED](TBD) * 107dab60f6541702644f4c87b7e92ba68f2fe6ef UNKNOWN Bot com

[jira] [Closed] (HUDI-3607) Support backend switch in HoodieFlinkStreamer

[ https://issues.apache.org/jira/browse/HUDI-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xianghu Wang closed HUDI-3607. -- Resolution: Fixed > Support backend switch in HoodieFlinkStreamer >

[GitHub] [hudi] peanut-chenzhong removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

peanut-chenzhong removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068708473 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hudi] peanut-chenzhong commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

peanut-chenzhong commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068771256 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[hudi] branch master updated: [HUDI-3607] Support backend switch in HoodieFlinkStreamer (#5032)

This is an automated email from the ASF dual-hosted git repository. wangxianghu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git The following commit(s) were added to refs/heads/master by this push: new 91849c3 [HUDI-3607] Support backend switch i

[GitHub] [hudi] wangxianghu merged pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

wangxianghu merged pull request #5032: URL: https://github.com/apache/hudi/pull/5032 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsub

[GitHub] [hudi] hudi-bot commented on pull request #4918: [HUDI-3518] Make HiveSchemaProvider support AWS Glue Catalog

hudi-bot commented on pull request #4918: URL: https://github.com/apache/hudi/pull/4918#issuecomment-1068770674 ## CI report: * 4be9c06e21020e9419112cc5402f3b2455c90c73 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4918: [HUDI-3518] Make HiveSchemaProvider support AWS Glue Catalog

hudi-bot removed a comment on pull request #4918: URL: https://github.com/apache/hudi/pull/4918#issuecomment-1068420799 ## CI report: * 4be9c06e21020e9419112cc5402f3b2455c90c73 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] wangxianghu commented on pull request #4918: [HUDI-3518] Make HiveSchemaProvider support AWS Glue Catalog

wangxianghu commented on pull request #4918: URL: https://github.com/apache/hudi/pull/4918#issuecomment-1068770601 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [hudi] rohit-m-99 opened a new issue #5050: [SUPPORT] Hudi clustering / deleting markers taking significant resources and time

rohit-m-99 opened a new issue #5050: URL: https://github.com/apache/hudi/issues/5050 **Describe the problem you faced** The deltastreamer requires significant amount of resources and is struggling to delete file markers during clustering. The image below shows the clustering taking

[GitHub] [hudi] hudi-bot removed a comment on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing

hudi-bot removed a comment on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1068721225 ## CI report: * a9f8c1316b55b72c57d18fbe8d0c8103948a30bc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing

hudi-bot commented on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1068757919 ## CI report: * 0d6ad6e1d8767d66b15b31bb06d1318fb08e582c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4877: [HUDI-3457] Refactored Spark DataSource Relations to avoid code duplication

hudi-bot removed a comment on pull request #4877: URL: https://github.com/apache/hudi/pull/4877#issuecomment-1068703912 ## CI report: * fa17c3dc6e76669fd8897c92ecbdc56eef3e3e59 UNKNOWN * 379c451648850deb79570b49b185e0a1e7449a9c UNKNOWN * 4c0d61041d5e7fef677af1829f0892f3e46f2

[GitHub] [hudi] hudi-bot commented on pull request #4877: [HUDI-3457] Refactored Spark DataSource Relations to avoid code duplication

hudi-bot commented on pull request #4877: URL: https://github.com/apache/hudi/pull/4877#issuecomment-1068752201 ## CI report: * fa17c3dc6e76669fd8897c92ecbdc56eef3e3e59 UNKNOWN * 379c451648850deb79570b49b185e0a1e7449a9c UNKNOWN * 4c0d61041d5e7fef677af1829f0892f3e46f228e Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

hudi-bot removed a comment on pull request #5032: URL: https://github.com/apache/hudi/pull/5032#issuecomment-1068693790 ## CI report: * caaf05c0a829d858889e33ce0a545ba4e290c6a1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

hudi-bot commented on pull request #5032: URL: https://github.com/apache/hudi/pull/5032#issuecomment-1068726837 ## CI report: * 87b7a0fa831fa06ef3888d94cd732df0d418dd1a Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068693712 ## CI report: * 7bfd0420dc03a97b129ddb6729702bed55099fe7 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068724220 ## CI report: * 9ba5c351c32f9f364c30b4bc9a814075150d9728 UNKNOWN * 6d129abe16af1cb27298326613053ecfa409d1f8 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing

hudi-bot commented on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1068721225 ## CI report: * a9f8c1316b55b72c57d18fbe8d0c8103948a30bc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing

hudi-bot removed a comment on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1068719900 ## CI report: * a9f8c1316b55b72c57d18fbe8d0c8103948a30bc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing

hudi-bot commented on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1068719900 ## CI report: * a9f8c1316b55b72c57d18fbe8d0c8103948a30bc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4693: [WIP][HUDI-3175][RFC-45] Implement async metadata indexing

hudi-bot removed a comment on pull request #4693: URL: https://github.com/apache/hudi/pull/4693#issuecomment-1067120688 ## CI report: * a9f8c1316b55b72c57d18fbe8d0c8103948a30bc Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068710431 ## CI report: * 7ee24be4d11864af37bf300250d571e15d5f9ae9 UNKNOWN * Unknown: [CANCELED](TBD) * 107dab60f6541702644f4c87b7e92ba68f2fe6ef UNKNOWN Bot com

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068708838 ## CI report: * 6c514c9968e56dfce6f16b283f5a0f0455736858 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068708838 ## CI report: * 6c514c9968e56dfce6f16b283f5a0f0455736858 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068707445 ## CI report: * 36bcc00ceb0677c697d741c7c88ff7ae146152ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] peanut-chenzhong removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

peanut-chenzhong removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1067706183 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[GitHub] [hudi] peanut-chenzhong commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

peanut-chenzhong commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068708473 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

[GitHub] [hudi] hudi-bot commented on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot commented on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1068707445 ## CI report: * 36bcc00ceb0677c697d741c7c88ff7ae146152ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5042: Three bulk_insert files are concurrently submitted and executed with a difference of 2s, the insert fails occasionally.

hudi-bot removed a comment on pull request #5042: URL: https://github.com/apache/hudi/pull/5042#issuecomment-1067799417 ## CI report: * 36bcc00ceb0677c697d741c7c88ff7ae146152ef Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4877: [HUDI-3457] Refactored Spark DataSource Relations to avoid code duplication

hudi-bot removed a comment on pull request #4877: URL: https://github.com/apache/hudi/pull/4877#issuecomment-1068661514 ## CI report: * fa17c3dc6e76669fd8897c92ecbdc56eef3e3e59 UNKNOWN * 379c451648850deb79570b49b185e0a1e7449a9c UNKNOWN * 4c0d61041d5e7fef677af1829f0892f3e46f2

[GitHub] [hudi] hudi-bot commented on pull request #4877: [HUDI-3457] Refactored Spark DataSource Relations to avoid code duplication

hudi-bot commented on pull request #4877: URL: https://github.com/apache/hudi/pull/4877#issuecomment-1068703912 ## CI report: * fa17c3dc6e76669fd8897c92ecbdc56eef3e3e59 UNKNOWN * 379c451648850deb79570b49b185e0a1e7449a9c UNKNOWN * 4c0d61041d5e7fef677af1829f0892f3e46f228e Azur

[GitHub] [hudi] alexeykudinkin commented on pull request #4877: [HUDI-3457] Refactored Spark DataSource Relations to avoid code duplication

alexeykudinkin commented on pull request #4877: URL: https://github.com/apache/hudi/pull/4877#issuecomment-1068702943 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [hudi] hudi-bot removed a comment on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

hudi-bot removed a comment on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068672812 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

hudi-bot commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068700735 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

hudi-bot commented on pull request #5032: URL: https://github.com/apache/hudi/pull/5032#issuecomment-1068693790 ## CI report: * caaf05c0a829d858889e33ce0a545ba4e290c6a1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

hudi-bot removed a comment on pull request #5032: URL: https://github.com/apache/hudi/pull/5032#issuecomment-1068692376 ## CI report: * caaf05c0a829d858889e33ce0a545ba4e290c6a1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068671452 ## CI report: * 7bfd0420dc03a97b129ddb6729702bed55099fe7 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068693712 ## CI report: * 7bfd0420dc03a97b129ddb6729702bed55099fe7 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] liufangqi commented on pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

liufangqi commented on pull request #5032: URL: https://github.com/apache/hudi/pull/5032#issuecomment-1068692802 @wangxianghu THX for your review. I think it's a good advice for the description and the exception msg. Updated the code in the new commit. Could you help to review it again whe

[GitHub] [hudi] hudi-bot commented on pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

hudi-bot commented on pull request #5032: URL: https://github.com/apache/hudi/pull/5032#issuecomment-1068692376 ## CI report: * caaf05c0a829d858889e33ce0a545ba4e290c6a1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5032: [HUDI-3607] Support backend switch in HoodieFlinkStreamer

hudi-bot removed a comment on pull request #5032: URL: https://github.com/apache/hudi/pull/5032#issuecomment-1067580075 ## CI report: * caaf05c0a829d858889e33ce0a545ba4e290c6a1 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] JerryYue-M commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

JerryYue-M commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068688722 @danny0405 in the real product scene，source operator don't use the default parallelism of job. for example, kafka source will set the parallelism mapping to partition num

[GitHub] [hudi] JerryYue-M commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

JerryYue-M commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068688541 @danny0405 in the real product scene，source operator don't use the default parallelism of job. for example, kafka source will set the parallelism mapping to partition num

[jira] [Updated] (HUDI-3609) Create scala version specific artifacts for hudi-spark-client

[ https://issues.apache.org/jira/browse/HUDI-3609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3609: - Priority: Critical (was: Blocker) > Create scala version specific artifacts for hudi-spark-client > -

[jira] [Updated] (HUDI-3609) Create scala version specific artifacts for hudi-spark-client

[ https://issues.apache.org/jira/browse/HUDI-3609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3609: - Priority: Blocker (was: Major) > Create scala version specific artifacts for hudi-spark-client >

[jira] [Updated] (HUDI-3609) Create scala version specific artifacts for hudi-spark-client

[ https://issues.apache.org/jira/browse/HUDI-3609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3609: - Component/s: dependencies > Create scala version specific artifacts for hudi-spark-client > --

[GitHub] [hudi] xiarixiaoyao commented on a change in pull request #4962: [HUDI-3355] Issue with out of order commits in the timeline when ingestion writers using SparkAllowUpdateStrategy

xiarixiaoyao commented on a change in pull request #4962: URL: https://github.com/apache/hudi/pull/4962#discussion_r827588395 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/BaseHoodieWriteClient.java ## @@ -120,6 +121,7 @@ protected transi

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-1068683210 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 4b4180032db7f8e216282a239e75e5f0593f354e UNKNOWN * 08ad2cb52c0a9084f7bfeb3a77386b120baeb3a0 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-1068649002 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 4b4180032db7f8e216282a239e75e5f0593f354e UNKNOWN * aa7efec413d83b5165e3660dbb48ee6a29354

[GitHub] [hudi] JerryYue-M edited a comment on pull request #5007: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

JerryYue-M edited a comment on pull request #5007: URL: https://github.com/apache/hudi/pull/5007#issuecomment-1068679281 @danny0405 ,the real problem is this operator just use the the default parallelism of job instead of source parallelism. in some case, we will set parallelism for each

[GitHub] [hudi] JerryYue-M commented on pull request #5007: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

JerryYue-M commented on pull request #5007: URL: https://github.com/apache/hudi/pull/5007#issuecomment-1068679281 @danny0405 ,the real problem is this operator just use the the default parallelism of job instead of source parallelism. in some case, we will set parallelism for each operato

[GitHub] [hudi] JerryYue-M commented on a change in pull request #5007: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

JerryYue-M commented on a change in pull request #5007: URL: https://github.com/apache/hudi/pull/5007#discussion_r827578046 ## File path: hudi-flink/src/main/java/org/apache/hudi/configuration/FlinkOptions.java ## @@ -387,6 +387,12 @@ private FlinkOptions() { .noDefault

[GitHub] [hudi] danny0405 commented on a change in pull request #5030: [HUDI-3617] MOR compact improve

danny0405 commented on a change in pull request #5030: URL: https://github.com/apache/hudi/pull/5030#discussion_r827577363 ## File path: hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/compact/HoodieCompactor.java ## @@ -280,8 +281,11 @@ HoodieCompact

[GitHub] [hudi] hudi-bot removed a comment on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

hudi-bot removed a comment on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068671559 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

hudi-bot commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068672812 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4286: [WIP][HUDI-2955] Upgrade Hadoop to 3.3.1, Hive to 3.1.2, HBase to 2.4.8

hudi-bot removed a comment on pull request #4286: URL: https://github.com/apache/hudi/pull/4286#issuecomment-1068669955 ## CI report: * 4e607fb282b9098d297c56a8fa1f367dd8294201 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4286: [WIP][HUDI-2955] Upgrade Hadoop to 3.3.1, Hive to 3.1.2, HBase to 2.4.8

hudi-bot commented on pull request #4286: URL: https://github.com/apache/hudi/pull/4286#issuecomment-1068672484 ## CI report: * dbe231115001abd287e8d948d51011b708c02f7c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] JerryYue-M commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

JerryYue-M commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068672286 @wangxianghu thanks for review, I had fixed the problem you pointed out -- This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [hudi] hudi-bot commented on pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

hudi-bot commented on pull request #5049: URL: https://github.com/apache/hudi/pull/5049#issuecomment-1068671559 ## CI report: * 4dfdad00bdf14e922ccbea542b7a4eaf8253cea0 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068671452 ## CI report: * 7bfd0420dc03a97b129ddb6729702bed55099fe7 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068670235 ## CI report: * 24f14bb406f84e4469388aa8d9a2831660351590 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] danny0405 commented on issue #5044: [SUPPORT]flink hudi table unsupport complex data type

danny0405 commented on issue #5044: URL: https://github.com/apache/hudi/issues/5044#issuecomment-1068671091 Component data type is supported in release 0.11.0, you can try the master code then. -- This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [hudi] danny0405 closed issue #5044: [SUPPORT]flink hudi table unsupport complex data type

danny0405 closed issue #5044: URL: https://github.com/apache/hudi/issues/5044 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068665920 ## CI report: * 24f14bb406f84e4469388aa8d9a2831660351590 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068670235 ## CI report: * 24f14bb406f84e4469388aa8d9a2831660351590 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] JerryYue-M opened a new pull request #5049: [HUDI-3598] Row Data to Hoodie Record Operator should support users t…

JerryYue-M opened a new pull request #5049: URL: https://github.com/apache/hudi/pull/5049 …o adjust the number of parallelism ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening

[GitHub] [hudi] hudi-bot commented on pull request #4286: [WIP][HUDI-2955] Upgrade Hadoop to 3.3.1, Hive to 3.1.2, HBase to 2.4.8

hudi-bot commented on pull request #4286: URL: https://github.com/apache/hudi/pull/4286#issuecomment-1068669955 ## CI report: * 4e607fb282b9098d297c56a8fa1f367dd8294201 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4286: [WIP][HUDI-2955] Upgrade Hadoop to 3.3.1, Hive to 3.1.2, HBase to 2.4.8

hudi-bot removed a comment on pull request #4286: URL: https://github.com/apache/hudi/pull/4286#issuecomment-1068668630 ## CI report: * 4e607fb282b9098d297c56a8fa1f367dd8294201 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4286: [WIP][HUDI-2955] Upgrade Hadoop to 3.3.1, Hive to 3.1.2, HBase to 2.4.8

hudi-bot commented on pull request #4286: URL: https://github.com/apache/hudi/pull/4286#issuecomment-1068668630 ## CI report: * 4e607fb282b9098d297c56a8fa1f367dd8294201 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4286: [WIP][HUDI-2955] Upgrade Hadoop to 3.3.1, Hive to 3.1.2, HBase to 2.4.8

hudi-bot removed a comment on pull request #4286: URL: https://github.com/apache/hudi/pull/4286#issuecomment-992996624 ## CI report: * 4e607fb282b9098d297c56a8fa1f367dd8294201 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068664490 ## CI report: * 24f14bb406f84e4469388aa8d9a2831660351590 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068665920 ## CI report: * 24f14bb406f84e4469388aa8d9a2831660351590 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot removed a comment on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1067462366 ## CI report: * 24f14bb406f84e4469388aa8d9a2831660351590 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4957: [HUDI-3406] Rollback incorrectly relying on FS listing instead of Com…

hudi-bot commented on pull request #4957: URL: https://github.com/apache/hudi/pull/4957#issuecomment-1068664490 ## CI report: * 24f14bb406f84e4469388aa8d9a2831660351590 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4877: [HUDI-3457] Refactored Spark DataSource Relations to avoid code duplication

hudi-bot removed a comment on pull request #4877: URL: https://github.com/apache/hudi/pull/4877#issuecomment-1068616068 ## CI report: * fa17c3dc6e76669fd8897c92ecbdc56eef3e3e59 UNKNOWN * 379c451648850deb79570b49b185e0a1e7449a9c UNKNOWN * 4c0d61041d5e7fef677af1829f0892f3e46f2

[GitHub] [hudi] hudi-bot commented on pull request #4877: [HUDI-3457] Refactored Spark DataSource Relations to avoid code duplication

hudi-bot commented on pull request #4877: URL: https://github.com/apache/hudi/pull/4877#issuecomment-1068661514 ## CI report: * fa17c3dc6e76669fd8897c92ecbdc56eef3e3e59 UNKNOWN * 379c451648850deb79570b49b185e0a1e7449a9c UNKNOWN * 4c0d61041d5e7fef677af1829f0892f3e46f228e Azur

[jira] [Created] (HUDI-3642) NullPointerException during multi-writer conflict resolution

Ethan Guo created HUDI-3642: --- Summary: NullPointerException during multi-writer conflict resolution Key: HUDI-3642 URL: https://issues.apache.org/jira/browse/HUDI-3642 Project: Apache Hudi Issue T

[jira] [Created] (HUDI-3641) Timeline server have different last known instant in the timeline from client

Ethan Guo created HUDI-3641: --- Summary: Timeline server have different last known instant in the timeline from client Key: HUDI-3641 URL: https://issues.apache.org/jira/browse/HUDI-3641 Project: Apache Hudi

[jira] [Updated] (HUDI-3640) Use default key generator class if not provided by user in TwoToThreeUpgradeHandler

[ https://issues.apache.org/jira/browse/HUDI-3640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3640: Issue Type: Bug (was: Task) > Use default key generator class if not provided by user in > TwoToThreeUpgra

[GitHub] [hudi] hudi-bot commented on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot commented on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-1068649002 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 4b4180032db7f8e216282a239e75e5f0593f354e UNKNOWN * aa7efec413d83b5165e3660dbb48ee6a29354fd9 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4175: [HUDI-2883] Refactor hive sync tool / config to use reflection and standardize configs

hudi-bot removed a comment on pull request #4175: URL: https://github.com/apache/hudi/pull/4175#issuecomment-1068643751 ## CI report: * 92baf390f22bc9578344d8933621ff0e3778b007 UNKNOWN * 4b4180032db7f8e216282a239e75e5f0593f354e UNKNOWN * aa7efec413d83b5165e3660dbb48ee6a29354

[hudi] branch master updated (55dca96 -> 296a0e6)

This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 55dca96 [HUDI-3589] flink sync hive metadata supports table properties and serde properties (#4995) add 296a0e6

[GitHub] [hudi] yihua merged pull request #4997: [HUDI-3588] Remove hudi-common and hudi-hadoop-mr jars in Presto Docker image

yihua merged pull request #4997: URL: https://github.com/apache/hudi/pull/4997 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

  1   2   3   4   >