wxplovecc opened a new pull request, #5383:
URL: https://github.com/apache/hudi/pull/5383
## *Tips*
- *Thank you very much for contributing to Apache Hudi.*
- *Please review https://hudi.apache.org/contribute/how-to-contribute before
opening a pull request.*
## What is the purpo
hudi-bot commented on PR #5383:
URL: https://github.com/apache/hudi/pull/5383#issuecomment-1104800762
## CI report:
* 774f150933923e70d12976c55462f6ea87c849a8 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5383:
URL: https://github.com/apache/hudi/pull/5383#issuecomment-1104803124
## CI report:
* 774f150933923e70d12976c55462f6ea87c849a8 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8193
XuQianJin-Stars commented on PR #5359:
URL: https://github.com/apache/hudi/pull/5359#issuecomment-1104803864
@zhangyue19921010 LGTM， It would be better if you can add a hudi's benchmark
for comparison.
--
This is an automated message from the Apache Git Service.
To respond to the message,
yihua commented on code in PR #5379:
URL: https://github.com/apache/hudi/pull/5379#discussion_r854863511
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##
@@ -336,7 +335,11 @@ abstract class HoodieBaseRelation(val sqlContext:
KnightChess commented on code in PR #5359:
URL: https://github.com/apache/hudi/pull/5359#discussion_r853201697
##
hudi-spark-datasource/hudi-spark/pom.xml:
##
@@ -434,6 +434,12 @@
${zk-curator.version}
+
+ com.aventrix.jnanoid
+ jnanoid
+ 2.0.0
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1104826200
## CI report:
* be06e770d6e7c1dac23795bf484b47afa8afde5f UNKNOWN
* 6864c81549aade3974045367ff1fd06e6a11f2b5 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1104843629
## CI report:
* 6864c81549aade3974045367ff1fd06e6a11f2b5 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1104846594
## CI report:
* 6864c81549aade3974045367ff1fd06e6a11f2b5 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8191
xushiyan merged PR #5380:
URL: https://github.com/apache/hudi/pull/5380
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new a9506aa545 [HUDI-3938] Fix default value for num
hudi-bot commented on PR #5370:
URL: https://github.com/apache/hudi/pull/5370#issuecomment-1104852749
## CI report:
* 95ca56ff2e76f43017333195df1c40b4cfa3aa0a UNKNOWN
* 4bde7abd738d375a17b7d1df92248227127db21b Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #5381:
URL: https://github.com/apache/hudi/pull/5381#issuecomment-1104858991
## CI report:
* 62d228369cc95f58f47e0b097eec8b0deee46662 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=819
KnightChess commented on PR #5381:
URL: https://github.com/apache/hudi/pull/5381#issuecomment-1104861370
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
hudi-bot commented on PR #5381:
URL: https://github.com/apache/hudi/pull/5381#issuecomment-1104862263
## CI report:
* 62d228369cc95f58f47e0b097eec8b0deee46662 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=819
xushiyan commented on code in PR #5377:
URL: https://github.com/apache/hudi/pull/5377#discussion_r854918528
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala:
##
@@ -774,4 +785,23 @@ object DataSourceOptionsHelper {
override
xushiyan merged PR #5377:
URL: https://github.com/apache/hudi/pull/5377
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from a9506aa545 [HUDI-3938] Fix default value for num retries to acquire
lock (#5380)
add 4b296f79cc [HUDI-3935] Addi
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1104883300
## CI report:
* dd8db55be78b9e056d658604404137bef48ba4fb UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1104888042
## CI report:
* dd8db55be78b9e056d658604404137bef48ba4fb Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8188
xushiyan commented on code in PR #5379:
URL: https://github.com/apache/hudi/pull/5379#discussion_r854951818
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/HoodieBaseRelation.scala:
##
@@ -336,7 +335,11 @@ abstract class HoodieBaseRelation(val sqlContex
hudi-bot commented on PR #5370:
URL: https://github.com/apache/hudi/pull/5370#issuecomment-1104911902
## CI report:
* 95ca56ff2e76f43017333195df1c40b4cfa3aa0a UNKNOWN
* 4bde7abd738d375a17b7d1df92248227127db21b Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #5383:
URL: https://github.com/apache/hudi/pull/5383#issuecomment-1104916478
## CI report:
* 774f150933923e70d12976c55462f6ea87c849a8 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8193
hudi-bot commented on PR #5370:
URL: https://github.com/apache/hudi/pull/5370#issuecomment-1104925906
## CI report:
* 95ca56ff2e76f43017333195df1c40b4cfa3aa0a UNKNOWN
* 07f2f122f1fe0fe8c0097af16e3c1772fa84dabc Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-
CaoYu created HUDI-3939:
---
Summary: Website Contributing code to the project (newbie JIRAs)
links wrong.
Key: HUDI-3939
URL: https://issues.apache.org/jira/browse/HUDI-3939
Project: Apache Hudi
Issue T
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1104952748
## CI report:
* dd8db55be78b9e056d658604404137bef48ba4fb Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8188
xushiyan commented on code in PR #5378:
URL: https://github.com/apache/hudi/pull/5378#discussion_r854971145
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32DataSourceUtils.scala:
##
@@ -0,0 +1,77 @@
+/*
+ * Licensed t
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1104994718
## CI report:
* 6864c81549aade3974045367ff1fd06e6a11f2b5 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=819
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit f25f79c27c27043bbc1a9ee53c245cec7847a128
Author: Raymond Xu
AuthorDate: Thu Apr 21 18:14:43 2022 +0800
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 4bbdf4a82633aeadc39bea9e3abf71d4cee972e4
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 13:14:40 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 681f4a2be2bf191039cf37833aa53f95315fba19
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 15:19:58 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit c872dc14ef648ae130539ecdafa39f58964e201d
Author: Sivabalan Narayanan
AuthorDate: Thu Apr 21 04:08:43 2022
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit bcf816e60fcaa7bbb5b46733e603ad2ea32cae7d
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 15:34:05 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit c60b8564344208511790101952b990f0525456ab
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 15:29:18 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 2a5f6168393f1d75f839bfab2a4636f06877a7f1
Author: Raymond Xu
AuthorDate: Thu Apr 21 18:15:54 2022 +0800
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 6fccca6c04724a304c117b77a8cb42b0e433a719
Author: Alexey Kudinkin
AuthorDate: Thu Apr 21 01:36:19 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a change to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
at 4d8c701b0b Revert "Cleaning up `ReflectionUtils`"
This branch includes the following new commits:
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 4d8c701b0b46f4777178559f7f2dceabc55f8dd3
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 22:22:47 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 8ae810c72c8c08a448c123c3bfd8ffe33b9087b1
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 15:32:48 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 669408e7311d2751caba0f5f1c2a7bb986175ca6
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 15:20:40 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit a4b2ff77f10222cac0d71bca778140c4dda1eb11
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 14:44:46 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit f58876cef0b1e6dfc6f56c1fe45b0090d2cfffd7
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 14:27:42 2022 -070
hudi-bot commented on PR #5381:
URL: https://github.com/apache/hudi/pull/5381#issuecomment-1105032487
## CI report:
* 62d228369cc95f58f47e0b097eec8b0deee46662 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=819
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1105049263
## CI report:
* dd8db55be78b9e056d658604404137bef48ba4fb UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1105052299
## CI report:
* dd8db55be78b9e056d658604404137bef48ba4fb Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8188
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1105090559
## CI report:
* dd8db55be78b9e056d658604404137bef48ba4fb Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8188
xushiyan merged PR #5384:
URL: https://github.com/apache/hudi/pull/5384
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new 4e1ac467da [MINOR] Increase azure CI timeout to
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1105117289
## CI report:
* dd8db55be78b9e056d658604404137bef48ba4fb Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8188
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1105120261
## CI report:
* dd8db55be78b9e056d658604404137bef48ba4fb Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8188
xushiyan commented on code in PR #5378:
URL: https://github.com/apache/hudi/pull/5378#discussion_r855120835
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -332,10 +390,33 @@ class
xushiyan commented on code in PR #5378:
URL: https://github.com/apache/hudi/pull/5378#discussion_r855120835
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -332,10 +390,33 @@ class
xiarixiaoyao commented on code in PR #5378:
URL: https://github.com/apache/hudi/pull/5378#discussion_r855132261
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -332,10 +390,33 @@ c
hudi-bot commented on PR #5379:
URL: https://github.com/apache/hudi/pull/5379#issuecomment-1105152335
## CI report:
* d24bcd682911017e9a08c5b385337dded5ad4719 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=819
xushiyan commented on code in PR #5378:
URL: https://github.com/apache/hudi/pull/5378#discussion_r855137210
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -332,10 +390,33 @@ class
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/rc3-patched-for-test by this
push:
new b41d66b4a1 use tail
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105169488
## CI report:
* 6864c81549aade3974045367ff1fd06e6a11f2b5 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=819
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105172351
## CI report:
* 6864c81549aade3974045367ff1fd06e6a11f2b5 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=819
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/rc3-patched-for-test by this
push:
new 4e1211ca80 fix tail
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105220102
## CI report:
* 6864c81549aade3974045367ff1fd06e6a11f2b5 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=819
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105224831
## CI report:
* 79ba7de9b6fe78f182920597eebb5add0eb9b11f Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=820
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105243826
## CI report:
* 79ba7de9b6fe78f182920597eebb5add0eb9b11f Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=820
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/rc3-patched-for-test by this
push:
new a3dd26158c fix unde
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105264084
## CI report:
* 79ba7de9b6fe78f182920597eebb5add0eb9b11f Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=820
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105269391
## CI report:
* b5ef8eb9bba7cca1bf627e89311f586737c6544d Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=820
p-powell opened a new issue, #5385:
URL: https://github.com/apache/hudi/issues/5385
Just a general question about the _hoodie_is_deleted column. Do we need to
include the _hoodie_is_deleted column in the initial load of data to a hudi
table? Is it expected to be there?
Environment
nsivabalan commented on code in PR #5376:
URL: https://github.com/apache/hudi/pull/5376#discussion_r855238436
##
hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java:
##
@@ -405,6 +407,18 @@ public static GenericRecord
rewriteRecordWithMetadata(GenericRecord gene
giannisp-verneek opened a new issue, #5386:
URL: https://github.com/apache/hudi/issues/5386
I have a pipeline where I send simple messages to a Kafka topic, write them
via HudiDeltaStreamer to a Hudi table and finally read it through Spark. I
first send a set of messages, and read them with
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105335212
## CI report:
* b5ef8eb9bba7cca1bf627e89311f586737c6544d Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=820
xiarixiaoyao commented on code in PR #5376:
URL: https://github.com/apache/hudi/pull/5376#discussion_r855301041
##
hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java:
##
@@ -741,10 +769,23 @@ private static Object rewriteRecordWithNewSchema(Object
oldRecord, Sc
codope commented on issue #5361:
URL: https://github.com/apache/hudi/issues/5361#issuecomment-1105364334
Can you please try enabling the following config in the second pipeline
(i.e. jdbc deltastreamer)
`hoodie.datasource.write.reconcile.schema`
--
This is an automated message from the
xiarixiaoyao commented on code in PR #5376:
URL: https://github.com/apache/hudi/pull/5376#discussion_r855303296
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/table/action/commit/HoodieMergeHelper.java:
##
@@ -109,10 +113,14 @@ public void runMerge(HoodieTable>,
xiarixiaoyao commented on code in PR #5376:
URL: https://github.com/apache/hudi/pull/5376#discussion_r855310604
##
hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java:
##
@@ -405,6 +407,18 @@ public static GenericRecord
rewriteRecordWithMetadata(GenericRecord ge
p-powell commented on issue #5351:
URL: https://github.com/apache/hudi/issues/5351#issuecomment-1105389992
@codope I built from master and takes 492 secs. Still seems slow.
We have an internal file(2.6m rows ~300col) takes 16min to load into a new
table(one partition). If we dump t
alexeykudinkin commented on code in PR #5378:
URL: https://github.com/apache/hudi/pull/5378#discussion_r855333175
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32DataSourceUtils.scala:
##
@@ -0,0 +1,77 @@
+/*
+ * Lice
alexeykudinkin commented on code in PR #5378:
URL: https://github.com/apache/hudi/pull/5378#discussion_r855334576
##
hudi-spark-datasource/hudi-spark3/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/Spark32HoodieParquetFileFormat.scala:
##
@@ -332,10 +390,33 @@
Sagar Sumit created HUDI-3940:
-
Summary: Lock manager does not increment retry count upon exception
Key: HUDI-3940
URL: https://issues.apache.org/jira/browse/HUDI-3940
Project: Apache Hudi
Issue
codope opened a new pull request, #5387:
URL: https://github.com/apache/hudi/pull/5387
## What is the purpose of the pull request
Retry count in lockmanager should be incremented even when it attempts to
acquire lock but fails.
## Brief change log
*(for example:)*
-
[
https://issues.apache.org/jira/browse/HUDI-3940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-3940:
-
Labels: pull-request-available (was: )
> Lock manager does not increment retry count upon excepti
hudi-bot commented on PR #5376:
URL: https://github.com/apache/hudi/pull/5376#issuecomment-1105426472
## CI report:
* 42dedcf6eaf051d131fc69619cc70e638e8bf5e6 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8187
santoshsb opened a new issue, #5388:
URL: https://github.com/apache/hudi/issues/5388
Hi Team,
Environment: AWS
emr-6.5.0
Applications: Hive 3.1.2, Tez 0.9.2, Presto 0.261, Spark 3.1.2
I have created a hudi table using spark/spark-session using the following
code
`val
hudi-bot commented on PR #5387:
URL: https://github.com/apache/hudi/pull/5387#issuecomment-1105426567
## CI report:
* 75c587a72afceb48ec30a94239acabcd441ab0c8 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
alexeykudinkin commented on code in PR #5387:
URL: https://github.com/apache/hudi/pull/5387#discussion_r855360523
##
hudi-client/hudi-client-common/src/main/java/org/apache/hudi/client/transaction/lock/LockManager.java:
##
@@ -70,11 +70,12 @@ public void lock() {
}
hudi-bot commented on PR #5376:
URL: https://github.com/apache/hudi/pull/5376#issuecomment-1105430123
## CI report:
* 42dedcf6eaf051d131fc69619cc70e638e8bf5e6 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8187
hudi-bot commented on PR #5387:
URL: https://github.com/apache/hudi/pull/5387#issuecomment-1105430218
## CI report:
* 75c587a72afceb48ec30a94239acabcd441ab0c8 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8204
xiarixiaoyao commented on PR #5376:
URL: https://github.com/apache/hudi/pull/5376#issuecomment-1105433325
@nsivabalan @alexeykudinkin could you pls review again
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
hudi-bot commented on PR #5378:
URL: https://github.com/apache/hudi/pull/5378#issuecomment-1105437084
## CI report:
* 6409d526040c06399ad8085f760a8d9537eb26c1 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8202
Rajesh Mahindra created HUDI-3941:
-
Summary: Add extrametadata and commitActiontype to write callback
Key: HUDI-3941
URL: https://issues.apache.org/jira/browse/HUDI-3941
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Mahindra reassigned HUDI-3941:
-
Assignee: sivabalan narayanan
> Add extrametadata and commitActiontype to write callback
[
https://issues.apache.org/jira/browse/HUDI-3941?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17525836#comment-17525836
]
Rajesh Mahindra commented on HUDI-3941:
---
[~shivnarayan] i have a local PR for this,
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a change to branch release-0.11.0
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 8fdbbd2e83 Bumping release candidate number 3
add c872dc14ef [HUDI-3938] Fix default value for num retrie
alexeykudinkin commented on code in PR #5377:
URL: https://github.com/apache/hudi/pull/5377#discussion_r855420115
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala:
##
@@ -774,4 +785,23 @@ object DataSourceOptionsHelper {
ov
hudi-bot commented on PR #5376:
URL: https://github.com/apache/hudi/pull/5376#issuecomment-1105502224
## CI report:
* cbdc49842258501c1888e5cc247c70fadfde20b7 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8203
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 4d3c0edf6753c67a7ec3567e85543f9dfa427d8e
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 15:34:05 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 2818846f62f72185fdb6c2fcae5104ccec132294
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 15:20:40 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit e535353f2e40fc1be943e59f65b6d643947364e5
Author: Raymond Xu <2701446+xushi...@users.noreply.github.com>
Aut
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit e2b59ef98fb223763e6f6d0c9ff7fa6d4b8f7fec
Author: Alexey Kudinkin
AuthorDate: Wed Apr 20 13:14:40 2022 -070
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit cbf1a1585ece155b3ba631dfca1eaea28910ad23
Author: Raymond Xu <2701446+xushi...@users.noreply.github.com>
Aut
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 44d47b0013d6df631516050e2d7cdddeb7b43269
Author: xiarixiaoyao
AuthorDate: Fri Apr 22 00:05:18 2022 +0800
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch rc3-patched-for-test
in repository https://gitbox.apache.org/repos/asf/hudi.git
commit 5bbd47f22214dc1c911688ebb04f75b8e9d7cbcb
Author: xiarixiaoyao
AuthorDate: Wed Apr 20 20:29:54 2022 +0800
1 - 100 of 230 matches
Mail list logo
