codope opened a new pull request, #5342:
URL: https://github.com/apache/hudi/pull/5342
## What is the purpose of the pull request
Currently, drop index deletes the partition but leaves any pending instant
on the timeline. If we do not delete the pending index instants, then
compactio
[
https://issues.apache.org/jira/browse/HUDI-3899?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-3899:
-
Labels: pull-request-available (was: )
> Drop index should delete index commit files from the tim
hudi-bot commented on PR #4480:
URL: https://github.com/apache/hudi/pull/4480#issuecomment-1101159452
## CI report:
* c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN
* 9e11c164c758d0da2e0c08c0ef849be5030f5753 UNKNOWN
* 45c2df4b21d99b4d322542f091b7a50f7ab8e4ce Azure:
[SUCCES
hudi-bot commented on PR #5342:
URL: https://github.com/apache/hudi/pull/5342#issuecomment-1101160120
## CI report:
* 9bb3e7a690559977a4e30804e621fb85f96bf670 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5342:
URL: https://github.com/apache/hudi/pull/5342#issuecomment-1101162432
## CI report:
* 9bb3e7a690559977a4e30804e621fb85f96bf670 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8095
hudi-bot commented on PR #5320:
URL: https://github.com/apache/hudi/pull/5320#issuecomment-1101175263
## CI report:
* 051d2951b69d9ba3ccdcbf5ddbe1ee6c1a1585f1 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8091
xushiyan opened a new pull request, #5343:
URL: https://github.com/apache/hudi/pull/5343
If schema on read is not enabled, use `HadoopFsRelation`.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to
hudi-bot commented on PR #5343:
URL: https://github.com/apache/hudi/pull/5343#issuecomment-1101178906
## CI report:
* 0354fcbd2b5841c4c403cc1a4f3b5bd0da647bec UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5343:
URL: https://github.com/apache/hudi/pull/5343#issuecomment-1101180671
## CI report:
* 0354fcbd2b5841c4c403cc1a4f3b5bd0da647bec Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8097
hudi-bot commented on PR #5341:
URL: https://github.com/apache/hudi/pull/5341#issuecomment-1101183925
## CI report:
* 2691cda7a183b61b9820c1d4cfe6d3570232746f Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8092
hudi-bot commented on PR #4724:
URL: https://github.com/apache/hudi/pull/4724#issuecomment-1101197673
## CI report:
* 20b1ee41afcb4cc5328bfb30e51e5a37bf0d46c7 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7999
hudi-bot commented on PR #5343:
URL: https://github.com/apache/hudi/pull/5343#issuecomment-1101202978
## CI report:
* 0354fcbd2b5841c4c403cc1a4f3b5bd0da647bec Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8097
hudi-bot commented on PR #5343:
URL: https://github.com/apache/hudi/pull/5343#issuecomment-1101205346
## CI report:
* 0354fcbd2b5841c4c403cc1a4f3b5bd0da647bec Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=809
xiarixiaoyao commented on code in PR #5343:
URL: https://github.com/apache/hudi/pull/5343#discussion_r851966494
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala:
##
@@ -101,4 +102,17 @@ class BaseFileOnlyRelation(sqlContext: SQ
zhangyue19921010 opened a new pull request, #5344:
URL: https://github.com/apache/hudi/pull/5344
https://issues.apache.org/jira/browse/HUDI-3879
Several improvements for HoodieMetadataTableValidator.
## What is the purpose of the pull request
*(For example: This pull requ
[
https://issues.apache.org/jira/browse/HUDI-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-3879:
-
Labels: pull-request-available (was: )
> Suppress exceptions that are not fatal in HoodieMetadata
hudi-bot commented on PR #5344:
URL: https://github.com/apache/hudi/pull/5344#issuecomment-1101215459
## CI report:
* ce61b19c10d4b4ad1f51ccd428d1aa5f8273f8f2 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5344:
URL: https://github.com/apache/hudi/pull/5344#issuecomment-1101218095
## CI report:
* ce61b19c10d4b4ad1f51ccd428d1aa5f8273f8f2 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8098
hudi-bot commented on PR #5343:
URL: https://github.com/apache/hudi/pull/5343#issuecomment-1101220518
## CI report:
* 0354fcbd2b5841c4c403cc1a4f3b5bd0da647bec Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=809
hudi-bot commented on PR #4441:
URL: https://github.com/apache/hudi/pull/4441#issuecomment-1101227260
## CI report:
* 2243884a4617e11f0c2d675bc973c644744c3a1e UNKNOWN
* 58a02eb9851c09f765371bd6eb71727def188baf Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
[
https://issues.apache.org/jira/browse/HUDI-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523602#comment-17523602
]
Danny Chen commented on HUDI-3898:
--
Adding a configuration option is easy but i want to b
hudi-bot commented on PR #4480:
URL: https://github.com/apache/hudi/pull/4480#issuecomment-1101233648
## CI report:
* c4a2ace5e28fafb29394a1448e1a6c2a0645dda9 UNKNOWN
* 9e11c164c758d0da2e0c08c0ef849be5030f5753 UNKNOWN
* aaeb0af88f7e0d5182dd3ab64e8838e79fb51e83 Azure:
[SUCCES
hudi-bot commented on PR #5344:
URL: https://github.com/apache/hudi/pull/5344#issuecomment-1101238386
## CI report:
* ce61b19c10d4b4ad1f51ccd428d1aa5f8273f8f2 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8098
hudi-bot commented on PR #4441:
URL: https://github.com/apache/hudi/pull/4441#issuecomment-1101240104
## CI report:
* 2243884a4617e11f0c2d675bc973c644744c3a1e UNKNOWN
* 58a02eb9851c09f765371bd6eb71727def188baf Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #5344:
URL: https://github.com/apache/hudi/pull/5344#issuecomment-1101240952
## CI report:
* ce61b19c10d4b4ad1f51ccd428d1aa5f8273f8f2 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=809
[
https://issues.apache.org/jira/browse/HUDI-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523613#comment-17523613
]
Chuang Lee commented on HUDI-3898:
--
I'm not sure if I understood your comment correctly:
miomiocat commented on PR #5111:
URL: https://github.com/apache/hudi/pull/5111#issuecomment-1101255459
> @alexeykudinkin : can you follow up on the review when you get a chance.
@miomiocat : can you rebase w/ latest master
Thanks for your reply.
Rebased, PTAL
--
This is an a
danny0405 commented on issue #5330:
URL: https://github.com/apache/hudi/issues/5330#issuecomment-110126
@Guanpx Did you use the code of latest master ? The shuffle strategy in
https://github.com/apache/hudi/blob/b8e465fdfcac1961fe05ed44993c8c6139e13b31/hudi-flink-datasource/hudi-flink/s
hudi-bot commented on PR #5111:
URL: https://github.com/apache/hudi/pull/5111#issuecomment-1101257529
## CI report:
* a9ddb49e67dc249e8449d6a688351008b35ffb47 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=726
hudi-bot commented on PR #5111:
URL: https://github.com/apache/hudi/pull/5111#issuecomment-1101259474
## CI report:
* a9ddb49e67dc249e8449d6a688351008b35ffb47 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=726
hudi-bot commented on PR #5342:
URL: https://github.com/apache/hudi/pull/5342#issuecomment-1101261772
## CI report:
* 9bb3e7a690559977a4e30804e621fb85f96bf670 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8095
hudi-bot commented on PR #5344:
URL: https://github.com/apache/hudi/pull/5344#issuecomment-1101261803
## CI report:
* ce61b19c10d4b4ad1f51ccd428d1aa5f8273f8f2 Azure:
[CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=809
[
https://issues.apache.org/jira/browse/HUDI-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523623#comment-17523623
]
Danny Chen commented on HUDI-3898:
--
> it means that the user knows whether the table with
[
https://issues.apache.org/jira/browse/HUDI-3898?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17523630#comment-17523630
]
Chuang Lee commented on HUDI-3898:
--
I agree with you.
Now I just want to confirm whether
hudi-bot commented on PR #5320:
URL: https://github.com/apache/hudi/pull/5320#issuecomment-1101276548
## CI report:
* 81f59f6d17f2b0b0e26243d2ea49b1166af8a546 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8096
xiarixiaoyao commented on code in PR #5343:
URL: https://github.com/apache/hudi/pull/5343#discussion_r852017845
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DefaultSource.scala:
##
@@ -98,6 +99,7 @@ class DefaultSource extends RelationProvider
v
hudi-bot commented on PR #5343:
URL: https://github.com/apache/hudi/pull/5343#issuecomment-1101299756
## CI report:
* 300c4f0c2d75619024f06efe764d1cc8990521c3 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8099
hudi-bot commented on PR #4441:
URL: https://github.com/apache/hudi/pull/4441#issuecomment-1101312238
## CI report:
* 2243884a4617e11f0c2d675bc973c644744c3a1e UNKNOWN
* a4f82cf5595ed530699182348ecc7abcbdd7f8d9 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
walkhan opened a new issue, #5345:
URL: https://github.com/apache/hudi/issues/5345
对于FSDataOutputStream(java.io.ByteArrayOutputStream), 找不到合适的构造器
Compile and integrate CDH,
hudi-bot commented on PR #5111:
URL: https://github.com/apache/hudi/pull/5111#issuecomment-1101330871
## CI report:
* 5a40626d6d8d6bad7ba86012ffb8dbf843b309ec Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8101
Aload commented on issue #4825:
URL: https://github.com/apache/hudi/issues/4825#issuecomment-1101345557
hi , When I use Flink to consume Kakfa and write hudi, I configure the hive
synchronization operation. The same problem occurred during startup .
When I looked through the hivesyncCont
Aload opened a new issue, #5346:
URL: https://github.com/apache/hudi/issues/5346
hi , When I use Flink to consume Kakfa and write hudi, I configure the hive
synchronization operation. The same problem occurred during startup .
When I looked through the hivesyncContext.java source code, I
codope opened a new pull request, #5347:
URL: https://github.com/apache/hudi/pull/5347
## What is the purpose of the pull request
When using custom transformers, user may not have turned on config to
reconcile schema explicitly. In that case, the schema in the transformed
dataset and
[
https://issues.apache.org/jira/browse/HUDI-3707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-3707:
-
Labels: pull-request-available (was: )
> Fix deltastreamer test with schema provider and transfor
hudi-bot commented on PR #5344:
URL: https://github.com/apache/hudi/pull/5344#issuecomment-1101348147
## CI report:
* e2200282573a65abbae99f5bc0fb81f903996ffe Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8102
zhilinli123 commented on issue #4881:
URL: https://github.com/apache/hudi/issues/4881#issuecomment-1101349187
> The expect behavior is that only after the bootstrap ends up we can handle
the in-coming new records. Maybe when you set the bootstrap parallelism as
`>1`, the in-coming records a
codope merged PR #5317:
URL: https://github.com/apache/hudi/pull/5317
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.or
This is an automated email from the ASF dual-hosted git repository.
codope pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from b8e465fdfc [MINOR] Fix typos in log4j-surefire.properties (#5212)
add 05dfc39c29 Fixing async clustering job test i
hudi-bot commented on PR #5347:
URL: https://github.com/apache/hudi/pull/5347#issuecomment-1101350055
## CI report:
* c72a7f1af64141c4b6d2ca466be5c2af9a5ca774 UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5347:
URL: https://github.com/apache/hudi/pull/5347#issuecomment-1101351856
## CI report:
* c72a7f1af64141c4b6d2ca466be5c2af9a5ca774 Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8103
lanyu1hao opened a new issue, #5348:
URL: https://github.com/apache/hudi/issues/5348
22/04/18 19:49:02 INFO timeline.HoodieActiveTimeline: Checking for file
exists ?/hudi/***/***_/.hoodie/20220418194506064.deltacommit.requested
Exception in thread "pool-24-thread-1"
org.apache.hudi.e
YuweiXiao commented on PR #4441:
URL: https://github.com/apache/hudi/pull/4441#issuecomment-1101361219
@hudi-bot run azure
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
T
hudi-bot commented on PR #4441:
URL: https://github.com/apache/hudi/pull/4441#issuecomment-1101362312
## CI report:
* 2243884a4617e11f0c2d675bc973c644744c3a1e UNKNOWN
* a4f82cf5595ed530699182348ecc7abcbdd7f8d9 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
hudi-bot commented on PR #5347:
URL: https://github.com/apache/hudi/pull/5347#issuecomment-1101409827
## CI report:
* c72a7f1af64141c4b6d2ca466be5c2af9a5ca774 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8103
hudi-bot commented on PR #4958:
URL: https://github.com/apache/hudi/pull/4958#issuecomment-1101411660
## CI report:
* 7bf1ce3392b26c8a8ea6b414a289acec2fccfa6e Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6676
hudi-bot commented on PR #4958:
URL: https://github.com/apache/hudi/pull/4958#issuecomment-1101413862
## CI report:
* 7bf1ce3392b26c8a8ea6b414a289acec2fccfa6e Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=6676
hudi-bot commented on PR #4441:
URL: https://github.com/apache/hudi/pull/4441#issuecomment-1101455754
## CI report:
* 2243884a4617e11f0c2d675bc973c644744c3a1e UNKNOWN
* a4f82cf5595ed530699182348ecc7abcbdd7f8d9 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2
nsivabalan merged PR #5329:
URL: https://github.com/apache/hudi/pull/5329
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apach
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/master by this push:
new b00d03fd62 [HUDI-3886] Adding default null for
nsivabalan commented on code in PR #5342:
URL: https://github.com/apache/hudi/pull/5342#discussion_r852164219
##
hudi-utilities/src/test/java/org/apache/hudi/utilities/TestHoodieIndexer.java:
##
@@ -132,29 +139,84 @@ public void testIndexerWithNotAllIndexesEnabled() {
asser
nsivabalan commented on code in PR #5347:
URL: https://github.com/apache/hudi/pull/5347#discussion_r85210
##
hudi-client/hudi-spark-client/src/main/scala/org/apache/hudi/HoodieSparkUtils.scala:
##
@@ -130,7 +129,15 @@ object HoodieSparkUtils extends SparkAdapterSupport {
hudi-bot commented on PR #4958:
URL: https://github.com/apache/hudi/pull/4958#issuecomment-1101469700
## CI report:
* 9a9e6149befed76a04fc2e691467772d44d158d5 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8106
hudi-bot commented on PR #5342:
URL: https://github.com/apache/hudi/pull/5342#issuecomment-1101498424
## CI report:
* 9bb3e7a690559977a4e30804e621fb85f96bf670 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8095
hudi-bot commented on PR #5342:
URL: https://github.com/apache/hudi/pull/5342#issuecomment-1101501037
## CI report:
* 9bb3e7a690559977a4e30804e621fb85f96bf670 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8095
hudi-bot commented on PR #5342:
URL: https://github.com/apache/hudi/pull/5342#issuecomment-1101557586
## CI report:
* f10e6ece4f254320ed20b28c721b8e82f201e163 Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8108
nsivabalan merged PR #5347:
URL: https://github.com/apache/hudi/pull/5347
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apach
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from b00d03fd62 [HUDI-3886] Adding default null for some of the fields in
col stats in MDT schema (#5329)
add 1718bc
zhedoubushishi commented on issue #5291:
URL: https://github.com/apache/hudi/issues/5291#issuecomment-1101617526
Sorry I don't fully understand your question. This should work:
`os.environ['HUDI_CONF_DIR'] = args['HUDI_CONF_DIR']`. But what
`args['HUDI_CONF_DIR']` stands for?
--
This is
hudi-bot commented on PR #5338:
URL: https://github.com/apache/hudi/pull/5338#issuecomment-1101649311
## CI report:
* 5cd21a598d455492412ea525feddaa53325b5c9a Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8087
hudi-bot commented on PR #5338:
URL: https://github.com/apache/hudi/pull/5338#issuecomment-1101651948
## CI report:
* 5cd21a598d455492412ea525feddaa53325b5c9a Azure:
[FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8087
xushiyan opened a new pull request, #5349:
URL: https://github.com/apache/hudi/pull/5349
Similar to #5338
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-
hudi-bot commented on PR #5349:
URL: https://github.com/apache/hudi/pull/5349#issuecomment-1101668855
## CI report:
* 14ad8c1acfba4a5596d530550d483534a7c2705b UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
alexeykudinkin commented on PR #5337:
URL: https://github.com/apache/hudi/pull/5337#issuecomment-1101671339
@nsivabalan i don't think there's a way for us to assert this easily. We can
try to assert the number of partitions after optimizing Spark plan. Will create
a ticket to follow-up on i
[
https://issues.apache.org/jira/browse/HUDI-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-3895:
-
Labels: pull-request-available (was: )
> Make sure Hudi relations do proper file-split packing (o
hudi-bot commented on PR #5349:
URL: https://github.com/apache/hudi/pull/5349#issuecomment-1101672108
## CI report:
* 14ad8c1acfba4a5596d530550d483534a7c2705b Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8111
[
https://issues.apache.org/jira/browse/HUDI-3896?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-3896:
--
Fix Version/s: 0.11.0
(was: 0.12.0)
> Support Spark optimizations for `Ha
[
https://issues.apache.org/jira/browse/HUDI-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-3884:
--
Fix Version/s: 0.11.0
(was: 0.12.0)
> Inspect why archival stops
[
https://issues.apache.org/jira/browse/HUDI-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
sivabalan narayanan updated HUDI-3884:
--
Sprint: Hudi-Sprint-Apr-12
> Inspect why archival stops at first savepoint. Add support
nsivabalan opened a new pull request, #5350:
URL: https://github.com/apache/hudi/pull/5350
## What is the purpose of the pull request
- So far, archival will stop at the first savepointed commit and will not
proceed further. For users who may not be interested in incremental queries,
[
https://issues.apache.org/jira/browse/HUDI-3884?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
ASF GitHub Bot updated HUDI-3884:
-
Labels: pull-request-available (was: )
> Inspect why archival stops at first savepoint. Add suppo
hudi-bot commented on PR #5350:
URL: https://github.com/apache/hudi/pull/5350#issuecomment-1101707065
## CI report:
* cff8f426ed8e62d37bb46984ad21e570cd04ff7c UNKNOWN
Bot commands
@hudi-bot supports the following commands:
- `@hudi-bot run azure` re-run the
hudi-bot commented on PR #5350:
URL: https://github.com/apache/hudi/pull/5350#issuecomment-1101709463
## CI report:
* cff8f426ed8e62d37bb46984ad21e570cd04ff7c Azure:
[PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8112
nsivabalan commented on PR #5344:
URL: https://github.com/apache/hudi/pull/5344#issuecomment-1101710498
@zhangyue19921010 : One of my error injection test run failed w/ below
exception with metadata table validation.
```
Run Number : 0
├── Deltastreamer Job
│ ├── Statu
nsivabalan commented on code in PR #5344:
URL: https://github.com/apache/hudi/pull/5344#discussion_r852372132
##
hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieMetadataTableValidator.java:
##
@@ -399,7 +400,9 @@ public void doMetadataTableValidation() {
Set ba
nsivabalan commented on PR #5337:
URL: https://github.com/apache/hudi/pull/5337#issuecomment-1101714149
sure, sg.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubs
nsivabalan commented on PR #5331:
URL: https://github.com/apache/hudi/pull/5331#issuecomment-1101715404
I don't see this being used anywhere. So, may I know whats the purpose then
?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to G
hudi-bot commented on PR #5338:
URL: https://github.com/apache/hudi/pull/5338#issuecomment-1101715941
## CI report:
* 5b414e455d3ce63b354860d75ea0505de8269a35 Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8110
nsivabalan commented on code in PR #5337:
URL: https://github.com/apache/hudi/pull/5337#discussion_r852377364
##
hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/BaseFileOnlyRelation.scala:
##
@@ -84,21 +84,24 @@ class BaseFileOnlyRelation(sqlContext: SQLCo
nsivabalan merged PR #5337:
URL: https://github.com/apache/hudi/pull/5337
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscr...@hudi.apach
sivabalan narayanan created HUDI-3901:
-
Summary: Add tests and assertions for
BaseFileOnlyRelation.collectFileSplits
Key: HUDI-3901
URL: https://issues.apache.org/jira/browse/HUDI-3901
Project: Ap
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git
from 1718bcab84 [HUDI-3707] Fix target schema handling in HoodieSparkUtils
while creating RDD (#5347)
add 7ecb47cd21
suryaprasanna commented on issue #5223:
URL: https://github.com/apache/hudi/issues/5223#issuecomment-1101721223
@sharathkola
I do not have much context if at all aws is having any custom implementation
on hudi code.
In the spark DAG, the filter block is showing output rows as 2. D
bhasudha commented on PR #5333:
URL: https://github.com/apache/hudi/pull/5333#issuecomment-1101729851
> hi @bhasudha have you verified it locally? LGTM
Yes. Verified locally.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to Gi
nsivabalan commented on PR #5342:
URL: https://github.com/apache/hudi/pull/5342#issuecomment-1101733790
There is some flakiness around
TestHoodieIndexer.testTwoIndexersOneCreateOneDropPartition. I tried running it
locally for 30 times and could not reproduce. have re-triggered CI run. lets
p-powell opened a new issue, #5351:
URL: https://github.com/apache/hudi/issues/5351
Concerned about performance. How long should the following mocked-up sample
take to write to s3? There are 1,369,765 records and 308 columns. It is taking
~10.5min running in docker container on an t2.xlarge
hudi-bot commented on PR #5349:
URL: https://github.com/apache/hudi/pull/5349#issuecomment-1101736038
## CI report:
* 14ad8c1acfba4a5596d530550d483534a7c2705b Azure:
[SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=8111
[
https://issues.apache.org/jira/browse/HUDI-3895?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin closed HUDI-3895.
-
Resolution: Fixed
> Make sure Hudi relations do proper file-split packing (on par w/ Spark)
>
Alexey Kudinkin created HUDI-3902:
-
Summary: Fallback to HadoopFsRelation for non-sophisticated COW
use-cases
Key: HUDI-3902
URL: https://issues.apache.org/jira/browse/HUDI-3902
Project: Apache Hudi
[
https://issues.apache.org/jira/browse/HUDI-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-3902:
--
Sprint: Hudi-Sprint-Apr-12
> Fallback to HadoopFsRelation for non-sophisticated COW use-cases
>
[
https://issues.apache.org/jira/browse/HUDI-3902?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Alexey Kudinkin updated HUDI-3902:
--
Status: In Progress (was: Open)
> Fallback to HadoopFsRelation for non-sophisticated COW use-ca
1 - 100 of 371 matches
Mail list logo
