[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093748687 ## CI report: * 784c8cf617b0f4eca028205f87067e08bb55457b UNKNOWN * c411bedee151888a7cb67690be123c0bc0f29797 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5271: [MINOR] Fix typos in the comments of HoodieMergeHandle

hudi-bot commented on PR #5271: URL: https://github.com/apache/hudi/pull/5271#issuecomment-1093746807 ## CI report: * e0505e07e7734c88a554279e4b52e7d3b5a3fa0d Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7943

[GitHub] [hudi] hudi-bot commented on pull request #5271: [MINOR] Fix typos in the comments of HoodieMergeHandle

hudi-bot commented on PR #5271: URL: https://github.com/apache/hudi/pull/5271#issuecomment-1093744862 ## CI report: * e0505e07e7734c88a554279e4b52e7d3b5a3fa0d UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] dongkelun opened a new pull request, #5271: [MINOR] Fix typos in the comments of HoodieMergeHandle

dongkelun opened a new pull request, #5271: URL: https://github.com/apache/hudi/pull/5271 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[jira] [Updated] (HUDI-3636) Clustering fails due to marker creation failure

[ https://issues.apache.org/jira/browse/HUDI-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3636: Status: Patch Available (was: In Progress) > Clustering fails due to marker creation failure >

[GitHub] [hudi] yihua commented on a diff in pull request #5268: [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex

yihua commented on code in PR #5268: URL: https://github.com/apache/hudi/pull/5268#discussion_r846582646 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bloom/SparkHoodieBloomIndexHelper.java: ## @@ -75,7 +80,9 @@ public static SparkHoodieBloomIndexHelper ge

[jira] [Created] (HUDI-3836) Improve the way of fetching metadata partitions from table config

Ethan Guo created HUDI-3836: --- Summary: Improve the way of fetching metadata partitions from table config Key: HUDI-3836 URL: https://issues.apache.org/jira/browse/HUDI-3836 Project: Apache Hudi Is

[GitHub] [hudi] hudi-bot commented on pull request #5268: [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex

hudi-bot commented on PR #5268: URL: https://github.com/apache/hudi/pull/5268#issuecomment-1093736911 ## CI report: * 201bac79e0dd29aa82c6a9d4991bcbf1ba90ee9b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7931

[GitHub] [hudi] hudi-bot commented on pull request #5268: [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex

hudi-bot commented on PR #5268: URL: https://github.com/apache/hudi/pull/5268#issuecomment-1093734940 ## CI report: * 201bac79e0dd29aa82c6a9d4991bcbf1ba90ee9b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7931

[hudi] branch master updated (1cc7542357 -> 81b25c543a)

This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 1cc7542357 [MINOR] Update README of docker build setup (#5256) add 81b25c543a [HUDI-3825] Fixing Column Stats Index

[GitHub] [hudi] yihua merged pull request #5267: [HUDI-3825] Fixing Column Stats Index updating sequence

yihua merged PR #5267: URL: https://github.com/apache/hudi/pull/5267 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[GitHub] [hudi] hudi-bot commented on pull request #5270: [HUDI-3835] Add UT for delete in java client

hudi-bot commented on PR #5270: URL: https://github.com/apache/hudi/pull/5270#issuecomment-1093729029 ## CI report: * 89346658ebebb9750cb1c7e3648827519662221c Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7940

[GitHub] [hudi] hudi-bot commented on pull request #5270: [HUDI-3835] Add UT for delete in java client

hudi-bot commented on PR #5270: URL: https://github.com/apache/hudi/pull/5270#issuecomment-1093727064 ## CI report: * 89346658ebebb9750cb1c7e3648827519662221c UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-3835) Add UT for delete in java client

[ https://issues.apache.org/jira/browse/HUDI-3835?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3835: - Labels: pull-request-available (was: ) > Add UT for delete in java client > -

[GitHub] [hudi] dongkelun opened a new pull request, #5270: [HUDI-3835] Add UT for delete in java client

dongkelun opened a new pull request, #5270: URL: https://github.com/apache/hudi/pull/5270 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093721102 ## CI report: * 784c8cf617b0f4eca028205f87067e08bb55457b UNKNOWN * c411bedee151888a7cb67690be123c0bc0f29797 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] yihua commented on a diff in pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

yihua commented on code in PR #5269: URL: https://github.com/apache/hudi/pull/5269#discussion_r846580321 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/HoodieSparkClusteringClient.java: ## @@ -53,11 +53,15 @@ public void cluster(HoodieInstant instant) thro

[jira] [Created] (HUDI-3835) Add UT for delete in java client

董可伦 created HUDI-3835: - Summary: Add UT for delete in java client Key: HUDI-3835 URL: https://issues.apache.org/jira/browse/HUDI-3835 Project: Apache Hudi Issue Type: Test Components: writer-co

[GitHub] [hudi] hudi-bot commented on pull request #4459: [HUDI-3116]Add a new HoodieDropPartitionsTool to let users drop table partitions through a standalone job.

hudi-bot commented on PR #4459: URL: https://github.com/apache/hudi/pull/4459#issuecomment-1093708513 ## CI report: * d9182c1661e37f29622caafd9eaa23de73b26331 UNKNOWN * a9adb389ced0da6b29961cfe30fb3c0fd7a2b3cb UNKNOWN * 7a342453cd4175e63689674cfb56cfcf3d03d2a6 Azure: [SUCCES

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093690865 ## CI report: * 79639f70c86407d2cce694670fad2170e3f59ee7 UNKNOWN * 723c55a7638c2110494863da74d56da06dd261d0 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

hudi-bot commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093672960 ## CI report: * c252f8d6d9a6b38adcebec0ba857d5aafae823cf UNKNOWN * 6097520274d65ff9a9c2734a25eaf253ef78529d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093665632 ## CI report: * 784c8cf617b0f4eca028205f87067e08bb55457b UNKNOWN * c411bedee151888a7cb67690be123c0bc0f29797 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] zhangyue19921010 commented on pull request #4459: [HUDI-3116]Add a new HoodieDropPartitionsTool to let users drop table partitions through a standalone job.

zhangyue19921010 commented on PR #4459: URL: https://github.com/apache/hudi/pull/4459#issuecomment-1093660042 Okay, Just merge from master and waiting for ci green :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [hudi] hudi-bot commented on pull request #4459: [HUDI-3116]Add a new HoodieDropPartitionsTool to let users drop table partitions through a standalone job.

hudi-bot commented on PR #4459: URL: https://github.com/apache/hudi/pull/4459#issuecomment-1093659106 ## CI report: * d9182c1661e37f29622caafd9eaa23de73b26331 UNKNOWN * a9adb389ced0da6b29961cfe30fb3c0fd7a2b3cb UNKNOWN * 5a7799b096c23e0947c599bcd2b9f7658db9b875 Azure: [SUCCES

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093646153 ## CI report: * b2028eefb54ce1c63f6653fb74a91b96e804baff Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7934

[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093646283 ## CI report: * d7515d1f98a1299f5a42e242d3e36d84a9a38bee Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] hudi-bot commented on pull request #4459: [HUDI-3116]Add a new HoodieDropPartitionsTool to let users drop table partitions through a standalone job.

hudi-bot commented on PR #4459: URL: https://github.com/apache/hudi/pull/4459#issuecomment-1093636603 ## CI report: * d9182c1661e37f29622caafd9eaa23de73b26331 UNKNOWN * a9adb389ced0da6b29961cfe30fb3c0fd7a2b3cb UNKNOWN * 5a7799b096c23e0947c599bcd2b9f7658db9b875 Azure: [SUCCES

[GitHub] [hudi] hudi-bot commented on pull request #5267: [HUDI-3825] Fixing Column Stats Index updating sequence

hudi-bot commented on PR #5267: URL: https://github.com/apache/hudi/pull/5267#issuecomment-1093633305 ## CI report: * db6572cfdf893553b8304ea3bef2a0c3a05853e6 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7933

[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093629451 ## CI report: * d7515d1f98a1299f5a42e242d3e36d84a9a38bee Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093623854 ## CI report: * d7515d1f98a1299f5a42e242d3e36d84a9a38bee Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093621910 ## CI report: * d7515d1f98a1299f5a42e242d3e36d84a9a38bee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7937

[GitHub] [hudi] nsivabalan commented on a diff in pull request #5268: [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex

nsivabalan commented on code in PR #5268: URL: https://github.com/apache/hudi/pull/5268#discussion_r846565010 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/index/bloom/SparkHoodieBloomIndexHelper.java: ## @@ -75,7 +80,9 @@ public static SparkHoodieBloomIndexHelp

[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093606372 ## CI report: * d7515d1f98a1299f5a42e242d3e36d84a9a38bee UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

hudi-bot commented on PR #5269: URL: https://github.com/apache/hudi/pull/5269#issuecomment-1093608288 ## CI report: * d7515d1f98a1299f5a42e242d3e36d84a9a38bee Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7937

[GitHub] [hudi] yihua commented on pull request #5251: Fix hadoop 3 compile Error, use FSDataOutputStream(OutputStream out, FileSystem.Statistics stats) instead of FSDataOutputStream(OutputStream out)

yihua commented on PR #5251: URL: https://github.com/apache/hudi/pull/5251#issuecomment-1093607101 > Sorry, I didn't nitice that PR, this PR can be closed. No worries. Feel free to chime in on that PR regarding the concern @danny0405 has put up :) -- This is an automated message f

[GitHub] [hudi] nsivabalan commented on a diff in pull request #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

nsivabalan commented on code in PR #5269: URL: https://github.com/apache/hudi/pull/5269#discussion_r846563805 ## hudi-client/hudi-spark-client/src/main/java/org/apache/hudi/client/HoodieSparkClusteringClient.java: ## @@ -53,11 +53,15 @@ public void cluster(HoodieInstant instant)

[GitHub] [hudi] hudi-bot commented on pull request #5268: [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex

hudi-bot commented on PR #5268: URL: https://github.com/apache/hudi/pull/5268#issuecomment-1093604414 ## CI report: * 201bac79e0dd29aa82c6a9d4991bcbf1ba90ee9b Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7931

[GitHub] [hudi] yihua opened a new pull request, #5269: [HUDI-3636] Create new write clients for async table services in DeltaStreamer

yihua opened a new pull request, #5269: URL: https://github.com/apache/hudi/pull/5269 ## What is the purpose of the pull request *(For example: This pull request adds quick-start document.)* ## Brief change log *(for example:)* - *Modify AnnotationLocation checkstyle

[jira] [Updated] (HUDI-3636) Clustering fails due to marker creation failure

[ https://issues.apache.org/jira/browse/HUDI-3636?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3636: - Labels: pull-request-available (was: ) > Clustering fails due to marker creation failure > --

[GitHub] [hudi] dongkelun commented on issue #5248: [QUESION] Should filter prop "hoodie.datasource.write.operation" when use spark sql create table?

dongkelun commented on issue #5248: URL: https://github.com/apache/hudi/issues/5248#issuecomment-1093602094 Not only `hoodie.datasource.write.operation`, but also other properties such as `hoodie.table.name` has the same problem. I think we should find all the parameters with similar prob

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093600536 ## CI report: * 658ba51ecffd10771161141864da7e7e4435a6e0 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093586902 ## CI report: * 658ba51ecffd10771161141864da7e7e4435a6e0 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] hudi-bot commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

hudi-bot commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093586844 ## CI report: * c252f8d6d9a6b38adcebec0ba857d5aafae823cf UNKNOWN * 6097520274d65ff9a9c2734a25eaf253ef78529d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] alexeykudinkin commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

alexeykudinkin commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093585813 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[GitHub] [hudi] hudi-bot commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

hudi-bot commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093584649 ## CI report: * c252f8d6d9a6b38adcebec0ba857d5aafae823cf UNKNOWN * 6097520274d65ff9a9c2734a25eaf253ef78529d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093578147 ## CI report: * 658ba51ecffd10771161141864da7e7e4435a6e0 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093576216 ## CI report: * ba21b8b51bb088b83a159392fc4b6e6a9115fa04 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093564424 ## CI report: * c125819a6310b97bfb656ba7b397a7500992fc37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7926

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093562387 ## CI report: * c125819a6310b97bfb656ba7b397a7500992fc37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7926

[GitHub] [hudi] hudi-bot commented on pull request #5267: [HUDI-3825] Fixing Column Stats Index updating sequence

hudi-bot commented on PR #5267: URL: https://github.com/apache/hudi/pull/5267#issuecomment-1093560342 ## CI report: * db99045030d04f226d26466b931cfb95cd5a186b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7927

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093560316 ## CI report: * ba21b8b51bb088b83a159392fc4b6e6a9115fa04 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] hudi-bot commented on pull request #5267: [HUDI-3825] Fixing Column Stats Index updating sequence

hudi-bot commented on PR #5267: URL: https://github.com/apache/hudi/pull/5267#issuecomment-1093558352 ## CI report: * db99045030d04f226d26466b931cfb95cd5a186b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7927

[jira] [Comment Edited] (HUDI-3825) Fix tests failing when enabling MT on the Read Path

[ https://issues.apache.org/jira/browse/HUDI-3825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17519851#comment-17519851 ] Alexey Kudinkin edited comment on HUDI-3825 at 4/9/22 1:16 AM: -

[GitHub] [hudi] hudi-bot commented on pull request #5268: [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex

hudi-bot commented on PR #5268: URL: https://github.com/apache/hudi/pull/5268#issuecomment-1093547700 ## CI report: * 201bac79e0dd29aa82c6a9d4991bcbf1ba90ee9b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7931

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093547669 ## CI report: * ba21b8b51bb088b83a159392fc4b6e6a9115fa04 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[GitHub] [hudi] alexeykudinkin commented on a diff in pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

alexeykudinkin commented on code in PR #5266: URL: https://github.com/apache/hudi/pull/5266#discussion_r846555002 ## hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java: ## @@ -159,18 +166,34 @@ public static HoodieTableMetaClient reload(HoodieTabl

[GitHub] [hudi] hudi-bot commented on pull request #5268: [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex

hudi-bot commented on PR #5268: URL: https://github.com/apache/hudi/pull/5268#issuecomment-1093545582 ## CI report: * 201bac79e0dd29aa82c6a9d4991bcbf1ba90ee9b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093545549 ## CI report: * ba21b8b51bb088b83a159392fc4b6e6a9115fa04 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=793

[jira] [Updated] (HUDI-3807) Add separate configs to control multi-modal index usage in write-side indexing

[ https://issues.apache.org/jira/browse/HUDI-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3807: - Labels: pull-request-available (was: ) > Add separate configs to control multi-modal index usage

[GitHub] [hudi] yihua opened a new pull request, #5268: [HUDI-3807] Add a new config to control the use of metadata index in HoodieBloomIndex

yihua opened a new pull request, #5268: URL: https://github.com/apache/hudi/pull/5268 ## What is the purpose of the pull request This PR adds a new config to control the use and reading of metadata index in HoodieBloomIndex, separate from the existing write configs, e.g., `hoodie.met

[jira] [Updated] (HUDI-3826) Commands deleting partitions do so incorrectly

[ https://issues.apache.org/jira/browse/HUDI-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3826: -- Description: Currently, `TruncateHoodieTableCommand` as well as `AlterHoodieTableDropPartitionC

[jira] [Updated] (HUDI-3826) Commands deleting partitions do so incorrectly

[ https://issues.apache.org/jira/browse/HUDI-3826?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3826: -- Summary: Commands deleting partitions do so incorrectly (was: TruncateHoodieTableCommand delete

[jira] [Updated] (HUDI-3807) Add separate configs to control multi-modal index usage in write-side indexing

[ https://issues.apache.org/jira/browse/HUDI-3807?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo updated HUDI-3807: Status: Patch Available (was: In Progress) > Add separate configs to control multi-modal index usage in wri

[jira] [Commented] (HUDI-3825) Fix tests failing when enabling MT on the Read Path

[ https://issues.apache.org/jira/browse/HUDI-3825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17519851#comment-17519851 ] Alexey Kudinkin commented on HUDI-3825: --- More test failures: {code:java} [ERROR] or

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093522719 ## CI report: * c125819a6310b97bfb656ba7b397a7500992fc37 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7926

[jira] [Updated] (HUDI-3834) Evaluate MT Column Stats Performance

[ https://issues.apache.org/jira/browse/HUDI-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3834: -- Status: Patch Available (was: In Progress) > Evaluate MT Column Stats Performance > --

[jira] [Reopened] (HUDI-3825) Fix tests failing when enabling MT on the Read Path

[ https://issues.apache.org/jira/browse/HUDI-3825?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin reopened HUDI-3825: --- > Fix tests failing when enabling MT on the Read Path > --

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093518493 ## CI report: * abf82b3871b7b65708932fd4e7115b279f64964b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7924

[GitHub] [hudi] hudi-bot commented on pull request #5267: [WIP] Fixing Column Stats Index updating sequence

hudi-bot commented on PR #5267: URL: https://github.com/apache/hudi/pull/5267#issuecomment-1093516253 ## CI report: * db99045030d04f226d26466b931cfb95cd5a186b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7927

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093516227 ## CI report: * abf82b3871b7b65708932fd4e7115b279f64964b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7924

[GitHub] [hudi] hudi-bot commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

hudi-bot commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093504604 ## CI report: * c252f8d6d9a6b38adcebec0ba857d5aafae823cf UNKNOWN * 6097520274d65ff9a9c2734a25eaf253ef78529d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] alexeykudinkin commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

alexeykudinkin commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093502499 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific commen

[hudi] branch master updated (26eb7b8183 -> 1cc7542357)

This is an automated email from the ASF dual-hosted git repository. yihua pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git from 26eb7b8183 [HUDI-3571] Spark datasource continuous checkpoint should have own fs variable (#5265) add 1cc7542357 [M

[GitHub] [hudi] yihua merged pull request #5256: [MINOR] Update README of docker build setup

yihua merged PR #5256: URL: https://github.com/apache/hudi/pull/5256 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@hudi.apache.org

[GitHub] [hudi] rahil-c commented on pull request #5256: [MINOR] Update README of docker build setup

rahil-c commented on PR #5256: URL: https://github.com/apache/hudi/pull/5256#issuecomment-1093457630 LGTM -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-

[GitHub] [hudi] hudi-bot commented on pull request #5267: [WIP] Fixing Column Stats Index updating sequence

hudi-bot commented on PR #5267: URL: https://github.com/apache/hudi/pull/5267#issuecomment-1093452743 ## CI report: * db99045030d04f226d26466b931cfb95cd5a186b Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7927

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093452535 ## CI report: * ed1fad096902d40c83d305606cf4d646bb63dfe9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7923

[GitHub] [hudi] hudi-bot commented on pull request #5267: [WIP] Fixing Column Stats Index updating sequence

hudi-bot commented on PR #5267: URL: https://github.com/apache/hudi/pull/5267#issuecomment-1093449983 ## CI report: * db99045030d04f226d26466b931cfb95cd5a186b UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093449822 ## CI report: * ed1fad096902d40c83d305606cf4d646bb63dfe9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7923

[GitHub] [hudi] hudi-bot commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

hudi-bot commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093447210 ## CI report: * c252f8d6d9a6b38adcebec0ba857d5aafae823cf UNKNOWN * 6097520274d65ff9a9c2734a25eaf253ef78529d Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] alexeykudinkin opened a new pull request, #5267: [WIP] Fixing Column Stats Index updating sequence

alexeykudinkin opened a new pull request, #5267: URL: https://github.com/apache/hudi/pull/5267 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093428414 ## CI report: * ed1fad096902d40c83d305606cf4d646bb63dfe9 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7923

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093425691 ## CI report: * abf82b3871b7b65708932fd4e7115b279f64964b Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7924

[GitHub] [hudi] nsivabalan commented on a diff in pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

nsivabalan commented on code in PR #5266: URL: https://github.com/apache/hudi/pull/5266#discussion_r846516629 ## hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableMetaClient.java: ## @@ -159,18 +166,34 @@ public static HoodieTableMetaClient reload(HoodieTableMet

[jira] [Closed] (HUDI-3611) Benchmark Data Skipping using MT

[ https://issues.apache.org/jira/browse/HUDI-3611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin closed HUDI-3611. - Resolution: Duplicate > Benchmark Data Skipping using MT > > >

[GitHub] [hudi] hudi-bot commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

hudi-bot commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093374069 ## CI report: * c252f8d6d9a6b38adcebec0ba857d5aafae823cf UNKNOWN * 23a10d80255247f32c77cade8b15d9a8711f7ee1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093365714 ## CI report: * 0ca9aaa1ef3eca6faa9431722cbafba2dd2f2603 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7922

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093363965 ## CI report: * 0ca9aaa1ef3eca6faa9431722cbafba2dd2f2603 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7922

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093362089 ## CI report: * 655d7d2a8417ce6ed1a6fdd1560563051672327c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7906

[GitHub] [hudi] hudi-bot commented on pull request #5193: [DO NOT MERGE][DBG] Enabling Column Stats Index by default for all columns

hudi-bot commented on PR #5193: URL: https://github.com/apache/hudi/pull/5193#issuecomment-1093360309 ## CI report: * 655d7d2a8417ce6ed1a6fdd1560563051672327c Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7906

[GitHub] [hudi] hudi-bot commented on pull request #5244: [HUDI-3812] Fixing Data Skipping configuration to respect Metadata Table configs

hudi-bot commented on PR #5244: URL: https://github.com/apache/hudi/pull/5244#issuecomment-1093358630 ## CI report: * c252f8d6d9a6b38adcebec0ba857d5aafae823cf UNKNOWN * 23a10d80255247f32c77cade8b15d9a8711f7ee1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093357009 ## CI report: * 0ca9aaa1ef3eca6faa9431722cbafba2dd2f2603 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7922

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093283339 ## CI report: * 0ca9aaa1ef3eca6faa9431722cbafba2dd2f2603 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?buildId=7922

[GitHub] [hudi] hudi-bot commented on pull request #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

hudi-bot commented on PR #5266: URL: https://github.com/apache/hudi/pull/5266#issuecomment-1093279292 ## CI report: * 0ca9aaa1ef3eca6faa9431722cbafba2dd2f2603 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure` re-run the

[jira] [Updated] (HUDI-3834) Evaluate MT Column Stats Performance

[ https://issues.apache.org/jira/browse/HUDI-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3834: - Labels: pull-request-available (was: ) > Evaluate MT Column Stats Performance >

[GitHub] [hudi] alexeykudinkin opened a new pull request, #5266: [HUDI-3834] Fixing performance hits in reading Column Stats Index

alexeykudinkin opened a new pull request, #5266: URL: https://github.com/apache/hudi/pull/5266 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the

[jira] [Commented] (HUDI-3834) Evaluate MT Column Stats Performance

[ https://issues.apache.org/jira/browse/HUDI-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17519770#comment-17519770 ] Alexey Kudinkin commented on HUDI-3834: --- After working this code-path around we see

[jira] [Updated] (HUDI-3834) Evaluate MT Column Stats Performance

[ https://issues.apache.org/jira/browse/HUDI-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3834: -- Attachment: Screen Shot 2022-04-08 at 9.12.48 AM.png > Evaluate MT Column Stats Performance > -

[jira] [Commented] (HUDI-3834) Evaluate MT Column Stats Performance

[ https://issues.apache.org/jira/browse/HUDI-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17519769#comment-17519769 ] Alexey Kudinkin commented on HUDI-3834: --- Original runtime of the query reading whole

[jira] [Updated] (HUDI-3834) Evaluate MT Column Stats Performance

[ https://issues.apache.org/jira/browse/HUDI-3834?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3834: -- Attachment: (was: Screen Shot 2022-04-08 at 12.14.29 PM.png) > Evaluate MT Column Stats Perf

  1   2   >