[GitHub] [hudi] hudi-bot removed a comment on pull request #5158: [HUDI-3733] Adding HoodieFailedWritesCleaningPolicy for restore with hudi-cli

hudi-bot removed a comment on pull request #5158: URL: https://github.com/apache/hudi/pull/5158#issuecomment-1084010103 ## CI report: * 77bfef4579876bf79d8ed971946da7c15a1e80e5 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5158: [HUDI-3733] Adding HoodieFailedWritesCleaningPolicy for restore with hudi-cli

hudi-bot commented on pull request #5158: URL: https://github.com/apache/hudi/pull/5158#issuecomment-1084177622 ## CI report: * 35481045e9f77ced3079a717ae53791986de2a94 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Assigned] (HUDI-3748) Hudi fails to insert into a partitioned table when the partition column is dropped from the parquet schema

[ https://issues.apache.org/jira/browse/HUDI-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reassigned HUDI-3748: Assignee: Yann Byron (was: Raymond Xu) > Hudi fails to insert into a partitioned table when the pa

[jira] [Updated] (HUDI-3748) Hudi fails to insert into a partitioned table when the partition column is dropped from the parquet schema

[ https://issues.apache.org/jira/browse/HUDI-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3748: - Sprint: Hudi-Sprint-Mar-22 > Hudi fails to insert into a partitioned table when the partition column is >

[jira] [Updated] (HUDI-3748) Hudi fails to insert into a partitioned table when the partition column is dropped from the parquet schema

[ https://issues.apache.org/jira/browse/HUDI-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3748: - Reviewers: Raymond Xu > Hudi fails to insert into a partitioned table when the partition column is > drop

[GitHub] [hudi] hudi-bot removed a comment on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot removed a comment on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1084164580 ## CI report: * 333da7447af7d602ffa3067a759cecc62e4365d8 UNKNOWN * f7d371bcdc435fb2ca6738c706233e387fa37e1a Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4925: [HUDI-3103] Enable MultiTableDeltaStreamer to update a single sink table from multiple source tables

hudi-bot commented on pull request #4925: URL: https://github.com/apache/hudi/pull/4925#issuecomment-1084180840 ## CI report: * 333da7447af7d602ffa3067a759cecc62e4365d8 UNKNOWN * f7d371bcdc435fb2ca6738c706233e387fa37e1a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

hudi-bot commented on pull request #5179: URL: https://github.com/apache/hudi/pull/5179#issuecomment-1084188413 ## CI report: * 1504f8e3a3e27527758ceaeb35f9779014bc46fb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

hudi-bot removed a comment on pull request #5179: URL: https://github.com/apache/hudi/pull/5179#issuecomment-1084015678 ## CI report: * a6afcea229b6ecfcb2e6ea8de506424e22da1133 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[jira] [Created] (HUDI-3757) Increase CI throughput

Raymond Xu created HUDI-3757: Summary: Increase CI throughput Key: HUDI-3757 URL: https://issues.apache.org/jira/browse/HUDI-3757 Project: Apache Hudi Issue Type: Task Components: tests

[GitHub] [hudi] hudi-bot removed a comment on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot removed a comment on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084162549 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * b5721e004c19e7b24ad70696f66a9860e481fb72 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot commented on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084193592 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * b5721e004c19e7b24ad70696f66a9860e481fb72 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] codope commented on a change in pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

codope commented on a change in pull request #5181: URL: https://github.com/apache/hudi/pull/5181#discussion_r839233618 ## File path: hudi-common/src/main/java/org/apache/hudi/avro/HoodieAvroUtils.java ## @@ -655,4 +786,112 @@ private static Schema resolveNullableSchema(Schema

[GitHub] [hudi] nsivabalan commented on a change in pull request #4880: [HUDI-2752] The MOR DELETE block breaks the event time sequence of CDC

nsivabalan commented on a change in pull request #4880: URL: https://github.com/apache/hudi/pull/4880#discussion_r839260523 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/log/HoodieMergedLogRecordScanner.java ## @@ -153,9 +154,29 @@ protected void process

[GitHub] [hudi] codejoyan commented on pull request #5153: [HUDI-3020] Utility to create manifest file

codejoyan commented on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084198346 @nsivabalan or @xushiyan - Can you please approve the workflow? I have made the below changes. @vingov please review when you get a chance. 1. @vinothchandar Moved the

[GitHub] [hudi] hudi-bot removed a comment on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot removed a comment on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1080716805 ## CI report: * 5f3b2ca943efdb3306921bd3b3cad3107ce286fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot commented on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084199045 ## CI report: * 5f3b2ca943efdb3306921bd3b3cad3107ce286fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot commented on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084199187 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * b5721e004c19e7b24ad70696f66a9860e481fb72 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot removed a comment on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot removed a comment on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084193592 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * b5721e004c19e7b24ad70696f66a9860e481fb72 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] codope merged pull request #5158: [HUDI-3733] Adding HoodieFailedWritesCleaningPolicy for restore with hudi-cli

codope merged pull request #5158: URL: https://github.com/apache/hudi/pull/5158 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr..

[hudi] branch master updated (ce45f7f -> 3cdb590)

This is an automated email from the ASF dual-hosted git repository. codope pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from ce45f7f [HUDI-3692] MetadataFileSystemView includes compaction in timeline (#5110) add 3cdb590 [HUDI-3733] Addi

[GitHub] [hudi] hudi-bot commented on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot commented on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084202743 ## CI report: * 5f3b2ca943efdb3306921bd3b3cad3107ce286fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot removed a comment on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084199045 ## CI report: * 5f3b2ca943efdb3306921bd3b3cad3107ce286fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot removed a comment on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084199187 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * b5721e004c19e7b24ad70696f66a9860e481fb72 Azure: [FAILURE](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot commented on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084202974 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * 63f6ef63329e3b727e91fec5c4caab76b3688485 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-or

[GitHub] [hudi] nsivabalan merged pull request #4489: [HUDI-3135] Make delete partitions lazy to be executed by the cleaner

nsivabalan merged pull request #4489: URL: https://github.com/apache/hudi/pull/4489 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[jira] [Created] (HUDI-3758) Optimize flink partition table with BucketIndex

konwu created HUDI-3758: --- Summary: Optimize flink partition table with BucketIndex Key: HUDI-3758 URL: https://issues.apache.org/jira/browse/HUDI-3758 Project: Apache Hudi Issue Type: Improvement

[hudi] branch master updated (3cdb590 -> 80011df)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 3cdb590 [HUDI-3733] Adding HoodieFailedWritesCleaningPolicy for restore with hudi-cli (#5158) add 80011df [H

[jira] [Updated] (HUDI-3758) Optimize flink partition table with BucketIndex

[ https://issues.apache.org/jira/browse/HUDI-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] konwu updated HUDI-3758: Description: When using flink bucket index , I meet two problems * without use all streamWriter tasks when partitio

[GitHub] [hudi] hudi-bot removed a comment on pull request #5125: [HUDI-3357] MVP implementation of BigQuerySyncTool

hudi-bot removed a comment on pull request #5125: URL: https://github.com/apache/hudi/pull/5125#issuecomment-1084162447 ## CI report: * ff55dc8ddd8a3f167ab11ab3d454841f8dffc389 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #5125: [HUDI-3357] MVP implementation of BigQuerySyncTool

hudi-bot commented on pull request #5125: URL: https://github.com/apache/hudi/pull/5125#issuecomment-1084213427 ## CI report: * ff55dc8ddd8a3f167ab11ab3d454841f8dffc389 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[jira] [Updated] (HUDI-3758) Optimize flink partition table with BucketIndex

[ https://issues.apache.org/jira/browse/HUDI-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] konwu updated HUDI-3758: Description: When using flink bucket index , I meet two problems * without use all streamWriter tasks when partitio

[jira] [Updated] (HUDI-3758) Optimize flink partition table with BucketIndex

[ https://issues.apache.org/jira/browse/HUDI-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] konwu updated HUDI-3758: Attachment: image-2022-03-31-15-44-34-450.png > Optimize flink partition table with BucketIndex > --

[jira] [Updated] (HUDI-3758) Optimize flink partition table with BucketIndex

[ https://issues.apache.org/jira/browse/HUDI-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] konwu updated HUDI-3758: Attachment: image-2022-03-31-15-44-30-480.png > Optimize flink partition table with BucketIndex > --

[GitHub] [hudi] hudi-bot commented on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot commented on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084225914 ## CI report: * 5f3b2ca943efdb3306921bd3b3cad3107ce286fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot removed a comment on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084202743 ## CI report: * 5f3b2ca943efdb3306921bd3b3cad3107ce286fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot removed a comment on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084225914 ## CI report: * 5f3b2ca943efdb3306921bd3b3cad3107ce286fd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot commented on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084229147 ## CI report: * b96ffa205e86bd3a5eb9a0c275251bb2ceaeff61 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot commented on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot commented on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1084233150 ## CI report: * 6ceac1ae15e9b2ef1411050d060f4acce5737305 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot removed a comment on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1084042283 ## CI report: * 6ceac1ae15e9b2ef1411050d060f4acce5737305 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot commented on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1084236842 ## CI report: * 121cb81a9551d980601397638577dc8c24ff9869 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #5168: [HUDI-3729][SPARK] fixed the per regression by enable vectorizeReader for parquet file

hudi-bot removed a comment on pull request #5168: URL: https://github.com/apache/hudi/pull/5168#issuecomment-1084233150 ## CI report: * 6ceac1ae15e9b2ef1411050d060f4acce5737305 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] wxplovecc opened a new pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

wxplovecc opened a new pull request #5185: URL: https://github.com/apache/hudi/pull/5185 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[jira] [Updated] (HUDI-3758) Optimize flink partition table with BucketIndex

[ https://issues.apache.org/jira/browse/HUDI-3758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3758: - Labels: pull-request-available (was: ) > Optimize flink partition table with BucketIndex > --

[GitHub] [hudi] hudi-bot commented on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot commented on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084250442 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot removed a comment on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot removed a comment on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084250442 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot commented on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084253565 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot removed a comment on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084202974 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * 63f6ef63329e3b727e91fec5c4caab76b3688485 Azure: [CANCELED](https://dev.azure.com/apache-hu

[GitHub] [hudi] hudi-bot removed a comment on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot removed a comment on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084253565 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot commented on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084256722 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot commented on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084256665 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * 63f6ef63329e3b727e91fec5c4caab76b3688485 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-or

[GitHub] [hudi] hudi-bot removed a comment on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot removed a comment on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084256722 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot commented on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084259836 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot removed a comment on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084229147 ## CI report: * b96ffa205e86bd3a5eb9a0c275251bb2ceaeff61 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot commented on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084266410 ## CI report: * b96ffa205e86bd3a5eb9a0c275251bb2ceaeff61 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot commented on pull request #5169: [HUDI-3743] Support DELETE_PARTITION for metadata table

hudi-bot commented on pull request #5169: URL: https://github.com/apache/hudi/pull/5169#issuecomment-1084266520 ## CI report: * 0912c879898f93520caee674deb4da364346f532 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5169: [HUDI-3743] Support DELETE_PARTITION for metadata table

hudi-bot removed a comment on pull request #5169: URL: https://github.com/apache/hudi/pull/5169#issuecomment-1083729028 ## CI report: * 0912c879898f93520caee674deb4da364346f532 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839328936 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/table/action/commit/TestCopyOnWriteActionExecutor.java ## @@ -498,4 +502,46

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839329377 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java ## @@ -117,30 +133,119 @@ public void trySave(int ta

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839331059 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java ## @@ -117,30 +133,119 @@ public void trySave(int ta

[GitHub] [hudi] hudi-bot removed a comment on pull request #5169: [HUDI-3743] Support DELETE_PARTITION for metadata table

hudi-bot removed a comment on pull request #5169: URL: https://github.com/apache/hudi/pull/5169#issuecomment-1084266520 ## CI report: * 0912c879898f93520caee674deb4da364346f532 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5169: [HUDI-3743] Support DELETE_PARTITION for metadata table

hudi-bot commented on pull request #5169: URL: https://github.com/apache/hudi/pull/5169#issuecomment-1084269766 ## CI report: * 0912c879898f93520caee674deb4da364346f532 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot removed a comment on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084256665 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * 63f6ef63329e3b727e91fec5c4caab76b3688485 Azure: [CANCELED](https://dev.azure.com/apache-hu

[GitHub] [hudi] hudi-bot commented on pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

hudi-bot commented on pull request #5181: URL: https://github.com/apache/hudi/pull/5181#issuecomment-1084273094 ## CI report: * cae55044a706a9cc245fabf280f1b201718d79ff UNKNOWN * 8d45afb2b9e791fa8b040e7fef9eff98686e5623 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-or

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839335312 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java ## @@ -117,30 +133,119 @@ public void trySave(int ta

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839337341 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java ## @@ -117,30 +133,119 @@ public void trySave(int ta

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839337758 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java ## @@ -117,30 +133,119 @@ public void trySave(int ta

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839338943 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java ## @@ -117,30 +133,119 @@ public void trySave(int ta

[GitHub] [hudi] prashantwason commented on pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on pull request #5179: URL: https://github.com/apache/hudi/pull/5179#issuecomment-1084279152 > We also need to ensure this works for tables created using Spark SQL and Spark Datasource, Flink etc If you can point me to where the tables are created in Spark and Fli

[GitHub] [hudi] hudi-bot commented on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot commented on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084279400 ## CI report: * 58ff678df3e79f0885a122791dec88623908b2a6 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #5153: [HUDI-3020] Utility to create manifest file

hudi-bot removed a comment on pull request #5153: URL: https://github.com/apache/hudi/pull/5153#issuecomment-1084266410 ## CI report: * b96ffa205e86bd3a5eb9a0c275251bb2ceaeff61 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839343612 ## File path: hudi-common/src/test/java/org/apache/hudi/common/util/TestTablePathUtils.java ## @@ -87,19 +92,22 @@ static void setup() throws IOExcept

[GitHub] [hudi] prashantwason edited a comment on pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason edited a comment on pull request #5179: URL: https://github.com/apache/hudi/pull/5179#issuecomment-1084279152 > We also need to ensure this works for tables created using Spark SQL and Spark Datasource, Flink etc @vinothchandar If you can point me to where the tabl

[GitHub] [hudi] xushiyan commented on a change in pull request #5153: [HUDI-3020] Utility to create manifest file

xushiyan commented on a change in pull request #5153: URL: https://github.com/apache/hudi/pull/5153#discussion_r839311861 ## File path: hudi-sync/hudi-sync-common/pom.xml ## @@ -104,6 +104,14 @@ junit-platform-commons test + + + org.apache.hudi +

[GitHub] [hudi] xushiyan commented on a change in pull request #5153: [HUDI-3020] Utility to create manifest file

xushiyan commented on a change in pull request #5153: URL: https://github.com/apache/hudi/pull/5153#discussion_r839341461 ## File path: hudi-sync/hudi-sync-common/src/main/java/org/apache/hudi/sync/common/util/ManifestFileUtil.java ## @@ -0,0 +1,142 @@ +/* + * Licensed to the

[GitHub] [hudi] xushiyan commented on pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

xushiyan commented on pull request #4012: URL: https://github.com/apache/hudi/pull/4012#issuecomment-1084304387 @liuhe0702 i think the merge commit break the CI parsing. Can you close this one and create a new PR that links back to this? -- This is an automated message from the Apache G

[GitHub] [hudi] prashantwason commented on a change in pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

prashantwason commented on a change in pull request #5179: URL: https://github.com/apache/hudi/pull/5179#discussion_r839370478 ## File path: hudi-common/src/main/java/org/apache/hudi/common/model/HoodiePartitionMetadata.java ## @@ -118,20 +135,86 @@ public void trySave(int tas

[GitHub] [hudi] codope commented on a change in pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

codope commented on a change in pull request #5181: URL: https://github.com/apache/hudi/pull/5181#discussion_r839372850 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieMetadataTableValidator.java ## @@ -835,13 +830,11 @@ public HoodieMetadataValidati

[GitHub] [hudi] codope commented on a change in pull request #5181: [HUDI-3664] Fixing Column Stats Index composition

codope commented on a change in pull request #5181: URL: https://github.com/apache/hudi/pull/5181#discussion_r839374371 ## File path: hudi-utilities/src/main/java/org/apache/hudi/utilities/HoodieMetadataTableValidator.java ## @@ -835,13 +830,11 @@ public HoodieMetadataValidati

[GitHub] [hudi] hudi-bot commented on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot commented on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084315372 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] hudi-bot removed a comment on pull request #5185: [HUDI-3758] Optimize flink partition table with BucketIndex

hudi-bot removed a comment on pull request #5185: URL: https://github.com/apache/hudi/pull/5185#issuecomment-1084259836 ## CI report: * 32e158829a18bcdecff670691d5e22d880746304 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

hudi-bot commented on pull request #5179: URL: https://github.com/apache/hudi/pull/5179#issuecomment-1084315306 ## CI report: * 1504f8e3a3e27527758ceaeb35f9779014bc46fb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

hudi-bot removed a comment on pull request #5179: URL: https://github.com/apache/hudi/pull/5179#issuecomment-1084188413 ## CI report: * 1504f8e3a3e27527758ceaeb35f9779014bc46fb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Closed] (HUDI-3536) Implement Hudi DataHub sync

[ https://issues.apache.org/jira/browse/HUDI-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3536. Resolution: Done > Implement Hudi DataHub sync > --- > > Key: HUDI-3

[jira] [Updated] (HUDI-3536) Implement Hudi DataHub sync

[ https://issues.apache.org/jira/browse/HUDI-3536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3536: - Reviewers: sivabalan narayanan > Implement Hudi DataHub sync > --- > >

[jira] [Updated] (HUDI-3020) Create a utility to generate mainfest file

[ https://issues.apache.org/jira/browse/HUDI-3020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3020: - Priority: Blocker (was: Major) > Create a utility to generate mainfest file > ---

[jira] [Updated] (HUDI-3748) Hudi fails to insert into a partitioned table when the partition column is dropped from the parquet schema

[ https://issues.apache.org/jira/browse/HUDI-3748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3748: - Epic Link: HUDI-1658 (was: HUDI-2438) > Hudi fails to insert into a partitioned table when the partition

[GitHub] [hudi] hudi-bot removed a comment on pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

hudi-bot removed a comment on pull request #5179: URL: https://github.com/apache/hudi/pull/5179#issuecomment-1084315306 ## CI report: * 1504f8e3a3e27527758ceaeb35f9779014bc46fb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #5179: [HUDI-3290] Different file formats for the partition metadata file.

hudi-bot commented on pull request #5179: URL: https://github.com/apache/hudi/pull/5179#issuecomment-1084318828 ## CI report: * 1504f8e3a3e27527758ceaeb35f9779014bc46fb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3020) Create a utility to generate mainfest file

[ https://issues.apache.org/jira/browse/HUDI-3020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3020: - Sprint: Hudi-Sprint-Mar-22 > Create a utility to generate mainfest file >

[GitHub] [hudi] hudi-bot commented on pull request #5157: [HUDI-3732] Fixing rollback validation

hudi-bot commented on pull request #5157: URL: https://github.com/apache/hudi/pull/5157#issuecomment-1084322287 ## CI report: * 6d049f532a187f840f35851ed3b48a1d7de754b3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #5157: [HUDI-3732] Fixing rollback validation

hudi-bot removed a comment on pull request #5157: URL: https://github.com/apache/hudi/pull/5157#issuecomment-1084148086 ## CI report: * Unknown: [CANCELED](TBD) * 6d049f532a187f840f35851ed3b48a1d7de754b3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42

[GitHub] [hudi] xiarixiaoyao commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

xiarixiaoyao commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084325330 @hudi-bot run azure -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specif

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084149764 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084325621 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot removed a comment on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084325621 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775

[GitHub] [hudi] hudi-bot commented on pull request #4910: [RFC-33] [HUDI-2429][Stacked on HUDI-2560] Support full Schema evolution for Spark

hudi-bot commented on pull request #4910: URL: https://github.com/apache/hudi/pull/4910#issuecomment-1084328808 ## CI report: * 52be34d7d5e025180415c46e64a3e2145c29e498 UNKNOWN * 78e86dd1953cc4d6bf10ca808a7bcffe22b4b587 UNKNOWN * fa9cee18b16f1b11ed039a9da3c490f017775e8d UNKN

[GitHub] [hudi] liuhe0702 closed pull request #4012: [HUDI-2777] Data import performance deteriorates because multiple Spark jobs are started when data is written to disks.

liuhe0702 closed pull request #4012: URL: https://github.com/apache/hudi/pull/4012 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] zhangyue19921010 opened a new pull request #5186: [HUDI-3451] Add checks for metadata table init to avoid possible out-of-sync

zhangyue19921010 opened a new pull request #5186: URL: https://github.com/apache/hudi/pull/5186 please refer https://issues.apache.org/jira/browse/HUDI-3451 for details After this patch we will add a new config named `hoodie.populate.meta.fields` in hoodie.properties file. ```

[jira] [Updated] (HUDI-3451) Add checks for metadata table init to avoid possible out-of-sync

[ https://issues.apache.org/jira/browse/HUDI-3451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3451: - Labels: pull-request-available (was: ) > Add checks for metadata table init to avoid possible out

  1   2   3   4   5   6   >