[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1042626657 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 65c8457ddb07ca94312168de529a2b293d40349e Azure: [SUCCESS](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1042665570 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 5b30050839b20af92e0477955829b19fc22a8192 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4712: URL: https://github.com/apache/hudi/pull/4712#issuecomment-1042662016 ## CI report: * e7d96f2665de80b8ff2c642de37340020646b9cd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4712: URL: https://github.com/apache/hudi/pull/4712#issuecomment-1042660231 ## CI report: * e7d96f2665de80b8ff2c642de37340020646b9cd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Updated] (HUDI-3214) Optimize auto partition in spark

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3214: - Summary: Optimize auto partition in spark (was: [UMBRELLA] optimize auto partition in spark) > Optimize

[jira] [Updated] (HUDI-3214) [UMBRELLA] optimize auto partition in spark

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3214: - Epic Link: HUDI-1658 > [UMBRELLA] optimize auto partition in spark > -

[GitHub] [hudi] hudi-bot removed a comment on pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4712: URL: https://github.com/apache/hudi/pull/4712#issuecomment-1035141424 ## CI report: * e7d96f2665de80b8ff2c642de37340020646b9cd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4712: URL: https://github.com/apache/hudi/pull/4712#issuecomment-1042660231 ## CI report: * e7d96f2665de80b8ff2c642de37340020646b9cd Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3444) NPE occured when ingesting data to MOR table by flink

2022-02-16 Thread qian heng (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3444?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] qian heng updated HUDI-3444: Description: *{*}Describe the problem you faced{*}* NPE occured when ingesting data to MOR table by flink.

[jira] [Created] (HUDI-3444) NPE occured when ingesting data to MOR table by flink

2022-02-16 Thread qian heng (Jira)
qian heng created HUDI-3444: --- Summary: NPE occured when ingesting data to MOR table by flink Key: HUDI-3444 URL: https://issues.apache.org/jira/browse/HUDI-3444 Project: Apache Hudi Issue Type: Bug

[GitHub] [hudi] GourdErwa opened a new issue #4834: [SUPPORT] Flink-Hudi Support MAP Schema ?

2022-02-16 Thread GitBox
GourdErwa opened a new issue #4834: URL: https://github.com/apache/hudi/issues/4834 Once the Parquet file appears, the query will report an error Steps to reproduce the behavior: ```sql # FLINK 1.14.4 # hudi 0.10.1 # hudi 0.10.1 # link https://hudi.apache.org/do

[GitHub] [hudi] codope commented on a change in pull request #4712: [HUDI-2809] Introduce a checksum mechanism for validating hoodie.properties

2022-02-16 Thread GitBox
codope commented on a change in pull request #4712: URL: https://github.com/apache/hudi/pull/4712#discussion_r808721812 ## File path: hudi-common/src/main/java/org/apache/hudi/common/table/HoodieTableConfig.java ## @@ -330,10 +360,28 @@ public static void create(FileSystem fs,

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1042612255 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 65c8457ddb07ca94312168de529a2b293d40349e Azure: [SUCCESS](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1042626657 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 65c8457ddb07ca94312168de529a2b293d40349e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] yihua commented on pull request #4020: [WIP][HUDI-2783] Upgrade HBase to 2.x

2022-02-16 Thread GitBox
yihua commented on pull request #4020: URL: https://github.com/apache/hudi/pull/4020#issuecomment-1042622328 I'm going to take over this PR and get it ready for review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Assigned] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

2022-02-16 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-3301: --- Assignee: Yue Zhang (was: Ethan Guo) > MergedLogRecordReader inline reading should be stateless and

[jira] [Assigned] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

2022-02-16 Thread Ethan Guo (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo reassigned HUDI-3300: --- Assignee: Yue Zhang (was: Ethan Guo) > Timeline server FSViewManager should avoid point lookup for m

[GitHub] [hudi] hudi-bot removed a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1041308305 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 65c8457ddb07ca94312168de529a2b293d40349e Azure: [SUCCESS](https://dev.azure.com/apache-hud

[GitHub] [hudi] hudi-bot commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1042612255 ## CI report: * cba4eaeedfa9c5fa6971b2fe24e98ff4469a0a15 UNKNOWN * 65c8457ddb07ca94312168de529a2b293d40349e Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org

[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042609195 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * ac98ca7624f74800ffbc801b3184f8b7c2d9368a Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042570800 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042572083 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf

[jira] [Created] (HUDI-3443) Async clustering cannot proceed due to archived deltacommit in metadata table

2022-02-16 Thread Ethan Guo (Jira)
Ethan Guo created HUDI-3443: --- Summary: Async clustering cannot proceed due to archived deltacommit in metadata table Key: HUDI-3443 URL: https://issues.apache.org/jira/browse/HUDI-3443 Project: Apache Hudi

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042601092 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf14d UNKN

[jira] [Updated] (HUDI-3161) Add Call Produce Command for spark sql

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3161: - Priority: Blocker (was: Critical) > Add Call Produce Command for spark sql >

[jira] [Updated] (HUDI-3161) Add Call Produce Command for spark sql

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3161: - Priority: Critical (was: Blocker) > Add Call Produce Command for spark sql >

[GitHub] [hudi] huberylee commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
huberylee commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1042597523 @alexeykudinkin You can verify this by running `TestCreateTable`, although the test passed, many exception messages were printed during the test. -- This is an automated messa

[GitHub] [hudi] huberylee edited a comment on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
huberylee edited a comment on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1042590299 > @alexeykudinkin This PR is intending to avoid printing too many exception stacks when creating hoodie table. When creating hoodie table, no data files in table

[jira] [Updated] (HUDI-1689) Support Multipath query for HoodieFileIndex

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1689: - Issue Type: New Feature (was: Task) > Support Multipath query for HoodieFileIndex > -

[jira] [Updated] (HUDI-33) Introduce config to allow users to control case-sensitivity in column projections #431

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-33?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-33: --- Issue Type: New Feature (was: Task) > Introduce config to allow users to control case-sensitivity in column >

[jira] [Updated] (HUDI-1677) Support Clustering and Metatable for SQL performance

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1677: - Issue Type: New Feature (was: Task) > Support Clustering and Metatable for SQL performance >

[jira] [Updated] (HUDI-1830) Support Cluster By In Create Table

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1830?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1830: - Issue Type: New Feature (was: Task) > Support Cluster By In Create Table > --

[jira] [Updated] (HUDI-1831) Support Create Index In Create Table

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1831?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1831: - Issue Type: New Feature (was: Task) > Support Create Index In Create Table >

[jira] [Updated] (HUDI-2166) Support Alter table drop column

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2166: - Issue Type: New Feature (was: Task) > Support Alter table drop column >

[jira] [Updated] (HUDI-1840) Add Commit Time Prefix To The UuidKeyGenerator For Insert Only

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1840: - Issue Type: Improvement (was: Task) > Add Commit Time Prefix To The UuidKeyGenerator For Insert Only > --

[jira] [Updated] (HUDI-1832) Support Hoodie CLI Command In Spark SQL

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1832: - Issue Type: New Feature (was: Task) > Support Hoodie CLI Command In Spark SQL > -

[jira] [Updated] (HUDI-1885) Support Delete/Update Non-Pk Table

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1885: - Issue Type: New Feature (was: Task) > Support Delete/Update Non-Pk Table > --

[jira] [Updated] (HUDI-1885) Support Delete/Update Non-Pk Table

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1885?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-1885: - Priority: Critical (was: Blocker) > Support Delete/Update Non-Pk Table >

[jira] [Updated] (HUDI-2283) Support Clustering Command For Spark Sql

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2283: - Issue Type: New Feature (was: Task) > Support Clustering Command For Spark Sql >

[jira] [Updated] (HUDI-2601) Support point lookup queries leveraging the bloom filter indexing

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2601: - Issue Type: New Feature (was: Task) > Support point lookup queries leveraging the bloom filter indexing >

[jira] [Updated] (HUDI-2470) use commit_time in the WHERE STATEMENT to optimize the incremental query

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-2470: - Issue Type: Improvement (was: Task) > use commit_time in the WHERE STATEMENT to optimize the incremental

[jira] [Deleted] (HUDI-3274) Support Time travel

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3274?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu deleted HUDI-3274: - > Support Time travel > --- > > Key: HUDI-3274 > URL: https:/

[jira] [Updated] (HUDI-3221) Support querying a table as of a savepoint

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3221: - Epic Link: HUDI-1658 (was: HUDI-3274) > Support querying a table as of a savepoint >

[jira] [Updated] (HUDI-109) RFC-7 Ability to query older snapshots of data

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-109: Epic Link: (was: HUDI-3274) > RFC-7 Ability to query older snapshots of data > ---

[jira] [Closed] (HUDI-109) RFC-7 Ability to query older snapshots of data

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-109. --- Fix Version/s: (was: 0.11.0) Resolution: Duplicate > RFC-7 Ability to query older snapshots of data

[GitHub] [hudi] huberylee commented on pull request #4773: [HUDI-3400] Avoid throw exception when create hoodie table

2022-02-16 Thread GitBox
huberylee commented on pull request #4773: URL: https://github.com/apache/hudi/pull/4773#issuecomment-1042590299 > @alexeykudinkin This PR is intending to avoid printing too many exception stacks when create a hoodie table. When creating hoodie table, no data files will be found

[jira] [Reopened] (HUDI-109) RFC-7 Ability to query older snapshots of data

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu reopened HUDI-109: - Assignee: (was: Nishith Agarwal) > RFC-7 Ability to query older snapshots of data >

[jira] [Closed] (HUDI-3060) DROP TABLE for spark sql

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3060. Reviewers: Shaofeng Li, Tao Meng Resolution: Done > DROP TABLE for spark sql >

[jira] [Closed] (HUDI-3099) Purge drop partition for spark sql

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-3099. Resolution: Done > Purge drop partition for spark sql > -- > >

[jira] [Updated] (HUDI-3161) Add Call Produce Command for spark sql

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3161: - Remaining Estimate: 8h Original Estimate: 8h > Add Call Produce Command for spark sql > -

[jira] [Updated] (HUDI-3161) Add Call Produce Command for spark sql

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu updated HUDI-3161: - Story Points: 2 > Add Call Produce Command for spark sql > -- > >

[GitHub] [hudi] hudi-bot removed a comment on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1042542433 ## CI report: * 698ed4043667b545a927c5a79fdf5f4620b3549a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1042575251 ## CI report: * 480bf8905b94bece1e9d790a30a37fd7496ec720 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042572083 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf14d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042562745 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf

[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042570800 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042564251 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a

[GitHub] [hudi] hudi-bot commented on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042564251 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a111 Azur

[GitHub] [hudi] hudi-bot removed a comment on pull request #4739: [HUDI-3365] Make sure Metadata Table records are updated appropriately on HDFS

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4739: URL: https://github.com/apache/hudi/pull/4739#issuecomment-1042493915 ## CI report: * 11f1b688459ab9017ebde2a38d1645e0f59b50c3 UNKNOWN * c243f70d774b7ecb059dad4bb03870b2c2d4436b UNKNOWN * ebf8acca2b7a3d8cd98bf65dbbc74581ed48a

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042562745 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf14d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042561271 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042561271 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf14d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042544937 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf

[GitHub] [hudi] hudi-bot commented on pull request #4833: [HUDI-3439] Remove the hive shade pattern for flink bundle jar

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4833: URL: https://github.com/apache/hudi/pull/4833#issuecomment-1042555753 ## CI report: * 9cea0f08742c0f2c7cf4884b7b4ab9adac1c448f Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4833: [HUDI-3439] Remove the hive shade pattern for flink bundle jar

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4833: URL: https://github.com/apache/hudi/pull/4833#issuecomment-1042520741 ## CI report: * 9cea0f08742c0f2c7cf4884b7b4ab9adac1c448f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] nsivabalan commented on issue #4814: [SUPPORT] NPE thrown while archiving data table with 0.10.1

2022-02-16 Thread GitBox
nsivabalan commented on issue #4814: URL: https://github.com/apache/hudi/issues/4814#issuecomment-1042546427 @xushiyan : hey can you triage this. One possible reason I can think of is: when concurrent writers are enabled, may be there is some overstepping during archival and so hudi

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042544937 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf14d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042542397 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf

[GitHub] [hudi] hudi-bot commented on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1042542433 ## CI report: * 698ed4043667b545a927c5a79fdf5f4620b3549a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042542397 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf14d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042514254 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf

[GitHub] [hudi] hudi-bot removed a comment on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1042541020 ## CI report: * 698ed4043667b545a927c5a79fdf5f4620b3549a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Comment Edited] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

2022-02-16 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493623#comment-17493623 ] Yue Zhang edited comment on HUDI-3301 at 2/17/22, 3:38 AM: --- Hi [

[GitHub] [hudi] hudi-bot removed a comment on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1041964246 ## CI report: * 698ed4043667b545a927c5a79fdf5f4620b3549a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4811: [HUDI-3213][WIP] Making commit preserve metadata to true for compaction

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4811: URL: https://github.com/apache/hudi/pull/4811#issuecomment-1042541020 ## CI report: * 698ed4043667b545a927c5a79fdf5f4620b3549a Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] baisui1981 edited a comment on issue #4802: [SUPPORT] Nullable column value from MySql exporting to Hudi faild

2022-02-16 Thread GitBox
baisui1981 edited a comment on issue #4802: URL: https://github.com/apache/hudi/issues/4802#issuecomment-1042538812 > for nullable columns, can you try making your schema as follows > > ``` > { > "name":"colName", > "type":["null","string"], >

[GitHub] [hudi] baisui1981 commented on issue #4802: [SUPPORT] Nullable column value from MySql exporting to Hudi faild

2022-02-16 Thread GitBox
baisui1981 commented on issue #4802: URL: https://github.com/apache/hudi/issues/4802#issuecomment-1042538812 > for nullable columns, can you try making your schema as follows > > ``` > { > "name":"colName", > "type":["null","string"], > "defau

[GitHub] [hudi] baisui1981 closed issue #4802: [SUPPORT] Nullable column value from MySql exporting to Hudi faild

2022-02-16 Thread GitBox
baisui1981 closed issue #4802: URL: https://github.com/apache/hudi/issues/4802 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...

[jira] [Comment Edited] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

2022-02-16 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493623#comment-17493623 ] Yue Zhang edited comment on HUDI-3301 at 2/17/22, 3:26 AM: --- Hi [

[jira] [Commented] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

2022-02-16 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493623#comment-17493623 ] Yue Zhang commented on HUDI-3301: - Hi [~manojg] and [~guoyihua] Just a quick think of this

[GitHub] [hudi] xiarixiaoyao commented on pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

2022-02-16 Thread GitBox
xiarixiaoyao commented on pull request #3808: URL: https://github.com/apache/hudi/pull/3808#issuecomment-1042523698 > Not storing entire history of schemas in main commit files is good. We still store the entire history in an auxilary file (.schema/..schemacommit) which we eventually n

[jira] [Resolved] (HUDI-3442) Duplicate code calls for 'FlinkOptions.flatOptions'

2022-02-16 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-3442. -- > Duplicate code calls for 'FlinkOptions.flatOptions' > ---

[jira] [Commented] (HUDI-3442) Duplicate code calls for 'FlinkOptions.flatOptions'

2022-02-16 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17493618#comment-17493618 ] Danny Chen commented on HUDI-3442: -- Fixed via master branch: 433c2573ef5d1f25cba42f169679

[jira] [Updated] (HUDI-3442) Duplicate code calls for 'FlinkOptions.flatOptions'

2022-02-16 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3442?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-3442: - Fix Version/s: 0.11.0 > Duplicate code calls for 'FlinkOptions.flatOptions' >

[hudi] branch master updated (ba0afe1 -> 433c257)

2022-02-16 Thread danny0405
This is an automated email from the ASF dual-hosted git repository. danny0405 pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from ba0afe1 [HUDI-3426] Sync datasource clustering config (#4828) add 433c257 [HUDI-3442]Duplicate code calls for

[GitHub] [hudi] danny0405 merged pull request #4832: [HUDI-3442]Duplicate code calls for 'FlinkOptions.flatOptions'

2022-02-16 Thread GitBox
danny0405 merged pull request #4832: URL: https://github.com/apache/hudi/pull/4832 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubsc

[GitHub] [hudi] hudi-bot removed a comment on pull request #4833: [HUDI-3439] Remove the hive shade pattern for flink bundle jar

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4833: URL: https://github.com/apache/hudi/pull/4833#issuecomment-1042519238 ## CI report: * 9cea0f08742c0f2c7cf4884b7b4ab9adac1c448f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run

[GitHub] [hudi] hudi-bot commented on pull request #4833: [HUDI-3439] Remove the hive shade pattern for flink bundle jar

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4833: URL: https://github.com/apache/hudi/pull/4833#issuecomment-1042520741 ## CI report: * 9cea0f08742c0f2c7cf4884b7b4ab9adac1c448f Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot commented on pull request #4833: [HUDI-3439] Remove the hive shade pattern for flink bundle jar

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4833: URL: https://github.com/apache/hudi/pull/4833#issuecomment-1042519238 ## CI report: * 9cea0f08742c0f2c7cf4884b7b4ab9adac1c448f UNKNOWN Bot commands @hudi-bot supports the following commands: - `@hudi-bot run azure`

[GitHub] [hudi] hudi-bot commented on pull request #4400: [HUDI-3069] compact improve

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1042517801 ## CI report: * 4fa5ba742fc6e9d5c8be2ea079ac3a5a61ad94d1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4400: [HUDI-3069] compact improve

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1042516540 ## CI report: * 2b453c1f110a29e530071f79fe16fe161d426456 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Updated] (HUDI-3439) Remove the hive shade pattern for flink bundle jar

2022-02-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-3439: - Labels: pull-request-available (was: ) > Remove the hive shade pattern for flink bundle jar > ---

[GitHub] [hudi] danny0405 opened a new pull request #4833: [HUDI-3439] Remove the hive shade pattern for flink bundle jar

2022-02-16 Thread GitBox
danny0405 opened a new pull request #4833: URL: https://github.com/apache/hudi/pull/4833 ## *Tips* - *Thank you very much for contributing to Apache Hudi.* - *Please review https://hudi.apache.org/contribute/how-to-contribute before opening a pull request.* ## What is the purpo

[GitHub] [hudi] hudi-bot removed a comment on pull request #4400: [HUDI-3069] compact improve

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-997674330 ## CI report: * 2b453c1f110a29e530071f79fe16fe161d426456 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/re

[GitHub] [hudi] hudi-bot commented on pull request #4400: [HUDI-3069] compact improve

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4400: URL: https://github.com/apache/hudi/pull/4400#issuecomment-1042516540 ## CI report: * 2b453c1f110a29e530071f79fe16fe161d426456 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3439) Remove the hive shade pattern for flink bundle jar

2022-02-16 Thread Danny Chen (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-3439: - Summary: Remove the hive shade pattern for flink bundle jar (was: Do not shade hive class for flink bundl

[jira] [Closed] (HUDI-6) Support for Hive 3.x

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-6. - > Support for Hive 3.x > > > Key: HUDI-6 > URL: https://issues.apach

[jira] [Closed] (HUDI-2499) jdbc-url, user and pass is required to be passed in HMS mode

2022-02-16 Thread Raymond Xu (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2499. > jdbc-url, user and pass is required to be passed in HMS mode > ---

[GitHub] [hudi] hudi-bot commented on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot commented on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042514254 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf14d UNKN

[GitHub] [hudi] hudi-bot removed a comment on pull request #4789: [HUDI-1296] Support Metadata Table in Spark Datasource

2022-02-16 Thread GitBox
hudi-bot removed a comment on pull request #4789: URL: https://github.com/apache/hudi/pull/4789#issuecomment-1042484683 ## CI report: * 740ea9d79bd54d02a869c8f27eb06c9ea54d7fa5 UNKNOWN * 956c9e9568acb6efe8b77d5715cbafefcd8656eb UNKNOWN * 3b96c428e1a09b3548c1be81517e644cedfaf

  1   2   3   4   >