[jira] [Updated] (HUDI-5195) FileIOUtils readDataFromPath will cut off data if the commit metadata which commited to HDFS is too huge

[ https://issues.apache.org/jira/browse/HUDI-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-5195: -- Summary: FileIOUtils readDataFromPath will cut off data if the commit metadata which commited to HDFS is too hug

[jira] [Updated] (HUDI-5195) FileIOUtils readDataFromPath will cut off data if the commit metadata is too huge

[ https://issues.apache.org/jira/browse/HUDI-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-5195: -- Summary: FileIOUtils readDataFromPath will cut off data if the commit metadata is too huge (was: FileIOUtils re

[jira] [Assigned] (HUDI-5195) FileIOUtils readDataFromPath will cut off data if the commit data in hdfs is too huge

[ https://issues.apache.org/jira/browse/HUDI-5195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng reassigned HUDI-5195: - Assignee: yuemeng > FileIOUtils readDataFromPath will cut off data if the commit data in hdfs is > too h

[jira] [Created] (HUDI-5195) FileIOUtils readDataFromPath will cut off data if the commit data in hdfs is too huge

yuemeng created HUDI-5195: - Summary: FileIOUtils readDataFromPath will cut off data if the commit data in hdfs is too huge Key: HUDI-5195 URL: https://issues.apache.org/jira/browse/HUDI-5195 Project: Apache H

[jira] [Closed] (HUDI-4779) Flink Hudi Support Partial Column Update

[ https://issues.apache.org/jira/browse/HUDI-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng closed HUDI-4779. - Resolution: Duplicate > Flink Hudi Support Partial Column Update > > >

[jira] [Assigned] (HUDI-4779) Flink Hudi Support Partial Column Update

[ https://issues.apache.org/jira/browse/HUDI-4779?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng reassigned HUDI-4779: - Assignee: yuemeng > Flink Hudi Support Partial Column Update > >

[jira] [Created] (HUDI-4779) Flink Hudi Support Partial Column Update

yuemeng created HUDI-4779: - Summary: Flink Hudi Support Partial Column Update Key: HUDI-4779 URL: https://issues.apache.org/jira/browse/HUDI-4779 Project: Apache Hudi Issue Type: New Feature

[jira] [Assigned] (HUDI-4715) Needed To ReSync Hive In StreamWriteOperatorCoordinator's initInstant method

[ https://issues.apache.org/jira/browse/HUDI-4715?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng reassigned HUDI-4715: - Assignee: yuemeng > Needed To ReSync Hive In StreamWriteOperatorCoordinator's initInstant method > --

[jira] [Created] (HUDI-4715) Needed To ReSync Hive In StreamWriteOperatorCoordinator's initInstant method

yuemeng created HUDI-4715: - Summary: Needed To ReSync Hive In StreamWriteOperatorCoordinator's initInstant method Key: HUDI-4715 URL: https://issues.apache.org/jira/browse/HUDI-4715 Project: Apache Hudi

[jira] [Created] (HUDI-4714) HoodieFlinkWriteClient can't load callback config to HoodieWriteConfig

yuemeng created HUDI-4714: - Summary: HoodieFlinkWriteClient can't load callback config to HoodieWriteConfig Key: HUDI-4714 URL: https://issues.apache.org/jira/browse/HUDI-4714 Project: Apache Hudi I

[jira] [Assigned] (HUDI-4714) HoodieFlinkWriteClient can't load callback config to HoodieWriteConfig

[ https://issues.apache.org/jira/browse/HUDI-4714?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng reassigned HUDI-4714: - Assignee: yuemeng > HoodieFlinkWriteClient can't load callback config to HoodieWriteConfig >

[jira] [Assigned] (HUDI-4392) Flink MOR table inline compaction plan execution sequence should be configurable

[ https://issues.apache.org/jira/browse/HUDI-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng reassigned HUDI-4392: - Assignee: yuemeng > Flink MOR table inline compaction plan execution sequence should be > configurable >

[jira] [Updated] (HUDI-4506) make BucketIndexPartitioner distribute data more balance

[ https://issues.apache.org/jira/browse/HUDI-4506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-4506: -- Summary: make BucketIndexPartitioner distribute data more balance (was: make BucketIndexPartitioner distribute

[jira] [Created] (HUDI-4506) make BucketIndexPartitioner distribute data more balanced

yuemeng created HUDI-4506: - Summary: make BucketIndexPartitioner distribute data more balanced Key: HUDI-4506 URL: https://issues.apache.org/jira/browse/HUDI-4506 Project: Apache Hudi Issue Type: Imp

[jira] [Created] (HUDI-4421) refactor flink streaming read based on flip-27 and support watermark

yuemeng created HUDI-4421: - Summary: refactor flink streaming read based on flip-27 and support watermark Key: HUDI-4421 URL: https://issues.apache.org/jira/browse/HUDI-4421 Project: Apache Hudi Iss

[jira] [Assigned] (HUDI-4421) refactor flink streaming read based on flip-27 and support watermark

[ https://issues.apache.org/jira/browse/HUDI-4421?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng reassigned HUDI-4421: - Assignee: yuemeng > refactor flink streaming read based on flip-27 and support watermark > --

[jira] [Assigned] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

[ https://issues.apache.org/jira/browse/HUDI-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng reassigned HUDI-4397: - Assignee: yuemeng > Flink Inline Cluster and Compact plan distribute strategy changed from > rebalance t

[jira] [Updated] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

[ https://issues.apache.org/jira/browse/HUDI-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-4397: -- Description: Currently.  Flink Inline cluster and compact distribute strategy are rebalanced. when a compact op

[jira] [Updated] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

[ https://issues.apache.org/jira/browse/HUDI-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-4397: -- Description: Currently.  Flink Inline cluster and compact distribute strategy are rebalanced. when a compact op

[jira] [Updated] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

[ https://issues.apache.org/jira/browse/HUDI-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-4397: -- Description: Currently.  Flink Inline cluster and compact distribute strategy are rebalanced. when a compact op

[jira] [Updated] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

[ https://issues.apache.org/jira/browse/HUDI-4397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-4397: -- Description: Currently.  Flink Inline cluster and compact distribute strategy are rebalanced. when a compact op

[jira] [Created] (HUDI-4397) Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file

yuemeng created HUDI-4397: - Summary: Flink Inline Cluster and Compact plan distribute strategy changed from rebalance to hash to avoid potential multiple threads accessing the same file Key: HUDI-4397 URL: https://issues

[jira] [Updated] (HUDI-4392) Flink MOR table inline compaction plan execution sequence should be configurable

[ https://issues.apache.org/jira/browse/HUDI-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-4392: -- Description: when there leaves too much compaction in some cases. Flink inline compaction always deals the earl

[jira] [Updated] (HUDI-4392) Flink MOR table inline compaction plan execution sequence should be configurable

[ https://issues.apache.org/jira/browse/HUDI-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-4392: -- Summary: Flink MOR table inline compaction plan execution sequence should be configurable (was: Flink mor table

[jira] [Updated] (HUDI-4392) Flink MOR table inline compaction plan execution sequence should be configurable

[ https://issues.apache.org/jira/browse/HUDI-4392?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-4392: -- Description: when there leaves too much compaction in some cases. Flink inline compaction always deals the earl

[jira] [Created] (HUDI-4392) Flink mor table inline compaction plan execution sequence should be configurable

yuemeng created HUDI-4392: - Summary: Flink mor table inline compaction plan execution sequence should be configurable Key: HUDI-4392 URL: https://issues.apache.org/jira/browse/HUDI-4392 Project: Apache Hudi

[jira] [Commented] (HUDI-3953) Flink Hudi module should support low-level read and write APIs

[ https://issues.apache.org/jira/browse/HUDI-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17527985#comment-17527985 ] yuemeng commented on HUDI-3953: --- [~wangxianghu] [~danny0405] ** can you take a look at this

[jira] [Updated] (HUDI-3953) Flink Hudi module should support low-level read and write APIs

[ https://issues.apache.org/jira/browse/HUDI-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-3953: -- Description: Currently.  Flink Hudi Module only supports SQL APIs. People who want to use low-level APIs such u

[jira] [Updated] (HUDI-3953) Flink Hudi module should support low-level read and write APIs

[ https://issues.apache.org/jira/browse/HUDI-3953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-3953: -- Description: Currently.  Flink Hudi Module only supports SQL APIs. People who want to use low-level APIs such u

[jira] [Created] (HUDI-3955) Support Hoodie Table Joined as a dim table with Flink

yuemeng created HUDI-3955: - Summary: Support Hoodie Table Joined as a dim table with Flink Key: HUDI-3955 URL: https://issues.apache.org/jira/browse/HUDI-3955 Project: Apache Hudi Issue Type: New Fea

[jira] [Created] (HUDI-3953) Flink Hudi module should support low-level read and write APIs

yuemeng created HUDI-3953: - Summary: Flink Hudi module should support low-level read and write APIs Key: HUDI-3953 URL: https://issues.apache.org/jira/browse/HUDI-3953 Project: Apache Hudi Issue Ty

[jira] [Updated] (HUDI-3651) optimize the hoodie hive client and ddl executor code with simpler and clearer abstraction

[ https://issues.apache.org/jira/browse/HUDI-3651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-3651: -- Description: currently. HoodieHiveClient both have DDLExecutor and IMetaStoreClient instance, some ddl executor

[jira] [Created] (HUDI-3651) optimize the hoodie hive client and ddl executor code with simpler and clearer abstraction

yuemeng created HUDI-3651: - Summary: optimize the hoodie hive client and ddl executor code with simpler and clearer abstraction Key: HUDI-3651 URL: https://issues.apache.org/jira/browse/HUDI-3651 Project: Apa

[jira] [Updated] (HUDI-3598) Row Data to Hoodie Record Operator parallelism needs to always be consistent with input operator for chaining purpose

[ https://issues.apache.org/jira/browse/HUDI-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-3598: -- Summary: Row Data to Hoodie Record Operator parallelism needs to always be consistent with input operator fo

[jira] [Commented] (HUDI-3598) Row Data to Hoodie Record Operator should support users to adjust the number of parallelism

[ https://issues.apache.org/jira/browse/HUDI-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503987#comment-17503987 ] yuemeng commented on HUDI-3598: --- can anyone to check this issue and assign to me > Row Data

[jira] [Updated] (HUDI-3598) Row Data to Hoodie Record Operator should support users to adjust the number of parallelism

[ https://issues.apache.org/jira/browse/HUDI-3598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] yuemeng updated HUDI-3598: -- Summary: Row Data to Hoodie Record Operator should support users to adjust the number of parallelism (was: Row

[jira] [Created] (HUDI-3598) Row Data to Hoodie Record Operator should support users to adjust the number of Parallelism

yuemeng created HUDI-3598: - Summary: Row Data to Hoodie Record Operator should support users to adjust the number of Parallelism Key: HUDI-3598 URL: https://issues.apache.org/jira/browse/HUDI-3598 Project: Ap