[jira] [Created] (HUDI-9570) Flink AsyncInstant may lost data when trigger recommit.

2025-07-07 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9570: --- Summary: Flink AsyncInstant may lost data when trigger recommit. Key: HUDI-9570 URL: https://issues.apache.org/jira/browse/HUDI-9570 Project: Apache Hudi Issue Type: B

[jira] [Created] (HUDI-9532) Flink clustering add sort columns in clustering plan

2025-06-17 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9532: --- Summary: Flink clustering add sort columns in clustering plan Key: HUDI-9532 URL: https://issues.apache.org/jira/browse/HUDI-9532 Project: Apache Hudi Issue Type: Impr

[jira] [Created] (HUDI-9523) Fix UT Only one SparkContext should be running in this JVM

2025-06-13 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9523: --- Summary: Fix UT Only one SparkContext should be running in this JVM Key: HUDI-9523 URL: https://issues.apache.org/jira/browse/HUDI-9523 Project: Apache Hudi Issue Type

[jira] [Created] (HUDI-9518) Upgrade Flink 1.15/1.16 parquet version from 1.12.2 to 1.12.3

2025-06-10 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9518: --- Summary: Upgrade Flink 1.15/1.16 parquet version from 1.12.2 to 1.12.3 Key: HUDI-9518 URL: https://issues.apache.org/jira/browse/HUDI-9518 Project: Apache Hudi Issue

[jira] [Created] (HUDI-9500) Make bulk insert as row nullable schema consistent with Table Schema

2025-06-05 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9500: --- Summary: Make bulk insert as row nullable schema consistent with Table Schema Key: HUDI-9500 URL: https://issues.apache.org/jira/browse/HUDI-9500 Project: Apache Hudi

[jira] [Created] (HUDI-9495) Modify bot to unify Flink avro and parquet version based on pom #13396

2025-06-05 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9495: --- Summary: Modify bot to unify Flink avro and parquet version based on pom #13396 Key: HUDI-9495 URL: https://issues.apache.org/jira/browse/HUDI-9495 Project: Apache Hudi

[jira] [Updated] (HUDI-9468) Parquet Binary Copy At Rowgroup Level

2025-05-27 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9468?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-9468: Summary: Parquet Binary Copy At Rowgroup Level (was: Parquet Binary Copy At Block Level) > Parquet Binary

[jira] [Created] (HUDI-9468) Parquet Binary Copy At Block Level

2025-05-27 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9468: --- Summary: Parquet Binary Copy At Block Level Key: HUDI-9468 URL: https://issues.apache.org/jira/browse/HUDI-9468 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-9437) Improve Flink Clustering Performance Using Row Reader

2025-05-22 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9437: --- Summary: Improve Flink Clustering Performance Using Row Reader Key: HUDI-9437 URL: https://issues.apache.org/jira/browse/HUDI-9437 Project: Apache Hudi Issue Type: New

[jira] [Created] (HUDI-9379) Spark RemotePartitioner For BucketIndex

2025-05-05 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9379: --- Summary: Spark RemotePartitioner For BucketIndex Key: HUDI-9379 URL: https://issues.apache.org/jira/browse/HUDI-9379 Project: Apache Hudi Issue Type: New Feature

[jira] [Assigned] (HUDI-9230) Partition Level Bucket Index adopt Spark and Flink reader bucket id pruning

2025-04-05 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9230?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang reassigned HUDI-9230: --- Assignee: Yue Zhang > Partition Level Bucket Index adopt Spark and Flink reader bucket id pruning > -

[jira] [Created] (HUDI-9210) The cache cleanup by releaseCachedData is incomplete

2025-04-04 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9210: --- Summary: The cache cleanup by releaseCachedData is incomplete Key: HUDI-9210 URL: https://issues.apache.org/jira/browse/HUDI-9210 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-9239) Fix the bug of Spark Cache not releasing cleanly

2025-03-27 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9239: --- Summary: Fix the bug of Spark Cache not releasing cleanly Key: HUDI-9239 URL: https://issues.apache.org/jira/browse/HUDI-9239 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-9229) Optimize the uniformity of the partition level bucket index partitioner

2025-03-27 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9229: --- Summary: Optimize the uniformity of the partition level bucket index partitioner Key: HUDI-9229 URL: https://issues.apache.org/jira/browse/HUDI-9229 Project: Apache Hudi

[jira] [Created] (HUDI-9230) Partition Level Bucket Index adopt Spark and Flink reader bucket id pruning

2025-03-27 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9230: --- Summary: Partition Level Bucket Index adopt Spark and Flink reader bucket id pruning Key: HUDI-9230 URL: https://issues.apache.org/jira/browse/HUDI-9230 Project: Apache Hudi

[jira] [Created] (HUDI-9207) Spark Insert Overwrite Support Row Writer

2025-03-21 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-9207: --- Summary: Spark Insert Overwrite Support Row Writer Key: HUDI-9207 URL: https://issues.apache.org/jira/browse/HUDI-9207 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-8990) Dynamic Partition Level Bucket Index

2025-02-06 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-8990: --- Summary: Dynamic Partition Level Bucket Index Key: HUDI-8990 URL: https://issues.apache.org/jira/browse/HUDI-8990 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-8900) Incremental Table Service CI

2025-01-22 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-8900: --- Summary: Incremental Table Service CI Key: HUDI-8900 URL: https://issues.apache.org/jira/browse/HUDI-8900 Project: Apache Hudi Issue Type: New Feature Repo

[jira] [Created] (HUDI-8780) RFC-83 Incremental Table Service

2024-12-17 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-8780: --- Summary: RFC-83 Incremental Table Service Key: HUDI-8780 URL: https://issues.apache.org/jira/browse/HUDI-8780 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-8675) Flink schedule compaction with incremental partitions

2024-12-08 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-8675: --- Summary: Flink schedule compaction with incremental partitions Key: HUDI-8675 URL: https://issues.apache.org/jira/browse/HUDI-8675 Project: Apache Hudi Issue Type: New

[jira] [Created] (HUDI-7158) Expose event time field to record event time in commit file

2023-11-28 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-7158: --- Summary: Expose event time field to record event time in commit file Key: HUDI-7158 URL: https://issues.apache.org/jira/browse/HUDI-7158 Project: Apache Hudi Issue Ty

[jira] [Created] (HUDI-7147) Hudi cdc write throws Unsupported Operation Exception

2023-11-27 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-7147: --- Summary: Hudi cdc write throws Unsupported Operation Exception Key: HUDI-7147 URL: https://issues.apache.org/jira/browse/HUDI-7147 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-7142) Support Custom partitioner in append mode

2023-11-26 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-7142: --- Summary: Support Custom partitioner in append mode Key: HUDI-7142 URL: https://issues.apache.org/jira/browse/HUDI-7142 Project: Apache Hudi Issue Type: New Feature

[jira] [Created] (HUDI-7109) Fix Flink may re-use a committed instant in append mode

2023-11-16 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-7109: --- Summary: Fix Flink may re-use a committed instant in append mode Key: HUDI-7109 URL: https://issues.apache.org/jira/browse/HUDI-7109 Project: Apache Hudi Issue Type: B

[jira] [Assigned] (HUDI-6945) Fix HoodieRowDataParquetWriter cast issue

2023-10-16 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang reassigned HUDI-6945: --- Assignee: Yue Zhang > Fix HoodieRowDataParquetWriter cast issue > ---

[jira] [Created] (HUDI-6945) Fix HoodieRowDataParquetWriter cast issue

2023-10-16 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-6945: --- Summary: Fix HoodieRowDataParquetWriter cast issue Key: HUDI-6945 URL: https://issues.apache.org/jira/browse/HUDI-6945 Project: Apache Hudi Issue Type: Bug

[jira] [Assigned] (HUDI-6944) Fix Flink bootstrap concurrency issue causes job to keep rolling back

2023-10-16 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang reassigned HUDI-6944: --- Assignee: Yue Zhang > Fix Flink bootstrap concurrency issue causes job to keep rolling back > ---

[jira] [Created] (HUDI-6944) Fix Flink bootstrap concurrency issue causes job to keep rolling back

2023-10-16 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-6944: --- Summary: Fix Flink bootstrap concurrency issue causes job to keep rolling back Key: HUDI-6944 URL: https://issues.apache.org/jira/browse/HUDI-6944 Project: Apache Hudi

[jira] [Updated] (HUDI-4575) Initial Kafka Global Offsets in Hudi Kafka Sink Connector

2023-05-30 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4575?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4575: Fix Version/s: 0.14.0 (was: 0.13.1) > Initial Kafka Global Offsets in Hudi Kafka Sin

[jira] [Updated] (HUDI-4735) Spark2 bundles made from master after 2022-07-23 failed to stop

2023-05-30 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4735: Fix Version/s: 0.14.0 (was: 0.13.1) > Spark2 bundles made from master after 2022-07-2

[jira] [Updated] (HUDI-2506) Hudi dependency governance

2023-05-30 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-2506: Fix Version/s: (was: 0.13.1) > Hudi dependency governance > -- > >

[jira] [Updated] (HUDI-4574) Failed to create timeline-server marker due to HoodieRemoteException

2023-05-30 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4574: Fix Version/s: 0.14.0 (was: 0.13.1) > Failed to create timeline-server marker due to

[jira] [Updated] (HUDI-4557) Support validation of column stats of avro log files in tests

2023-05-30 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4557?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4557: Fix Version/s: 0.14.0 (was: 0.13.1) > Support validation of column stats of avro log

[jira] [Created] (HUDI-6270) 0.13.1 release doc

2023-05-26 Thread Yue Zhang (Jira)
Yue Zhang created HUDI-6270: --- Summary: 0.13.1 release doc Key: HUDI-6270 URL: https://issues.apache.org/jira/browse/HUDI-6270 Project: Apache Hudi Issue Type: New Feature Reporter: Yue

[jira] [Updated] (HUDI-6099) Improve performance of checking for valid commits when tagging record location

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6099?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6099: Fix Version/s: (was: 0.13.1) > Improve performance of checking for valid commits when tagging record loc

[jira] [Updated] (HUDI-5909) Reuse hive client if possible

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5909: Fix Version/s: (was: 0.13.1) > Reuse hive client if possible > - > >

[jira] [Updated] (HUDI-5983) Improve loading data via cloud store incr source

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5983?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5983: Fix Version/s: (was: 0.13.1) > Improve loading data via cloud store incr source > -

[jira] [Updated] (HUDI-5972) Fix the flink 1.13 bundle jar version on website

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5972?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5972: Fix Version/s: (was: 0.13.1) > Fix the flink 1.13 bundle jar version on website > --

[jira] [Updated] (HUDI-5922) Reuse IMetaStoreClient between HoodieHiveSyncClient and DDLExecutor

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5922: Fix Version/s: (was: 0.13.1) > Reuse IMetaStoreClient between HoodieHiveSyncClient and DDLExecutor > ---

[jira] [Updated] (HUDI-5916) flink bundle jar includes the hive-exec core by default

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5916: Fix Version/s: (was: 0.13.1) > flink bundle jar includes the hive-exec core by default > ---

[jira] [Updated] (HUDI-5887) Should not mark the concurrency mode as OCC by default when MDT is enabled

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5887: Fix Version/s: (was: 0.13.1) > Should not mark the concurrency mode as OCC by default when MDT is enable

[jira] [Updated] (HUDI-5870) Fix some comments about column type change rules

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5870: Fix Version/s: 0.14.0 (was: 0.13.1) > Fix some comments about column type change rule

[jira] [Updated] (HUDI-5947) Update the README for flink jar building

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5947: Fix Version/s: (was: 0.13.1) > Update the README for flink jar building > --

[jira] [Updated] (HUDI-5873) The pending compactions of dataset table should not block MDT compaction

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5873: Fix Version/s: (was: 0.13.1) > The pending compactions of dataset table should not block MDT compaction

[jira] [Updated] (HUDI-5881) Handle pending clean instants while running savepoint

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5881?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5881: Fix Version/s: (was: 0.13.1) 0.14.0 > Handle pending clean instants while running sav

[jira] [Updated] (HUDI-5611) Revisit metadata-table-based file listing calls and use batch lookup instead

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5611: Fix Version/s: 0.14.0 (was: 0.13.1) > Revisit metadata-table-based file listing calls

[jira] [Updated] (HUDI-5809) Keep RFC-56 early conflict detection update to date

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5809: Fix Version/s: 0.14.0 (was: 0.13.1) > Keep RFC-56 early conflict detection update to

[jira] [Updated] (HUDI-5848) No PreCombineField mode - make COMBINE_BEFORE_UPSERT=false automatically

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5848: Fix Version/s: 0.14.0 (was: 0.13.1) > No PreCombineField mode - make COMBINE_BEFORE_U

[jira] [Updated] (HUDI-5794) Fail any new commits if there is any inflight restore in timeline

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5794?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5794: Fix Version/s: 0.14.0 (was: 0.13.1) > Fail any new commits if there is any inflight r

[jira] [Updated] (HUDI-5845) Remove usage of deprecated getTableAvroSchemaWithoutMetadataFields

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5845?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5845: Fix Version/s: (was: 0.13.1) > Remove usage of deprecated getTableAvroSchemaWithoutMetadataFields >

[jira] [Updated] (HUDI-5853) Add infer function for BQ sync configs

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5853?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5853: Fix Version/s: 0.14.0 (was: 0.13.1) > Add infer function for BQ sync configs > --

[jira] [Updated] (HUDI-5812) Optimize the data size check in HoodieBaseParquetWriter

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5812: Fix Version/s: (was: 0.13.1) > Optimize the data size check in HoodieBaseParquetWriter > ---

[jira] [Updated] (HUDI-5651) sort the inputs by record keys for bulk insert tasks

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5651?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5651: Fix Version/s: (was: 0.13.1) > sort the inputs by record keys for bulk insert tasks > --

[jira] [Updated] (HUDI-5664) Improve SqlQueryPreCommitValidator#queries Parallelism

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5664: Fix Version/s: (was: 0.13.1) > Improve SqlQueryPreCommitValidator#queries Parallelism >

[jira] [Updated] (HUDI-5791) Handle empty payloads for AbstractDebeziumAvroPayload

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5791: Fix Version/s: 0.14.0 (was: 0.13.1) > Handle empty payloads for AbstractDebeziumAvroP

[jira] [Updated] (HUDI-5724) Test MOR table w/ global index w/ update partition path to true

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5724: Fix Version/s: 0.14.0 (was: 0.13.1) > Test MOR table w/ global index w/ update partit

[jira] [Updated] (HUDI-5612) Integrate metadata table with SpillableMapBasedFileSystemView and RocksDbBasedFileSystemView

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5612: Fix Version/s: 0.14.0 (was: 0.13.1) > Integrate metadata table with SpillableMapBased

[jira] [Updated] (HUDI-5531) RECENT_DAYS strategy of ClusteringPlanPartitionFilterMode should rename to RECENT_PARTITIONS

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5531: Fix Version/s: 0.14.0 (was: 0.13.1) > RECENT_DAYS strategy of ClusteringPlanPartition

[jira] [Updated] (HUDI-5449) Misc and adhoc fixes to add record level index support to MDT

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5449: Fix Version/s: 0.14.0 (was: 0.13.1) > Misc and adhoc fixes to add record level index

[jira] [Updated] (HUDI-5445) Fix/Unify deletion code paths for MDT

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5445: Fix Version/s: 0.14.0 (was: 0.13.1) > Fix/Unify deletion code paths for MDT > ---

[jira] [Updated] (HUDI-5300) Optimize initial commit w/ metadata table

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5300: Fix Version/s: 0.14.0 (was: 0.13.1) > Optimize initial commit w/ metadata table > ---

[jira] [Updated] (HUDI-4585) Optimize query performance on Presto Hudi connector

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4585?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4585: Fix Version/s: 0.14.0 (was: 0.13.1) > Optimize query performance on Presto Hudi conn

[jira] [Updated] (HUDI-5451) Ensure switching "001" and "002" suffix for compaction and cleaning in MDT is backwards compatible

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5451: Fix Version/s: 0.14.0 (was: 0.13.1) > Ensure switching "001" and "002" suffix for com

[jira] [Updated] (HUDI-5245) Honor pruned partitions while looking up in col stats partition in MDT

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5245: Fix Version/s: 0.14.0 (was: 0.13.1) > Honor pruned partitions while looking up in col

[jira] [Updated] (HUDI-5173) Skip if there is only one file in clusteringGroup

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5173: Fix Version/s: (was: 0.13.1) > Skip if there is only one file in clusteringGroup > -

[jira] [Updated] (HUDI-5453) Ensure new fileId format is good across all code paths and backwards compatible

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5453: Fix Version/s: 0.14.0 (was: 0.13.1) > Ensure new fileId format is good across all cod

[jira] [Updated] (HUDI-5498) Update docs for reading Hudi tables on Databricks runtime

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5498: Fix Version/s: 0.14.0 (was: 0.13.1) > Update docs for reading Hudi tables on Databric

[jira] [Updated] (HUDI-5427) Cache final snapshot records for Metadata table FILES partition

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5427?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5427: Fix Version/s: 0.14.0 (was: 0.13.1) > Cache final snapshot records for Metadata table

[jira] [Updated] (HUDI-5448) Add metrics to record level index in MDT

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5448?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5448: Fix Version/s: 0.14.0 (was: 0.13.1) > Add metrics to record level index in MDT >

[jira] [Updated] (HUDI-5440) Benchmark MDT performance for diff sizes of datasets

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5440: Fix Version/s: 0.14.0 (was: 0.13.1) > Benchmark MDT performance for diff sizes of dat

[jira] [Updated] (HUDI-5292) Exclude the test resources from every module packaging

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5292?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5292: Fix Version/s: 0.14.0 (was: 0.13.1) > Exclude the test resources from every module pa

[jira] [Updated] (HUDI-4329) Add separate control for compaction operation sync/async mode

2023-05-23 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4329: Fix Version/s: 0.14.0 (was: 0.13.1) > Add separate control for compaction operation s

[jira] [Updated] (HUDI-4248) Upgrade Apache Avro version for hudi-flink

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4248?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4248: Fix Version/s: 0.14.0 (was: 0.13.1) > Upgrade Apache Avro version for hudi-flink > --

[jira] [Updated] (HUDI-3519) Make sure every public Hudi Client Method invokes necessary prologue

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3519?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-3519: Fix Version/s: 0.14.0 (was: 0.13.1) > Make sure every public Hudi Client Method invok

[jira] [Updated] (HUDI-4245) Support nested fields in Column Stats Index

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-4245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-4245: Fix Version/s: 0.14.0 (was: 0.13.1) > Support nested fields in Column Stats Index > -

[jira] [Updated] (HUDI-3674) Remove unnecessary HBase-related dependencies from bundles if there is any

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-3674: Fix Version/s: 0.14.0 (was: 0.13.1) > Remove unnecessary HBase-related dependencies f

[jira] [Updated] (HUDI-2767) Enable timeline server based marker type as default

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2767?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-2767: Fix Version/s: 0.14.0 (was: 0.13.1) > Enable timeline server based marker type as def

[jira] [Updated] (HUDI-3879) Suppress exceptions that are not fatal in HoodieMetadataTableValidator

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3879?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-3879: Fix Version/s: 0.14.0 (was: 0.13.1) > Suppress exceptions that are not fatal in Hoodi

[jira] [Updated] (HUDI-3115) Kafka Connect should not be packaged as a bundle

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3115?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-3115: Fix Version/s: 0.14.0 (was: 0.13.1) > Kafka Connect should not be packaged as a bundl

[jira] [Updated] (HUDI-3531) Review and shade transitive dependencies in hudi bundle jar

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-3531: Fix Version/s: 0.14.0 (was: 0.13.1) > Review and shade transitive dependencies in hud

[jira] [Updated] (HUDI-3321) HFileWriter, HFileReader and HFileDataBlock should avoid hardcoded key field name

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3321?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-3321: Fix Version/s: 0.14.0 (was: 0.13.1) > HFileWriter, HFileReader and HFileDataBlock sho

[jira] [Updated] (HUDI-3317) Partition specific pointed lookup/reading strategy for metadata table

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-3317?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-3317: Fix Version/s: 0.14.0 (was: 0.13.1) > Partition specific pointed lookup/reading strat

[jira] [Updated] (HUDI-2737) Use earliest instant by default for compaction and clustering job

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2737?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-2737: Fix Version/s: 0.14.0 (was: 0.13.1) > Use earliest instant by default for compaction

[jira] [Updated] (HUDI-2736) Redundant metadata table initialization by the metadata writer

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-2736: Fix Version/s: 0.14.0 (was: 0.13.1) > Redundant metadata table initialization by the

[jira] [Updated] (HUDI-2458) Relax compaction in metadata being fenced based on inflight requests in data table

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-2458: Fix Version/s: 0.14.0 (was: 0.13.1) > Relax compaction in metadata being fenced based

[jira] [Updated] (HUDI-2388) Add test nodes for Spark SQL in integration test suite

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-2388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-2388: Fix Version/s: 0.14.0 (was: 0.13.1) > Add test nodes for Spark SQL in integration tes

[jira] [Updated] (HUDI-1101) Decouple Hive dependencies from hudi-spark

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1101?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-1101: Fix Version/s: 0.14.0 (was: 0.13.1) > Decouple Hive dependencies from hudi-spark > --

[jira] [Updated] (HUDI-6127) Flink Hudi Support Commit on empty batch

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6127: Issue Type: Improvement (was: New Feature) > Flink Hudi Support Commit on empty batch > --

[jira] [Updated] (HUDI-5517) HoodieTimeline support filter instants by state transition time

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5517: Fix Version/s: (was: 0.13.1) > HoodieTimeline support filter instants by state transition time > ---

[jira] [Updated] (HUDI-6091) Add Java 11 and 17 to bundle validation image

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6091?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6091: Issue Type: Improvement (was: New Feature) > Add Java 11 and 17 to bundle validation image > --

[jira] [Updated] (HUDI-5941) Support savepoint CALL procedure with table base path

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5941: Fix Version/s: 0.14.0 (was: 0.13.1) > Support savepoint CALL procedure with table bas

[jira] [Updated] (HUDI-6176) Fix flaky test testArchivalWithMultiWriters

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6176: Fix Version/s: 0.14.0 (was: 0.13.1) > Fix flaky test testArchivalWithMultiWriters > -

[jira] [Updated] (HUDI-6138) HoodieAvroRecord - Fix Option get for empty values

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6138?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6138: Fix Version/s: 0.14.0 (was: 0.13.1) > HoodieAvroRecord - Fix Option get for empty val

[jira] [Updated] (HUDI-6061) NPE with nullable MapType and new hudi merger

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6061: Fix Version/s: 0.14.0 (was: 0.13.1) > NPE with nullable MapType and new hudi merger >

[jira] [Updated] (HUDI-5904) support more than one update actions in merge into table

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5904?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5904: Fix Version/s: 0.14.0 (was: 0.13.1) > support more than one update actions in merge i

[jira] [Updated] (HUDI-5890) Fix build failure of asf-site branch

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5890: Fix Version/s: 0.14.0 (was: 0.13.1) > Fix build failure of asf-site branch >

[jira] [Updated] (HUDI-6011) Hudi CLI show archived commits is broken for replace commit

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6011?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6011: Fix Version/s: (was: 0.13.1) > Hudi CLI show archived commits is broken for replace commit > ---

[jira] [Updated] (HUDI-5914) Fix for RowData class cast exception

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5914: Fix Version/s: (was: 0.13.1) > Fix for RowData class cast exception > --

[jira] [Updated] (HUDI-5968) Global index update partition for MOR creating duplicates

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-5968?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-5968: Fix Version/s: (was: 0.13.1) > Global index update partition for MOR creating duplicates > -

[jira] [Updated] (HUDI-6025) Incremental read with MOR doesn't give correct results

2023-05-22 Thread Yue Zhang (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yue Zhang updated HUDI-6025: Fix Version/s: 0.14.0 (was: 0.13.1) > Incremental read with MOR doesn't give correct

  1   2   3   4   5   >