[jira] [Closed] (HUDI-8261) Cover more type conversion for hive fg reader

[ https://issues.apache.org/jira/browse/HUDI-8261?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-8261. - Resolution: Duplicate > Cover more type conversion for hive fg rea

[jira] [Updated] (HUDI-9641) Create HoodieAvroBinaryRecord and remove payload usage on writer path

[ https://issues.apache.org/jira/browse/HUDI-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown updated HUDI-9641: Description: As part of migrating towards our new record merging classes, we will no longer

[jira] [Updated] (HUDI-9641) Create HoodieAvroBinaryRecord and remove payload usage on writer path

[ https://issues.apache.org/jira/browse/HUDI-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown updated HUDI-9641: Summary: Create HoodieAvroBinaryRecord and remove payload usage on writer path (was: Create

[jira] [Updated] (HUDI-9641) Create HoodieAvroBinaryRecord

[ https://issues.apache.org/jira/browse/HUDI-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown updated HUDI-9641: Description: (was: For write path.) > Create HoodieAvroBinaryRec

[jira] [Assigned] (HUDI-9641) Create HoodieAvroBinaryRecord

[ https://issues.apache.org/jira/browse/HUDI-9641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown reassigned HUDI-9641: --- Assignee: Timothy Brown (was: Lin Liu) > Create HoodieAvroBinaryRec

[jira] [Updated] (HUDI-9685) Enable row group-level file stitching in Hudi clustering using schema grouping and Parquet APIs

[ https://issues.apache.org/jira/browse/HUDI-9685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9685: - Labels: pull-request-available (was: ) > Enable row group-level file stitching in H

[jira] [Created] (HUDI-9685) Enable row group-level file stitching in Hudi clustering using schema grouping and Parquet APIs

Xinli Shang created HUDI-9685: - Summary: Enable row group-level file stitching in Hudi clustering using schema grouping and Parquet APIs Key: HUDI-9685 URL: https://issues.apache.org/jira/browse/HUDI-9685

[jira] [Closed] (HUDI-9667) Incorporate completion time into restore workflow

[ https://issues.apache.org/jira/browse/HUDI-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9667. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch

[jira] [Resolved] (HUDI-9667) Incorporate completion time into restore workflow

[ https://issues.apache.org/jira/browse/HUDI-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-9667. -- > Incorporate completion time into restore workf

[jira] [Updated] (HUDI-9667) Incorporate completion time into restore workflow

[ https://issues.apache.org/jira/browse/HUDI-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-9667: - Fix Version/s: 1.1.0 > Incorporate completion time into restore workf

[jira] [Closed] (HUDI-9664) Refactor HoodieReaderContext and move record APIs into RecordContext

[ https://issues.apache.org/jira/browse/HUDI-9664?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lokesh Jain closed HUDI-9664. - Fix Version/s: 1.1.0 Resolution: Fixed > Refactor HoodieReaderContext and move record APIs i

[jira] [Created] (HUDI-9684) Add follow up tests for Uprgade/Downgrade Fixtures Framework

Rahil Chertara created HUDI-9684: Summary: Add follow up tests for Uprgade/Downgrade Fixtures Framework Key: HUDI-9684 URL: https://issues.apache.org/jira/browse/HUDI-9684 Project: Apache Hudi

[jira] [Closed] (HUDI-9675) Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS

[ https://issues.apache.org/jira/browse/HUDI-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9675. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch

[jira] [Updated] (HUDI-9675) Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS

[ https://issues.apache.org/jira/browse/HUDI-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-9675: - Fix Version/s: 1.1.0 > Savepoint safety checks are missing for cleaner pol

[jira] [Updated] (HUDI-1045) Support updates during clustering

[ https://issues.apache.org/jira/browse/HUDI-1045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1045: - Fix Version/s: 1.2.0 (was: 1.1.0) > Support updates during cluster

[jira] [Commented] (HUDI-8480) Add support to NBCC to MDT in 1.0

[ https://issues.apache.org/jira/browse/HUDI-8480?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18011738#comment-18011738 ] Vinoth Chandar commented on HUDI-8480: -- Should this be closed? > Add sup

[jira] (HUDI-8480) Add support to NBCC to MDT in 1.0

[ https://issues.apache.org/jira/browse/HUDI-8480 ] Vinoth Chandar deleted comment on HUDI-8480: -- was (Author: vc): Should this be closed? > Add support to NBCC to MDT in 1.0 > - > >

[jira] [Updated] (HUDI-8736) Simplification of archival, savepoint, restore, cleaning interplays

[ https://issues.apache.org/jira/browse/HUDI-8736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-8736: - Summary: Simplification of archival, savepoint, restore, cleaning interplays (was

[jira] [Commented] (HUDI-4112) Relax constraint in metadata table that rollback of a commit that got archived in MDT throws exception

[ https://issues.apache.org/jira/browse/HUDI-4112?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18011736#comment-18011736 ] Vinoth Chandar commented on HUDI-4112: -- What is the actual issue here? is th

[jira] [Closed] (HUDI-5611) Revisit metadata-table-based file listing calls and use batch lookup instead

[ https://issues.apache.org/jira/browse/HUDI-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-5611. Resolution: Won't Fix > Revisit metadata-table-based file listing calls and use batc

[jira] [Resolved] (HUDI-5611) Revisit metadata-table-based file listing calls and use batch lookup instead

[ https://issues.apache.org/jira/browse/HUDI-5611?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar resolved HUDI-5611. -- > Revisit metadata-table-based file listing calls and use batch lookup inst

[jira] [Updated] (HUDI-6981) Revisit Savepoint Design to handle OOM issues due to very large save points

[ https://issues.apache.org/jira/browse/HUDI-6981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-6981: - Fix Version/s: 1.2.0 (was: 1.1.0) > Revisit Savepoint Design to handle

[jira] [Closed] (HUDI-9683) Fix spark rename columns for HoodieInternalRowUtils.genUnsafeRowWriter

[ https://issues.apache.org/jira/browse/HUDI-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9683. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch

[jira] [Resolved] (HUDI-9683) Fix spark rename columns for HoodieInternalRowUtils.genUnsafeRowWriter

[ https://issues.apache.org/jira/browse/HUDI-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen resolved HUDI-9683. -- > Fix spark rename columns for HoodieInternalRowUtils.genUnsafeRowWri

[jira] [Updated] (HUDI-9683) Fix spark rename columns for HoodieInternalRowUtils.genUnsafeRowWriter

[ https://issues.apache.org/jira/browse/HUDI-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-9683: -- Status: Patch Available (was: In Progress) > Fix spark rename columns

[jira] [Updated] (HUDI-9683) Fix spark rename columns for HoodieInternalRowUtils.genUnsafeRowWriter

[ https://issues.apache.org/jira/browse/HUDI-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-9683: -- Status: In Progress (was: Open) > Fix spark rename columns

[jira] [Updated] (HUDI-9683) Fix spark rename columns for HoodieInternalRowUtils.genUnsafeRowWriter

[ https://issues.apache.org/jira/browse/HUDI-9683?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9683: - Labels: pull-request-available (was: ) > Fix spark rename columns

[jira] [Created] (HUDI-9683) Fix spark rename columns for HoodieInternalRowUtils.genUnsafeRowWriter

Jonathan Vexler created HUDI-9683: - Summary: Fix spark rename columns for HoodieInternalRowUtils.genUnsafeRowWriter Key: HUDI-9683 URL: https://issues.apache.org/jira/browse/HUDI-9683 Project: Apache

[jira] [Closed] (HUDI-9676) Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic with renamed columns is wrong

[ https://issues.apache.org/jira/browse/HUDI-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9676. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch

[jira] [Updated] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9681: -- Description: This code in {{AbstractTableFileSystemView}} incurs a mkdir operation which is an anti

[jira] [Updated] (HUDI-9682) Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration

[ https://issues.apache.org/jira/browse/HUDI-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9682: - Labels: pull-request-available (was: ) > Add support to FileGroupRecordBuffer to assist w/

[jira] [Assigned] (HUDI-9682) Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration

[ https://issues.apache.org/jira/browse/HUDI-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9682: - Assignee: sivabalan narayanan > Add support to FileGroupRecordBuffer to assis

[jira] [Updated] (HUDI-9682) Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration

[ https://issues.apache.org/jira/browse/HUDI-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9682: -- Fix Version/s: 1.1.0 > Add support to FileGroupRecordBuffer to assist w/ cow me

[jira] [Created] (HUDI-9682) Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration

sivabalan narayanan created HUDI-9682: - Summary: Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration Key: HUDI-9682 URL: https://issues.apache.org/jira/browse/HUDI-9682

[jira] [Closed] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo closed HUDI-9681. - Resolution: Fixed > Remove mkdirs from the partition listing in the file system v

[jira] [Commented] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18011516#comment-18011516 ] Y Ethan Guo commented on HUDI-9681: --- Fixed by [https://github.com/apache/hudi/

[jira] [Updated] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9681: -- Fix Version/s: 1.0.0-beta2 > Remove mkdirs from the partition listing in the file system v

[jira] [Updated] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9681: -- Affects Version/s: 0.15.0 0.14.1 0.14.0

[jira] [Updated] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9681: -- Fix Version/s: 1.0.0 (was: 1.1.0) > Remove mkdirs from the partition listing

[jira] [Updated] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9681: -- Description: This code in {{AbstractTableFileSystemView}} incurs a mkdir operation which is an anti

[jira] [Updated] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9681: -- Description: This code in {{AbstractTableFileSystemView}} incurs a mkdir operation which is an anti

[jira] [Assigned] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo reassigned HUDI-9681: - Assignee: Y Ethan Guo > Remove mkdirs from the partition listing in the file system v

[jira] [Created] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

Y Ethan Guo created HUDI-9681: - Summary: Remove mkdirs from the partition listing in the file system view Key: HUDI-9681 URL: https://issues.apache.org/jira/browse/HUDI-9681 Project: Apache Hudi

[jira] [Updated] (HUDI-9681) Remove mkdirs from the partition listing in the file system view

[ https://issues.apache.org/jira/browse/HUDI-9681?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-9681: -- Fix Version/s: 1.1.0 > Remove mkdirs from the partition listing in the file system v

[jira] [Assigned] (HUDI-9680) Failure to Create Secondary Index in Hudi 1.0.2

[ https://issues.apache.org/jira/browse/HUDI-9680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vamsi Karnika reassigned HUDI-9680: --- Assignee: Y Ethan Guo > Failure to Create Secondary Index in Hudi 1.

[jira] [Updated] (HUDI-9680) Failure to Create Secondary Index in Hudi 1.0.2

[ https://issues.apache.org/jira/browse/HUDI-9680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vamsi Karnika updated HUDI-9680: Summary: Failure to Create Secondary Index in Hudi 1.0.2 (was: Failing to create Secondary Index

[jira] [Created] (HUDI-9680) Failing to create Secondary Index

Vamsi Karnika created HUDI-9680: --- Summary: Failing to create Secondary Index Key: HUDI-9680 URL: https://issues.apache.org/jira/browse/HUDI-9680 Project: Apache Hudi Issue Type: Bug

[jira] [Closed] (HUDI-8746) Spark using file group reader to support multi-base file format

[ https://issues.apache.org/jira/browse/HUDI-8746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-8746. - Resolution: Fixed > Spark using file group reader to support multi-base file for

[jira] [Closed] (HUDI-9672) Disable skipping clustering for spark incremental query to solve data duplication

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9672. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch

[jira] [Updated] (HUDI-9671) Ignore -U msg for snapshot queries

[ https://issues.apache.org/jira/browse/HUDI-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-9671: - Summary: Ignore -U msg for snapshot queries (was: Spark reads the changelog data whose _hoodie_operation

[jira] [Updated] (HUDI-9671) Ignore -U msg for snapshot queries

[ https://issues.apache.org/jira/browse/HUDI-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen updated HUDI-9671: - Fix Version/s: 1.1.0 > Ignore -U msg for snapshot quer

[jira] [Closed] (HUDI-9671) Ignore -U msg for snapshot queries

[ https://issues.apache.org/jira/browse/HUDI-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9671. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch

[jira] [Updated] (HUDI-9679) Refactor filesystem operations to use storage

[ https://issues.apache.org/jira/browse/HUDI-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9679: - Labels: 1.1.0 pull-request-available (was: 1.1.0) > Refactor filesystem operations to

[jira] [Updated] (HUDI-9678) Spark overwrite partitioned mor table failed

[ https://issues.apache.org/jira/browse/HUDI-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9678: - Labels: pull-request-available (was: ) > Spark overwrite partitioned mor table fai

[jira] [Assigned] (HUDI-9679) Refactor filesystem operations to use storage

[ https://issues.apache.org/jira/browse/HUDI-9679?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mansi Patel reassigned HUDI-9679: - Assignee: Mansi Patel > Refactor filesystem operations to use stor

[jira] [Created] (HUDI-9679) Refactor filesystem operations to use storage

Mansi Patel created HUDI-9679: - Summary: Refactor filesystem operations to use storage Key: HUDI-9679 URL: https://issues.apache.org/jira/browse/HUDI-9679 Project: Apache Hudi Issue Type: Task

[jira] [Assigned] (HUDI-9672) Disable skipping clustering for spark incremental query to solve data duplication

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng reassigned HUDI-9672: Assignee: Shuo Cheng > Disable skipping clustering for spark incremental query to solve d

[jira] [Updated] (HUDI-9678) Spark overwrite partitioned mor table failed

[ https://issues.apache.org/jira/browse/HUDI-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuehai-chen updated HUDI-9678: -- Affects Version/s: 0.14.1 > Spark overwrite partitioned mor table fai

[jira] [Updated] (HUDI-9678) Spark overwrite partitioned mor table failed

[ https://issues.apache.org/jira/browse/HUDI-9678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] xuehai-chen updated HUDI-9678: -- Status: In Progress (was: Open) > Spark overwrite partitioned mor table fai

[jira] [Created] (HUDI-9678) Spark overwrite partitioned mor table failed

xuehai-chen created HUDI-9678: - Summary: Spark overwrite partitioned mor table failed Key: HUDI-9678 URL: https://issues.apache.org/jira/browse/HUDI-9678 Project: Apache Hudi Issue Type: Bug

[jira] [Updated] (HUDI-9672) Disable skipping clustering for spark incremental query to solve data duplication

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Summary: Disable skipping clustering for spark incremental query to solve data duplication (was: Fix

[jira] [Updated] (HUDI-9672) Fix data loss for spark incremental query with skip clustering enabled

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Description: Considering the following ingestion case for spark: * MOR table + upsert/insert 1st insert

[jira] [Updated] (HUDI-9672) Fix data loss for spark incremental query with skip clustering enabled

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Description: Considering the following ingestion case for spark: * MOR table + upsert/insert 1st insert

[jira] [Updated] (HUDI-9672) Fix data loss for spark incremental query with skip clustering enabled

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Description: Considering the following ingestion case for spark: * MOR table + upsert/insert 1st insert

[jira] [Updated] (HUDI-9672) Fix data loss for spark incremental query with skip clustering enabled

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Description: Considering the following ingestion case for spark: * MOR table + upsert/insert 1st insert

[jira] [Updated] (HUDI-9672) Fix data loss for spark incremental query with skip clustering enabled

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Description: Considering the following ingestion case for spark: * MOR table + upsert/insert 1st insert

[jira] [Updated] (HUDI-9672) Fix data loss for spark incremental query with skip clustering enabled

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Description: Considering the following ingestion case for spark: * MOR table + upsert/insert 1st insert

[jira] [Updated] (HUDI-9672) Fix data loss for spark incremental query with skip clustering enabled

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Description: Considering the following ingestion case for spark: * MOR table + upsert/insert 1st insert

[jira] [Updated] (HUDI-9672) Fix data loss for spark incremental query with skip clustering enabled

[ https://issues.apache.org/jira/browse/HUDI-9672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shuo Cheng updated HUDI-9672: - Description: Considering the following ingestion case for spark: MOR table + upsert/insert 1st insert

[jira] [Closed] (HUDI-9673) Remove the eventime metadata function from DefaultHoodieRecordPayload

[ https://issues.apache.org/jira/browse/HUDI-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9673. Resolution: Fixed Fixed via master branch: 2869cb70dfb8beadef77ad923407bca56d3b8728 > Remove the event

[jira] [Updated] (HUDI-9677) 'hoodie.datasource.read.incr.filters' is not used in the filegroup reader path

[ https://issues.apache.org/jira/browse/HUDI-9677?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-9677: -- Description: It is also not used in any tests so not sure if anyone is actually using this

[jira] [Created] (HUDI-9677) 'hoodie.datasource.read.incr.filters' is not used in the filegroup reader path

Jonathan Vexler created HUDI-9677: - Summary: 'hoodie.datasource.read.incr.filters' is not used in the filegroup reader path Key: HUDI-9677 URL: https://issues.apache.org/jira/browse/HUDI-9677

[jira] [Updated] (HUDI-8385) Apply clean commits to col stats partition on restore in data table

[ https://issues.apache.org/jira/browse/HUDI-8385?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-8385: - Labels: pull-request-available (was: ) > Apply clean commits to col stats partition on rest

[jira] [Updated] (HUDI-4449) Spark: Support DataSourceV2 Read

[ https://issues.apache.org/jira/browse/HUDI-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-4449: -- Fix Version/s: 1.2.0 (was: 1.1.0) > Spark: Support DataSourceV2 R

[jira] [Updated] (HUDI-4449) Spark: Support DataSourceV2 Read

[ https://issues.apache.org/jira/browse/HUDI-4449?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Y Ethan Guo updated HUDI-4449: -- Fix Version/s: 1.1.0 > Spark: Support DataSourceV2 R

[jira] [Closed] (HUDI-9615) Unify Schema On Read in the filegroup reader

[ https://issues.apache.org/jira/browse/HUDI-9615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-9615. - Resolution: Won't Fix > Unify Schema On Read in the filegrou

[jira] [Updated] (HUDI-9668) Fix float to double conversion for nested + arrays + maps

[ https://issues.apache.org/jira/browse/HUDI-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-9668: -- Status: Patch Available (was: In Progress) > Fix float to double conversion for nes

[jira] [Closed] (HUDI-9565) Unify Schema Evolution in the FilegroupReader

[ https://issues.apache.org/jira/browse/HUDI-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-9565. - Resolution: Won't Fix > Unify Schema Evolution in the Filegro

[jira] [Closed] (HUDI-9609) Add support for V1 incremental queries in spark using fg reader

[ https://issues.apache.org/jira/browse/HUDI-9609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-9609. - Resolution: Fixed > Add support for V1 incremental queries in spark using fg rea

[jira] [Closed] (HUDI-9576) Add Filegroup Reader Testing for Schema Evolution

[ https://issues.apache.org/jira/browse/HUDI-9576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-9576. - Resolution: Fixed > Add Filegroup Reader Testing for Schema Evolut

[jira] [Updated] (HUDI-9668) Fix float to double conversion for nested + arrays + maps

[ https://issues.apache.org/jira/browse/HUDI-9668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-9668: -- Status: In Progress (was: Open) > Fix float to double conversion for nested + arrays + m

[jira] [Closed] (HUDI-9645) Master broken July 25, 2025

[ https://issues.apache.org/jira/browse/HUDI-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-9645. - Resolution: Fixed > Master broken July 25, 2

[jira] [Updated] (HUDI-9673) Remove the eventime metadata function from DefaultHoodieRecordPayload

[ https://issues.apache.org/jira/browse/HUDI-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-9673: -- Status: Patch Available (was: In Progress) > Remove the eventime metadata function f

[jira] [Updated] (HUDI-9673) Remove the eventime metadata function from DefaultHoodieRecordPayload

[ https://issues.apache.org/jira/browse/HUDI-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Liu updated HUDI-9673: -- Status: In Progress (was: Open) > Remove the eventime metadata function from DefaultHoodieRecordPayl

[jira] [Updated] (HUDI-9676) Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic with renamed columns is wrong

[ https://issues.apache.org/jira/browse/HUDI-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-9676: -- Status: Patch Available (was: In Progress) > Avro HoodieAvroUtils.rewriteRecordWithNewSch

[jira] [Updated] (HUDI-9676) Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic with renamed columns is wrong

[ https://issues.apache.org/jira/browse/HUDI-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-9676: -- Status: In Progress (was: Open) > Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic w

[jira] [Updated] (HUDI-9676) Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic with renamed columns is wrong

[ https://issues.apache.org/jira/browse/HUDI-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9676: - Labels: pull-request-available (was: ) > Avro HoodieAvroUtils.rewriteRecordWithNewSchema lo

[jira] [Assigned] (HUDI-9676) Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic with renamed columns is wrong

[ https://issues.apache.org/jira/browse/HUDI-9676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-9676: - Assignee: Jonathan Vexler > Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic w

[jira] [Created] (HUDI-9676) Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic with renamed columns is wrong

Jonathan Vexler created HUDI-9676: - Summary: Avro HoodieAvroUtils.rewriteRecordWithNewSchema logic with renamed columns is wrong Key: HUDI-9676 URL: https://issues.apache.org/jira/browse/HUDI-9676

[jira] [Updated] (HUDI-9673) Remove the eventime metadata function from DefaultHoodieRecordPayload

[ https://issues.apache.org/jira/browse/HUDI-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9673: - Labels: pull-request-available (was: ) > Remove the eventime metadata function f

[jira] [Updated] (HUDI-9667) Incorporate completion time into restore workflow

[ https://issues.apache.org/jira/browse/HUDI-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown updated HUDI-9667: Status: In Progress (was: Open) > Incorporate completion time into restore workf

[jira] [Updated] (HUDI-9667) Incorporate completion time into restore workflow

[ https://issues.apache.org/jira/browse/HUDI-9667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown updated HUDI-9667: Status: Patch Available (was: In Progress) > Incorporate completion time into restore workf

[jira] [Closed] (HUDI-9630) Support non-globally unique record keys in the record index

[ https://issues.apache.org/jira/browse/HUDI-9630?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen closed HUDI-9630. Reviewers: Danny Chen Resolution: Fixed Fixed via master branch

[jira] [Updated] (HUDI-9675) Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS

[ https://issues.apache.org/jira/browse/HUDI-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HUDI-9675: - Labels: pull-request-available (was: ) > Savepoint safety checks are missing for cleaner pol

[jira] [Assigned] (HUDI-9675) Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS

[ https://issues.apache.org/jira/browse/HUDI-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown reassigned HUDI-9675: --- Assignee: Timothy Brown > Savepoint safety checks are missing for cleaner pol

[jira] [Updated] (HUDI-9675) Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS

[ https://issues.apache.org/jira/browse/HUDI-9675?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Timothy Brown updated HUDI-9675: Description: You can currently savepoint to an invalid commit when the {{KEEP_LATEST_FILE_VERSIONS

[jira] [Created] (HUDI-9675) Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS

Timothy Brown created HUDI-9675: --- Summary: Savepoint safety checks are missing for cleaner policy KEEP_LATEST_FILE_VERSIONS Key: HUDI-9675 URL: https://issues.apache.org/jira/browse/HUDI-9675 Project

[jira] [Created] (HUDI-9674) Audit performance of Spark Reads in Hudi 1.X

Timothy Brown created HUDI-9674: --- Summary: Audit performance of Spark Reads in Hudi 1.X Key: HUDI-9674 URL: https://issues.apache.org/jira/browse/HUDI-9674 Project: Apache Hudi Issue Type

[jira] [Assigned] (HUDI-9673) Remove the eventime metadata function from DefaultHoodieRecordPayload

[ https://issues.apache.org/jira/browse/HUDI-9673?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Danny Chen reassigned HUDI-9673: Assignee: Lin Liu > Remove the eventime metadata function from DefaultHoodieRecordPayl

[jira] [Created] (HUDI-9673) Remove the eventime metadata function from DefaultHoodieRecordPayload

Danny Chen created HUDI-9673: Summary: Remove the eventime metadata function from DefaultHoodieRecordPayload Key: HUDI-9673 URL: https://issues.apache.org/jira/browse/HUDI-9673 Project: Apache Hudi

  1   2   3   4   5   6   7   8   9   10   >