[jira] [Assigned] (HUDI-9682) Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration

2025-08-01 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9682: - Assignee: sivabalan narayanan > Add support to FileGroupRecordBuffer to assist w/

[jira] [Updated] (HUDI-9682) Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration

2025-08-01 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9682?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9682: -- Fix Version/s: 1.1.0 > Add support to FileGroupRecordBuffer to assist w/ cow merge handl

[jira] [Created] (HUDI-9682) Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration

2025-08-01 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9682: - Summary: Add support to FileGroupRecordBuffer to assist w/ cow merge handle migration Key: HUDI-9682 URL: https://issues.apache.org/jira/browse/HUDI-9682 Pr

[jira] [Updated] (HUDI-9655) Migrating from 0.13.x to 1.x has issues in polling archived timeline

2025-07-28 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9655: -- Fix Version/s: 1.1.0 > Migrating from 0.13.x to 1.x has issues in polling archived timel

[jira] [Created] (HUDI-9655) Migrating from 0.13.x to 1.x has issues in polling archived timeline

2025-07-28 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9655: - Summary: Migrating from 0.13.x to 1.x has issues in polling archived timeline Key: HUDI-9655 URL: https://issues.apache.org/jira/browse/HUDI-9655 Project: A

[jira] [Assigned] (HUDI-9655) Migrating from 0.13.x to 1.x has issues in polling archived timeline

2025-07-28 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9655: - Assignee: Danny Chen (was: sivabalan narayanan) > Migrating from 0.13.x to 1.x h

[jira] [Assigned] (HUDI-9655) Migrating from 0.13.x to 1.x has issues in polling archived timeline

2025-07-28 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9655: - Assignee: sivabalan narayanan > Migrating from 0.13.x to 1.x has issues in pollin

[jira] [Updated] (HUDI-9655) Migrating from 0.13.x to 1.x has issues in polling archived timeline

2025-07-28 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9655?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9655: -- Priority: Blocker (was: Major) > Migrating from 0.13.x to 1.x has issues in polling arc

[jira] [Closed] (HUDI-9637) Address comments to an existing PR

2025-07-27 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9637. - Resolution: Fixed https://github.com/apache/hudi/commit/3f37e656e8115e8821fdbc61d344a7fb91

[jira] [Closed] (HUDI-9572) Fix minor performance improvements

2025-07-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9572. - Resolution: Fixed https://github.com/apache/hudi/commit/346e5b5690d8e9d75a072f4ff9ee9a318d

[jira] [Updated] (HUDI-9572) Fix minor performance improvements

2025-07-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9572?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9572: -- Fix Version/s: 1.1.0 > Fix minor performance improvements >

[jira] [Closed] (HUDI-9640) Replace MERGE_PROPERTIES with multiple configs with prefix

2025-07-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9640?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9640. - Resolution: Fixed https://github.com/apache/hudi/commit/8a18ee62243dfde75aab0c1d27d3a58933

[jira] [Created] (HUDI-9651) Revisit deleting metadata table when lagging during 7 -> 8 upgrade

2025-07-26 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9651: - Summary: Revisit deleting metadata table when lagging during 7 -> 8 upgrade Key: HUDI-9651 URL: https://issues.apache.org/jira/browse/HUDI-9651 Project: Apa

[jira] [Closed] (HUDI-9633) Add ability to remove custom configs from being passed to kafka consumer

2025-07-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9633. - Fix Version/s: 1.1.0 Resolution: Fixed https://github.com/apache/hudi/commit/49ac54

[jira] [Assigned] (HUDI-9645) Master broken July 25, 2025

2025-07-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9645: - Assignee: Rahil Chertara > Master broken July 25, 2025 >

[jira] [Updated] (HUDI-9645) Master broken July 25, 2025

2025-07-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9645: -- Fix Version/s: 1.1.0 > Master broken July 25, 2025 > --- > >

[jira] [Updated] (HUDI-9645) Master broken July 25, 2025

2025-07-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9645: -- Description: Master broken July 25, 2025  [https://dev.azure.com/apachehudi/hudi-oss-ci

[jira] [Updated] (HUDI-9645) Master broken July 25, 2025

2025-07-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9645: -- Attachment: image-2025-07-25-08-31-00-094.png > Master broken July 25, 2025 > --

[jira] [Updated] (HUDI-9645) Master broken July 25, 2025

2025-07-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9645?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9645: -- Attachment: image-2025-07-25-08-31-22-065.png > Master broken July 25, 2025 > --

[jira] [Created] (HUDI-9645) Master broken July 25, 2025

2025-07-25 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9645: - Summary: Master broken July 25, 2025 Key: HUDI-9645 URL: https://issues.apache.org/jira/browse/HUDI-9645 Project: Apache Hudi Issue Type: Bug

[jira] [Created] (HUDI-9644) Revisit PartialUpdateMode to account for Partial update encoding from Merge Into

2025-07-25 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9644: - Summary: Revisit PartialUpdateMode to account for Partial update encoding from Merge Into Key: HUDI-9644 URL: https://issues.apache.org/jira/browse/HUDI-9644

[jira] [Updated] (HUDI-9638) Fix table creation logic for payload deprecation

2025-07-25 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9638: -- Description: When a user creates a new table in v9 w/ payload configs, we should do the

[jira] [Updated] (HUDI-9642) Local maven build fails July 24, 2025

2025-07-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9642: -- Fix Version/s: 1.1.0 > Local maven build fails July 24, 2025 > -

[jira] [Created] (HUDI-9642) Local maven build fails July 24, 2025

2025-07-24 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9642: - Summary: Local maven build fails July 24, 2025 Key: HUDI-9642 URL: https://issues.apache.org/jira/browse/HUDI-9642 Project: Apache Hudi Issue Type:

[jira] [Assigned] (HUDI-9642) Local maven build fails July 24, 2025

2025-07-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9642: - Assignee: Shuo Cheng > Local maven build fails July 24, 2025 > --

[jira] [Closed] (HUDI-9543) Secondary index readers and writers do not handle null char properly

2025-07-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9543. - Resolution: Fixed https://github.com/apache/hudi/commit/43c521310733eb7f332b86e201bfb1961a

[jira] [Updated] (HUDI-9543) Secondary index readers and writers do not handle null char properly

2025-07-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9543: -- Fix Version/s: 1.1.0 > Secondary index readers and writers do not handle null char prope

[jira] [Assigned] (HUDI-9579) only allow SI creation for certain column types

2025-07-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9579: - Assignee: Davis Zhang > only allow SI creation for certain column types > ---

[jira] [Closed] (HUDI-9579) only allow SI creation for certain column types

2025-07-24 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9579?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9579. - Resolution: Fixed https://github.com/apache/hudi/commit/804328f5f2972e9eaf45ecb0f713d4a1c9

[jira] [Closed] (HUDI-9584) Validate index lookup set type compatibility at runtime [non spark engine]

2025-07-23 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9584. - Resolution: Fixed > Validate index lookup set type compatibility at runtime [non spark eng

[jira] [Assigned] (HUDI-9584) Validate index lookup set type compatibility at runtime [non spark engine]

2025-07-23 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9584: - Assignee: Davis Zhang > Validate index lookup set type compatibility at runtime [

[jira] [Updated] (HUDI-9584) Validate index lookup set type compatibility at runtime [non spark engine]

2025-07-23 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9584: -- Fix Version/s: 1.1.0 (was: 1.2.0) > Validate index lookup set typ

[jira] [Commented] (HUDI-9584) Validate index lookup set type compatibility at runtime [non spark engine]

2025-07-23 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18009421#comment-18009421 ] sivabalan narayanan commented on HUDI-9584: --- [https://github.com/apache/hudi/com

[jira] [Assigned] (HUDI-9591) FG reader supports an iterator as log records

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9591: - Assignee: Lokesh Jain > FG reader supports an iterator as log records > -

[jira] [Assigned] (HUDI-9602) Fix or migrate all writers to use mode mode + mergers

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9602: - Assignee: Lokesh Jain (was: Lin Liu) > Fix or migrate all writers to use mode mo

[jira] [Assigned] (HUDI-9591) FG reader supports an iterator as log records

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9591?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9591: - Assignee: Lin Liu (was: Lokesh Jain) > FG reader supports an iterator as log rec

[jira] [Commented] (HUDI-9281) DT MDT DAG rewrite for efficient streaming writes: Impl

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008816#comment-18008816 ] sivabalan narayanan commented on HUDI-9281: --- Phase 2 ticket:  https://issues.ap

[jira] [Closed] (HUDI-9281) DT MDT DAG rewrite for efficient streaming writes: Impl

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9281. - Resolution: Fixed > DT MDT DAG rewrite for efficient streaming writes: Impl > ---

[jira] [Assigned] (HUDI-9546) Performance improvements for streaming DAG write with secondary index

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9546: - Assignee: Lokesh Jain > Performance improvements for streaming DAG write with sec

[jira] [Closed] (HUDI-9340) Add SI support w/ new dag

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9340. - Resolution: Fixed > Add SI support w/ new dag > - > >

[jira] [Updated] (HUDI-8471) Unify row writer and non-row writer code paths

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8471: -- Status: Open (was: In Progress) > Unify row writer and non-row writer code paths >

[jira] [Closed] (HUDI-9406) Add write config to guard the streaming writes to mdt

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9406. - Resolution: Fixed > Add write config to guard the streaming writes to mdt > --

[jira] [Closed] (HUDI-8479) Fix table services in MDT

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-8479. - Resolution: Fixed > Fix table services in MDT > - > >

[jira] [Closed] (HUDI-8471) Unify row writer and non-row writer code paths

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-8471. - Resolution: Fixed > Unify row writer and non-row writer code paths > -

[jira] [Closed] (HUDI-9405) Support streaming writes with MDT metadata writer

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9405?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9405. - Resolution: Fixed > Support streaming writes with MDT metadata writer > --

[jira] [Closed] (HUDI-8474) Design and Impl MDT repartitioner to assist with writing to MDT

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8474?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-8474. - Resolution: Fixed > Design and Impl MDT repartitioner to assist with writing to MDT >

[jira] [Closed] (HUDI-9417) Add callback for handling write stats during commit

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9417. - Fix Version/s: 1.1.0 Resolution: Fixed > Add callback for handling write stats duri

[jira] [Closed] (HUDI-8472) Start commits in both DT and MDT within Lock

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-8472. - Resolution: Fixed > Start commits in both DT and MDT within Lock > ---

[jira] [Closed] (HUDI-8469) Re-design DAG to write to DT and MDT

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-8469. - Resolution: Fixed > Re-design DAG to write to DT and MDT > ---

[jira] [Updated] (HUDI-8469) Re-design DAG to write to DT and MDT

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-8469: -- Status: Open (was: In Progress) > Re-design DAG to write to DT and MDT > --

[jira] [Closed] (HUDI-8477) Fix marker reconciliation based on revamped dag

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8477?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-8477. - Resolution: Fixed > Fix marker reconciliation based on revamped dag >

[jira] [Closed] (HUDI-8475) Generate all required stats required for MDT within DT write handles

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-8475. - Resolution: Fixed > Generate all required stats required for MDT within DT write handles >

[jira] [Created] (HUDI-9616) DT MDT DAG rewrite for efficient streaming writes Phase 2

2025-07-21 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9616: - Summary: DT MDT DAG rewrite for efficient streaming writes Phase 2 Key: HUDI-9616 URL: https://issues.apache.org/jira/browse/HUDI-9616 Project: Apache Hudi

[jira] [Assigned] (HUDI-9616) DT MDT DAG rewrite for efficient streaming writes Phase 2

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9616: - Assignee: sivabalan narayanan > DT MDT DAG rewrite for efficient streaming writes

[jira] [Updated] (HUDI-9616) DT MDT DAG rewrite for efficient streaming writes Phase 2

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9616?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9616: -- Fix Version/s: 1.2.0 > DT MDT DAG rewrite for efficient streaming writes Phase 2 > -

[jira] [Commented] (HUDI-9282) DT MDT Dag Rewrite Testing

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18008807#comment-18008807 ] sivabalan narayanan commented on HUDI-9282: --- We tested streaming writes w/ spark

[jira] [Closed] (HUDI-9282) DT MDT Dag Rewrite Testing

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9282. - Assignee: sivabalan narayanan (was: Kate Huber) Resolution: Fixed > DT MDT Dag Rewr

[jira] [Reopened] (HUDI-9282) DT MDT Dag Rewrite Testing

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reopened HUDI-9282: --- > DT MDT Dag Rewrite Testing > -- > > Key: HUDI-92

[jira] [Closed] (HUDI-9282) DT MDT Dag Rewrite Testing

2025-07-21 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan closed HUDI-9282. - Resolution: Fixed > DT MDT Dag Rewrite Testing > -- > >

[jira] [Assigned] (HUDI-9578) Support reader caching inside FG reader

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9578: - Assignee: Lin Liu > Support reader caching inside FG reader > ---

[jira] [Updated] (HUDI-9602) Fix or migrate all writers to use mode mode + mergers

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9602: -- Description: Instead of using mergers directly, we need to use the merge mode and then

[jira] [Updated] (HUDI-9602) Fix or migrate all writers to use mode mode + mergers

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9602: -- Parent: HUDI-9560 Issue Type: Sub-task (was: Improvement) > Fix or migrate all

[jira] [Updated] (HUDI-9602) Fix or migrate all writers to use mode mode + mergers

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9602: -- Fix Version/s: 1.1.0 > Fix or migrate all writers to use mode mode + mergers > -

[jira] [Assigned] (HUDI-9602) Fix or migrate all writers to use mode mode + mergers

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9602: - Assignee: Lin Liu > Fix or migrate all writers to use mode mode + mergers > -

[jira] [Created] (HUDI-9602) Fix or migrate all writers to use mode mode + mergers

2025-07-16 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9602: - Summary: Fix or migrate all writers to use mode mode + mergers Key: HUDI-9602 URL: https://issues.apache.org/jira/browse/HUDI-9602 Project: Apache Hudi

[jira] [Assigned] (HUDI-9601) Leverage new partial update mode for MIT writes

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9601: - Assignee: Lin Liu > Leverage new partial update mode for MIT writes > ---

[jira] [Updated] (HUDI-9601) Leverage new partial update mode for MIT writes

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9601: -- Parent: HUDI-9560 Issue Type: Sub-task (was: Improvement) > Leverage new partia

[jira] [Created] (HUDI-9601) Leverage new partial update mode for MIT writes

2025-07-16 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9601: - Summary: Leverage new partial update mode for MIT writes Key: HUDI-9601 URL: https://issues.apache.org/jira/browse/HUDI-9601 Project: Apache Hudi I

[jira] [Updated] (HUDI-9601) Leverage new partial update mode for MIT writes

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9601: -- Fix Version/s: 1.1.0 > Leverage new partial update mode for MIT writes > ---

[jira] [Updated] (HUDI-9600) Fix downgrade handler from 9 to 8

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9600: -- Parent: HUDI-9560 Issue Type: Sub-task (was: Improvement) > Fix downgrade handl

[jira] [Assigned] (HUDI-9600) Fix downgrade handler from 9 to 8

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9600: - Assignee: Lin Liu > Fix downgrade handler from 9 to 8 > -

[jira] [Updated] (HUDI-9600) Fix downgrade handler from 9 to 8

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9600?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9600: -- Fix Version/s: 1.1.0 > Fix downgrade handler from 9 to 8 > -

[jira] [Created] (HUDI-9600) Fix downgrade handler from 9 to 8

2025-07-16 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9600: - Summary: Fix downgrade handler from 9 to 8 Key: HUDI-9600 URL: https://issues.apache.org/jira/browse/HUDI-9600 Project: Apache Hudi Issue Type: Imp

[jira] [Created] (HUDI-9599) Fix upgrade handler from 8 to 9

2025-07-16 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9599: - Summary: Fix upgrade handler from 8 to 9 Key: HUDI-9599 URL: https://issues.apache.org/jira/browse/HUDI-9599 Project: Apache Hudi Issue Type: Impro

[jira] [Assigned] (HUDI-9599) Fix upgrade handler from 8 to 9

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9599: - Assignee: Lin Liu > Fix upgrade handler from 8 to 9 > ---

[jira] [Updated] (HUDI-9599) Fix upgrade handler from 8 to 9

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9599: -- Fix Version/s: 1.1.0 > Fix upgrade handler from 8 to 9 > ---

[jira] [Updated] (HUDI-9599) Fix upgrade handler from 8 to 9

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9599?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9599: -- Parent: HUDI-9560 Issue Type: Sub-task (was: Improvement) > Fix upgrade handler

[jira] [Updated] (HUDI-9598) Add support for event time watermark to migrate DefaultHoodieRecordPayload

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9598: -- Parent: HUDI-9560 Issue Type: Sub-task (was: Improvement) > Add support for eve

[jira] [Created] (HUDI-9598) Add support for event time watermark to migrate DefaultHoodieRecordPayload

2025-07-16 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9598: - Summary: Add support for event time watermark to migrate DefaultHoodieRecordPayload Key: HUDI-9598 URL: https://issues.apache.org/jira/browse/HUDI-9598 Proj

[jira] [Assigned] (HUDI-9598) Add support for event time watermark to migrate DefaultHoodieRecordPayload

2025-07-16 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9598?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9598: - Assignee: Lin Liu > Add support for event time watermark to migrate DefaultHoodie

[jira] [Comment Edited] (HUDI-9590) OptimizedLogBlockScan support w/ FG reader

2025-07-14 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18005225#comment-18005225 ] sivabalan narayanan edited comment on HUDI-9590 at 7/14/25 7:09 PM:

[jira] [Commented] (HUDI-9590) OptimizedLogBlockScan support w/ FG reader

2025-07-14 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18005225#comment-18005225 ] sivabalan narayanan commented on HUDI-9590: --- So, the core is intact. We just nee

[jira] [Commented] (HUDI-9590) OptimizedLogBlockScan support w/ FG reader

2025-07-14 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18005221#comment-18005221 ] sivabalan narayanan commented on HUDI-9590: --- Purpose:  Optimized Log block scan

[jira] [Assigned] (HUDI-9590) OptimizedLogBlockScan support w/ FG reader

2025-07-14 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9590: - Assignee: sivabalan narayanan > OptimizedLogBlockScan support w/ FG reader >

[jira] [Created] (HUDI-9590) OptimizedLogBlockScan support w/ FG reader

2025-07-14 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9590: - Summary: OptimizedLogBlockScan support w/ FG reader Key: HUDI-9590 URL: https://issues.apache.org/jira/browse/HUDI-9590 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-9565) Proposal: Unify Schema Evolution in the Reader

2025-07-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9565: -- Description: There are 2 types of schema evolution that we have:  schema.on.write schema

[jira] [Assigned] (HUDI-9565) Proposal: Unify Schema Evolution in the Reader

2025-07-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9565: - Assignee: Jonathan Vexler > Proposal: Unify Schema Evolution in the Reader >

[jira] [Updated] (HUDI-9565) Proposal: Unify Schema Evolution in the Reader

2025-07-02 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9565: -- Fix Version/s: 1.1.0 > Proposal: Unify Schema Evolution in the Reader >

[jira] [Assigned] (HUDI-9526) Use FileGroupReader for CDC Flows

2025-07-01 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9526: - Assignee: Timothy Brown > Use FileGroupReader for CDC Flows > ---

[jira] [Updated] (HUDI-9526) Use FileGroupReader for CDC Flows

2025-07-01 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9526: -- Fix Version/s: 1.1.0 > Use FileGroupReader for CDC Flows > -

[jira] [Updated] (HUDI-9526) Use FileGroupReader for CDC Flows

2025-07-01 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9526: -- Status: In Progress (was: Open) > Use FileGroupReader for CDC Flows > -

[jira] [Assigned] (HUDI-8283) Use filegroup reader for all internal reading that requires merging

2025-07-01 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-8283: - Assignee: Jonathan Vexler > Use filegroup reader for all internal reading that re

[jira] [Assigned] (HUDI-8635) Revisit stats generated in HoodieSparkFileGroupReaderBasedMergeHandle

2025-06-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-8635: - Assignee: Timothy Brown (was: Y Ethan Guo) > Revisit stats generated in HoodieSp

[jira] [Assigned] (HUDI-8409) Ensure that upgrade and downgrade work with merging configs

2025-06-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-8409: - Assignee: Jonathan Vexler (was: Y Ethan Guo) > Ensure that upgrade and downgrade

[jira] [Assigned] (HUDI-9395) Code deprecation given FG reader adoption

2025-06-30 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9395: - Assignee: Jonathan Vexler (was: Lin Liu) > Code deprecation given FG reader adop

[jira] [Assigned] (HUDI-9559) Fail rollback execution if deletion of files fails

2025-06-28 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan reassigned HUDI-9559: - Assignee: sivabalan narayanan > Fail rollback execution if deletion of files fail

[jira] [Updated] (HUDI-9559) Fail rollback execution if deletion of files fails

2025-06-28 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9559: -- Fix Version/s: 1.1.0 > Fail rollback execution if deletion of files fails >

[jira] [Updated] (HUDI-9559) Fail rollback execution if deletion of files fails

2025-06-28 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9559: -- Priority: Critical (was: Major) > Fail rollback execution if deletion of files fails >

[jira] [Created] (HUDI-9559) Fail rollback execution if deletion of files fails

2025-06-28 Thread sivabalan narayanan (Jira)
sivabalan narayanan created HUDI-9559: - Summary: Fail rollback execution if deletion of files fails Key: HUDI-9559 URL: https://issues.apache.org/jira/browse/HUDI-9559 Project: Apache Hudi

[jira] [Updated] (HUDI-9555) Fix secondary write to metadata table when streaming writes to metadata table is enabled

2025-06-26 Thread sivabalan narayanan (Jira)
[ https://issues.apache.org/jira/browse/HUDI-9555?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] sivabalan narayanan updated HUDI-9555: -- Fix Version/s: 1.1.0 > Fix secondary write to metadata table when streaming writes to me

  1   2   3   4   5   6   7   8   9   10   >