[jira] [Created] (HUDI-8180) Fix the CI by deleting gh actions cache with workflow

2024-09-06 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-8180: - Summary: Fix the CI by deleting gh actions cache with workflow Key: HUDI-8180 URL: https://issues.apache.org/jira/browse/HUDI-8180 Project: Apache Hudi Iss

[jira] [Reopened] (HUDI-1441) HoodieAvroUtils - rewrite() is not handling evolution of a nested record field.

2024-09-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reopened HUDI-1441: --- Assignee: Jonathan Vexler (was: Vinoth Chandar) > HoodieAvroUtils - rewrite() is not handli

[jira] [Closed] (HUDI-7918) Remove support of Spark 2, 3.0, 3.1, and 3.2

2024-09-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7918. - Resolution: Fixed > Remove support of Spark 2, 3.0, 3.1, and 3.2 > ---

[jira] [Closed] (HUDI-8137) Fix Time travel query for spark datasource read of MDT

2024-09-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-8137. - Resolution: Fixed > Fix Time travel query for spark datasource read of MDT > -

[jira] [Closed] (HUDI-8134) build is broken if no spark profile provided on m1 mac

2024-09-09 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8134?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-8134. - Resolution: Fixed > build is broken if no spark profile provided on m1 mac > -

[jira] [Updated] (HUDI-1441) HoodieAvroUtils - rewrite() is not handling evolution of a nested record field.

2024-09-09 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-1441: -- Status: Patch Available (was: In Progress) > HoodieAvroUtils - rewrite() is not handling evolut

[jira] [Closed] (HUDI-7925) Implement logic for `shouldExtractPartitionValuesFromPartitionPath` in `HoodieHadoopFsRelationFactory`

2024-09-09 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7925. - Resolution: Fixed > Implement logic for `shouldExtractPartitionValuesFromPartitionPath` in > `Hoo

[jira] [Closed] (HUDI-8031) Allow read partition path field directly from file in new filegroup reader

2024-09-09 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8031?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-8031. - Resolution: Duplicate > Allow read partition path field directly from file in new filegroup reader

[jira] [Closed] (HUDI-7876) Use TypedProperties to store the spillable map configs for the FG reader

2024-09-09 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7876. - Resolution: Fixed > Use TypedProperties to store the spillable map configs for the FG reader > ---

[jira] [Closed] (HUDI-7871) Remove tableconfig from HoodieFilegroupReader params

2024-09-09 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7871. - Resolution: Fixed > Remove tableconfig from HoodieFilegroupReader params > ---

[jira] [Closed] (HUDI-1441) HoodieAvroUtils - rewrite() is not handling evolution of a nested record field.

2024-09-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-1441?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-1441. - Resolution: Fixed > HoodieAvroUtils - rewrite() is not handling evolution of a nested record > fi

[jira] [Created] (HUDI-8197) Get rid of disable vectorized reader in sql config in spark fg reader implementation

2024-09-11 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-8197: - Summary: Get rid of disable vectorized reader in sql config in spark fg reader implementation Key: HUDI-8197 URL: https://issues.apache.org/jira/browse/HUDI-8197 Pr

[jira] [Updated] (HUDI-8197) Get rid of disable vectorized reader in sql config in spark fg reader implementation

2024-09-11 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-8197: -- Description: Modifying the sql conf side effects and is not necessary (was: Modifying the sql c

[jira] [Updated] (HUDI-8197) Get rid of disable vectorized reader in sql config in spark fg reader implementation

2024-09-11 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-8197: -- Fix Version/s: 1.0.0 Priority: Blocker (was: Major) > Get rid of disable vectorized re

[jira] [Updated] (HUDI-8197) Get rid of disable vectorized reader in sql config in spark fg reader implementation

2024-09-12 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-8197: -- Status: In Progress (was: Open) > Get rid of disable vectorized reader in sql config in spark f

[jira] [Updated] (HUDI-8197) Get rid of disable vectorized reader in sql config in spark fg reader implementation

2024-09-12 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-8197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-8197: -- Status: Patch Available (was: In Progress) > Get rid of disable vectorized reader in sql config

[jira] [Closed] (HUDI-6544) HoodieMergeHelper merges bootstrap files twice

2024-09-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-6544. - Resolution: Fixed > HoodieMergeHelper merges bootstrap files twice > -

[jira] [Created] (HUDI-8202) Remove event time (default) and overwrite with latest record mergers

2024-09-16 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-8202: - Summary: Remove event time (default) and overwrite with latest record mergers Key: HUDI-8202 URL: https://issues.apache.org/jira/browse/HUDI-8202 Project: Apache Hu

[jira] [Created] (HUDI-8203) Make record merge mode the primary merging config

2024-09-16 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-8203: - Summary: Make record merge mode the primary merging config Key: HUDI-8203 URL: https://issues.apache.org/jira/browse/HUDI-8203 Project: Apache Hudi Issue T

[jira] [Closed] (HUDI-7566) Break-up schema evolution: add schema evolution changes to ported spark

2024-04-16 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7566?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7566. - Resolution: Fixed > Break-up schema evolution: add schema evolution changes to ported spark >

[jira] [Commented] (HUDI-7610) Delete records are inconsistent depending on MOR/COW, Avro/Spark record merger, new filegroup reader enabled/disabled

2024-04-16 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837759#comment-17837759 ] Jonathan Vexler commented on HUDI-7610: --- Tested with compaction and that isn't even

[jira] [Commented] (HUDI-7610) Delete records are inconsistent depending on MOR/COW, Avro/Spark record merger, new filegroup reader enabled/disabled

2024-04-16 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7610?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17837761#comment-17837761 ] Jonathan Vexler commented on HUDI-7610: --- delete precombine less than insert is consi

[jira] [Updated] (HUDI-7269) Fallback to key-based merging if there is no positions in log header

2024-04-17 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7269?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7269: -- Status: Patch Available (was: In Progress) > Fallback to key-based merging if there is no posit

[jira] [Created] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7658: - Summary: Log time taken when meta sync fails in stream sync Key: HUDI-7658 URL: https://issues.apache.org/jira/browse/HUDI-7658 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7658: -- Status: In Progress (was: Open) > Log time taken when meta sync fails in stream sync >

[jira] [Assigned] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-7658: - Assignee: Jonathan Vexler > Log time taken when meta sync fails in stream sync >

[jira] [Updated] (HUDI-7658) Log time taken when meta sync fails in stream sync

2024-04-23 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7658?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7658: -- Status: Patch Available (was: In Progress) > Log time taken when meta sync fails in stream sync

[jira] [Created] (HUDI-7693) Allow Vectorized Reading for bootstrap in the new fg reader under some conditions

2024-04-30 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7693: - Summary: Allow Vectorized Reading for bootstrap in the new fg reader under some conditions Key: HUDI-7693 URL: https://issues.apache.org/jira/browse/HUDI-7693 Proje

[jira] [Created] (HUDI-7704) Unify test client storage classes with duplicate code

2024-05-02 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7704: - Summary: Unify test client storage classes with duplicate code Key: HUDI-7704 URL: https://issues.apache.org/jira/browse/HUDI-7704 Project: Apache Hudi Is

[jira] [Updated] (HUDI-7587) Move hadoop-dependent reader and writer implementation to hudi-hadoop-common module

2024-05-02 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7587: -- Status: Patch Available (was: In Progress) > Move hadoop-dependent reader and writer implementa

[jira] [Updated] (HUDI-7350) Introduce HoodieIOFactory to abstract the reader and writer implementation

2024-05-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7350: -- Status: In Progress (was: Open) > Introduce HoodieIOFactory to abstract the reader and writer i

[jira] [Updated] (HUDI-7350) Introduce HoodieIOFactory to abstract the reader and writer implementation

2024-05-06 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7350: -- Status: Patch Available (was: In Progress) > Introduce HoodieIOFactory to abstract the reader a

[jira] [Created] (HUDI-7721) Fix broken build on master

2024-05-06 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7721: - Summary: Fix broken build on master Key: HUDI-7721 URL: https://issues.apache.org/jira/browse/HUDI-7721 Project: Apache Hudi Issue Type: Bug Re

[jira] [Updated] (HUDI-7725) Restructure HFileBootstrapIndex to separate Hadoop-dependent logic

2024-05-07 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7725: -- Status: In Progress (was: Open) > Restructure HFileBootstrapIndex to separate Hadoop-dependent

[jira] [Updated] (HUDI-7726) Restructure TableSchemaResolver to separate Hadoop logic and use BaseFileUtils

2024-05-07 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7726?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7726: -- Status: In Progress (was: Open) > Restructure TableSchemaResolver to separate Hadoop logic and

[jira] [Updated] (HUDI-7725) Restructure HFileBootstrapIndex to separate Hadoop-dependent logic

2024-05-07 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7725?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7725: -- Status: Patch Available (was: In Progress) > Restructure HFileBootstrapIndex to separate Hadoop

[jira] [Created] (HUDI-7729) Move ParquetUtils to hudi-hadoop-common

2024-05-08 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7729: - Summary: Move ParquetUtils to hudi-hadoop-common Key: HUDI-7729 URL: https://issues.apache.org/jira/browse/HUDI-7729 Project: Apache Hudi Issue Type: Impro

[jira] [Updated] (HUDI-7729) Move ParquetUtils to hudi-hadoop-common

2024-05-08 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7729?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7729: -- Issue Type: Task (was: Improvement) > Move ParquetUtils to hudi-hadoop-common > ---

[jira] [Created] (HUDI-7730) HoodieStorage.openSeekable should not have wrapStream param

2024-05-08 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7730: - Summary: HoodieStorage.openSeekable should not have wrapStream param Key: HUDI-7730 URL: https://issues.apache.org/jira/browse/HUDI-7730 Project: Apache Hudi

[jira] [Created] (HUDI-7731) Fix usage of new Configuration() in production code

2024-05-08 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7731: - Summary: Fix usage of new Configuration() in production code Key: HUDI-7731 URL: https://issues.apache.org/jira/browse/HUDI-7731 Project: Apache Hudi Issue

[jira] [Created] (HUDI-7732) Reduce number of constructors in HoodieHadoopStorage

2024-05-08 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7732: - Summary: Reduce number of constructors in HoodieHadoopStorage Key: HUDI-7732 URL: https://issues.apache.org/jira/browse/HUDI-7732 Project: Apache Hudi Issu

[jira] [Created] (HUDI-7733) Reduce number of constructors in HadoopStorageConfig

2024-05-08 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7733: - Summary: Reduce number of constructors in HadoopStorageConfig Key: HUDI-7733 URL: https://issues.apache.org/jira/browse/HUDI-7733 Project: Apache Hudi Issu

[jira] [Closed] (HUDI-7350) Introduce HoodieIOFactory to abstract the reader and writer implementation

2024-05-09 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7350. - Resolution: Fixed > Introduce HoodieIOFactory to abstract the reader and writer implementation > -

[jira] [Assigned] (HUDI-7731) Fix usage of new Configuration() in production code

2024-05-09 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-7731: - Assignee: Jonathan Vexler > Fix usage of new Configuration() in production code > ---

[jira] [Created] (HUDI-7741) Implement methods in HFileUtils extends BaseFileUtils

2024-05-09 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7741: - Summary: Implement methods in HFileUtils extends BaseFileUtils Key: HUDI-7741 URL: https://issues.apache.org/jira/browse/HUDI-7741 Project: Apache Hudi Is

[jira] [Created] (HUDI-7743) Fix simple mistakes with StoragePath in production code.

2024-05-10 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7743: - Summary: Fix simple mistakes with StoragePath in production code. Key: HUDI-7743 URL: https://issues.apache.org/jira/browse/HUDI-7743 Project: Apache Hudi

[jira] [Updated] (HUDI-7743) Fix simple mistakes with StoragePath in production code.

2024-05-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7743: -- Status: Patch Available (was: In Progress) > Fix simple mistakes with StoragePath in production

[jira] [Updated] (HUDI-7743) Fix simple mistakes with StoragePath in production code.

2024-05-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7743?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7743: -- Status: In Progress (was: Open) > Fix simple mistakes with StoragePath in production code. > --

[jira] [Updated] (HUDI-7731) Fix usage of new Configuration() in production code

2024-05-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7731: -- Status: In Progress (was: Open) > Fix usage of new Configuration() in production code > ---

[jira] [Updated] (HUDI-7731) Fix usage of new Configuration() in production code

2024-05-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7731: -- Status: Patch Available (was: In Progress) > Fix usage of new Configuration() in production cod

[jira] [Created] (HUDI-7744) Create HoodieIOFactory and config to set it

2024-05-10 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7744: - Summary: Create HoodieIOFactory and config to set it Key: HUDI-7744 URL: https://issues.apache.org/jira/browse/HUDI-7744 Project: Apache Hudi Issue Type: I

[jira] [Created] (HUDI-7746) HadoopConf loses set values when HoodieStorage.getConf is called

2024-05-10 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7746: - Summary: HadoopConf loses set values when HoodieStorage.getConf is called Key: HUDI-7746 URL: https://issues.apache.org/jira/browse/HUDI-7746 Project: Apache Hudi

[jira] [Created] (HUDI-7747) In MetaClient remove getBasePathV2() and return StoragePath from getBasePath()

2024-05-11 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7747: - Summary: In MetaClient remove getBasePathV2() and return StoragePath from getBasePath() Key: HUDI-7747 URL: https://issues.apache.org/jira/browse/HUDI-7747 Project:

[jira] [Created] (HUDI-7754) Remove AvroWriteSupport and ParquetReaderIterator from hudi-common

2024-05-13 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7754: - Summary: Remove AvroWriteSupport and ParquetReaderIterator from hudi-common Key: HUDI-7754 URL: https://issues.apache.org/jira/browse/HUDI-7754 Project: Apache Hudi

[jira] [Created] (HUDI-7760) Row Writer Clustering should use fg reader

2024-05-14 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7760: - Summary: Row Writer Clustering should use fg reader Key: HUDI-7760 URL: https://issues.apache.org/jira/browse/HUDI-7760 Project: Apache Hudi Issue Type: Im

[jira] [Created] (HUDI-7764) DefaultHoodieRecordPayload should be projection compatible

2024-05-15 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7764: - Summary: DefaultHoodieRecordPayload should be projection compatible Key: HUDI-7764 URL: https://issues.apache.org/jira/browse/HUDI-7764 Project: Apache Hudi

[jira] [Updated] (HUDI-7764) DefaultHoodieRecordPayload should be projection compatible

2024-05-15 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7764: -- Status: In Progress (was: Open) > DefaultHoodieRecordPayload should be projection compatible >

[jira] [Updated] (HUDI-7764) DefaultHoodieRecordPayload should be projection compatible

2024-05-15 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7764: -- Status: Patch Available (was: In Progress) > DefaultHoodieRecordPayload should be projection co

[jira] [Closed] (HUDI-7764) DefaultHoodieRecordPayload should be projection compatible

2024-05-15 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7764. - Resolution: Not A Bug > DefaultHoodieRecordPayload should be projection compatible > -

[jira] [Commented] (HUDI-7764) DefaultHoodieRecordPayload should be projection compatible

2024-05-15 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17846745#comment-17846745 ] Jonathan Vexler commented on HUDI-7764: --- Changing this leads to OOM issues with spar

[jira] [Created] (HUDI-7770) Bootstrap read tries to parse partition from the bootstrap base path

2024-05-15 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7770: - Summary: Bootstrap read tries to parse partition from the bootstrap base path Key: HUDI-7770 URL: https://issues.apache.org/jira/browse/HUDI-7770 Project: Apache Hu

[jira] [Created] (HUDI-7813) Hive Style partitioning on a bootstrap table is not configurable

2024-05-29 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7813: - Summary: Hive Style partitioning on a bootstrap table is not configurable Key: HUDI-7813 URL: https://issues.apache.org/jira/browse/HUDI-7813 Project: Apache Hudi

[jira] [Created] (HUDI-7833) Validate that fg reader works with nested column as record key

2024-06-05 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7833: - Summary: Validate that fg reader works with nested column as record key Key: HUDI-7833 URL: https://issues.apache.org/jira/browse/HUDI-7833 Project: Apache Hudi

[jira] [Created] (HUDI-7838) Use Config hoodie.schema.cache.enable in HoodieBaseFileGroupRecordBuffer and AbstractHoodieLogRecordReader

2024-06-06 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7838: - Summary: Use Config hoodie.schema.cache.enable in HoodieBaseFileGroupRecordBuffer and AbstractHoodieLogRecordReader Key: HUDI-7838 URL: https://issues.apache.org/jira/browse/HU

[jira] [Created] (HUDI-7840) Add position merging back to file group reader

2024-06-06 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7840: - Summary: Add position merging back to file group reader Key: HUDI-7840 URL: https://issues.apache.org/jira/browse/HUDI-7840 Project: Apache Hudi Issue Type

[jira] [Updated] (HUDI-7693) Allow Vectorized Reading for bootstrap in the new fg reader under some conditions

2024-06-07 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7693?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7693: -- Description: Vectorized reading can be used for bootstrap if we don't need to do any merging. Ad

[jira] [Closed] (HUDI-6787) Hive Integrate FileGroupReader with HoodieMergeOnReadSnapshotReader and RealtimeCompactedRecordReader for Hive

2024-06-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-6787. - Resolution: Fixed > Hive Integrate FileGroupReader with HoodieMergeOnReadSnapshotReader and > Rea

[jira] [Closed] (HUDI-6792) Integrate FileGroupReader with NewHoodieParquetFileFormat for Spark Incremental Query

2024-06-11 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-6792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-6792. - Resolution: Duplicate > Integrate FileGroupReader with NewHoodieParquetFileFormat for Spark > Inc

[jira] [Created] (HUDI-7869) Ensure properties are copied when modifying schema

2024-06-12 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7869: - Summary: Ensure properties are copied when modifying schema Key: HUDI-7869 URL: https://issues.apache.org/jira/browse/HUDI-7869 Project: Apache Hudi Issue

[jira] [Updated] (HUDI-7869) Ensure properties are copied when modifying schema

2024-06-12 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7869: -- Status: Patch Available (was: In Progress) > Ensure properties are copied when modifying schema

[jira] [Updated] (HUDI-7869) Ensure properties are copied when modifying schema

2024-06-12 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7869: -- Status: In Progress (was: Open) > Ensure properties are copied when modifying schema >

[jira] [Created] (HUDI-7871) Remove tableconfig from HoodieFilegroupReader params

2024-06-13 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7871: - Summary: Remove tableconfig from HoodieFilegroupReader params Key: HUDI-7871 URL: https://issues.apache.org/jira/browse/HUDI-7871 Project: Apache Hudi Issu

[jira] [Updated] (HUDI-7871) Remove tableconfig from HoodieFilegroupReader params

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7871: -- Status: In Progress (was: Open) > Remove tableconfig from HoodieFilegroupReader params > --

[jira] [Updated] (HUDI-7871) Remove tableconfig from HoodieFilegroupReader params

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7871: -- Status: Patch Available (was: In Progress) > Remove tableconfig from HoodieFilegroupReader para

[jira] [Created] (HUDI-7875) Remove tablePath from HoodieFileGroupReader

2024-06-13 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7875: - Summary: Remove tablePath from HoodieFileGroupReader Key: HUDI-7875 URL: https://issues.apache.org/jira/browse/HUDI-7875 Project: Apache Hudi Issue Type: I

[jira] [Created] (HUDI-7876) Use TypedProperties to store the spillable map configs for the FG reader

2024-06-13 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7876: - Summary: Use TypedProperties to store the spillable map configs for the FG reader Key: HUDI-7876 URL: https://issues.apache.org/jira/browse/HUDI-7876 Project: Apach

[jira] [Updated] (HUDI-7840) Add position merging back to file group reader

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7840: -- Status: Patch Available (was: In Progress) > Add position merging back to file group reader > -

[jira] [Updated] (HUDI-7840) Add position merging back to file group reader

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7840: -- Status: In Progress (was: Open) > Add position merging back to file group reader >

[jira] [Closed] (HUDI-7869) Ensure properties are copied when modifying schema

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7869. - Resolution: Fixed > Ensure properties are copied when modifying schema > -

[jira] [Closed] (HUDI-7840) Add position merging back to file group reader

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7840?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7840. - Resolution: Fixed > Add position merging back to file group reader > -

[jira] [Updated] (HUDI-7876) Use TypedProperties to store the spillable map configs for the FG reader

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7876: -- Status: Patch Available (was: In Progress) > Use TypedProperties to store the spillable map con

[jira] [Updated] (HUDI-7873) Remove getStorage method from HoodieReaderContext

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7873: -- Status: Patch Available (was: In Progress) > Remove getStorage method from HoodieReaderContext

[jira] [Updated] (HUDI-7875) Remove tablePath from HoodieFileGroupReader

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7875: -- Status: In Progress (was: Open) > Remove tablePath from HoodieFileGroupReader > ---

[jira] [Updated] (HUDI-7873) Remove getStorage method from HoodieReaderContext

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7873?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7873: -- Status: In Progress (was: Open) > Remove getStorage method from HoodieReaderContext > -

[jira] [Updated] (HUDI-7875) Remove tablePath from HoodieFileGroupReader

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7875: -- Status: Patch Available (was: In Progress) > Remove tablePath from HoodieFileGroupReader >

[jira] [Updated] (HUDI-7876) Use TypedProperties to store the spillable map configs for the FG reader

2024-06-13 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7876?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7876: -- Status: In Progress (was: Open) > Use TypedProperties to store the spillable map configs for th

[jira] [Created] (HUDI-7873) Remove getStorage method from HoodieReaderContext

2024-06-13 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7873: - Summary: Remove getStorage method from HoodieReaderContext Key: HUDI-7873 URL: https://issues.apache.org/jira/browse/HUDI-7873 Project: Apache Hudi Issue T

[jira] [Updated] (HUDI-7918) Remove support of Spark 2, 3.0, 3.1, and 3.2

2024-06-26 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7918?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7918: -- Status: In Progress (was: Open) > Remove support of Spark 2, 3.0, 3.1, and 3.2 > --

[jira] [Created] (HUDI-7932) Fix the import ordering

2024-06-26 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7932: - Summary: Fix the import ordering Key: HUDI-7932 URL: https://issues.apache.org/jira/browse/HUDI-7932 Project: Apache Hudi Issue Type: Task Compon

[jira] [Updated] (HUDI-7932) Fix the import ordering

2024-06-27 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7932: -- Status: Patch Available (was: In Progress) > Fix the import ordering > ---

[jira] [Resolved] (HUDI-7932) Fix the import ordering

2024-06-27 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler resolved HUDI-7932. --- > Fix the import ordering > --- > > Key: HUDI-7932 >

[jira] [Updated] (HUDI-7932) Fix the import ordering

2024-06-27 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7932: -- Status: In Progress (was: Open) > Fix the import ordering > --- > >

[jira] [Commented] (HUDI-7932) Fix the import ordering

2024-06-27 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7932?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17860522#comment-17860522 ] Jonathan Vexler commented on HUDI-7932: --- [https://github.com/apache/hudi/pull/11524]

[jira] [Created] (HUDI-7935) Update developer setup on website to apply import style rules correctly

2024-06-27 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7935: - Summary: Update developer setup on website to apply import style rules correctly Key: HUDI-7935 URL: https://issues.apache.org/jira/browse/HUDI-7935 Project: Apache

[jira] [Created] (HUDI-7936) Add CI check for import ordering

2024-06-27 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7936: - Summary: Add CI check for import ordering Key: HUDI-7936 URL: https://issues.apache.org/jira/browse/HUDI-7936 Project: Apache Hudi Issue Type: Test

[jira] [Updated] (HUDI-7966) NPE from AvroSchemaUtils.createNewSchemaFromFieldsWithReference

2024-07-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7966: -- Status: In Progress (was: Open) > NPE from AvroSchemaUtils.createNewSchemaFromFieldsWithReferen

[jira] [Assigned] (HUDI-7966) NPE from AvroSchemaUtils.createNewSchemaFromFieldsWithReference

2024-07-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler reassigned HUDI-7966: - Assignee: Sagar Sumit > NPE from AvroSchemaUtils.createNewSchemaFromFieldsWithReference >

[jira] [Updated] (HUDI-7966) NPE from AvroSchemaUtils.createNewSchemaFromFieldsWithReference

2024-07-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler updated HUDI-7966: -- Status: Patch Available (was: In Progress) > NPE from AvroSchemaUtils.createNewSchemaFromFields

[jira] [Closed] (HUDI-7966) NPE from AvroSchemaUtils.createNewSchemaFromFieldsWithReference

2024-07-10 Thread Jonathan Vexler (Jira)
[ https://issues.apache.org/jira/browse/HUDI-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Vexler closed HUDI-7966. - Resolution: Fixed > NPE from AvroSchemaUtils.createNewSchemaFromFieldsWithReference >

[jira] [Created] (HUDI-7999) Disable ci testing for spark versions less than 3.3

2024-07-17 Thread Jonathan Vexler (Jira)
Jonathan Vexler created HUDI-7999: - Summary: Disable ci testing for spark versions less than 3.3 Key: HUDI-7999 URL: https://issues.apache.org/jira/browse/HUDI-7999 Project: Apache Hudi Issue

  1   2   3   4   5   6   7   8   9   10   >