[GitHub] [hudi] yanghua commented on issue #4558: [BUG] Bootstrap operation data loading missing

yanghua commented on issue #4558: URL: https://github.com/apache/hudi/issues/4558#issuecomment-1039934131 @waywtdcc Does Hudi 0.10 also have this issue, did you try? IMHO, there are some issues in Hudi 0.9 with Flink integration. -- This is an automated message from the Apache Git Servic

[GitHub] [hudi] hudi-bot commented on pull request #4212: [HUDI-2925] Fix duplicate cleaning of same files when unfinished clean operations are present.

hudi-bot commented on pull request #4212: URL: https://github.com/apache/hudi/pull/4212#issuecomment-1039921232 ## CI report: * cb266359f3a11e4fcff70e4df55427381c5843c1 Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4212: [HUDI-2925] Fix duplicate cleaning of same files when unfinished clean operations are present.

hudi-bot removed a comment on pull request #4212: URL: https://github.com/apache/hudi/pull/4212#issuecomment-1039868384 ## CI report: * 96299439e77b68cf82478a07f51bef7c0b003b4c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

hudi-bot commented on pull request #3808: URL: https://github.com/apache/hudi/pull/3808#issuecomment-1039903448 ## CI report: * ad1630ead2e2530fe92c54883bc55f7852d9af10 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

hudi-bot removed a comment on pull request #3808: URL: https://github.com/apache/hudi/pull/3808#issuecomment-1039831567 ## CI report: * c585862a92bd8c1c184cfa2dd90fc7fc23830886 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #4792: [HUDI-3366] Remove hardcoded logic of disabling metadata table in tests

hudi-bot commented on pull request #4792: URL: https://github.com/apache/hudi/pull/4792#issuecomment-1039892648 ## CI report: * 92d8377315d30921e2fecdf0472367ba15818a5c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4792: [HUDI-3366] Remove hardcoded logic of disabling metadata table in tests

hudi-bot removed a comment on pull request #4792: URL: https://github.com/apache/hudi/pull/4792#issuecomment-1039801948 ## CI report: * d8967834c4778bbbdaad3aef70de4efa7c4a5d6d Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4777: [HUDI-2931] Add config to disable table services

hudi-bot commented on pull request #4777: URL: https://github.com/apache/hudi/pull/4777#issuecomment-1039885425 ## CI report: * 9c350835427bfdc586f0be3834ead1db6691cba3 Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4777: [HUDI-2931] Add config to disable table services

hudi-bot removed a comment on pull request #4777: URL: https://github.com/apache/hudi/pull/4777#issuecomment-1039784186 ## CI report: * 9c350835427bfdc586f0be3834ead1db6691cba3 Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot removed a comment on pull request #4212: [HUDI-2925] Fix duplicate cleaning of same files when unfinished clean operations are present.

hudi-bot removed a comment on pull request #4212: URL: https://github.com/apache/hudi/pull/4212#issuecomment-1039866841 ## CI report: * 96299439e77b68cf82478a07f51bef7c0b003b4c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4212: [HUDI-2925] Fix duplicate cleaning of same files when unfinished clean operations are present.

hudi-bot commented on pull request #4212: URL: https://github.com/apache/hudi/pull/4212#issuecomment-1039868384 ## CI report: * 96299439e77b68cf82478a07f51bef7c0b003b4c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4212: [HUDI-2925] Fix duplicate cleaning of same files when unfinished clean operations are present.

hudi-bot removed a comment on pull request #4212: URL: https://github.com/apache/hudi/pull/4212#issuecomment-1035259608 ## CI report: * 96299439e77b68cf82478a07f51bef7c0b003b4c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4212: [HUDI-2925] Fix duplicate cleaning of same files when unfinished clean operations are present.

hudi-bot commented on pull request #4212: URL: https://github.com/apache/hudi/pull/4212#issuecomment-1039866841 ## CI report: * 96299439e77b68cf82478a07f51bef7c0b003b4c Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] nsivabalan commented on a change in pull request #4212: [HUDI-2925] Fix duplicate cleaning of same files when unfinished clean operations are present.

nsivabalan commented on a change in pull request #4212: URL: https://github.com/apache/hudi/pull/4212#discussion_r803776863 ## File path: hudi-client/hudi-spark-client/src/test/java/org/apache/hudi/client/functional/TestHoodieBackedMetadata.java ## @@ -1737,6 +1739,75 @@ publi

[GitHub] [hudi] hudi-bot commented on pull request #4818: [WIP][HUDI-3396][Stacked on 4789] Make sure `BaseFileOnlyViewRelation` only reads projected columns

hudi-bot commented on pull request #4818: URL: https://github.com/apache/hudi/pull/4818#issuecomment-1039861398 ## CI report: * f5b4e6c758066cfbbe117827f4e8f4d11162eade Azure: [FAILURE](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[GitHub] [hudi] hudi-bot removed a comment on pull request #4818: [WIP][HUDI-3396][Stacked on 4789] Make sure `BaseFileOnlyViewRelation` only reads projected columns

hudi-bot removed a comment on pull request #4818: URL: https://github.com/apache/hudi/pull/4818#issuecomment-1039782601 ## CI report: * f5b4e6c758066cfbbe117827f4e8f4d11162eade Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[jira] [Updated] (HUDI-3218) Upgrade Avro to 1.10.2

[ https://issues.apache.org/jira/browse/HUDI-3218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3218: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-10) > Upgrade Avro to 1.10.2

[jira] [Updated] (HUDI-1623) Support start_commit_time & end_commit_times for serializable incremental pull

[ https://issues.apache.org/jira/browse/HUDI-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1623: - Sprint: Hudi-Sprint-Feb-14 > Support start_commit_time & end_commit_times for serializable increme

[jira] [Updated] (HUDI-2955) Upgrade Hadoop to 3.3.x

[ https://issues.apache.org/jira/browse/HUDI-2955?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2955: - Sprint: Hudi-Sprint-Feb-14 > Upgrade Hadoop to 3.3.x > --- > >

[jira] [Closed] (HUDI-109) RFC-7 Ability to query older snapshots of data

[ https://issues.apache.org/jira/browse/HUDI-109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar closed HUDI-109. --- Resolution: Fixed > RFC-7 Ability to query older snapshots of data > -

[jira] [Created] (HUDI-3433) Migrate _hoodie_partition_metadata file to parquet to ensure bigquery is happy

Vinoth Chandar created HUDI-3433: Summary: Migrate _hoodie_partition_metadata file to parquet to ensure bigquery is happy Key: HUDI-3433 URL: https://issues.apache.org/jira/browse/HUDI-3433 Project: A

[GitHub] [hudi] hudi-bot removed a comment on pull request #4817: [HUDI-3429] Support clustering scheduleAndExecute for hudi-cli and add clustering-cli Tests

hudi-bot removed a comment on pull request #4817: URL: https://github.com/apache/hudi/pull/4817#issuecomment-1039782583 ## CI report: * 924c0fd27a015e8b7a0c358f2f978e1c95da01cb Azure: [PENDING](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/r

[GitHub] [hudi] hudi-bot commented on pull request #4817: [HUDI-3429] Support clustering scheduleAndExecute for hudi-cli and add clustering-cli Tests

hudi-bot commented on pull request #4817: URL: https://github.com/apache/hudi/pull/4817#issuecomment-1039858760 ## CI report: * 924c0fd27a015e8b7a0c358f2f978e1c95da01cb Azure: [SUCCESS](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?b

[jira] [Updated] (HUDI-3396) Make sure Spark reads only Projected Columns for both MOR/COW

[ https://issues.apache.org/jira/browse/HUDI-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alexey Kudinkin updated HUDI-3396: -- Epic Link: HUDI-1297 > Make sure Spark reads only Projected Columns for both MOR/COW > -

[jira] [Updated] (HUDI-2732) Spark Datasource V2 integration RFC

[ https://issues.apache.org/jira/browse/HUDI-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2732: - Reviewers: Vinoth Chandar (was: Raymond Xu, Vinoth Chandar) > Spark Datasource V2 integration RFC

[jira] [Created] (HUDI-3432) Test restore scenarios with MT table

Vinoth Chandar created HUDI-3432: Summary: Test restore scenarios with MT table Key: HUDI-3432 URL: https://issues.apache.org/jira/browse/HUDI-3432 Project: Apache Hudi Issue Type: Task

[jira] [Assigned] (HUDI-3432) Test restore scenarios with MT table

[ https://issues.apache.org/jira/browse/HUDI-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar reassigned HUDI-3432: Assignee: sivabalan narayanan > Test restore scenarios with MT table >

[jira] [Updated] (HUDI-3432) Test restore scenarios with MT table

[ https://issues.apache.org/jira/browse/HUDI-3432?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3432: - Fix Version/s: 0.11.0 > Test restore scenarios with MT table > ---

[jira] [Updated] (HUDI-3300) Timeline server FSViewManager should avoid point lookup for metadata file partition

[ https://issues.apache.org/jira/browse/HUDI-3300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3300: - Sprint: Hudi-Sprint-Feb-14 > Timeline server FSViewManager should avoid point lookup for metadata

[jira] [Updated] (HUDI-3307) Implement a repair tool for bring back table into a clean state

[ https://issues.apache.org/jira/browse/HUDI-3307?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3307: - Sprint: Hudi-Sprint-Feb-14 > Implement a repair tool for bring back table into a clean state > ---

[GitHub] [hudi] zhangyue19921010 commented on pull request #4810: [HUDI-3421]Pending clustering may break AbstractTableFileSystemView#getxxBaseFile()

zhangyue19921010 commented on pull request #4810: URL: https://github.com/apache/hudi/pull/4810#issuecomment-1039856405 Hi @codope and @satishkotha Sorry to bother you. Would you mind to take a look at his patch? Thanks a lot :) -- This is an automated message from the Apache Git Serv

[jira] [Updated] (HUDI-3376) Understand the implication of mismatch between metadata table vs FS during clean

[ https://issues.apache.org/jira/browse/HUDI-3376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3376: - Sprint: Hudi-Sprint-Feb-14 > Understand the implication of mismatch between metadata table vs FS d

[jira] [Updated] (HUDI-3301) MergedLogRecordReader inline reading should be stateless and thread safe

[ https://issues.apache.org/jira/browse/HUDI-3301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3301: - Sprint: Hudi-Sprint-Feb-14 > MergedLogRecordReader inline reading should be stateless and thread s

[jira] [Commented] (HUDI-1180) Upgrade HBase to 2.x

[ https://issues.apache.org/jira/browse/HUDI-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17492362#comment-17492362 ] Vinoth Chandar commented on HUDI-1180: -- apache hudi can move to HBase 2.x , as long a

[GitHub] [hudi] nsivabalan commented on pull request #4385: [HUDI-1436]: provided option to trigger clean every nth commit

nsivabalan commented on pull request #4385: URL: https://github.com/apache/hudi/pull/4385#issuecomment-1039852714 @pratyakshsharma : let me know once the feedback is addressed. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [hudi] nsivabalan commented on pull request #3646: [HUDI-349]: Added new cleaning policy based on number of hours

nsivabalan commented on pull request #3646: URL: https://github.com/apache/hudi/pull/3646#issuecomment-1039852572 @pratyakshsharma : once you address the feedback, let me know. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[hudi] branch master updated (27bd7b5 -> cb6ca7f)

This is an automated email from the ASF dual-hosted git repository. sivabalan pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/hudi.git. from 27bd7b5 [HUDI-1576] Make archiving an async service (#4795) add cb6ca7f [HUDI-3204] fix problem that spark on

[GitHub] [hudi] nsivabalan merged pull request #4714: [HUDI-3204] fix problem that spark on TimestampKeyGenerator has no re…

nsivabalan merged pull request #4714: URL: https://github.com/apache/hudi/pull/4714 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubs

[jira] [Updated] (HUDI-2597) Improve code quality around Generics with Java 8

[ https://issues.apache.org/jira/browse/HUDI-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2597: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7 (was: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-S

[jira] [Updated] (HUDI-2439) Refactor table.action.commit package (CommitActionExecutors) in hudi-client module

[ https://issues.apache.org/jira/browse/HUDI-2439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2439: - Sprint: Hudi-Sprint-Jan-18, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-18) > Refactor table.action.

[jira] [Updated] (HUDI-3042) Refactor clustering action in hudi-client module to use HoodieData abstraction

[ https://issues.apache.org/jira/browse/HUDI-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3042: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-24, Hudi

[jira] [Updated] (HUDI-3334) Unable to merge HoodieMetadataPayload during partition listing

[ https://issues.apache.org/jira/browse/HUDI-3334?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3334: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Unable to merge HoodieMe

[jira] [Updated] (HUDI-2931) Add a config to turn off all table services

[ https://issues.apache.org/jira/browse/HUDI-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2931: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Add a config to turn off

[jira] [Updated] (HUDI-3368) Support metadata bloom index for secondary keys

[ https://issues.apache.org/jira/browse/HUDI-3368?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3368: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Support metadata bloom i

[jira] [Updated] (HUDI-2757) Support AWS Glue API for metastore sync

[ https://issues.apache.org/jira/browse/HUDI-2757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2757: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Support AWS Glue API for

[jira] [Updated] (HUDI-3430) Deltastreamers Spark app hangs after DeltaSync being shut down

[ https://issues.apache.org/jira/browse/HUDI-3430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3430: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Deltastreamers Spark app

[jira] [Updated] (HUDI-3381) Rebase `HoodieMergeHandle` to operate on `HoodieRecord`

[ https://issues.apache.org/jira/browse/HUDI-3381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3381: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-3380) Rebase `HoodieDataBlock`s to operate on `HoodieRecord`

[ https://issues.apache.org/jira/browse/HUDI-3380?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3380: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-1127) Handling late arriving Deletes

[ https://issues.apache.org/jira/browse/HUDI-1127?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1127: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-3203) Meta bloom index should use the bloom filter type property to construct back the bloom filter instant

[ https://issues.apache.org/jira/browse/HUDI-3203?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3203: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-1492) Enhance DeltaWriteStat with block level metadata correctly for storage schemes that support appends

[ https://issues.apache.org/jira/browse/HUDI-1492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1492: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-3386) DROP INDEX comand

[ https://issues.apache.org/jira/browse/HUDI-3386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3386: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > DROP INDEX comand >

[jira] [Updated] (HUDI-3354) Rebase `HoodieRealtimeRecordReader` to return `HoodieRecord`

[ https://issues.apache.org/jira/browse/HUDI-3354?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3354: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-3349) Revisit HoodieRecord API to be able to replace HoodieRecordPayload

[ https://issues.apache.org/jira/browse/HUDI-3349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3349: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-3225) RFC for Async Metadata Index

[ https://issues.apache.org/jira/browse/HUDI-3225?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3225: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprin

[jira] [Updated] (HUDI-2965) Fix layout optimization to appropriately handle nested columns references

[ https://issues.apache.org/jira/browse/HUDI-2965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2965: - Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint

[jira] [Updated] (HUDI-3284) Restore hudi-presto-bundle changes and upgrade presto version in docker setup

[ https://issues.apache.org/jira/browse/HUDI-3284?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3284: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-3088) Make Spark 3 the default profile for build and test

[ https://issues.apache.org/jira/browse/HUDI-3088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3088: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-2747) Fix hudi cli metadata commands

[ https://issues.apache.org/jira/browse/HUDI-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2747: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Fix hudi cli metadata co

[jira] [Updated] (HUDI-3142) Metadata new Indices initialization during table creation

[ https://issues.apache.org/jira/browse/HUDI-3142?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3142: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-3382) Support removal of bloom and column stats indexes

[ https://issues.apache.org/jira/browse/HUDI-3382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3382: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Support removal of bloom

[jira] [Updated] (HUDI-2732) Spark Datasource V2 integration RFC

[ https://issues.apache.org/jira/browse/HUDI-2732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2732: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-3356) Conversion of write stats to metadata index records should use HoodieData throughout

[ https://issues.apache.org/jira/browse/HUDI-3356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3356: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-2597) Improve code quality around Generics with Java 8

[ https://issues.apache.org/jira/browse/HUDI-2597?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2597: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-3365) Make sure Metadata Records always bear full file-size

[ https://issues.apache.org/jira/browse/HUDI-3365?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3365: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-3258) Support multiple metadata index partitions - bloom and column stats

[ https://issues.apache.org/jira/browse/HUDI-3258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3258: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Support multiple metadat

[jira] [Updated] (HUDI-3161) Add Call Produce Command for spark sql

[ https://issues.apache.org/jira/browse/HUDI-3161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3161: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Add Call Produce Command

[jira] [Updated] (HUDI-3166) Implement new HoodieIndex based on metadata indices

[ https://issues.apache.org/jira/browse/HUDI-3166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3166: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprin

[jira] [Updated] (HUDI-3404) Disable metadata table by config with conditions

[ https://issues.apache.org/jira/browse/HUDI-3404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3404: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Disable metadata table b

[jira] [Updated] (HUDI-3397) Make sure Spark RDDs triggering actual FS activity are only dereferenced once

[ https://issues.apache.org/jira/browse/HUDI-3397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3397: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Make sure Spark RDDs tri

[jira] [Updated] (HUDI-3394) Fail to release in-process lock due to IllegalMonitorStateException

[ https://issues.apache.org/jira/browse/HUDI-3394?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3394: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Fail to release in-proce

[jira] [Updated] (HUDI-3396) Make sure Spark reads only Projected Columns for both MOR/COW

[ https://issues.apache.org/jira/browse/HUDI-3396?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3396: - Sprint: Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Feb-7) > Make sure Spark reads on

[jira] [Updated] (HUDI-3221) Support querying a table as of a savepoint

[ https://issues.apache.org/jira/browse/HUDI-3221?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3221: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-3246) Blog on Kafka Connect Sink for Hudi

[ https://issues.apache.org/jira/browse/HUDI-3246?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3246: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprin

[jira] [Updated] (HUDI-2930) Rollbacks are not archived when metadata table is enabled

[ https://issues.apache.org/jira/browse/HUDI-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2930: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-2925) Cleaner may attempt to delete the same file twice when metadata table is enabled

[ https://issues.apache.org/jira/browse/HUDI-2925?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2925: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-3207) Hudi Trino connector PR review

[ https://issues.apache.org/jira/browse/HUDI-3207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3207: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprin

[jira] [Updated] (HUDI-2973) Rewrite/re-publish RFC for Data skipping index

[ https://issues.apache.org/jira/browse/HUDI-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2973: - Sprint: Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint

[jira] [Updated] (HUDI-2809) Introduce a checksum mechanism for validating hoodie.properties

[ https://issues.apache.org/jira/browse/HUDI-2809?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2809: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-3366) Remove unnecessary hardcoded logic of disabling metadata table in tests

[ https://issues.apache.org/jira/browse/HUDI-3366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3366: - Sprint: Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Sprint-Jan-31, Hudi-

[jira] [Updated] (HUDI-3074) Docs for Z-order

[ https://issues.apache.org/jira/browse/HUDI-3074?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3074: - Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint

[jira] [Updated] (HUDI-3175) Support INDEX action for async metadata indexing

[ https://issues.apache.org/jira/browse/HUDI-3175?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3175: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprin

[jira] [Updated] (HUDI-1180) Upgrade HBase to 2.x

[ https://issues.apache.org/jira/browse/HUDI-1180?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1180: - Sprint: Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint

[jira] [Updated] (HUDI-1296) Implement Spark DataSource using range metadata for file/partition pruning

[ https://issues.apache.org/jira/browse/HUDI-1296?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1296: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprin

[jira] [Updated] (HUDI-2695) Documentation

[ https://issues.apache.org/jira/browse/HUDI-2695?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2695: - Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint

[jira] [Updated] (HUDI-3280) Clean up unused/deprecated methods

[ https://issues.apache.org/jira/browse/HUDI-3280?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3280: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-2751) To avoid the duplicates for streaming read MOR table

[ https://issues.apache.org/jira/browse/HUDI-2751?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-2751: - Sprint: Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint

[jira] [Updated] (HUDI-3177) CREATE INDEX command

[ https://issues.apache.org/jira/browse/HUDI-3177?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3177: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprin

[jira] [Updated] (HUDI-1370) Scoping work needed to support bootstrapped data table and RFC-15 together

[ https://issues.apache.org/jira/browse/HUDI-1370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-1370: - Sprint: Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint

[jira] [Updated] (HUDI-3075) Docs for Debezium source

[ https://issues.apache.org/jira/browse/HUDI-3075?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3075: - Sprint: Hudi-Sprint-Jan-3, Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint

[jira] [Updated] (HUDI-3341) Investigate that metadata table cannot be read for hadoop-aws 2.7.x

[ https://issues.apache.org/jira/browse/HUDI-3341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3341: - Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-

[jira] [Updated] (HUDI-3208) Come up with rollout plan for enabling metadata table by default in 0.11

[ https://issues.apache.org/jira/browse/HUDI-3208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-3208: - Sprint: Hudi-Sprint-Jan-10, Hudi-Sprint-Jan-18, Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprin

[jira] [Updated] (HUDI-512) Support for Index functions on columns to generate logical or micro partitioning

[ https://issues.apache.org/jira/browse/HUDI-512?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinoth Chandar updated HUDI-512: Sprint: Hudi-Sprint-Jan-24, Hudi-Sprint-Jan-31, Hudi-Sprint-Feb-7, Hudi-Sprint-Feb-14 (was: Hudi-Spr

[jira] [Closed] (HUDI-1576) Add ability to perform archival synchronously

[ https://issues.apache.org/jira/browse/HUDI-1576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-1576. Resolution: Done > Add ability to perform archival synchronously > -

[jira] [Closed] (HUDI-2370) Supports data encryption (COW tables)

[ https://issues.apache.org/jira/browse/HUDI-2370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu closed HUDI-2370. Resolution: Done > Supports data encryption (COW tables) > - > >

[jira] [Resolved] (HUDI-3254) Introduce HoodieCatalog to manage tables for Spark Datasource V2

[ https://issues.apache.org/jira/browse/HUDI-3254?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Raymond Xu resolved HUDI-3254. -- > Introduce HoodieCatalog to manage tables for Spark Datasource V2 > ---

[jira] [Closed] (HUDI-3398) Schema validation fails for metadata table base file

[ https://issues.apache.org/jira/browse/HUDI-3398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ethan Guo closed HUDI-3398. --- Resolution: Fixed > Schema validation fails for metadata table base file > ---

[GitHub] [hudi] hudi-bot removed a comment on pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

hudi-bot removed a comment on pull request #3808: URL: https://github.com/apache/hudi/pull/3808#issuecomment-1039829492 ## CI report: * 58a7ff6fa38b21edeab6b2b221cd133f2eba9c28 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/

[GitHub] [hudi] hudi-bot commented on pull request #3808: [HUDI-2560] introduce id_based schema to support full schema evolution.

hudi-bot commented on pull request #3808: URL: https://github.com/apache/hudi/pull/3808#issuecomment-1039831567 ## CI report: * c585862a92bd8c1c184cfa2dd90fc7fc23830886 Azure: [CANCELED](https://dev.azure.com/apache-hudi-ci-org/785b6ef4-2f42-4a89-8f0e-5f0d7039a0cc/_build/results?

[GitHub] [hudi] alexeykudinkin commented on a change in pull request #4667: [HUDI-3276] Rebased Parquet-based `FileInputFormat` impls to inherit from `MapredParquetInputFormat`

alexeykudinkin commented on a change in pull request #4667: URL: https://github.com/apache/hudi/pull/4667#discussion_r806428520 ## File path: hudi-hadoop-mr/src/main/java/org/apache/hudi/hadoop/HoodieCopyOnWriteTableInputFormat.java ## @@ -161,6 +173,15 @@ protected FileSplit

  1   2   3   4   5   6   >