hudi-bot opened a new issue, #17267:
URL: https://github.com/apache/hudi/issues/17267
In HoodieFileIndex, we have 5 indices support:
* RecordLevelIndexSupport
* BucketIndexSupport
* SecondaryIndexSupport
* FunctionalIndexSupport
* BloomFiltersIndexSupport
* ColumnStatsIndexSupport
But the logic would return early when the first index support applied and
got pruned files.
A better way is we can chain the multiple indices support all-together: one
index support can still be applied based on the pruned files returned by
another index support.
Key points in contribution:
1. think through the shared contract/param among these indices support;
2. add a orthoganal test for random index supoprt composition, valid the
result set and the indices support are applied effectively.
## JIRA info
- Link: https://issues.apache.org/jira/browse/HUDI-8164
- Type: Sub-task
- Parent: https://issues.apache.org/jira/browse/HUDI-9101
- Fix version(s):
- 1.1.0
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
