[
https://issues.apache.org/jira/browse/CALCITE-7218?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Zhen Chen updated CALCITE-7218:
-------------------------------
Description:
Currently, ArrowSet may contain redundant functional dependencies. For example:
If both "(a, b) -> (c)" and "(b) -> (c)" are present, the former can be removed
since it is implied by the latter.
We should implement a best-effort minimization algorithm that:
# Removes redundant FDs where a subset of determinants already implies the same
dependents
# Handles the most common cases rather than achieving perfect minimization
# Maintains functional correctness while improving storage efficiency
was:
Currently, ArrowSet may contain redundant functional dependencies. For example:
If both "{a, b} -> {c}" and "{b} -> {c}" are present, the former can be removed
since it is implied by the latter.
We should implement a best-effort minimization algorithm that:
# Removes redundant FDs where a subset of determinants already implies the same
dependents
# Handles the most common cases rather than achieving perfect minimization
# Maintains functional correctness while improving storage efficiency
> ArrowSet needs to maintain a minimal set of functional dependencies
> ---------------------------------------------------------------------
>
> Key: CALCITE-7218
> URL: https://issues.apache.org/jira/browse/CALCITE-7218
> Project: Calcite
> Issue Type: Improvement
> Components: core
> Affects Versions: 1.40.0
> Reporter: Zhen Chen
> Priority: Major
>
> Currently, ArrowSet may contain redundant functional dependencies. For
> example:
> If both "(a, b) -> (c)" and "(b) -> (c)" are present, the former can be
> removed since it is implied by the latter.
> We should implement a best-effort minimization algorithm that:
> # Removes redundant FDs where a subset of determinants already implies the
> same dependents
> # Handles the most common cases rather than achieving perfect minimization
> # Maintains functional correctness while improving storage efficiency
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
