Thank you!
Bests,
Dongjoon
On Mon, Sep 28, 2020 at 8:07 PM Dr. Kent Yao wrote:
> Thanks, Dongjon,
>
>I pined two long-standing issues to the umbrella.
>
>
>
>https://issues.apache.org/jira/browse/SPARK-28895
>
>https://issues.apache.org/jira/browse/SPARK-28992
>
>
>
>This helps
i have been doing tests with iterative algorithms that do caching/uncaching
at each iteration and i see improvements when i turn on AQE for cache.
now i am wondering... with an iterative algo using AQE it is true that the
output of every iteration can have a slightly different number of
partitions
