xudong963 commented on PR #15503:
URL: https://github.com/apache/datafusion/pull/15503#issuecomment-2785968029
> > How does it return all partitions' statistics?
>
> I think the idea like
>
> ```rust
> let all_partition_statistics = plan.statistics(None);
>
> // get only statistics for partition 3
> let partition_statistics = plan.statistics(Some(3));
> ```
Yeah, that's also my understanding, but for our use case, optimized SPM, we
need all the partitions' statistics: `Vec<Statistics>` to check if there is
overlapping during partitions' statistics.
So if we follow this way, it seems that we need to collect all partitions
statistics like this when we need all partitions' statistics, right?:
```rust
let mut partitions_statistics = vec![];
for partition_idx in (0..partition_cout) {
partitions_statistics.push(executor.statistics(Some(partition_id));
}
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org
For additional commands, e-mail: github-h...@datafusion.apache.org
