Re: [PR] Optimize TopK with filter [datafusion]

2025-04-13 Thread via GitHub
Dandandan commented on code in PR #15697: URL: https://github.com/apache/datafusion/pull/15697#discussion_r2041118426 ## datafusion/physical-plan/src/topk/mod.rs: ## @@ -202,24 +204,93 @@ impl TopK { }) .collect::>>()?; +// selected indices +

Re: [PR] Optimize TopK with filter [datafusion]

2025-04-13 Thread via GitHub
Dandandan commented on code in PR #15697: URL: https://github.com/apache/datafusion/pull/15697#discussion_r2041118282 ## datafusion/physical-plan/src/topk/mod.rs: ## @@ -202,24 +204,93 @@ impl TopK { }) .collect::>>()?; +// selected indices +

[PR] Optimize TopK with filter [datafusion]

2025-04-13 Thread via GitHub
Dandandan opened a new pull request, #15697: URL: https://github.com/apache/datafusion/pull/15697 ## Which issue does this PR close? - Closes #. ## Rationale for this change This optimizes our TopK by filtering early based on the threshold values, avoidin