rluvaton commented on issue #23197:
URL: https://github.com/apache/datafusion/issues/23197#issuecomment-4896271118
Here is my take from my experience after implementing couple of Window Execs
that are way more optimized but not for the general case due to the Window API
limitation
The requirement for window expressions to get the entire partition in order
to output a value is a major thing that prevent from optimizing window
expression as it requires both
1. having all the partition in hand even when the expression might not need
that
2. it requires having it in memory - which takes a lot of memory and you
can't do any spilling
It should be similar to `GroupsAccumulator` that hold state and handle that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
