panbingkun commented on PR #49411: URL: https://github.com/apache/spark/pull/49411#issuecomment-2635424303
> > * Based on that the root cause for the performance regression of `SubExprEliminationBenchmark` is not due to the codegen implementation of `from_json`(the root cause is that the operator `FilterExEc` did not implement `SubExprElimination` optimization in `WSC`), this PR will close here. > > * The operator `FilterExec` implementing `SubExprElimination` optimization in `WSC` is still being explored for implementation: [[Only Test][Don't Review] Make `FilterExec` to support `subexpressionElimination` in the codegen scenario #49573](https://github.com/apache/spark/pull/49573) > > @panbingkun is currently on vacation. According to @panbingkun's intention, if `FilterExec` supports subexpressionElimination in the codegen scenario, this pr would not be needed. BUt, #49573 is still under development. Yeah, that's right. Currently, I want to focus on implementing `subexpressionElimination` for `FilterExec` in the `WSC` scenario. Thanks @dongjoon-hyun @LuciferYang ❤️ -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
