[
https://issues.apache.org/jira/browse/BEAM-7199?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17090897#comment-17090897
]
Ismaël Mejía commented on BEAM-7199:
------------------------------------
Can you detail on how the combiner lifting optimization would work? I am
puzzled because I thought Combination must happen in the SDK side because it is
the one that knows how to apply the combine function, no? or this is only for
python based runners?
Also I am curious on what were the optimizations for SDF?
> Better optimize Portable pipelines
> ----------------------------------
>
> Key: BEAM-7199
> URL: https://issues.apache.org/jira/browse/BEAM-7199
> Project: Beam
> Issue Type: Improvement
> Components: sdk-py-core
> Reporter: Ankur Goenka
> Priority: Major
> Labels: portability
>
> Python has an experimental flag pre_optimize=all which does pre-optimization
> of python pipelines by fusing operators.
> Python optimization is expected to be better than the one in java because it
> has more information about the pipeline.
> Make java pipeline optimization at par with python so that the benefits can
> be shared by all languages.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
