Re: Pyflink Side Output Question and/or suggested documentation change

Thank you! On Mon, Feb 13, 2023 at 5:55 AM Dian Fu wrote: > Thanks Andrew, I think this is a valid advice. I will update the > documentation~ > > Regards, > Dian > > , > > On Fri, Feb 10, 2023 at 10:08 PM Andrew Otto wrote: > >> Question about side outputs and OutputTags in pyflink. The docs >

Re: Pyflink Side Output Question and/or suggested documentation change

Thanks Andrew, I think this is a valid advice. I will update the documentation~ Regards, Dian , On Fri, Feb 10, 2023 at 10:08 PM Andrew Otto wrote: > Question about side outputs and OutputTags in pyflink. The docs >

Pyflink Side Output Question and/or suggested documentation change

Question about side outputs and OutputTags in pyflink. The docs say we are supposed to yield output_tag, value Docs then say: > For retrieving the side output stream you use getSideOutput(OutputTag) on the re

Re: Side output question

There is no clear reference as it's not a use case that has occurred yet. I'd be careful with all metrics related to output. Shuffle service should be fine [1] as side-output also go over it. I wouldn't be surprised if currentOutputWatermark is not updated though. [1] https://ci.apache.org/project

Re: Side output question

Thanks Arvid for your answer. Can you please point me to any documentation/reference as to which metrics might be impacted ? Also, let me know of any other pitfall. Once again, I appreciate your help. On Tuesday, December 10, 2019, 03:23:01 AM EST, Arvid Heise wrote: Hi Mans, there sho

Re: Side output question

Hi Mans, there should be no issue to only have side-outputs in your operator. There should also be no big drawbacks. I guess mostly some metrics will not be properly populated, but you can always populate them manually or add new ones. Best, Arvid On Mon, Dec 2, 2019 at 8:40 PM M Singh wrote:

Side output question

Hi: I am replacing SplitOperator in my flink application with a simple processor with side outputs. My questions is that does the main stream from which we get the side outputs need to have any events (ie, produced using by the using collector.collect) ?  Or can we have all the output as side o