RE: Implementing Multiple sink

2024-06-03 Thread Colletta, Edward via user
Yes. But the filter us usually a very light weight operation. From: Mingliang Liu Sent: Monday, June 3, 2024 7:16 PM To: Colletta, Edward Cc: mejri houssem ; user@flink.apache.org Subject: Re: Implementing Multiple sink NOTICE: This email is from an external sender - do not click on links or

Re: Implementing Multiple sink

2024-06-03 Thread Mingliang Liu
ddSink(SinkforCondtiton2); > > > > > > *From:* Mingliang Liu > *Sent:* Monday, June 3, 2024 1:03 PM > *To:* mejri houssem > *Cc:* user@flink.apache.org > *Subject:* Re: Implementing Multiple sink > > > > *NOTICE: This email is from an external sender - *

Re: Implementing Multiple sink

2024-06-03 Thread mejri houssem
; >.addSink(SinkforCondtiton2); > > > > > > *From:* Mingliang Liu > *Sent:* Monday, June 3, 2024 1:03 PM > *To:* mejri houssem > *Cc:* user@flink.apache.org > *Subject:* Re: Implementing Multiple sink > > > > *NOTICE: This email is from an e

RE: Implementing Multiple sink

2024-06-03 Thread Colletta, Edward via user
); streamWithMultipleConditions.filter(FilterForCondition2) .addSink(SinkforCondtiton2); From: Mingliang Liu Sent: Monday, June 3, 2024 1:03 PM To: mejri houssem Cc: user@flink.apache.org Subject: Re: Implementing Multiple sink NOTICE: This email is

Re: Implementing Multiple sink

2024-06-03 Thread Mingliang Liu
Hi Mejri, Have you checked side outputs? https://nightlies.apache.org/flink/flink-docs-release-1.19/docs/dev/datastream/side_output/ On Mon, Jun 3, 2024 at 8:28 AM mejri houssem wrote: > Hello community, > > We have a use case in our Flink job that requires the implementation of > multiple sink

Implementing Multiple sink

2024-06-03 Thread mejri houssem
Hello community, We have a use case in our Flink job that requires the implementation of multiple sinks. I need to filter messages based on certain conditions (information in the message) to determine which sink to dispatch them to. To clarify, I would like to implement logic in the operator tha