Re: Writing multiple streams to multiple kafka

2016-03-31 Thread Deepak Jha
It works... Thanks On Thu, Mar 31, 2016 at 2:23 AM, Aljoscha Krettek wrote: > Hi, > yes you can output the stages to several different Kafka Topics. If you > don't want to call addSink inside the run() method you somehow have to > return the handle to your stage3 DataStream, for example: > > pri

Re: Writing multiple streams to multiple kafka

2016-03-31 Thread Aljoscha Krettek
Hi, yes you can output the stages to several different Kafka Topics. If you don't want to call addSink inside the run() method you somehow have to return the handle to your stage3 DataStream, for example: private val env = StreamExecutionEnvironment.getExecutionEnvironment private val src = env.ad

Writing multiple streams to multiple kafka

2016-03-30 Thread Deepak Jha
Hi, I'm building a pipeline using Flink using Kafka as source and sink. As part of the this pipeline I have multiple stages in my run command and I would like to publish some substages output into separate kafka topic. My question is can I write multiple stages of run to multiple kafka topics ? pr