Re: Reg. custom sinks in Flink

2016-12-12 Thread Chesnay Schepler
From: Meghashyam Sandeep V mailto:vr1meghash...@gmail.com>> Date: Friday, December 9, 2016 at 12:26 PM To: mailto:user@flink.apache.org>>, mailto:d...@flink.apache.org>> Su

Re: Reg. custom sinks in Flink

2016-12-12 Thread Meghashyam Sandeep V
016 at 10:54 AM, Shannon Carey >>>>> wrote: >>>>> >>>>>> You haven't really added a sink in Flink terminology, you're just >>>>>> performing a side effect within a map operator. So while it may work, if >>>>>

Re: Reg. custom sinks in Flink

2016-12-12 Thread Till Rohrmann
ide effect within a map operator. So while it may work, if >>>>> you want to add a sink proper you need have an object that extends >>>>> SinkFunction or RichSinkFunction. The method call on the stream should be >>>>> ".addSink(…)". >>>

Re: Reg. custom sinks in Flink

2016-12-12 Thread Meghashyam Sandeep V
want to add a sink proper you need have an object that extends >>>> SinkFunction or RichSinkFunction. The method call on the stream should be >>>> ".addSink(…)". >>>> >>>> Also, the dbSession isn't really Flink state as it will not vary ba

Re: Reg. custom sinks in Flink

2016-12-12 Thread Chesnay Schepler
he cluster building by passing your own ClusterBuilder into the constructor. -Shannon From: Meghashyam Sandeep V mailto:vr1meghash...@gmail.com>> Date: Friday, December 9, 2016 at 12:26 PM To: mailto:user@flink.apache.org>>, mailt

Re: Reg. custom sinks in Flink

2016-12-12 Thread Meghashyam Sandeep V
". >>> >>> Also, the dbSession isn't really Flink state as it will not vary based >>> on the position in or content in the stream. It's a necessary helper >>> object, yes, but you don't need Flink to checkpoint it. >>> >>>

Re: Reg. custom sinks in Flink

2016-12-12 Thread Till Rohrmann
heckpoint it. >> >> You can still use the sinks provided with flink-connector-cassandra and >> customize the cluster building by passing your own ClusterBuilder into the >> constructor. >> >> -Shannon >> >> From: Meghashyam Sandeep V >> Date: Fr

Re: Reg. custom sinks in Flink

2016-12-09 Thread Meghashyam Sandeep V
e > constructor. > > -Shannon > > From: Meghashyam Sandeep V > Date: Friday, December 9, 2016 at 12:26 PM > To: , > Subject: Reg. custom sinks in Flink > > Hi there, > > I have a flink streaming app where my source is Kafka and a custom sink to &

Re: Reg. custom sinks in Flink

2016-12-09 Thread Shannon Carey
assandra and customize the cluster building by passing your own ClusterBuilder into the constructor. -Shannon From: Meghashyam Sandeep V mailto:vr1meghash...@gmail.com>> Date: Friday, December 9, 2016 at 12:26 PM To: mailto:user@flink.apache.org>>, mailto:d...@flink.apache.org>> S

Reg. custom sinks in Flink

2016-12-09 Thread Meghashyam Sandeep V
Hi there, I have a flink streaming app where my source is Kafka and a custom sink to Cassandra(I can't use standard C* sink that comes with flink as I have customized auth to C*). I'm currently have the following: messageStream .rebalance() .map( s-> { return mapper.readValu