Re: kinesis producer setCustomPartitioner use stream's own data

2017-03-02 Thread Sathi Chowdhury
Thanks Gordon, It was simple to resolve. Best, Sathi From: "Tzu-Li (Gordon) Tai" Reply-To: "user@flink.apache.org" Date: Monday, February 20, 2017 at 11:46 PM To: "user@flink.apache.org" Subject: Re: kinesis producer setCustomPartitioner use stream's own d

Re: kinesis producer setCustomPartitioner use stream's own data

2017-02-20 Thread Tzu-Li (Gordon) Tai
Hi Sathi, The `getPartitionId` method is invoked with each record from the stream. In there, you can extract values / fields from the record, and use that to determine the target partition id. Is this what you had in mind? Cheers, Gordon On February 21, 2017 at 11:54:21 AM, Sathi Chowdhury (

kinesis producer setCustomPartitioner use stream's own data

2017-02-20 Thread Sathi Chowdhury
Hi flink users and experts, In my flink processor I am trying to use Flink Kinesis connector . I read from a kinesis stream , and After the transformation (for which I use RichCoFlatMapFunction), json event needs to sink to a kinesis stream k1. DataStream myStream = see.addSource(new FlinkKine