Re: access to key in sink

2017-01-09 Thread Jark Wu
Hi Telco, What do you mean about the “keyBy value” ? Is it the string parameter value, i.e. “partition” in your case , or the real key value of an actual element being processed ? If you mean the string parameter value, it seems that currently it doesn’t support. If you mean the latter one,

Re: access to key in sink

2017-01-09 Thread Aljoscha Krettek
Hi, it's not possible to access the key in the open method because without an element that is being processed there is no key. The user function is being used to produce elements of different keys that are being processed on the same shard (instance of a parallel operator). You can get the key manu

access to key in sink

2016-12-24 Thread Telco Phone
I am trying to access the keyBy value in the "open" method in a RichSink Is there a way to access the actual keyBy value in the RichSink ? DataStream stream = env.addSource(new FlinkKafkaConsumer08<>("test", schema, properties) ).setParallelism(1).keyBy("partition");