Re: Cannot used managed keyed state in sink

2018-02-25 Thread Tzu-Li (Gordon) Tai
Hi, Are you using a `RichSinkFunction`? There you should have access to the runtime context, with which you can use to access keyed state. Cheers, Gordon On 24 February 2018 at 3:04:55 PM, Kien Truong (duckientru...@gmail.com) wrote: Hi, It seems that I can't used managed keyed state inside s

Re: Retrieving name of last external checkpoint directory

2018-02-25 Thread Dawid Wysakowicz
Thx for your suggestions. In the end I’ve integrated altering flink-conf.yaml into job submission, which we do always via some custom ansible scripts. This way each job has its own directory for external checkpoints. Best, Dawid > On 20 Feb 2018, at 17:21, Chesnay Schepler wrote: > > There is

Re: Caused by: java.lang.ClassNotFoundException: org.apache.flink.streaming.connectors.kafka.FlinkKafkaConsumerBase

2018-02-25 Thread Tzu-Li (Gordon) Tai
Hi, Good to see that you have it working! Yes, each of the Kafka version-specific connectors also have a dependency on the base Kafka connector module. Note that it is usually not recommended to put optional dependencies (such as the connectors) under the lib folder. To add additional dependenc

Does Queryable State only support K/V queries not SQL?

2018-02-25 Thread kant kodali
Hi All, 1) Does Queryable State support SQL? By which I mean I can do issue a full-fledged sql query like say ("select * from table where foo='hello' group by name") 2) Does Queryable state support offset and limit? Because if I have a million rows I don't want to get all at once. Sorry if these