Re: Flink 1.3 -- get data from Cassandra as generic ResultSet and convert it to DataSet

2017-12-26 Thread Ufuk Celebi
Hey Gregory, 1) There is no special support for ResultSet in Flink, so you have to manually parse it and emit records of the type you want. 2) In your asyncInvoke you don't need to submit to the executorService since the client is already async and returns a future. You can use the code in run()

Re: Need to restart flink job on yarn as supervisord does

2017-12-26 Thread Ufuk Celebi
Hey Shivam, check this out: https://ci.apache.org/projects/flink/flink-docs-release-1.4/dev/restart_strategies.html Does it answer your questions? – Ufuk On Tue, Dec 26, 2017 at 9:30 AM, Shivam Sharma <28shivamsha...@gmail.com> wrote: > I am submitting my Flink Job on Yarn(Amazon EMR) > > On Tu

[jira] [Created] (FLINK-8322) support getting existing timers from TimerService

2017-12-26 Thread Bowen Li (JIRA)
Bowen Li created FLINK-8322: --- Summary: support getting existing timers from TimerService Key: FLINK-8322 URL: https://issues.apache.org/jira/browse/FLINK-8322 Project: Flink Issue Type: Improvement

Re: CEP: Dynamic Patterns

2017-12-26 Thread Shivam Sharma
Hi Rafi, Even I also wanted this facility from Flink Core. But I think this is already solved by Uber on Flink. https://eng.uber.com/athenax/ Best On Tue, Dec 26, 2017 at 6:21 PM, Rafi Aroch wrote: > Hi, > > I'm Rafi, Data Architect at WalkMe. > > Our Mobile platform generates events coming f

[jira] [Created] (FLINK-8321) Generate _SUCCESS (map-reduce style) when folder has been written!

2017-12-26 Thread yanxiaobin (JIRA)
yanxiaobin created FLINK-8321: - Summary: Generate _SUCCESS (map-reduce style) when folder has been written! Key: FLINK-8321 URL: https://issues.apache.org/jira/browse/FLINK-8321 Project: Flink I

CEP: Dynamic Patterns

2017-12-26 Thread Rafi Aroch
Hi, I'm Rafi, Data Architect at WalkMe. Our Mobile platform generates events coming from the end-users mobile device for different actions that the user does. The use case I wanted to implement using Flink CEP is as follows: We would like to expose a UI where we could define a set of rules. Rul

[jira] [Created] (FLINK-8320) Flink cluster does not work on Java 9

2017-12-26 Thread Steve Layland (JIRA)
Steve Layland created FLINK-8320: Summary: Flink cluster does not work on Java 9 Key: FLINK-8320 URL: https://issues.apache.org/jira/browse/FLINK-8320 Project: Flink Issue Type: Bug Affec

[jira] [Created] (FLINK-8319) Savepoint restore failing in CEP

2017-12-26 Thread Shashank Agarwal (JIRA)
Shashank Agarwal created FLINK-8319: --- Summary: Savepoint restore failing in CEP Key: FLINK-8319 URL: https://issues.apache.org/jira/browse/FLINK-8319 Project: Flink Issue Type: Bug

Re: Need to restart flink job on yarn as supervisord does

2017-12-26 Thread Shivam Sharma
​I am submitting my Flink Job on Yarn(Amazon EMR)​ On Tue, Dec 26, 2017 at 1:59 PM, Shivam Sharma <28shivamsha...@gmail.com> wrote: > Hi, > > My Flink job fails due to external activity like when Kafka goes down. I > want to restart my Flink job after certain time interval. > > *I need to know be

Need to restart flink job on yarn as supervisord does

2017-12-26 Thread Shivam Sharma
Hi, My Flink job fails due to external activity like when Kafka goes down. I want to restart my Flink job after certain time interval. *I need to know best practices in this. How to restart Flink job automatically.* Thanks -- Shivam Sharma Data Engineer @ Goibibo Indian Institute Of Informatio