Ceph configuration for checkpoints?

2018-02-12 Thread Julio Biason
Hello people, I'm looking for the configuration options required to use Ceph as a backend for checkpoints. So far, I can see that `state.backend.fs.checkpointdir` and `state.checkpoints.dir` should be something like `ceph:///my-checkpoint-bucket`. But where do I define server and acess and secret

Re: Optimizing multiple aggregate queries on a CEP using Flink

2018-02-12 Thread Timo Walther
Hi Sahil, I'm not a CEP expert but I will loop in Kostas (in CC). In general, the example that you described can be easily done with a ProcessFunction [1]. A process function not only allows to keep state (like a count) but also allows you to set timers flexibly for specific use cases such tha

Re: Unable to submit job from the web UI in flink 4.0

2018-02-12 Thread Timo Walther
Hi Puneet, in Flink 1.4.0 there was a bug such that error were not printed on the web UI. What happens if you submit the job via the command line? Regards, Timo Am 2/10/18 um 12:51 PM schrieb Puneet Kinra: Hi All I am unable to deposit jobs from frontend, no errors are also getting generat

Re: Share Spring Application context among operators

2018-02-12 Thread Gordon Weakliem
I don't understand your execution model - do you have a Spring app that launches Flink embedded? What container is running the Flink application? On Sun, Feb 11, 2018 at 9:44 PM, Swapnil Dharane wrote: > Hello Gordon, > > Thanks for the reply. > > I do have an alternative to share BasicDataSourc