Re: Accessing StateBackend snapshots outside of Flink

thanks a lot for the info, seems not too complex I'll try to write simple tool to read this state. Aljoscha, does the key reflects unique id of operator in some way? Or key is just a "name" that passed to ValueStateDescriptor. thanks in advance On 15 April 2016 at 15:10, Stephan Ewen wrote: >

[no subject]

Hello, I'm new to flink so this might seem a basic question. I added flink to an existing project using maven and can run the program locally with StreamExecutionEnvironment with no problems, however i want to know how can I submit jobs for that project and be able to view these jobs from flink's w

Flink support for Scala

Hi, Just downloaded Flink and coming from Spark and Hive background. My interest for Flink is its support for Complex Event Processing (CEP) libraries. Couple of questions if I may 1) is there a quick start guide for Splink (I am not referring to a simple example that comes with quick start gui

Re: Flink support for Scala

Hi, I just found out it does Scala-Flink> thanks Dr Mich Talebzadeh LinkedIn * https://www.linkedin.com/profile/view?id=AAEWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw * http://talebzadehmich.wordpress.com On 16

jar dependency in the cluster

Hi, Could anyone help me with the following problem: I have a flink cluster of a couple of nodes (i am using the old version 0.10). I am packaging a jar that needs to use kafka connector. When I create the jar in eclipse I am adding the flink connector dependency and set to be packed with the j

throttled stream

is there a way to consume a kafka stream using flink with a predefined rate limit (eg 5 events per second) we need this because we need to control some 3rd party api rate limitations so, even if we have a much larger throughput potential, we must control the consumption rate in order not to over

Re: throttled stream

Simple idea: create a map function that only does "sleep 1/5 second" and put that in your pipeline somewhere. Niels On 16 Apr 2016 22:38, "Chen Bekor" wrote: > is there a way to consume a kafka stream using flink with a predefined > rate limit (eg 5 events per second) > > we need this because w

Re: throttled stream

There is a utility in flink-streaming-examples that might be useful, but is generally the same idea that Niels suggests. [1] [1] https://github.com/apache/flink/blob/master/flink-examples/flink-examples-streaming/src/main/java/org/apache/flink/streaming/examples/utils/ThrottledIterator.java On Su