Accessing external DB inside RichFlatMap Function

Hi guys Is there a easy way to handle external DB connections inside a RichFlatMap Function? --Thanks Simon

Re: No key found restore States

Hi In other words, what's the easiest way to clean up states in flink, if this key may never arrive again? --Thanks Simon > On 02 Jun 2016, at 10:16, simon peyer wrote: > > Hi Max > > Thanks for your answer. > We have some states, on some keys, which we would

Re: No key found restore States

> Max > > On Wed, Jun 1, 2016 at 4:00 PM, simon peyer wrote: >> Hi Max >> >> I'm using a keyby but would like to store the state. >> >> Thus what's the way to go? >> >> How do I have to handle the state in option 2). >> >&

Re: No key found restore States

> > > I think you want to use one of the two. Although it is possible to use > both, it looks like you're confusing the two in your example. > > Cheers, > Max > > On Wed, Jun 1, 2016 at 3:06 PM, simon peyer wrote: >> Hi together >> >> I did imp

No key found restore States

Hi together I did implement a little pipeline, which has some statefull computation: Conntaing a function which extends RichFlatMapFunction and Checkpointed. The state is stored in the field: private var state_item: ValueState[Option[Pathsection]] = null override def open(conf: Configurat

Flink Kafka from Time Offset

Hi together I'm using flink 1.0.1 and a FlinkKafkaConsumer09. I'm very interested in getting data from a specific Time offset in Kafka. Is there a property which can do this? Or is there another way of handling such issues? I'm also using checkpointing. If I deploy a new pipeline with the same i

Re: Import Configuration File in Flink Cluster

WA 98101, USA > 47° 36' 41" N. 122° 19' 57" W > HERE Maps > > > > > > > > > > > > On 5/23/16, 8:54 AM, "simon peyer" wrote: > >> Hi Max >> >> Thanks a lot for your helpful answer. >> It now works on the cluster. >>

Re: Logging with slf4j

roblem?On Wed, May 25, 2016 at 3:58 PM, simon peyer <simon.pe...@soom-it.ch> wrote:Hi guysTrying to log stuff, I used the print/println function which works quite well.But now I would like to use the slf4j logger.For each class/object in scala I intiliaized a logger like this: var log: Logge

Logging with slf4j

Hi guys Trying to log stuff, I used the print/println function which works quite well. But now I would like to use the slf4j logger. For each class/object in scala I intiliaized a logger like this: var log: Logger = LoggerFactory.getLogger(getClass) then I did some logging log.error("Error")

Re: Import Configuration File in Flink Cluster

a method to the > ParameterTool which loads from a resource to make it more convenient. > > Cheers, > Max > > On Mon, May 23, 2016 at 4:42 PM, simon peyer wrote: >> Hi >> >> @Max >> So for each file in the src/main/resources folder, I first have to create a >

Re: Import Configuration File in Flink Cluster

onfigOnDisk); Cheers, Max > > On Mon, May 23, 2016 at 3:56 PM, simon peyer <mailto:simon.pe...@soom-it.ch>> wrote: > Hi together > > Currently I'm using flink on a docker cluster on AWS. > I would like to use property files with the integrated > Param

Import Configuration File in Flink Cluster

Hi together Currently I'm using flink on a docker cluster on AWS. I would like to use property files with the integrated ParameterTool.fromPropertiesFile function of Flink. Locally this version works absolutely fine: val configuration = ParameterTool.fromPropertiesFile("src/main/resources/confi

Re: [RichFlattMapfunction] Configuration File

open(conf: Configuration) signature is legacy from how >> Functions used to work quite a while back. In the streaming API this >> Configuration is always empty. If you want to configure your user function >> you can have the values as fields in your class and pass them in the >&g

Re: [RichFlattMapfunction] Configuration File

n(conf: Configuration) signature is legacy from how > Functions used to work quite a while back. In the streaming API this > Configuration is always empty. If you want to configure your user function > you can have the values as fields in your class and pass them in the > constructor.

[RichFlattMapfunction] Configuration File

Hi folks I'm extending a RichFlatMapFunction in order to use states on a keyed stream. Concerning this i have two questions: 1. I have a var state_item: ValueState[Option[String]] as a local variable in this class. Initialized with state_item = getRuntimeContext.getState(new ValueStateDescript

Re: Flink Version 1.1

t; <mailto:se...@apache.org>> wrote: >> >> Hi! >> >> That question is coming up more and more. >> I think we should start the public discussion about the 1.1 release >> planning, scope, and release manager in the next days. >> >> Stephan

Re: Flink Version 1.1

ne. I am not aware of the 1.1.0 schedule yet, but it is about time to start > the discussion on that. > > Are you looking for a specific feature that 1.1.0 would bring to the table? > > Best, > > Marton > > On Wed, May 18, 2016 at 1:28 PM, simon peyer <mailto:simon.pe...

Flink Version 1.1

Hi guys When are you expecting to release a stable version of flink 1.1? --Cheers Simon