Re: printing datastream to the log - instead of stdout

2016-04-14 Thread Christian Kreutzfeldt
Hi Chen I haven't tried the following code out but it should be as easy as: stream.addSink(new SinkFunction() { private final Logger LOG = LogManager.getLogger("loggerName"); public void invoke(String value) throws Exception { Log.info(value); } }); It's JAVA but I think it suffice to geht the b

Re: Monitoring and alerting mechanisms for Flink on YARN

2016-04-14 Thread Christian Kreutzfeldt
code. Best Christian Kreutzfeldt 2016-04-13 4:29 GMT+02:00 Soumya Simanta : > We are about to deploy a Flink job on YARN in production. Given that it is > a long running process we want to have alerting and monitoring mechanisms > in place. > > Any existing solutions or suggestio

Re: Accessing configuration in RichFunction

2016-01-18 Thread Christian Kreutzfeldt
rt >> dedicated information for a dedicated filter instance. >> >> Best >> Christian >> >> >> 2016-01-18 12:30 GMT+01:00 Maximilian Michels : >> >>> Hi Christian, >>> >>> For your implementation, would it suffice to pass a

Re: Accessing configuration in RichFunction

2016-01-18 Thread Christian Kreutzfeldt
ion? Can you confirm this is a bug? > > Cheers, > Max > > On Wed, Jan 13, 2016 at 10:59 AM, Christian Kreutzfeldt > wrote: > > Hi Fabian, > > > > thanks for your quick response. I just figured out that I forgot to > mention > > a small bu

Re: Flink Execution Plan

2016-01-14 Thread Christian Kreutzfeldt
Hi Is there a way to map a JSON representation back to an executable flink job? If there is no such API, what is the best starting point to implement such a feature? Best Christian 2016-01-14 15:18 GMT+01:00 Márton Balassi : > Hey Alex, > > Flink has 3 abstractions having a Graph suffix in pl

Re: Accessing configuration in RichFunction

2016-01-13 Thread Christian Kreutzfeldt
etParameters().setString("myKey", "myVal"); > > Best, Fabian > > > 2016-01-13 10:29 GMT+01:00 Christian Kreutzfeldt : > >> Hi >> >> While working on a RichFilterFunction implementation I was wondering, if >> there is a much better way to ac

Accessing configuration in RichFunction

2016-01-13 Thread Christian Kreutzfeldt
Hi While working on a RichFilterFunction implementation I was wondering, if there is a much better way to access configuration options read from file during startup. Actually, I am using getRuntimeContext().getExecutionConfig().getGlobalJobParameters() to get access to my settings. Reason for tha

Re: Flink, Kappa and Lambda

2015-11-13 Thread Christian Kreutzfeldt
Hi Personally, I find the the concepts of the so-called Kappa architecture intriguing. But I doubt that it is applicable in a generic setup where different use cases are mapped into the architecture. To be fair, I think the same applies to Lambda architectures. Therefore I wouldn't assume that Lam