Re: [DISCUSS] Releasing Flink 1.4.1

2018-01-15 Thread Maciek Próchniak
l On Mon, Jan 15, 2018 at 11:56 AM, Maciek Próchniak wrote: Hi Gordon, do you think I'd be possible to include https://issues.apache.org/jira /browse/FLINK-7949? thanks, maciek On 15/01/2018 11:49, Tzu-Li (Gordon) Tai wrote: Hi all, I would like to bring up the discussion of relea

Re: [DISCUSS] Releasing Flink 1.4.1

2018-01-15 Thread Maciek Próchniak
Hi Gordon, do you think I'd be possible to include https://issues.apache.org/jira/browse/FLINK-7949? thanks, maciek On 15/01/2018 11:49, Tzu-Li (Gordon) Tai wrote: Hi all, I would like to bring up the discussion of releasing Flink 1.4.1. We’ve collected a few issues over the past few weeks,

Re: [DISCUSS] Hold copies in HeapStateBackend

2016-11-21 Thread Maciek Próchniak
Hi, it will come with performance overhead when updating the state, but I think it'll be possible to perform asynchronous snapshots using HeapStateBackend (probably some changes to underlying data structures would be needed) - which would bring more predictable performance. thanks, maciek O

Re: FLIP-6 and running many "small" jobs

2016-11-04 Thread Maciek Próchniak
e pattern once FLIP-6 is ready, which is targeted for Flink 1.3.0. -Max On Thu, Oct 20, 2016 at 10:07 AM, Maciek Próchniak wrote: Hi, we're looking at FLIP-6 and while it looks really great we started to wonder how it fits in our use case. We currently have around 20 processes but th

FLIP-6 and running many "small" jobs

2016-10-20 Thread Maciek Próchniak
Hi, we're looking at FLIP-6 and while it looks really great we started to wonder how it fits in our use case. We currently have around 20 processes but the idea is to have many more of them. Many of them are pretty "small" - them don't large sources, are stateless, mainly filtering data. A

Re: Advice - Drools in Flink

2016-06-23 Thread Maciek Próchniak
eally appreciated. I am familiar with Drools but am new to Flink. Whereas you seem familiar with both - so your feedback is really appreciated. On Thu, Jun 23, 2016 at 8:30 AM, Maciek Próchniak wrote: you mean - keeping working memory facts in Flink state and with each event throw them into stat

Re: Advice - Drools in Flink

2016-06-22 Thread Maciek Próchniak
/2016 21:19, Anton wrote: Thanks Maiek On Wed, Jun 22, 2016 at 9:00 PM, Maciek Próchniak wrote: This is straightforward, it also shouldn't be problematic performance wise OTOH, if you want to use stateful sessions things are getting more complicated - because if you want to play well with

Re: Advice - Drools in Flink

2016-06-22 Thread Maciek Próchniak
Hi, I've been using drools in a few projects. Embedding Drools in Flink is certainly possible, however there are a few points you have to consider. - are you going to use Drools in stateful or stateless way? The blog post you mention uses flink in stateless way - that is, each event is process