Re: [DISCUSS] FLIP-8: Rescalable Non-Partitioned State

2016-08-13 Thread Gyula Fóra
Hi, Yes I think it makes sense. :) Gyula On Fri, Aug 12, 2016, 17:02 Ufuk Celebi wrote: > I will update the design doc with more details for the Checkpointed > variants and remove Option 2 (I think that's an orthogonal thing). > > The way I see it now, we should have base CheckpointedBase inter

Re: expose side output stream

2016-08-13 Thread Chen Qin
Stephan & Aljoscha, What I did was a API hack without much thoughts into architect at beginning :-) patch attached, I think it would be "tricky" to achieve backward compatibility with current architect. We might need to encapsulate "Collectors" to ProcessContext as starting point. I would try to

[jira] [Created] (FLINK-4392) Make RPC Service Thread Safe

2016-08-13 Thread Stephan Ewen (JIRA)
Stephan Ewen created FLINK-4392: --- Summary: Make RPC Service Thread Safe Key: FLINK-4392 URL: https://issues.apache.org/jira/browse/FLINK-4392 Project: Flink Issue Type: Sub-task Compo

Some thoughts about the lower-level Flink APIs

2016-08-13 Thread Jamie Grier
Hey all, I've noticed a few times now when trying to help users implement particular things in the Flink API that it can be complicated to map what they know they are trying to do onto higher-level Flink concepts such as windowing or Connect/CoFlatMap/ValueState, etc. At some point it just become

[jira] [Created] (FLINK-4391) Provide support for asynchronous operations over streams

2016-08-13 Thread Jamie Grier (JIRA)
Jamie Grier created FLINK-4391: -- Summary: Provide support for asynchronous operations over streams Key: FLINK-4391 URL: https://issues.apache.org/jira/browse/FLINK-4391 Project: Flink Issue Type