Thanks Gyula.
Yes, I am using state only in RichFlatMapFunction. Will try to evaluate
generating events for removal of state.
Regards,
Sowmya
On Mon, Apr 25, 2016 at 5:44 PM, Gyula Fóra wrote:
> Hi,
>
> The removal markers are just something I made up :) What I meant is that
> you can generate
Hi,
The removal markers are just something I made up :) What I meant is that
you can generate events in a custom source for instance that will trigger
the removal of the state. This might be easy or hard to do depending on
your use-case.
What do you mean by custom state maintenance? As long as yo
Hi Gyula,
Thank you so much.
1. Can you point me to any documentation on removal markers?
2. My understanding is this implementation of custom state maintenance does
not impact scalabiity. Is that right?
Thanks,
Sowmya
On Mon, Apr 25, 2016 at 3:06 PM, Gyula Fóra wrote:
> Hi,
>
> (a) I think y
Hi,
(a) I think your understanding is correct, one consideration might be that
if you are always sending the state to the sink, it might make sense to
build it there directly using a RichSinkFunction.
(b) There is no built-in support for this at the moment. What you can do
yourself is to generate
