Subject: Re: DeltaIterations: shrink solution set
UDFs exist intentionally across iterations, it is a feature, to allow you to
keep state. To Figure out when an iteration starts and ends, you can use a
RichFunctions, which get calls to open() and close() for each iteration.
On Wed, Feb 11, 2015 at 10
ss?
>
>
>
> @Stefan: Are operators intentionally reused across iterations, i.e., is it
> an explicit feature or is it likely to change in the future?
>
>
>
> Cheers,
>
> Sebastian
>
>
>
> *From:* ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] *On Beh
nge in the future?
Cheers,
Sebastian
From: ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] On Behalf Of Stephan
Ewen
Sent: Mittwoch, 11. Februar 2015 10:02
To: user@flink.apache.org
Subject: Re: DeltaIterations: shrink solution set
You can also use a bulk iteration and just keep the stat
You can also use a bulk iteration and just keep the state yourself. Since
the functions love across iterations, it is easily doable to just gather
the state in a HashMap yourself. Use map(), or mapPartition(), a manual
partition() call - that should do the trick...
Am 10.02.2015 21:44 schrieb "Alex
True.
2015-02-10 19:14 GMT+01:00 Vasiliki Kalavri :
> Hi,
>
> It's hard to tell without details about your algorithm, but what you're
> describing sounds to me like something you can use the workset for.
>
> -V.
> On Feb 10, 2015 6:54 PM, "Alexander Alexandrov" <
> alexander.s.alexand...@gmail.co
Hi,
It's hard to tell without details about your algorithm, but what you're
describing sounds to me like something you can use the workset for.
-V.
On Feb 10, 2015 6:54 PM, "Alexander Alexandrov" <
alexander.s.alexand...@gmail.com> wrote:
> I am not sure whether this is supported at the moment.
I am not sure whether this is supported at the moment. The only workaround
I could think of is indeed to use a boolean flag that indicates whether the
element has been deleted or not.
An alternative approach is to ditch Flink's native iteration construct and
write your intermediate results to Tach
Hi everyone,
>From playing around a bit around with delta iterations, I saw that you can
>update elements from the solution set and add new elements. My question is: is
>it possible to remove elements from the solution set (apart from marking them
>as "deleted" somehow)?
My use case at hand fo
