Subject: Re: DeltaIterations: shrink solution set
UDFs exist intentionally across iterations, it is a feature, to allow you to
keep state. To Figure out when an iteration starts and ends, you can use a
RichFunctions, which get calls to open() and close() for each iteration.
On Wed, Feb 11, 2015 at 10
ss?
>
>
>
> @Stefan: Are operators intentionally reused across iterations, i.e., is it
> an explicit feature or is it likely to change in the future?
>
>
>
> Cheers,
>
> Sebastian
>
>
>
> *From:* ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] *On Beh
nge in the future?
Cheers,
Sebastian
From: ewenstep...@gmail.com [mailto:ewenstep...@gmail.com] On Behalf Of Stephan
Ewen
Sent: Mittwoch, 11. Februar 2015 10:02
To: user@flink.apache.org
Subject: Re: DeltaIterations: shrink solution set
You can also use a bulk iteration and just keep the stat
You can also use a bulk iteration and just keep the state yourself. Since
the functions love across iterations, it is easily doable to just gather
the state in a HashMap yourself. Use map(), or mapPartition(), a manual
partition() call - that should do the trick...
Am 10.02.2015 21:44 schrieb "Alex
True.
2015-02-10 19:14 GMT+01:00 Vasiliki Kalavri :
> Hi,
>
> It's hard to tell without details about your algorithm, but what you're
> describing sounds to me like something you can use the workset for.
>
> -V.
> On Feb 10, 2015 6:54 PM, "Alexander Alexandrov" <
> alexander.s.alexand...@gmail.co
Hi,
It's hard to tell without details about your algorithm, but what you're
describing sounds to me like something you can use the workset for.
-V.
On Feb 10, 2015 6:54 PM, "Alexander Alexandrov" <
alexander.s.alexand...@gmail.com> wrote:
> I am not sure whether this is supported at the moment.
I am not sure whether this is supported at the moment. The only workaround
I could think of is indeed to use a boolean flag that indicates whether the
element has been deleted or not.
An alternative approach is to ditch Flink's native iteration construct and
write your intermediate results to Tach
