ckpoint UI ? For example,
>> the
>> attached operator has a `alreadyOutputed` value state, which seems to keep
>> increasing if there are always new keys ?
>>
>> Best,
>> Yun
>>
>>
>> --Original Mail --
>> *Sender:*Dan Hill
>&
ted` value state, which seems
> to keep
> increasing if there are always new keys ?
>
> Best,
> Yun
>
>
> --Original Mail --
> *Sender:*Dan Hill <mailto:quietgol...@gmail.com>>
> *Send Date:*Tue Ma
ttached operator has a `alreadyOutputed` value state, which seems to keep
> increasing if there are always new keys ?
>
> Best,
> Yun
>
>
> --Original Mail --
> *Sender:*Dan Hill
> *Send Date:*Tue Mar 9 00:59:24 2021
> *Recipient
Hi Dan,
Regarding the original checkpoint size problem, could you also have a check
which tasks' state are increasing from the checkpoint UI ? For example, the
attached operator has a `alreadyOutputed` value state, which seems to keep
increasing if there are always new keys ?
Best,
Yun
Hi Yun!
Thanks for the quick reply.
One of the lowerBounds is large but the table being joined with is ~500
rows. I also have my own operator that only outputs the first value.
public class OnlyFirstUser extends
RichFlatMapFunction {
private transient ValueState alreadyOutputted;
@O
Hi Dan,
Have you use a too large upperBound or lowerBound?
If not, could you also check the watermark strategy ?
The interval join operator depends on the event-time
timer for cleanup, and the event-time timer would be
triggered via watermark.
Best,
Yun
--Original Mail -
