t; >> >> and a URL. This method of failing fast is the way that I
> >> discovered
> >> >> that I needed to increase transfer threads from the default.
> >> >>
> >>
t; <mailto:myas...@live.com <mailto:myas...@live.com>
<mailto:myas...@live.com <mailto:myas...@live.com>>>> wrote:
>> >
>> > Hi Jeff
>> >
>> > 1. "after around 50G
1. What's your checkpoint interval?
> > >> > 2. How frequently are you updating the state into RocksDB?
> > >> > 3. How many task managers are you using?
> > >> > 4. How much data each task manager handles while taking
&g
.com>>
>> > <mailto:myas...@live.com <mailto:myas...@live.com>
<mailto:myas...@live.com <mailto:myas...@live.com>>>> wrote:
>> >
>> > Hi Jeff
>> >
>> > 1. "after
;
> >> >
> >> >
> >> >
> >> >
> >> > On Thu, Jun 18, 2020 at 5:12 PM Timothy Victor <
> vict...@gmail.com
> >> <mailto:vict...@gmail.com>
> >> > <mailto:vict...@gmail
k
task-manager
> logs and GC logs.
>
> Best
> Yun Tang
>
----
> *From:* Jeff Henrikson mailto:jehenri...@gmail.com>
>
task-manager
> logs and GC logs.
>
> Best
> Yun Tang
>
> *From:* Jeff Henrikson mailto:jehenri...@gmail.com>
> <
gt; > and the later one is mainly due to some internal error.
> > 2. Have you checked what reason the remote task manager is lost?
> > If the remote task manager is not crashed, it might be due
> > to GC impact, I think you might need to check ta
logs and GC logs.
Best
Yun Tang
*From:* Jeff Henrikson mailto:jehenri...@gmail.com>>
*Sent:* Thursday, June 18, 2020 1:46
*To:* user mailto:user@flink.apache.org>>
*Subject:* Trouble with large state
Hello Fli
:* Thursday, June 18, 2020 1:46
*To:* user
*Subject:* Trouble with large state
Hello Flink users,
I have an application of around 10 enrichment joins. All events are
read from kafka and have event timestamps. The joins are built using
.cogroup, with a global window, triggering on every 1 event, p
t be due to GC
>>impact, I think you might need to check task-manager logs and GC logs.
>>
>> Best
>> Yun Tang
>> ------
>> *From:* Jeff Henrikson
>> *Sent:* Thursday, June 18, 2020 1:46
>> *To:* user
>> *Subject:* Trouble with larg
t reason the remote task manager is lost?
>If the remote task manager is not crashed, it might be due to GC
>impact, I think you might need to check task-manager logs and GC logs.
>
> Best
> Yun Tang
> --
> *From:* Jeff Henrikson
> *Sent:* Thur
_
From: Jeff Henrikson
Sent: Thursday, June 18, 2020 1:46
To: user
Subject: Trouble with large state
Hello Flink users,
I have an application of around 10 enrichment joins. All events are
read from kafka and have event timestamps. The joins are built using
.cogroup, with a global window, tri
Hello Flink users,
I have an application of around 10 enrichment joins. All events are
read from kafka and have event timestamps. The joins are built using
.cogroup, with a global window, triggering on every 1 event, plus a
custom evictor that drops records once a newer record for the same I
14 matches
Mail list logo
