Re: Flink task node shut it self off.

2020-01-15 Thread John Smith
]. Sender[null] sent message >>>> of type "akka.actor.Identify".. >>>> >>>> This reads like the machine lost network connectivity for some reason. >>>> The tasks start failing because kafka cannot be reached, and the TM then >>>

Re: Flink task node shut it self off.

2020-01-06 Thread John Smith
r reach the ResourceManager. >>> >>> On 25/12/2019 04:34, Zhijiang wrote: >>> >>> If you use rocksDB state backend, it might consume extra native memory. >>> Some resource framework cluster like yarn would kill the container if >>> the memory usa

Re: Flink task node shut it self off.

2020-01-04 Thread John Smith
Zhijiang wrote: >> >> If you use rocksDB state backend, it might consume extra native memory. >> Some resource framework cluster like yarn would kill the container if the >> memory usage exceeds some threshold. You can also double check whether it >> exists in your case. >> >>

Re: Flink task node shut it self off.

2020-01-03 Thread John Smith
ld kill the container if the > memory usage exceeds some threshold. You can also double check whether it > exists in your case. > > -------------- > From:John Smith > Send Time:2019 Dec. 25 (Wed.) 03:40 > To:Zhijiang > Cc:user > Subject:Re: Flink task node shut it

Re: Flink task node shut it self off.

2020-01-03 Thread Chesnay Schepler
shold. You can also double check whether it exists in your case. -- From:John Smith Send Time:2019 Dec. 25 (Wed.) 03:40 To:Zhijiang Cc:user Subject:Re: Flink task node shut it self off. The shutdown happ

Re: Flink task node shut it self off.

2019-12-24 Thread Zhijiang
. -- From:John Smith Send Time:2019 Dec. 25 (Wed.) 03:40 To:Zhijiang Cc:user Subject:Re: Flink task node shut it self off. The shutdown happened after the massive IO wait. I don't use any state Checkpoints are disk based... On Mon., Dec. 23, 2019, 1:42 a.m. Zhijiang, wrote: Hi

Re: Flink task node shut it self off.

2019-12-24 Thread John Smith
The shutdown happened after the massive IO wait. I don't use any state Checkpoints are disk based... On Mon., Dec. 23, 2019, 1:42 a.m. Zhijiang, wrote: > Hi John, > > Thanks for the positive comments of Flink usage. No matter at least-once > or exactly-once you used for checkpoint, it would neve

Re: Flink task node shut it self off.

2019-12-22 Thread Zhijiang
Hi John, Thanks for the positive comments of Flink usage. No matter at least-once or exactly-once you used for checkpoint, it would never lose one message during failure recovery. Unfortunatelly I can not visit the logs you posted. Generally speaking the longer internal checkpoint would mean r

Re: Flink task node shut it self off.

2019-12-20 Thread jingjing bai
hi john in our experience , the checkpoint interval we set interval 1-10 minute and timeout usurally 5*interval . mostly we set 2 or 5 minute and 10 or 20timeout. it depend on u data bulk per second and which window used. John Smith 于2019年12月21日周六 上午5:26写道： > Hi, using Flink 1.8.0 > > 1st off

Flink task node shut it self off.

2019-12-20 Thread John Smith
Hi, using Flink 1.8.0 1st off I must say Flink resiliency is very impressive, we lost a node and never lost one message by using checkpoints and Kafka. Thanks! The cluster is a self hosted cluster and we use our own zookeeper cluster. We have... 3 zookeepers: 4 cpu, 8GB (each) 3 job nodes: 4 cpu,