Unsubscribe

2022-01-13 Thread Jerome Li
Unsubscribe

Best Practice of Using HashSet State

2021-08-05 Thread Jerome Li
Hi, I am new to Flink and state backend. I find Flink does provide ValueState, ListState, and MapState. But it does not provide State object for HashSet. What is the best practice of storing HashSet State in Flink? Should we use ValueState and set the value to be HashSet? Or should we use ListS

Re: Kafka Consumer stop consuming data

2021-07-13 Thread Jerome Li
has data consistently coming in. Best wish, Jerome From: Aeden Jameson Date: Tuesday, July 13, 2021 at 3:22 PM To: Jerome Li Cc: user@flink.apache.org Subject: Re: Kafka Consumer stop consuming data This can happen if you have an idle partition. Are all partitions receiving data consistently? On

Kafka Consumer stop consuming data

2021-07-13 Thread Jerome Li
Hi, I got question about Flink Kafka consumer. I am facing the issue that the Kafka consumer somehow stop consuming data from Kafka after start for few minutes or after few hours. While stopping, I checked the backpressure and cpu and memory consumption. It all looks like not data consuming ins

Re: Jobmanager Crashes with Kubernetes HA When Restart Kubernetes Master Node

2021-07-12 Thread Jerome Li
Mountable secrets: flinkapp-token-mpbd5 Tokens: flinkapp-token-mpbd5 Events: Not sure if I am missing any configuration…. Any help would be appreciated! Best, Jerome From: Yang Wang Date: Wednesday, May 26, 2021 at 11:25 PM To: Jerome Li Cc: user@flink.apache.org S

Re: Flink Resource Management

2021-06-22 Thread Jerome Li
usage went down when there were not data coming in. When the data flow resume, cpu and memory usage would goes high again. Best, From: Chesnay Schepler Date: Tuesday, June 22, 2021 at 12:57 PM To: Jerome Li , user@flink.apache.org Subject: Re: Flink Resource Management No; Flink does not

Flink Resource Management

2021-06-22 Thread Jerome Li
Hi and Dear Flink users, I am new to Flink. My project is using Flink v1.12.4+. I am curious about how Flink manage the cpu and memory when an instance of a ProcessFunction/Sink is idle? Will Flink resource manager take deallocate cpu and memory from it? Because I am trying to expand the parall

Re: Jobmanager Crashes with Kubernetes HA When Restart Kubernetes Master Node

2021-05-26 Thread Jerome Li
behaviors? Or is it a bug? Or if I am missing something? Best, Jerome From: Yang Wang Date: Tuesday, May 25, 2021 at 1:03 AM To: Jerome Li Cc: user@flink.apache.org Subject: Re: Jobmanager Crashes with Kubernetes HA When Restart Kubernetes Master Node By "restart master node", do y

Jobmanager Crashes with Kubernetes HA When Restart Kubernetes Master Node

2021-05-24 Thread Jerome Li
Hi, I am running Flink v1.12.2 in Standalone mode on Kubernetes. I set Kubernetes native as HA. The HA works well when either jobmanager or taskmanager pod lost or crashes. But, when I restart master node, jobmanager pod will always crash and restart. This results in the entire Flink cluster r