Re: changing serializer affects resuming from checkpoint

2023-06-10 Thread Peng Peng
Hi Hangxiang, Thanks for your reply. I don't think these 2 jobs have any dependencies, they are packaged in different jars, although they run on the same cluster in session mode. The producer job does some filtering and sends it to kafka using customized serialization logic for serializing key and

Why does ClosureCleaner ignore checkSerialization=false on recursion?

2023-06-10 Thread DONOUGHE Logan via user
Hi Everyone, Why does every recursive ClosureCleaner.clean call check if the associated object is serializable? While investigating some issues getting a test with ProcessFunctionTestHarnesses.forKeyedProcessFunction working, I noticed that initially ClosureCleaner.clean is called with checkSe

Re: Flink source error handling

2023-06-10 Thread Anirban Dutta Gupta
Hello, Thanks for the guidance. We will surely think of moving to a newer version of Flink. Just a few followup questions when using KafkaSource..(sorry if I am being naive in my questions) 1. How does KafkaSource handle disruptions with the Kafka broker ? Will it keep on trying to connect a