Re: changing serializer affects resuming from checkpoint

2023-06-11 Thread Hangxiang Yu
Hi, Peng. Maybe you could check your same codes in your different jars, shared configurations between two jobs (due to your session mode). If these are all separate, the consumer should not affect the producer from my experience. On Sun, Jun 11, 2023 at 10:01 AM Peng Peng wrote: > Hi Hangxiang,

Re: changing serializer affects resuming from checkpoint

2023-06-10 Thread Peng Peng
Hi Hangxiang, Thanks for your reply. I don't think these 2 jobs have any dependencies, they are packaged in different jars, although they run on the same cluster in session mode. The producer job does some filtering and sends it to kafka using customized serialization logic for serializing key and

Re: changing serializer affects resuming from checkpoint

2023-06-06 Thread Hangxiang Yu
HI, Peng. Do these two jobs have any dependency? Or Could you please share the specific logic of the two jobs if convenient ? Could you also share the failure message of the producer job ? In my opinion, if the two tasks have no other association, as you said, the consumer job will fail due to unsu

changing serializer affects resuming from checkpoint

2023-06-05 Thread Peng Peng
Hi, I have 2 flink jobs, of which one produces records to kafka using kryo serializer and the other consumes records from kafka and deserializes with kryo. It has been working fine. Then I stopped both jobs with checkpoints and changed the consumer job to disable generic type and kryo to use avro