Re: Issues with Kafka-based Exactly Once Processing and taskmanager.numberOfTaskSlots

2024-12-09 Thread Rion Williams
It's probably worth noting that these jobs were originally run with taskmanager.numberOfTaskSlots of 1 before increasing to 2, which may also explain the issue. I thought I'd mention it for context in case it's relevant. On Mon, Dec 9, 2024 at 8:13 AM Rion Williams wrote: > Hi all, > > In trying

Issues with Kafka-based Exactly Once Processing and taskmanager.numberOfTaskSlots

2024-12-09 Thread Rion Williams
Hi all, In trying to optimize the performance of some of the existing Flink jobs that are running in production environments, I've recently done some experimenting with taking advantage of the taskmanager.numberOfTaskSlots configuration for some of my Flink jobs and noticed an issue. It appears w