Kafka Streams - one topic moves faster the other one

2021-12-29 Thread Miguel González
Hi team So I ran into a complicated issue, something which I believe Kafka Streams is not prepared for. Basically my app is reading from two topics and joining them. But when testing the in my staging environment I found, one topic moves faster than the other one basically pushing stream time fo

Re: Kafka Streams - one topic moves faster the other one

2021-12-29 Thread Luke Chen
Hi Miguel, Yes, the grace period is the solution to fix the problem. Alternatively, you can try to set a higher value for "max.task.idle.ms" configuration, because this is some kind of out-of-order data. Let's say, A topic has 1 record per second (fast), B topic has 1 record per minute (slow). Yo