Thanks Richard for proposing this feature! We also have encountered some similar feature request that we want to define a generic async processing API<https://issues.apache.org/jira/browse/KAFKA-7566>.
However I guess the motivation here is that we should skip big records during normal processing, or let a separate task handle those records who takes P99 processing time. Since my feeling is that if some edge cases happen, could we just skip the bad record and continue processing next record? Also I want to understand what kind of ordering guarantee we are gonna provide with this new API, or there is no ordering guarantee at all? Could we discuss any potential issues if consumer needs to process out-of-order messages? Best, Boyang ________________________________ From: Richard Yu <yohan.richard...@gmail.com> Sent: Saturday, December 22, 2018 2:00 AM To: dev@kafka.apache.org Subject: KIP-408: Add Asynchronous Processing to Kafka Streams Hi all, Lately, there has been considerable interest in adding asynchronous processing to Kafka Streams. Here is the KIP for such an addition: https://cwiki.apache.org/confluence/display/KAFKA/KIP-408%3A+Add+Asynchronous+Processing+To+Kafka+Streams I wish to discuss the best ways to approach this problem. Thanks, Richard Yu
