Hi Team, I have a Flink application reading from Kafka. Each payload is a request sent by a user containing a list of queries. What I would like to do is use Flink to process the queries parallelly and aggregate results and send back to the user.
For example, let's say we have two messages in Kafka message 1: "user1 - [query1, query2, query3]" should return as "user1 - [result1, result2, result3]" message 2: "user2 - [query1, query2, query3, query4]" should return as "user2 - [result1, result2, result3, result4]" My idea is to use flatmap to split each query and keyBy user and then aggregate. But how do I know when aggregation is finished? If I use `countWindow` how to pass in queries length as a variable since it's not constant? Thanks. - Li
