Hi devs,
I'd like to start a discussion about FLIP-409: DataStream V2 Building Blocks: DataStream, Partitioning and ProcessFunction [1]. As the first sub-FLIP for DataStream API V2, we'd like to discuss and try to answer some of the most fundamental questions in stream processing: 1. What kinds of data streams do we have? 2. How to partition data over the streams? 3. How to define a processing on the data stream? The answer to these questions involve three core concepts: DataStream, Partitioning and ProcessFunction. In this FLIP, we will discuss the definitions and related API primitives of these concepts in detail. You can find more details in FLIP-409 [1]. This sub-FLIP is at the heart of the entire DataStream API V2, and its relationship with other sub-FLIPs can be found in the umbrella FLIP [2]. Looking forward to hearing from you, thanks! Best regards, Weijie [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-409%3A+DataStream+V2+Building+Blocks%3A+DataStream%2C+Partitioning+and+ProcessFunction [2] https://cwiki.apache.org/confluence/display/FLINK/FLIP-408%3A+%5BUmbrella%5D+Introduce+DataStream+API+V2