Hello, We are building a data pipe line with the following semantics. We need to maintain order till the last unit of work is done in this pipe line .We cannot have a single partition since that looses our ability to scale . Looked at using partitioning keys ,but does that guarantee order in the pipe line as such as opposed to between a topic and consumers?
produces > consumes enriches and produces >consumes ,does work and produces > persistent store Thanks, Chinchu
