Guozhang Wang created KAFKA-3478:
------------------------------------

             Summary: Finer Stream Flow Control
                 Key: KAFKA-3478
                 URL: https://issues.apache.org/jira/browse/KAFKA-3478
             Project: Kafka
          Issue Type: Sub-task
            Reporter: Guozhang Wang
             Fix For: 0.10.1.0


Today we have a event-time based flow control mechanism in order to synchronize 
multiple input streams in a best effort manner:

http://docs.confluent.io/2.1.0-alpha1/streams/architecture.html#flow-control-with-timestamps

However, there are some use cases where users would like to have finer control 
of the input streams, for example, with two input streams, one of them always 
reading from offset 0 upon (re)-starting, and the other reading for log end 
offset.

Today we only have one consumer config "offset.auto.reset" to control that 
behavior, which means all streams are read either from "earliest" or "latest".

We should consider how to improve this settings to allow users have finer 
control over these frameworks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to