Ewen Cheslack-Postava created KAFKA-2483:
--------------------------------------------

             Summary: Add support for batch/scheduled Copycat connectors
                 Key: KAFKA-2483
                 URL: https://issues.apache.org/jira/browse/KAFKA-2483
             Project: Kafka
          Issue Type: Sub-task
          Components: copycat
            Reporter: Ewen Cheslack-Postava
            Assignee: Ewen Cheslack-Postava


A few connectors may not perform well if run continuously; for example, HDFS 
may not handle a task holding a file open for very long periods of time well.

These connectors will work better if they can schedule themselves to be 
executed periodically. Note that this cannot currently be implemented by the 
connector itself because in sink connectors get data delivered to them as it 
streams in. However, it might be possible to make connectors handle this 
themselves given the combination of KAFKA-2481 and KAFKA-2482 would make it 
possible, if inconvenient, to implement this in the task itself.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to