Hey All,

I'd like to share with you a potential improvement to the workflow for
Connect users that may make connector configurations easier to develop and
debug. The focus for this is on reducing the number of manual steps
involved in seeing the effects of a config change, so that each iteration
is faster and a user can work through errors/misconfigurations faster.

The details should be found here:
https://gitlab.gregswebserver.com/gharris1727/kafka-notes/-/wikis/Wishlist/ConfigCycleTime

While exploring this idea, I implemented a change to the Connect Standalone
runner which watches the provided configuration files for changes, and
applies them to the worker as soon as they are discovered. The prototype
branch can be found here:
https://github.com/gharris1727/kafka/tree/prototype-standalone-config-watcher

I wanted to put this out in order to ask a question of the maintainers:
Does this sort of usability improvement belong in apache/kafka, or some
external project? Would a KIP (or several) to implement this functionality
upstream be warranted for further discussion?

As-is, I believe that it is possible to implement all of this functionality
in an external utility and/or a RestExtension without any (significant)
upstream changes. This proposal would not constitute any strictly new
use-cases, but rather make the Standalone Mode more viable for the stated
use-case, which is for "ad hoc, small, or experimental jobs."

Thanks in advance for your comments,
Greg Harris

Reply via email to