[
https://issues.apache.org/jira/browse/KAFKA-5295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16029625#comment-16029625
]
Randall Hauch commented on KAFKA-5295:
--------------------------------------
Created
[KIP-158|https://cwiki.apache.org/confluence/display/KAFKA/KIP-158%3A+Kafka+Connect+should+allow+source+connectors+to+set+topic-specific+settings+for+new+topics]
to discuss how to change the public API for Connect to make this possible.
Discussions welcome on the [mailing list
thread|https://www.mail-archive.com/[email protected]/msg73775.html]
mentioned at the top of the KIP.
> Allow Kafka Connect source connectors to specify topic-specific settings for
> new topics
> ---------------------------------------------------------------------------------------
>
> Key: KAFKA-5295
> URL: https://issues.apache.org/jira/browse/KAFKA-5295
> Project: Kafka
> Issue Type: Improvement
> Components: KafkaConnect
> Affects Versions: 0.10.2.1
> Reporter: Randall Hauch
> Assignee: Randall Hauch
> Labels: needs-kip
>
> As of 0.11.0.0, Kafka Connect will be able to automatically create its
> internal topics using the new AdminClient (see KAFKA-4667). However, it still
> relies upon the broker auto-creating topics to which source connector records
> are written.
> Kafka Connect should use the AdminClient to explicitly create the new topics
> before writing the first source record to a new topic, and it should allow
> the connector the opportunity to customize the topic-specific settings for
> those new topics. As such, it will require a change in the public API
> (configs and/or framework) for source connectors and thus will require a KIP.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)