[
https://issues.apache.org/jira/browse/KAFKA-2375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15139836#comment-15139836
]
Ewen Cheslack-Postava commented on KAFKA-2375:
----------------------------------------------
[~arttii] Great to hear you're working on this! This JIRA was filed early on
when we weren't sure if we would include some more complex examples of
connectors with Kafka itself (in which case dependencies might be more of a
concern, thus the comment about using the REST API). Using the Java API
provided with ES can definitely make sense if you're not trying to limit
dependencies.
I think plenty of folks in the community are interested in more open source
connectors, especially for popular systems. Generally we're planning to keep
most connector plugins as external libraries so development is federated (and
not limited by the throughput of Kafka committers reviewing code!). If you're
thinking about sharing it, I'd recommend putting it up on GitHub/BitBucket/your
preferred repository hosting service and posting a note to the mailing list
about it.
> Implement elasticsearch Copycat sink connector
> ----------------------------------------------
>
> Key: KAFKA-2375
> URL: https://issues.apache.org/jira/browse/KAFKA-2375
> Project: Kafka
> Issue Type: Sub-task
> Components: copycat
> Reporter: Ewen Cheslack-Postava
> Assignee: Liquan Pei
>
> Implement an elasticsearch sink connector for Copycat. This should send
> records to elasticsearch with unique document IDs, given appropriate configs
> to extract IDs from input records.
> The motivation here is to provide a good end-to-end example with built-in
> connectors that require minimal dependencies. Because Elasticsearch has a
> very simple REST API, an elasticsearch connector shouldn't require any extra
> dependencies and logs -> Elasticsearch (in combination with KAFKA-2374)
> provides a compelling out-of-the-box Copycat use case.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
