The confluent platform download has everything pre-configured for everything to work after unzipping the download, including any dependencies that it needs to run. The shell script that starts up the kafka connect worker ensures that everything that needs to be on the classpath is on the classpath (take a look at them to see how everything is being wired together, but its essentially a series of scripts that are building up the classpath and setting any appropriate environment variables). The elasticsearch connector is available bundled with the platform, so you shouldn't need to do anything to get that working beyond configuration of the plugin and submitting that to the worker.
Just follow the quickstart guide here: https://docs.confluent.io/current/connect/connect-elasticsearch/docs/elasticsearch_connector.html On Fri, Sep 29, 2017 at 8:24 AM, Marina Popova <ppine7...@protonmail.com> wrote: > Thanks, Matthias, > the "download" part is what I am not clear about.... > I don't see a separate download for just a connector, only for the whole > Confluent platform. > Is it just a matter of taking one jar, say, the > kafka-connect-elasticsearch-3.3.0.jar from the .../confluent-3.3.0/share/ > java/kafka-connect-elasticsearch/ dir? and adding it into the plugin.path > dir for Kafka? Or do I package the whole > ./confluent-3.3.0/share/java/kafka-connect-elasticsearch/ > dir as an Uber Jar to make sure all dependencies are also included? > > Thanks, > Marina > > Sent with [ProtonMail](https://protonmail.com) Secure Email. > > > -------- Original Message -------- > > Subject: Re: how to use Confluent connector with Apache Kafka > > Local Time: September 27, 2017 2:45 PM > > UTC Time: September 27, 2017 6:45 PM > > From: matth...@confluent.io > > To: users@kafka.apache.org > > > > All connectors are compatible with vanilla AK, as Confluent Open Source > > ships with "plain" Apache Kafka under the hood. > > > > So you can just download the connector, plug it in, and configure it as > > any other connector, too. > > > > https://www.confluent.io/product/connectors/ > > > > -Matthias > > > > On 9/26/17 1:15 PM, Marina Popova wrote: > >> Hi, > >> we have an existing Kafka cluster (0.10) already setup and working in > production. > >> I woudl like to explore using Confluent"s Elasticsearch Connector - > however, I see it comes as part of the Confluent distribution of Kafka > (with separate confluent scripts, libs, etc.). > >> > >> Is there an easy way to just use the Confluent Connector with the plain > (non-Confluent) Apache distribution of Kafka? > >> > >> thanks! > >> Marina > >> >
