Kafka connect etcd source

2019-01-05 Thread Berryman, Eric
Is there an existing Kafka Connect etcd source? Where the etcd keys on watch update a Kafka topic. I thought I would ask before writing one. It's a difficult Google search, because of all the interest in using etcd instead of zookeeper in Kafka.

Re: Using Kafka to build a streaming platform for a research facility?

2018-03-12 Thread Berryman, Eric
The European Spallation Source [1] seems to be using it for this case [2]. I am also using this code [2], but only for visualization in another "data center". [1] https://europeanspallationsource.se/ [2] https://github.com/ess-dmsc/forward-epics-to-kafka Thank you! Eric

RE: kafka-connect log4j

2017-01-11 Thread Berryman, Eric
nder > > and then add the lines you have in your email. > > Or you can get rid of stdout appender completely if you prefer. > > You may find the log4j primer useful: > https://logging.apache.org/log4j/1.2/manual.html > > On Tue, Jan 10, 2017 at 7:42 A

kafka-connect log4j

2017-01-10 Thread Berryman, Eric
Hello! Is there a log4j.appender.connectAppender? I noticed there is a log4j.appender.kafkaAppender. I was hoping to setup the connect-log4j.properties like kafka's. log4j.appender.connectAppender=org.apache.log4j.DailyRollingFileAppender log4j.appender.connectAppender.DatePattern='.'-MM-dd-

FW: mirror and schema topics

2016-11-30 Thread Berryman, Eric
Hello! I'm trying to mirror a kafka cluster, then run connect on the mirror. It seems the schemas are not getting moved in the mirror though, so I get the following error. Is this a configuration problem? Thank you for the help! Mirror>curl -X GET http://localhost:8081/subjects [] Machine1>c

mirror and schema topics

2016-11-30 Thread Berryman, Eric
Hello! I'm trying to mirror a kafka cluster, then run connect on the mirror. It seems the schemas are not getting moved in the mirror though, so I get the following error. Is this a configuration problem? Thank you for the help! Mirror>curl -X GET http://localhost:8081/subjects [] Machine1>cu