Kafka Source Connector tasks run only in same node

2016-08-31 Thread dhanuka ranasinghe
Hi All, I'm new to Kafka and I created TCP Kafka Source connector [1] and deployed in Kafka Connect Cluster in distributed mode. There is two node/instance of connectors in Kafka Connector cluster. But out of them only in one node run *tasks* even though it shows connector in both nodes active an

Re: Kafka Source Connector tasks run only in same node

2016-08-31 Thread dhanuka ranasinghe
kafka connector status {"name":"socket-connector","connector":{"state":"RUNNING","worker_id":"*10.72.133.194:8084 <http://10.72.133.194:8084>* "},"tasks":[{"state":"RUNNING","id

Re: Kafka Source Connector tasks run only in same node

2016-08-31 Thread dhanuka ranasinghe
As you can see, connector/worker and task run in different hosts On Thu, Sep 1, 2016 at 9:48 AM, dhanuka ranasinghe < dhanuka.priyan...@gmail.com> wrote: > kafka connector status > > {"name":"socket-connector","connector":{"state&q

Re: Kafka Source Connector tasks run only in same node

2016-08-31 Thread dhanuka ranasinghe
Please note *zookeeper* running on only in *10.72.133.195 <http://10.72.133.195:8084>* On Thu, Sep 1, 2016 at 9:49 AM, dhanuka ranasinghe < dhanuka.priyan...@gmail.com> wrote: > As you can see, connector/worker and task run in different hosts > > On Thu, Sep 1, 201

Kafka Source Connector - JSON with Escape double quotes

2016-09-14 Thread dhanuka ranasinghe
Hi, I am using Kafka connect to feed data into kafka, please find sample code snippet from Source Task. My question is , why kafka connect dematerialize JSON message by escaping double quotes? Is there way to get the same without escaping? byte[] message = null; Charset charset = Charset.forName

Can't send json array as configuration

2016-10-03 Thread dhanuka ranasinghe
Hi All, When trying to reconfigure kafka standalone connector I am getting below Exception. Could you please help on this? Caused by: com.fasterxml.jackson.databind.JsonMappingException: Can not deserialize instance of java.lang.String out of START_ARRAY token Error payload: {"connector.class"