Do you get any output from *docker logs*? And does it work if you don't use
authentication?
How about if you try one of the dockerised Kafka Connect examples here?
https://github.com/confluentinc/demo-scene/tree/master/kafka-connect-zero-to-hero
--
Robin Moffatt | Senior Developer Advocate | ro
Hey everyone,
I am having some issues when running Kafka Connect inside of Docker, so
would really appreciate some feedback on what I'm doing wrong.
I'm able to run locally (by executing `connect-distributed
config.properties`. However, when running in Docker and passing the same
configuration as
We're also seeing lots of failures as the TopicPartitionWriter tries
to close WAL files in HDFS [1].
[1] http://pastebin.com/6ipUndZv
On Wed, Jul 27, 2016 at 5:01 PM, Kristoffer Sjögren wrote:
> The workers seems happier when reducing number of partitions for each
> worker. And when adding more
The workers seems happier when reducing number of partitions for each
worker. And when adding more topics they eventually die into a
rebalancing state.
May I ask what's a good configuration? At the moment we have...
- 2 docker instances with 4 cores, 4 GB heap
- each instance reads 4000 kB/s and
We found very high cpu usage which might cause the problem. Seems to be
spending a lot of cycles querying and parsing hdfs paths?
Den 24 jul 2016 02:40 skrev "Ewen Cheslack-Postava" :
That definitely sounds unusual -- rebalancing normally only happens either
when a) there are new workers or b) the
That definitely sounds unusual -- rebalancing normally only happens either
when a) there are new workers or b) there are connectivity issues/failures.
Is it possible there's something causing large latencies?
-Ewen
On Sat, Jul 16, 2016 at 6:09 AM, Kristoffer Sjögren
wrote:
> Hi
>
> I'm running
Hi
I'm running Kafka Connect in distributed mode with the confluent HDFS
sink connector.
But the WorkerSinkTask constantly gets interfered with rebalancing
requests from the broker (onPartitionsRevoked) [1] and gets stuck in a
recovery state where the brokers constantly logs "Preparing to
restabi
