Re: Kafka Connect Distributed Mode Issues

2021-04-04 Thread Himanshu Shukla
Did anyone face it before? The connector URL is giving 500 request time out. On Thu, Apr 1, 2021 at 9:55 AM Himanshu Shukla wrote: > Hi, > I am using kafka-connect-file-pulse connector and scanning around 20K > files. After the scan step, the whole connect cluster is becoming > unresponsive. I c

Yet Another Repartitioning Question About Kafka Streams

2021-04-04 Thread Gareth Collins
Hi, Thanks very much for answers to my previous questions here. I had a couple more questions about repartitioning and I just want to confirm my understanding. (1) Given the following scenario: (a) I have a cluster of Kafka stream nodes with partitions assigned to each. (b) One node goes down.

Kafka log cleaner

2021-04-04 Thread Muath AlBassam
Hi, I'm having some problems with kafka. After a week from starting the kafka/zookeeper servers on windows, I get an error message "Failed to clean up logs for __consumer_offset_5 in dir C:\tmp\kafka-logs due to IOExeption" Windows Server 2019 standard Thanks

Re: Kafka Connectors output to topic.

2021-04-04 Thread Israel Ekpo
Nick, There will be drawbacks to this because you would be using the wrong tool for the task. The Kafka ecosystem is very rich with different tools and you should spend a little more time to understand what they do and are meant for I believe the ecosystem component you are looking for is Kafka S