Partition rebalancing when both leader and follower is down?

2018-02-03 Thread Devendar Rao
Hi, I don't see partition rebalancing happening when both leader and replica nodes are down for a given partition. The partition's leader is set to -1; but never gets fixed. I manually assign the partition using "kafka-preferred-replica-election.sh". Does kafka not balance the partitions automati

Re: Shouldn't KStream#through let you specify a Consumed?

2018-02-03 Thread Matthias J. Sax
With "default" I mean "FailOnInvalidTimestampExtractor" that is set as config if you don't overwrite it. Thus, for through() the setting in StreamsConfig is ignored if you set a custom extractor. >> So, KStream.through() and KStream.to()-Topology.stream() are not >> semantically equivalent? Is the

Store not ready

2018-02-03 Thread dizzy0ny
Hi,We have a recurring problem that I wonder if there is a better way to solve.  Currently when we restart our backed Kafka services and then our datastreams app, the app is unable to reach many of the Kafka topic state stores. We currently retry, but more often than not, it requires a restart o