Stuck replicas after reassign-partitions in kafka 0.9

2016-09-03 Thread vinay gupta
Topic: events Partition: 6 Leader: 21 Replicas: 25,21,9,17,22,3 Isr: 21,17,25 Topic: events Partition: 7 Leader: 20 Replicas: 5,20,9 Isr: 20,5,9 We have some replicas in our topic which are extras. (topic replication factor is 3).Tried to do kafka-reassign-partition.sh by removing the non-sync

KStreams regex-topic null pointer Exception with multiple Consumer processes

2016-09-03 Thread David Garcia
This bug may be fixed after commit: 6fb33afff976e467bfa8e0b29eb82770a2a3aaec When you start two consumer processes with a regex topic (with 2 or more partitions for the matching topics), the second (i.e. nonleader) consumer will fail with a null pointer exception. Exception in thread "StreamThr

Re: Partitioning at the edges

2016-09-03 Thread Andy Chambers
Hi Eno, I'll try. We have a feed of transaction data from the bank. Each of which we must try to associate with a customer in our system. Unfortunately the transaction data doesn't include the customer-id itself but rather a variety of other identifiers that we can use to lookup the customer-id in

Re: Partitioning at the edges

2016-09-03 Thread Eno Thereska
Hi Andy, Could you share a bit more info or pseudocode so that we can understand the scenario a bit better? Especially around the streams at the edges. How are they created and what is the join meant to do? Thanks Eno > On 3 Sep 2016, at 02:43, Andy Chambers wrote: > > Hey Folks, > > We are