Re: Partitions Question with java Producer

2018-04-16 Thread Brett Rann
What you've described should work. A producer can send to a single partition topic. "When I run consumers to connect to the Topic I see no messages" But you can't have more than one consumer in a consumer group consuming, anything beyond the first consumer won't have a partition assigned to it si

Bug report: Topologies affecting each other through store: Partition XXX is not assigned to any tasks: {}

2018-04-16 Thread Erwin Joost BOLWIDT
Hi, It took me a long time to figure the problem out, and I think it may be a bug in kafka-streams, or at least something that could have a better log warning message. I’m using the high-level API. I get errors of the form “Partition XXX is not assigned to any tasks: {}”, even though I was usi

Partitions Question with java Producer

2018-04-16 Thread ESS Gee
Scenario 1)We have a Topic SGFAGLFLEXT1 created with single Partition. A java Producer created from Informatica server cannot send messages to this Topic. When I run consumers to connect to the Topic I see no messages A standard producer can send messages to the Topic without issues. Scenario 2) W

Aggregating data when a base is already present

2018-04-16 Thread Gaurav Arora
I'm new to kafka and have been going over the basic example of how positions from trades are aggregated. However I am unable to get my head around how this would work when a position already exists. As an example, if I execute an initial trade on MSFT then my position will either be created but wha

Re: Turning on compaction - can I rolling restart?

2018-04-16 Thread Xin Li
Hey Sean, You can do rolling restart, then can do a describe of the topic, to check if the broker is back. Then continue with the next one. Best, Xin On 13.04.18, 21:09, "McNealy, Sean" wrote: I have a cluster of 3 kafka brokers running 0.10.2 that have been running for a while with the