Re: Create Topic Error: Create Topic Error and cannot write to console producer

Hi, Without changing any configuration, got the error again now: [2017-08-13 20:09:52,727] ERROR Error when sending message to topic test02 with key: null, value: 5 bytes with error: (org.apache.kafka.clients.producer.internals.ErrorLoggingCallback) org.apache.kafka.common.errors.TimeoutExcepti

Re: How to clear a particular partition?

I can't help you here but maybe can focus the question - why would you want to? jan On 10/08/2017, Sven Ludwig wrote: > Hello, > > assume that all producers and consumers regarding a topic-partition have > been shutdown. > > Is it possible in this situation to empty that topic-partition, while t

Re: How to clear a particular partition?

This is an area that is being worked on. See KIP-107 for details. https://cwiki.apache.org/confluence/display/KAFKA/KIP-107%3A+Add+purgeDataBefore%28%29+API+in+AdminClient -hans > On Aug 10,

Re: Forwarding consumer with kafka streams

Hi Richardo, What you described seems very similar to the demo example code as stated here: https://github.com/apache/kafka/blob/trunk/streams/quickstart/java/src/main/resources/archetype-resources/src/main/java/Pipe.java If you started the program it should just pipe all data starting from the e

Re: Streams: Fetch Offset 0 is out of range for partition foo-0, resetting offset

Hi Garrett, Since your error message says "offset X" is out of range, it means that the offset was reset to because there was no data any more on topic partition "foo-0". I suspect that is because all the log segments got truncated and the topic partition contains empty list. It is less likely cau

Re: [kafka streams] discuss: dynamically update subscription pattern

Hello Bart, Before we talk about dynamic subscription in Streams I'd like to ask some more questions about your usage. Let's say the current running application is reading from topic A, and have just reached offset 100; now from the global state there is a notification saying "stop on topic A, st

Re: Shooting for microsecond latency between a Kafka producer and a Kafka consumer

Hi Viktor, Thanks! I didn't know that. In my case, I was just sending topics carrying byte arrays of size 1--512B. Chao On 08/11/2017 10:03 AM, Viktor Somogyi wrote: Hi Chao, Apart from the actual request, the consumer sends metadata requests as well. What is actually going through the netw

Kafka 0.11.0.0

Hi, We are currently on 0.8.2.2 in production and are planning on moving to the latest stable release which currently is 0.11.0.0. Have a few questions: * Folks who are on 0.11.0.0 in production - can you comment on how stable is it? Any problems? * Usually, I look for a maintenance release, is

Synchronized methods in RockSB key store

Hi, I was inspecting RocksDBStore and I saw get and put methods being synchronized. Are there any issues in RocksDB due to which we have used it. Could someone please enlighten more on this. @Override public synchronized V get(K key) { validateStoreOpen(); byte[] byteValue =

RocksDB error

Exception while doing the join, cant decipher more on this. Has anyone faced it. complete exception trace attached. 2017-08-14 11:15:55 ERROR ConsumerCoordinator:269 - User provided listener org.apache.kafka.streams.processor.internals.StreamThread$RebalanceListener for group c-7-a34 failed on par