Re: kafka-streams correct Supplier semantics

2019-09-05 Thread Jorg Heymans
Thanks for the confirmation Matthias ! On 2019/09/05 23:23:01, "Matthias J. Sax" wrote: > I must create a new instance. Only creating a `new > WrappingValueTransformer()` won't work. > > > -Matthias > > > > On 9/5/19 2:42 AM, Jorg Heymans wrote: > > Hi, > > > > If i have a ValueTransforme

Re: kafka-streams correct Supplier semantics

2019-09-05 Thread Matthias J. Sax
I must create a new instance. Only creating a `new WrappingValueTransformer()` won't work. -Matthias On 9/5/19 2:42 AM, Jorg Heymans wrote: > Hi, > > If i have a ValueTransformer that wraps another ValueTransformer like: > > class WrappingValueTransformer implements ValueTransformer { > ..

Re: Is an in-memory stream-stream join possible?

2019-09-05 Thread Matthias J. Sax
This should be addressed via https://cwiki.apache.org/confluence/display/KAFKA/KIP-479%3A+Add+Materialized+to+Join -Matthias On 9/5/19 8:05 AM, Dmitry Minkovsky wrote: > Whoops! Just after sending this email I saw > https://issues.apache.org/jira/browse/KAFKA-4729. > > On Thu, Sep 5, 2019 at 11:

Purging dead consumer ids from _consumer_offsets?

2019-09-05 Thread Ash G
_consumer_offsets is becoming rather big > 1 TB. Is there a way to purge dead/inactive consumer id rows from it?

Re: Kafka

2019-09-05 Thread Bruno Cadonna
Hi Ghullam, Apache Kafka is open source. See license under https://github.com/apache/kafka/blob/trunk/LICENSE Best, Bruno On Thu, Sep 5, 2019 at 10:19 PM Ghullam Mohiyudin wrote: > > Hi , > I read the information about kafka. Now i want to create a degree final > project using kafka. Can you pl

Kafka

2019-09-05 Thread Ghullam Mohiyudin
Hi , I read the information about kafka. Now i want to create a degree final project using kafka. Can you please tell me that kafka have free edition ? Thanking You..!! -- *Ghullam Mohiyuddin Chishtti *

Custom AuthenticateCallbackHandler and unexpected Callback type

2019-09-05 Thread David McNelis
G’day, I’m a bit confused as to some of the behavior of building a custom AuthenticateCallbackHandler implementation / extending the PlainServerCallbackHandler. I have the following config: sasl.enabled.mechanisms=PLAIN sasl.mechanism.inter.broker.protocol=PLAIN security.inter.broker.protoc

MirrorMaker and

2019-09-05 Thread Paul Podolny
Hi, Is it possible to enable idempotent producing in MirrorMaker? By code examples, I've seen this needs to be explicitly enabled via the producer API by sending a 'initTransactions' method: https://github.com/omkreddy/kafka-examples/blob/master/producer/src/main/java/kafka/examples/producer/Tra

Custom callback handler breaking with unexpected Callback types

2019-09-05 Thread David McNelis
G’day, *Kafka_2.12-2.3.0 is the version I’m running and compiling for. I’m a bit confused as to some of the behavior of building a custom AuthenticateCallbackHandler implementation / extending the PlainServerCallbackHandler. I have the following config: sasl.enabled.mechanisms=PLAIN sasl.mecha

Re: Is an in-memory stream-stream join possible?

2019-09-05 Thread Dmitry Minkovsky
Whoops! Just after sending this email I saw https://issues.apache.org/jira/browse/KAFKA-4729. On Thu, Sep 5, 2019 at 11:04 AM Dmitry Minkovsky wrote: > Hello! > > When I saw KAFKA-4730/KIP-428 ("Streams does not have an in-memory > windowed store") were included in 2.3.0, I thought maybe it woul

Is an in-memory stream-stream join possible?

2019-09-05 Thread Dmitry Minkovsky
Hello! When I saw KAFKA-4730/KIP-428 ("Streams does not have an in-memory windowed store") were included in 2.3.0, I thought maybe it would be possible to configure an in-memory stream-stream join using KStream#join. But I am not seeing this in the API. My use case is joining streams of short-live

Kafka server not recognizing consumer thread is down

2019-09-05 Thread Sriram V
Hi, I am currently using kafka server 0.9 version. My kafka consumer version is 0.8.2.2. I run into cases where my kafka consumer thread is down (when I check the threaddump, I can see my kafka consumer thread is down), but the server still thinks the kafka consumer thread is up and doesn't re

kafka-streams correct Supplier semantics

2019-09-05 Thread Jorg Heymans
Hi, If i have a ValueTransformer that wraps another ValueTransformer like: class WrappingValueTransformer implements ValueTransformer { final ValueTransformer delegateTransformer; ProcessorContext processorContext; WrappingValueTransformer(ValueTransformer delegateTransformer) {