There seems some issue with javadoc on KStream#transformValues

2020-02-22 Thread Sachin Mittal
Hi, The javadoc of this method states: If the return value of ValueTransformer#transform() is null, no records are emitted. However when I check the underlying processor for the same: KStreamT

Re: Understanding concept of grace in JoinWindows

2020-02-22 Thread Matthias J. Sax
Sachin, "late" data is data that arrives after the grace period and is not processed but dropped for this reason. What you mean is "out-of-order data" for which you can use the grace period to process it -- increasing the window size would be a semantic change, while increasing the grace period al

Re: There seems some issue with javadoc on KStream#transformValues

2020-02-22 Thread Matthias J. Sax
It's a bug in the implementation. It's already fixed for upcoming 2.4.1 and 2.5.0 releases Cf. https://issues.apache.org/jira/browse/KAFKA-9533 -Matthias On 2/22/20 1:46 AM, Sachin Mittal wrote: > Hi, > The javadoc of this method states: > If the return value of ValueTransformer#transform() > <

Query on use of Glassfish application server

2020-02-22 Thread ashish sood
Hello, This is more of a query rather than an issue. I am working with java based application & Kafka connect worker in distributed mode. While going through the logs post I started the worker, I see some logs for Glassfish. I would want to know if Kafka uses Glassfish server internally to run the

Re: Understanding concept of grace in JoinWindows

2020-02-22 Thread Sachin Mittal
Hi, This really helped to understand that grace period takes care of out of order records rather than late arriving records. I however have a question that why would a record arrive out of order. Doesn't kafka guarantees the order. If we use default timestamp extractor then it will use the embedde

Re: Query on use of Glassfish application server

2020-02-22 Thread Guozhang Wang
Hello, As far as I know Kafka connect's Rest server depends on Glassfish for web-app configuration; the Kafka brokers do not. Guozhang On Sat, Feb 22, 2020 at 5:29 AM ashish sood wrote: > Hello, > > This is more of a query rather than an issue. I am working with java based > application & Kafk

Re: Can we use transform to exchange data between two streams

2020-02-22 Thread Guozhang Wang
Hi Sachin, You can check first by topology.describe() if there are indeed some repartition topics existing in your topology. If there's none, you may also want to check if the children operators of the split is in the order of (AA, AB, B): if the B sub-stream is the first child, then it may also t