Vishal, there is no support for overriding topic configuration like
retention. Instead, remote topics will have the same configuration as their
source topics. You could disable config sync or blacklist retention.ms to
prevent that from happening, and then alter retention for remote topics
manually
I had encountered similar problem and I was using stream to table join.
However if a record arrives late in the table, it would not join as per
stream to table join semantics.
Unfortunately windowing is not supported in stream to table join.
I suggest to use stream to stream join with appropriate
I think literature on confluent/ASF and also the community support here is
best to learn about streaming.
On Mon, Jan 13, 2020 at 6:47 PM M. Manna wrote:
> Hey Sachin,
>
> On Mon, 13 Jan 2020 at 05:12, Sachin Mittal wrote:
>
> > Hi,
> > The way I have used streams processing in past; use case t
Can I override the retention on target topics through mm2.properties ? It
should be as simple as stating the retention.ms globally ? Am also
curious whether it can more at a single channel level ?
For example A->B, topic on B should have a retention of x and for B->A the
retention is y..
Is tha
CVE-2019-12399: Apache Kafka Connect REST API may expose plaintext secrets
in tasks endpoint
Severity: Medium
Vendor: The Apache Software Foundation
Versions Affected:
Apache Kafka 2.0.0, 2.0.1, 2.1.0, 2.1.1, 2.2.0, 2.2.1, 2.3.0
Description:
When Connect workers in Apache Kafka 2.0.0, 2.0.1,
Hello,
According to the docs, Kafka Streams tasks pick from the partition with the
smallest timestamp to process the next record.
(
https://kafka.apache.org/documentation/streams/core-concepts#streams_out_of_ordering
)
One can also configure max.task.idle.ms so that Kafka Streams tasks wait
for al
You can take a profile with Java Flight Recorder if you use Java 11 or
using async profiler otherwise. See below for the latter:
https://issues.apache.org/jira/browse/KAFKA-9339?page=com.atlassian.jira.plugin.system.issuetabpanels%3Acomment-tabpanel&focusedCommentId=17013400#comment-17013400
It's
Hey Sachin,
On Mon, 13 Jan 2020 at 05:12, Sachin Mittal wrote:
> Hi,
> The way I have used streams processing in past; use case to process streams
> is when you have a continuous stream of data which needs to be processed
> and used by certain applications.
> Since in kafka streams can be a simp
