> will it consider a timestamp in the body of the message, if we have
> implemented a custom TimeExtractor?
Yes.
> Or, which I feel is more likely - does TimeExtractor stream time only apply
> later on once deserialisation has happened?
Well, the extractor does apply after deserialization, bu
Thanks for your reply Matthias, and really great talks :-)
You’re right that I only have one input topic - though it does have 20
partitions.
The pointer to max.task.idle.ms cleared something up for me; I read the
following line from Kafka docs but couldn’t find what configuration they were
r
Hi Raman,
I believe for MM2 you just specify the transforms and predicates on each
mirror source connector, like this:
us-west->us-east.transforms=myFilter
us-west->us-east.transforms.myFilter.type=Filter
And similarly with the predicates, as described in Robin's blog or the
documentation.
Kind
You can find details of the Filter function and its use here:
https://rmoff.net/2020/12/22/twelve-days-of-smt-day-11-predicate-and-filter/
Something I need to add to this page is a new JMESPath-based Predicate that
I found recently which looks really useful. The author wrote details and
example of
HI Tom,
For which connector class connector do I need to submit ?
Can you share some samples for the same?
On Wed, 10 Mar 2021 at 14:32, Tom Bentley wrote:
> Kafka Connect has the Filter SMT which can be used with a predicate to
> filter out certain messages, see
> https://kafka.apache.org/docu
Hi All,
I was able to set up MM2 successfully but I see the same message being sent
again and again. Also I see the following log message which I don't
understand why. The topics on source and destination have the same number
of partitions. Please give me some advice.
[2021-03-10 09:41:02,072] IN
Kafka Connect has the Filter SMT which can be used with a predicate to
filter out certain messages, see
https://kafka.apache.org/documentation/#connect_predicates
Kinds regards,
Tom
On Wed, Mar 10, 2021 at 8:46 AM raman gugnani
wrote:
> HI Team,
>
> I want to filter out some of the kafka messa
HI Team,
I want to filter out some of the kafka messages from source kafka cluster
to destination kafka cluster via some logic.
Logics to filter
1. If possible to filter data on the basis of static data.
2. If possible, filter data dynamically based on a custom provider (some
jar or som
