You can find details of the Filter function and its use here: https://rmoff.net/2020/12/22/twelve-days-of-smt-day-11-predicate-and-filter/
Something I need to add to this page is a new JMESPath-based Predicate that I found recently which looks really useful. The author wrote details and example of it here: https://forum.confluent.io/t/kafka-connect-jmespath-expressive-content-based-record-filtering/1104 -- Robin Moffatt | Senior Developer Advocate | ro...@confluent.io | @rmoff On Wed, 10 Mar 2021 at 09:55, raman gugnani <ramangugnani....@gmail.com> wrote: > HI Tom, > > For which connector class connector do I need to submit ? > Can you share some samples for the same? > > On Wed, 10 Mar 2021 at 14:32, Tom Bentley <tbent...@redhat.com> wrote: > > > Kafka Connect has the Filter SMT which can be used with a predicate to > > filter out certain messages, see > > https://kafka.apache.org/documentation/#connect_predicates > > > > Kinds regards, > > > > Tom > > > > On Wed, Mar 10, 2021 at 8:46 AM raman gugnani < > ramangugnani....@gmail.com> > > wrote: > > > > > HI Team, > > > > > > I want to filter out some of the kafka messages from source kafka > cluster > > > to destination kafka cluster via some logic. > > > > > > Logics to filter > > > > > > 1. If possible to filter data on the basis of static data. > > > 2. If possible, filter data dynamically based on a custom provider > > (some > > > jar or some other way around). > > > > > > > > > Looking to do the same via any of the below features > > > > > > 1. Kafka mirror > > > 2. Kafka Connect > > > 3. Kafka Streams. > > > > > > -- > > > Raman Gugnani > > > > > > > > -- > Raman Gugnani >
