Re: Mirrormaker 2.0

2019-12-29 Thread Ryanne Dolan
> Is there a way to prevent that from happening? Unfortunately there is no tooling (yet?) to manipulate Connect's offsets, so it's difficult to force MM2 to skip ahead, reset, etc. One approach is to use Connect's Simple Message Transform feature. This enables you to filter the messages being rep

Re: Mirrormaker 2.0

2019-12-29 Thread Ryanne Dolan
Sebastian, you can drop in a custom jar in the "Connect plug-in path" and MM2 will be able to load it. That enables you to implement your own ReplicationPolicy (and other pluggable interfaces) without compiling everything. In an upcoming release we'll have a "LegacyReplicationPolicy" that does not

Re: Kafka connect issue with mysql - Debezium CDC

2019-12-29 Thread KhajaAsmath Mohammed
Hi, I was able to resolve this issue by changing the name of server to docker container name. [image: image.png] Thanks, Asmath On Wed, Dec 25, 2019 at 8:30 PM KhajaAsmath Mohammed < mdkhajaasm...@gmail.com> wrote: > Hi, > > I am trying to do POC for kafka CDC with database and ingest it into

Re: Mirrormaker 2.0

2019-12-29 Thread Sebastian Schmitz
Hello, I found that it's using the DefaultReplicationPolicy that always returns "sourceClusterAlias + separator + topic" with only the separator being configurable in the configuration-file with REPLICATION_POLICY_SEPARATOR. It seems like I need a different ReplicationPolicy, like a SimpleRe

Re: Mirrormaker 2.0

2019-12-29 Thread Sebastian Schmitz
Hello, another thing I found and didn't find any configuration in the KIP yet was that if I have two clusters (source and target) and a topic "replicateme" on the source-cluster it will get replicated to the target-cluster as "source.replicateme". How can I stop it from adding the cluster-na

StateStore extends UnicastRemoteObject

2019-12-29 Thread Michelle Francois
Hello, I want to have two way communication in Apache Kafka and since the Apache Kafka Topology permits no cyclic topology I was suggested by my supervisor to use State Stores as remote objects. I created custom State Stores as described here: https://docs.confluent.io/current/streams/developer-gu

Re: Please help me with link to documentation ... (generics I think)

2019-12-29 Thread Matthias J. Sax
If it's about generics, see https://stackoverflow.com/questions/5297978/calling-static-generic-methods On 12/28/19 8:50 AM, Guozhang Wang wrote: > Hello Aurel, > > Maybe this helps: > https://kafka.apache.org/24/documentation/streams/developer-guide/dsl-api.html > > Guozhang > > On Fri, Dec 27