Glad to hear you are replicating now :)
> it probably started mirroring the last seven days as there was no offset
for the new consumer-group.
That's correct -- MM2 will replicate the entire topic, as far back as the
retention period. However, technically there are no consumer groups in MM2!
550
Sebastian, there are multiple ways to run MM2. One way is to start the
individual Connectors (MirrorSourceConnector, MirrorCheckpointConnector,
and MirrorHeartbeatConnector) on an existing Connect cluster, if you have
one. Some of the configuration properties you've listed, e.g. "name" and
"connect
Hello again!
Some probably important configs I found out:
We need this to enable mirroring as it seems to disabled by default?
source->target.enabled = true
target->source.enabled = true
Also, the Client-IDs can be configured using:
source.client.id = my_cool_id
target.client.id = my_cooler_i
Also please note the upgrade guide
https://kafka.apache.org/documentation/streams/upgrade-guide that when you
upgrade from lower version to 2.4 you'd need to set the upgrade.from
config, AND if you use optimization there's a small change you'd need to
make as well.
On Mon, Dec 23, 2019 at 3:03 PM
Hello Nitay,
Could you share the topology description on both 2.4 and 2.3.1, and also
could you elaborate on the feature flag you turned on / off?
Guozhang
On Mon, Dec 23, 2019 at 9:32 AM Nitay Kufert wrote:
> Hello,
>
> So as the title says, I am trying to upgrade our streams client to the n
Hello,
I tried running this connect-mirror-config:
name = $MIRROR_NAME
clusters = source, target
source.bootstrap.servers = $SOURCE_SERVERS
target.bootstrap.servers = $TARGET_SERVERS
source->target.topics = $SOURCE_TARGET_TOPICS
target->source.topics = $TARGET_SOURCE_TOPICS
source->target.emit.
Hello Sebastian, please let us know what issues you are facing and we can
probably help. Which config from the KIP are you referencing? Also check
out the readme under ./connect/mirror for more examples.
Ryanne
On Mon, Dec 23, 2019, 12:58 PM Sebastian Schmitz <
sebastian.schm...@propellerhead.co.
Says to create a state store from the result and give it the name
count_store so you can reference and use the data later.
Carl
On Mon, Dec 23, 2019, 12:31 Aurel Sandu wrote:
> I'am reading the folowing code :
> ...
> KTable wordCounts = textLines
> .flatMapValues(textLi
I find the best is the README in the source. Look under connect mirror
maker directory I believe.
Carl
On Mon, Dec 23, 2019, 13:57 Sebastian Schmitz <
sebastian.schm...@propellerhead.co.nz> wrote:
> Hello,
>
> I'm currently trying to implement the new Kafka 2.4.0 and the new MM2.
>
> However, it
Hello,
I'm currently trying to implement the new Kafka 2.4.0 and the new MM2.
However, it looks like the only documentation available is the KIP-382,
and the documentation
(https://kafka.apache.org/documentation/#basic_ops_mirror_maker) for the
MM isn't yet updated, and the documentation in t
Hello,
So as the title says, I am trying to upgrade our streams client to the new
version (2.4) - and when trying to run our app with the new version on my
local machine (and our test env) i keep getting the following error:
> java.lang.IllegalArgumentException: Number of partitions must be at le
I'am reading the folowing code :
...
KTable wordCounts = textLines
.flatMapValues(textLine ->
Arrays.asList(textLine.toLowerCase().split("\\W+")))
.groupBy((key, word) -> word)
.count(Materialized.>as("counts-store"));
...
I do not understand th
I'am reading the folowing code :
...
KTable wordCounts = textLines
.flatMapValues(textLine ->
Arrays.asList(textLine.toLowerCase().split("\\W+")))
.groupBy((key, word) -> word)
.count(Materialized.>as("counts-store"));
...
I do not understand th
13 matches
Mail list logo
