[jira] [Resolved] (KAFKA-10587) Rename kafka-mirror-maker CLI command line arguments for KIP-629

[ https://issues.apache.org/jira/browse/KAFKA-10587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantine Karantasis resolved KAFKA-10587. Resolution: Fixed > Rename kafka-mirror-maker CLI command line argume

[jira] [Created] (KAFKA-10587) Rename kafka-mirror-maker CLI command line arguments for KIP-629

Xavier Léauté created KAFKA-10587: - Summary: Rename kafka-mirror-maker CLI command line arguments for KIP-629 Key: KAFKA-10587 URL: https://issues.apache.org/jira/browse/KAFKA-10587 Project: Kafka

[jira] [Created] (KAFKA-9745) Attribute is missed in kafka mirror maker metrics

Nikita Krasnov created KAFKA-9745: - Summary: Attribute is missed in kafka mirror maker metrics Key: KAFKA-9745 URL: https://issues.apache.org/jira/browse/KAFKA-9745 Project: Kafka Issue Type

Re: Kafka mirror maker help

I run instances of Mirror Maker as supervisord tasks (http://supervisord.org ). I’d recommend looking into it. In addition to letting you sidestep the service issue, supervisord watches the processes and can auto-restart them if they stop for any reason. — Peter Bukowin

Re: Kafka mirror maker help

Sorry I hit send a bit too soon. I was so focused on the systemd part of the email and not the Mirror Maker part. Confluent packages include Mirror Maker but the systemd scripts are setup to use Confluent Replicator rather than Mirror Maker. My apologies. -hans /** * Hans Jespersen, Director Sys

Re: Kafka mirror maker help

The latest Confluent packages now ship with systemd scripts. That is since Confluent Version 4.1 - which included Apache Kafka 1.1 -hans /** * Hans Jespersen, Director Systems Engineering, Confluent Inc. * h...@confluent.io (650)924-2670 */ On Fri, Apr 27, 2018 at 11:15 AM, Andrew Otto wrote

Re: Kafka mirror maker help

Hiya, Saravanan, I saw you emailed my colleague Alex about WMF’s old debian packaging. I’ll reply here. We now use Confluent’s Kafka debian packaging which does not (or did not?) ship with init scripts. We don’t use Sys V init.d scripts anymore either, but use systemd instead. Our systemd serv

Re: Kafka mirror maker help

You should share related info, such source-destination Kafka versions, sample Config or error if any. FYI, Go through https://kafka.apache.org/documentation/#basic_ops_mirror_maker

Kafka mirror maker help

Hello, I'm setting up mirror maker for kafka however it doesn't help can you guide me some steps or else share the model shell script to execute the mirror maker ? highly appreciated your help. Thanks Sara

[jira] [Resolved] (KAFKA-3327) Warning from kafka mirror maker about ssl properties not valid

exists > Warning from kafka mirror maker about ssl properties not valid > -- > > Key: KAFKA-3327 > URL: https://issues.apache.org/jira/browse/KAFKA-3327 > Project: Kafka >

[jira] [Resolved] (KAFKA-4102) Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X?

bility for 0.10+ brokers & clients. > Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X? > - > > Key: KAFKA-4102 > URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Updated] (KAFKA-4102) Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X?

[ https://issues.apache.org/jira/browse/KAFKA-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-4102: - Fix Version/s: (was: 0.10.2.0) > Is kafka mirror maker in 0.10.X do

[jira] [Updated] (KAFKA-4102) Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X?

[ https://issues.apache.org/jira/browse/KAFKA-4102?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4102: --- Fix Version/s: (was: 0.10.1.0) 0.10.2.0 > Is kafka mirror maker

[jira] [Updated] (KAFKA-4102) Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X?

at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:98) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63) > Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X? > - > >

[jira] [Updated] (KAFKA-4102) Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X?

quest(AbstractFetcherThread.scala:107) at kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:98) at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63) > Is kafka mirror maker in 0.10.X don't support mirro

[jira] [Created] (KAFKA-4102) Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X?

yf created KAFKA-4102: - Summary: Is kafka mirror maker in 0.10.X don't support mirror kafka 0.8.X? Key: KAFKA-4102 URL: https://issues.apache.org/jira/browse/KAFKA-4102 Project: Kafka Issue Type

Kafka Mirror maker duplicate issue

Hi there, I created a broker as stand by using Kafka Mirror maker but same messages gets consumed by both Source broker and mirror broker. Ex: I send 1000 messages let's say offset value 1 to 1000 and consumed 500 messages from the source broker. Now my broker goes down and want to read

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

pull request at: https://github.com/apache/kafka/pull/1687 > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > URL: https://issues.apache.org/jir

[GitHub] kafka pull request #1687: KAFKA-3950: kafka mirror maker tool is not respect...

Github user omkreddy closed the pull request at: https://github.com/apache/kafka/pull/1687 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

the 0.10.0 branch. In trunk, we'll pursue KAFKA-3396 instead. > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > URL: https://issues.apache.or

[jira] [Resolved] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

] > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > URL: https://issues.apache.org/jira/browse/KAFKA-3950 > Project: Kafka > Issue T

[jira] [Updated] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

[ https://issues.apache.org/jira/browse/KAFKA-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-3950: --- Affects Version/s: (was: 0.10.0.0) 0.9.0.0 > kafka mirror ma

[jira] [Updated] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

[ https://issues.apache.org/jira/browse/KAFKA-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-3950: --- Reviewer: Ismael Juma Fix Version/s: 0.10.0.1 > kafka mirror maker tool is

[jira] [Updated] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

[ https://issues.apache.org/jira/browse/KAFKA-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar Reddy updated KAFKA-3950: --- Affects Version/s: 0.10.0.0 > kafka mirror maker tool is not respecting whitelist opt

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

uest: https://github.com/apache/kafka/pull/1687 KAFKA-3950: kafka mirror maker tool is not respecting whitelist option You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka KAFKA-3950 Alternatively you can review and a

[GitHub] kafka pull request #1687: KAFKA-3950: kafka mirror maker tool is not respect...

GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/1687 KAFKA-3950: kafka mirror maker tool is not respecting whitelist option You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka KAFKA

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

pull request at: https://github.com/apache/kafka/pull/1615 > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > URL: https://issues.apache.org/jir

[GitHub] kafka pull request #1615: KAFKA-3950: kafka mirror maker tool is not respect...

Github user omkreddy closed the pull request at: https://github.com/apache/kafka/pull/1615 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

.0.1 release? > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > URL: https://issues.apache.org/jira/browse/KAFKA-3950 > Project: Kafka >

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

uest: https://github.com/apache/kafka/pull/1615 KAFKA-3950: kafka mirror maker tool is not respecting whitelist option You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka KAFKA-3950-CONSUMER-PATTREN Alternatively you

[GitHub] kafka pull request #1615: KAFKA-3950: kafka mirror maker tool is not respect...

GitHub user omkreddy opened a pull request: https://github.com/apache/kafka/pull/1615 KAFKA-3950: kafka mirror maker tool is not respecting whitelist option You can merge this pull request into a Git repository by running: $ git pull https://github.com/omkreddy/kafka KAFKA

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

} > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > URL: https://issues.apache.org/jira/browse/KAFKA-3950 > Project: Kafka > Issue

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

the authorization for a topic that you meant to include in your regex, you won't get an error. I think that's OK, but something that is important to call out. > kafka mirror maker tool is not respecting whitelist option > -- >

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

n to read are returned I think we can consider this is a authorization success. And we can throw exception if none of topics matched. > kafka mirror maker tool is not respecting whitelist option > -- > >

[jira] [Comment Edited] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

point, we can perhaps change the semantics so that we apply the regex over the authorized topics only. > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > U

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

t, we can perhaps change the semantics so that we apply the regex over the authorized topics only. > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > URL: https:

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

e ones the consumer has permission to read. We can simply return them that matches the pattern to end user > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 >

[jira] [Comment Edited] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

return them that matches the pattern to end user > kafka mirror maker tool is not respecting whitelist option > -- > > Key: KAFKA-3950 > URL: https://issues.apache.org/jira/browse/KAFKA-39

[jira] [Commented] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

ary in Java as that is probably the closest one would have to a standard. In any case, it's a significant change which would require a KIP and quite a bit of discussion. > kafka mirror maker tool is not respe

[jira] [Updated] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

metadata and then it is applying the pattern matching on client side. One possible solution is, send the pattern string to server and fetch only required topic metadata [~ijuma] [~hachikuji]] I would like to know your views on this issue. > kafka mirror maker tool is not respecting whitel

[jira] [Updated] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

[ https://issues.apache.org/jira/browse/KAFKA-3950?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sriharsha Chintalapani updated KAFKA-3950: -- Assignee: Manikumar Reddy > kafka mirror maker tool is not respecting whitel

[jira] [Created] (KAFKA-3950) kafka mirror maker tool is not respecting whitelist option

Raghav Kumar Gautam created KAFKA-3950: -- Summary: kafka mirror maker tool is not respecting whitelist option Key: KAFKA-3950 URL: https://issues.apache.org/jira/browse/KAFKA-3950 Project: Kafka

[jira] [Commented] (KAFKA-3609) Implement partial mirroring functionality in Kafka Mirror Maker

tial mirroring of topics by using --whitelist config property. > Implement partial mirroring functionality in Kafka Mirror Maker > > > Key: KAFKA-3609 > URL: https://issues.apache.org/jir

[jira] [Created] (KAFKA-3609) Implement partial mirroring functionality in Kafka Mirror Maker

Sukhdev Saini created KAFKA-3609: Summary: Implement partial mirroring functionality in Kafka Mirror Maker Key: KAFKA-3609 URL: https://issues.apache.org/jira/browse/KAFKA-3609 Project: Kafka

[jira] [Created] (KAFKA-3327) Warning from kafka mirror maker about ssl properties not valid

Munir Khan created KAFKA-3327: - Summary: Warning from kafka mirror maker about ssl properties not valid Key: KAFKA-3327 URL: https://issues.apache.org/jira/browse/KAFKA-3327 Project: Kafka

Re: KAfka Mirror Maker

Mirror Maker does not have specific restrictions on cluster size. The error you saw was because consumer was not able to talk to the broker. Can you try to use kafka-console-consumer to consume some data from your source cluster and see if it works? It should be under KAFKA_HOME/bin/ Jiangjie (Be

KAfka Mirror Maker

Hi, I'm using Mirror Maker with a cluster of 3 nodes and cluster of 5 nodes. I would like to ask - is the number of nodes a restriction for Mirror Maker? Also, are there any other restrictions or properties that should be common across both the clusters so that they continue mirroring. I'm aski