You don't need to put in the jar file name in the plug in.path variable.
Something like plugin.path=/kafka/plugin. Then have the jar file in that
plugin folder. Restart the worker and it will pick it up.
On Sun, Jun 26, 2022 at 8:04 AM mason lee wrote:
> Hi I’m new to Kafka and i can not pass s
ed the distributor and connector
and it is working now.
:bang head on table:
Thanks for your help Chris and Martin.
On Tue, Mar 8, 2022 at 8:01 AM Men Lim wrote:
> HI Martin,
>
> the owner of the file is 'adm.' I have switched to the user 'adm' and is
> exe
e config provider isn't actually set up on the Connect
> worker. What does your Connect worker config look like (usually a file
> called something like connect-distributed.properties)? Feel free to change
> any sensitive values to a string like "", but please don't remove
&g
.TimestampConverter",
"transforms.Reroute.key.enforce.uniqueness": "false",
"transforms.Reroute.topic.regex": "(.*)",
"transforms.Reroute.topic.replacement": "list-cdc-generals-02",
"transforms.Reroute.t
pro:user\"} password=\"${file:/path/file.pro
> :password}\";"
>
> and still ran into issues, we'd probably need to see log files or, at the
> very least, the stack trace for the task from the REST API (if it failed at
> all) in order to follow up and provide
sorts of errors are you seeing when trying to use a config provider
> with sasl/scram credentials?
>
> [1] - https://issues.apache.org/jira/browse/KAFKA-9845
>
> Cheers,
>
> Chris
>
> On Mon, Mar 7, 2022 at 10:35 AM Men Lim wrote:
>
> > Hi all,
> >
> > re
Hi all,
recently, I found out about
config.providers=file
config.providers.file.class=org.apache.kafka.common.config.provider.FileConfigProvider
This works great to remove our embedded database password into an external
file. However, it does not work when I tried to do the same thing with the
ommended for production scenarios
>
> I hope this clarifies your concerns
>
>
>
> On Wed, Jan 26, 2022 at 9:50 AM Men Lim wrote:
>
> > i'm curious at what point can 3.x be production ready?
> >
> > On Mon, Jan 24, 2022 at 10:04 AM David Jacot wrote:
> &g
Thanks Ed.
On Mon, Jan 24, 2022 at 2:21 PM Edward Capriolo
wrote:
> In general you can delete log4j1.jar
> Replace with log4jcore_2.17.1.jar
> And log4japi_2.17.1.jar
>
> Ed
>
> On Monday, January 24, 2022, Men Lim wrote:
>
> > Is there a write out of t
i'm curious at what point can 3.x be production ready?
On Mon, Jan 24, 2022 at 10:04 AM David Jacot wrote:
> The Apache Kafka community is pleased to announce the release for
> Apache Kafka 3.1.0.
>
> It is a major release that includes many new features, including:
>
> * Apache Kafka supports J
Is there a write out of the steps that need to be taken?
On Mon, Jan 24, 2022 at 10:36 AM Edward Capriolo
wrote:
> Explained in another thread log4j api is separate from implementation. Its
> possible to remove log4j 1.2 jars from classpath and upgrade to log4j
> 2.17.1 without changing a line o
I am running AWS MSK v2.7.0 with SASL/SCRAM. I have an ec2 instance running
the kafka connector and mirror maker 2 (MM2). I was able to start up the
distributor w/o any issue but when I run the curl command to start the
worker, the output look fine but no data are replicating.
curl -s -X POST -H '
I'm currently using Kafka-gitops.
On Sat, Nov 6, 2021 at 3:35 AM Kafka Life wrote:
> Dear Kafka experts
>
> does anyone have ready /automated script to create /delete /alter topics in
> different environments?
> taking Configuration parameter as input .
>
> if yes i request you to kindly share i
Nope. Mm2 has that prefix. I read that in 3.0, that prefix is going away.
On Thu, Oct 7, 2021 at 11:31 AM Jake Mayward
wrote:
> Hi,
>
> I have read a bit on MirrorMaker 2 via
> https://kafka.apache.org/documentation/#georeplication-overview, and I am
> curious whether I can enable replication wi
bump
On Wed, Sep 29, 2021 at 4:09 PM Men Lim wrote:
> Hi all,
> I'm setting up two new clusters today and using mm2 to replicate data from
> clusterA --> clusterB. I noticed that the topic has the same amount of
> record but the size is small by 5x.
>
> source topic
Hi all,
I'm setting up two new clusters today and using mm2 to replicate data from
clusterA --> clusterB. I noticed that the topic has the same amount of
record but the size is small by 5x.
source topic is 6.975 MB
target topic is: 1.136 MB
It has the same number of record. both cluster is usin
did you try setting these values in the distributor.properties file?
On Mon, Sep 20, 2021 at 12:43 AM Jamie wrote:
> Hi All,
> Has anyone been able to override the producer and consumer values of the
> MM2 MirrorSourceConnector as described below?
> Many Thanks,
> Jamie
>
>
> -Original Messa
Have you tried running mm2 in a distributed mode instead of
standalone/dedicated? Try using this file below that I have working on a
AWS EC2 instance:
name=mm2
clusters = source, target
source.bootstrap.servers = source:9092
target.bootstrap.servers = target:9092
group.id = mm2
## all replicatio
that article linked to apache error code, which tells you their meaning.
https://kafka.apache.org/protocol.html#protocol_error_codes
On Wed, Apr 28, 2021 at 6:44 AM Nikita Kretov wrote:
> I'm doing little research about what metrics and formulas used to
> calculate SLA for kafka clusters. I fou
Hi Madhan,
try this article I found a while back in case this also become my use case
https://stackoverflow.com/questions/59390555/is-it-possible-to-replicate-kafka-topics-without-alias-prefix-with-mirrormaker2
On Thu, Apr 22, 2021 at 9:40 PM Dhanikachalam, Madhan (CORP)
wrote:
> I am testing
SSL-enabled, then the consumer of mm2
> should be configured to read from SSL-enabled cluster
> if the target kafka cluster is SSL-enabled, then the producer of mm2
> should be configured to write to SSL-enabled cluster.
>
> On 2021/04/16 03:23:21, Men Lim wrote:
> > well the 405 is
. at least got past the curl problem.
On Wed, Apr 14, 2021 at 12:11 PM Men Lim wrote:
> I read thru the security_ssl page when I started this, it doesn't apply
> much to me because I'm running this in AWS MSK, where I can't access the
> broker. so my hands are ti
r is SSL enabled. If your MM2
> wants to write to such cluster, you may have the following config in your
> MM2:
>
>
> https://github.com/ning2008wisc/minikube-mm2-demo/blob/master/kafka-mm/values.yaml#L79-L80
>
> on the broker (even client) side, you may refer to:
>
> http://
h SSL and IIRC, probably give a try of
> self-signing certs and key for testing purpose:
> https://linuxize.com/post/creating-a-self-signed-ssl-certificate/
>
> On 2021/04/09 03:14:30, Men Lim wrote:
> > Hi Ryanne,
> >
> > thanks for the reply. My kafka clusters are on A
host and fail to
> find these files.
>
> Ryanne
>
>
> On Wed, Mar 31, 2021, 8:22 PM Men Lim wrote:
>
> > Hello. I was wondering if someone can help answer my question. I'm
> trying
> > to run MirrorMaker 2 in distributed mode using SSL. I have the
> distri
Hello. I was wondering if someone can help answer my question. I'm trying
to run MirrorMaker 2 in distributed mode using SSL. I have the distributor
running in SSL but when I can't get the curl REST api to do so. I saw that
kif-208 fixed this but I can't seem to implement it.
in my mm2-dist.pro
26 matches
Mail list logo
