[ 
https://issues.apache.org/jira/browse/KAFKA-17547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17884911#comment-17884911
 ] 

George Yang commented on KAFKA-17547:
-------------------------------------

Could someone who has a deep understanding of Mirror Maker 2 please take a look?

> Write large number of mirror maker logs when Kafka crashes
> ----------------------------------------------------------
>
>                 Key: KAFKA-17547
>                 URL: https://issues.apache.org/jira/browse/KAFKA-17547
>             Project: Kafka
>          Issue Type: Task
>          Components: mirrormaker
>    Affects Versions: 3.7.1
>         Environment: OS: AlmaLinux 9.3
> CPU: 28cores
> Mem: 128GiB
> Kafka: v3.7.0
> MirrorMaker2: v3.7.1
>            Reporter: George Yang
>            Priority: Blocker
>         Attachments: connect.log
>
>   Original Estimate: 48h
>  Remaining Estimate: 48h
>
> We have deployed 2 data centers, each with one node, and on each node, there 
> is a Kafka pod and a MirrorMaker2 pod. Currently, if one of the Kafka pods 
> crashes, the running MirrorMaker2 pod will continuously output a large number 
> of logs (please see the attachment). As long as the Kafka pod remains down, 
> the logs will keep accumulating, eventually filling up the disk. Besides 
> stopping all the MirrorMaker2 instances or getting the crashed Kafka pod back 
> online, are there any other solutions to prevent this excessive logging? For 
> example, can we configure any parameters in MirrorMaker2 to handle this?



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to