[ https://issues.apache.org/jira/browse/KAFKA-5377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Markus B updated KAFKA-5377: ---------------------------- Summary: Kafka server process crashing due to access violation (caused by log cleaner) (was: Kafka process crashing due to access violation) > Kafka server process crashing due to access violation (caused by log cleaner) > ----------------------------------------------------------------------------- > > Key: KAFKA-5377 > URL: https://issues.apache.org/jira/browse/KAFKA-5377 > Project: Kafka > Issue Type: Bug > Components: core > Affects Versions: 0.10.2.0, 0.10.2.1 > Environment: Windows 2008 R2, Intel Xeon CPU, 64 GB RAM > 4 Disk Drives (C for software, D for log files, E/F for Kafka/Zookeeper data) > 2 broker cluster > Reporter: Markus B > Labels: windows > Attachments: hs_err_pid15944.log, hs_err_pid6304.log, > hs_err_pid7356.log, hs_err_pid9056.log, hs_err_pid9276.log, > java_error7192.log, server.1.properties > > > We are running Kafka in a 2 x broker cluster configuration on Windows, and > overall it has been working well for us. We have been seeing occasional > issues where the broker crashes first on one node, and then almost > immediately on the second. When we go an try to re-start, the broker > continues to crash during startup. > I finally figured out that the cause of the startup not working was a bad set > of files in __consumer_offsets-2 (in this latest case). Once I deleted the > bad files, the broker started up correctly again. > From what I can tell, looking at both code, crash dump files, it is all > happening because of the log cleaner, and I can pinpoint it down in most (if > not all) cases to TimeIndex. The java dump file indicates some kind of an > access violation, but I am not sure when/how that is happening. > I am attaching dump files from two separate instances of when it initially > crashed, and then when we try to restart. Also including the broker config > settings that we are using. > I'm not sure what additional information to provide, but I can add more if > needed. > Any help, suggestions or input would be very appreciated. -- This message was sent by Atlassian JIRA (v6.3.15#6346)