Hi, I've been working with Kafka a lot recently and have the log retention set to over two years.
Today, as I was trying some things I happened to have the log running in another window and on two different VMs, Kafka decided to delete all my log messages, thus losing the entire topic's worth of data - something that takes a couple of hours to load. Can anyone tell me what might have affected this? I set the log retention to a very big number in the server.properties file, but I'm unaware of anything else that might affect this. What I observed is that this happened very soon after a reboot of Kafka (under 5 minutes I think - certainly less than 10) and I watched it occur on two boxes within half an hour of each other as I was restarting Kafka...