Hello users, We are using kafka 0.11 2 node kafka cluster which is running on Linux. Has any one faced below error while cleaning up old segments. Do I need to manually clean up old segments? Any info provided would be help full.
[2019-01-31 14:35:25,109] ERROR Exception in deleting Log(/Kafka/KafkaBroker/ hostname /appdata/__consumer_offsets-14.ca6412ac81b448d58f3a820cd18df24e-delete). Moving it to the end of the queue. (kafka.log.LogManager) java.nio.file.FileSystemException: /Kafka/KafkaBroker/hostname/appdata/__consumer_offsets-14.ca6412ac81b448d58f3a820cd18df24e-delete/.nfs000000009ddffd03000011e7: Device or resource busy at sun.nio.fs.UnixException.translateToIOException(UnixException.java:91) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) at sun.nio.fs.UnixFileSystemProvider.implDelete(UnixFileSystemProvider.java:244) at sun.nio.fs.AbstractFileSystemProvider.delete(AbstractFileSystemProvider.java:103) at java.nio.file.Files.delete(Files.java:1126) at org.apache.kafka.common.utils.Utils$2.visitFile(Utils.java:591) at org.apache.kafka.common.utils.Utils$2.visitFile(Utils.java:580) at java.nio.file.Files.walkFileTree(Files.java:2670) at java.nio.file.Files.walkFileTree(Files.java:2742) at org.apache.kafka.common.utils.Utils.delete(Utils.java:580) at kafka.log.Log.delete(Log.scala:1346) at kafka.log.LogManager.kafka$log$LogManager$$deleteLogs(LogManager.scala:446) at kafka.log.LogManager$$anonfun$startup$5.apply$mcV$sp(LogManager.scala:244) at kafka.utils.KafkaScheduler$$anonfun$1.apply$mcV$sp(KafkaScheduler.scala:110) at kafka.utils.CoreUtils$$anon$1.run(CoreUtils.scala:57) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:308) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$301(ScheduledThreadPoolExecutor.java:180) at java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:294) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) This message may contain information that is confidential or privileged. If you are not the intended recipient, please advise the sender immediately and delete this message. See http://www.blackrock.com/corporate/compliance/email-disclaimers for further information. Please refer to http://www.blackrock.com/corporate/compliance/privacy-policy for more information about BlackRock’s Privacy Policy. For a list of BlackRock's office addresses worldwide, see http://www.blackrock.com/corporate/about-us/contacts-locations. © 2019 BlackRock, Inc. All rights reserved.