[
https://issues.apache.org/jira/browse/KAFKA-3802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15319321#comment-15319321
]
Andrew Otto commented on KAFKA-3802:
------------------------------------
I am running Kafka 0.9.01 on Debian Jessie, with 12 log.dirs on different
disks.
Here are my server.logs during the shutdown:
{noformat}
[2016-06-07 17:50:41,421] INFO [Kafka Server 20], shutting down
(kafka.server.KafkaServer)
[2016-06-07 17:50:41,428] INFO [Kafka Server 20], Starting controlled shutdown
(kafka.server.KafkaServer)
[2016-06-07 17:50:41,956] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWebBrowse,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,159] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWebBrowse,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,161] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,14]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,161] INFO Truncating log __consumer_offsets-14 to offset
108. (kafka.log.Log)
[2016-06-07 17:50:42,599] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileAppShareAttempts,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,600] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileAppShareAttempts,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,601] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging-valid-mixed,8]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,603] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging-valid-mixed,8]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,603] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_text,9] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,605] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_text,9] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,606] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,28]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,608] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,28]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,608] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_GuidedTourButtonClick,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,611] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_GuidedTourButtonClick,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,613] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_parsoid,1]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,619] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_parsoid,1]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,621] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_CompletionSuggestions,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,624] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_CompletionSuggestions,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,625] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_maps,5] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,625] INFO [ReplicaFetcherThread-10-12], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:42,659] INFO [ReplicaFetcherThread-10-12], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:42,659] INFO [ReplicaFetcherThread-10-12], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:42,663] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_maps,5] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,667] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging-valid-mixed,3]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,679] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging-valid-mixed,3]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,684] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,36]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,690] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,36]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,691] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_EventError,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,694] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_EventError,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,694] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,6]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,697] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,6]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,698] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppShareAFact,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,702] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppShareAFact,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,703] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_maps,10] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,705] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_maps,10] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,706] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_PageDeletion,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,708] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_PageDeletion,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,708] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppLangSelect,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,709] INFO [ReplicaFetcherThread-11-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:42,753] INFO [ReplicaFetcherThread-11-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:42,753] INFO [ReplicaFetcherThread-11-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:42,757] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppLangSelect,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,758] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_upload,21]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,760] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_upload,21]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,762] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_parsoid,5]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:42,762] INFO Truncating log webrequest_parsoid-5 to offset 0.
(kafka.log.Log)
[2016-06-07 17:50:43,271] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppPageScroll,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:43,272] INFO Truncating log
eventlogging_MobileWikiAppPageScroll-0 to offset 43378416. (kafka.log.Log)
[2016-06-07 17:50:43,769] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_UploadWizardStep,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:43,770] INFO [ReplicaFetcherThread-10-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:43,793] INFO [ReplicaFetcherThread-10-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:43,793] INFO [ReplicaFetcherThread-10-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:43,796] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_UploadWizardStep,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:43,797] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_SaveTiming,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:43,797] INFO Truncating log eventlogging_SaveTiming-0 to
offset 66966500. (kafka.log.Log)
[2016-06-07 17:50:44,231] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppWiktionaryPopup,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:44,233] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppWiktionaryPopup,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:44,234] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileAppLoginAttempts,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:44,234] INFO Truncating log
eventlogging_MobileAppLoginAttempts-0 to offset 23055. (kafka.log.Log)
[2016-06-07 17:50:44,666] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_ContentTranslationError,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:44,666] INFO Truncating log
eventlogging_ContentTranslationError-0 to offset 861283. (kafka.log.Log)
[2016-06-07 17:50:45,160] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,23]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,162] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [__consumer_offsets,23]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,163] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_text,22] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,164] INFO Truncating log webrequest_text-22 to offset
14932414156. (kafka.log.Log)
[2016-06-07 17:50:45,607] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWebLanguageSwitcher,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,609] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWebLanguageSwitcher,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,610] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWebEditing,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,612] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWebEditing,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,613] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging-valid-mixed,9]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,616] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging-valid-mixed,9]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,617] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging-valid-mixed,4]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:45,617] INFO Truncating log eventlogging-valid-mixed-4 to
offset 283209759. (kafka.log.Log)
[2016-06-07 17:50:46,023] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppSavedPages,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,027] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppSavedPages,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,029] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppInstallReferrer,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,029] INFO [ReplicaFetcherThread-7-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:46,125] INFO [ReplicaFetcherThread-7-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:46,125] INFO [ReplicaFetcherThread-7-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:46,131] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppInstallReferrer,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,132] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppFindInPage,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,133] INFO [ReplicaFetcherThread-6-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:46,163] INFO [ReplicaFetcherThread-6-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:46,163] INFO [ReplicaFetcherThread-6-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:46,167] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_MobileWikiAppFindInPage,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,168] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [webrequest_misc,0] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,168] INFO Truncating log webrequest_misc-0 to offset
92211111. (kafka.log.Log)
[2016-06-07 17:50:46,560] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [test2,0] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,563] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [test2,0] (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,564] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions [eventlogging_QuickSurveyInstance,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:46,565] INFO Truncating log
eventlogging_QuickSurveyInstance-0 to offset 0. (kafka.log.Log)
[2016-06-07 17:50:46,822] INFO [Kafka Server 20], Controlled shutdown succeeded
(kafka.server.KafkaServer)
[2016-06-07 17:50:46,829] INFO [Socket Server on Broker 20], Shutting down
(kafka.network.SocketServer)
[2016-06-07 17:50:46,867] INFO [Socket Server on Broker 20], Shutdown completed
(kafka.network.SocketServer)
[2016-06-07 17:50:46,869] INFO [Kafka Request Handler on Broker 20], shutting
down (kafka.server.KafkaRequestHandlerPool)
[2016-06-07 17:50:47,047] INFO [Kafka Request Handler on Broker 20], shut down
completely (kafka.server.KafkaRequestHandlerPool)
[2016-06-07 17:50:47,057] INFO [ThrottledRequestReaper-Produce], Shutting down
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-06-07 17:50:47,573] INFO [ThrottledRequestReaper-Produce], Stopped
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-06-07 17:50:47,573] INFO [ThrottledRequestReaper-Produce], Shutdown
completed (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-06-07 17:50:47,573] INFO [ThrottledRequestReaper-Fetch], Shutting down
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-06-07 17:50:47,581] INFO [ThrottledRequestReaper-Fetch], Stopped
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-06-07 17:50:47,581] INFO [ThrottledRequestReaper-Fetch], Shutdown
completed (kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-06-07 17:50:47,584] INFO [KafkaApi-20] Shutdown complete.
(kafka.server.KafkaApis)
[2016-06-07 17:50:47,588] INFO [Replica Manager on Broker 20]: Shutting down
(kafka.server.ReplicaManager)
[2016-06-07 17:50:47,589] INFO [ReplicaFetcherManager on broker 20] shutting
down (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:47,590] INFO [ReplicaFetcherThread-6-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,709] INFO [ReplicaFetcherThread-6-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,709] INFO [ReplicaFetcherThread-6-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,713] INFO [ReplicaFetcherThread-8-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,961] INFO [ReplicaFetcherThread-8-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,961] INFO [ReplicaFetcherThread-8-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,965] INFO [ReplicaFetcherThread-9-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,968] INFO [ReplicaFetcherThread-9-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,968] INFO [ReplicaFetcherThread-9-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:47,971] INFO [ReplicaFetcherThread-3-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,179] INFO [ReplicaFetcherThread-3-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,179] INFO [ReplicaFetcherThread-3-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,183] INFO [ReplicaFetcherThread-0-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,190] INFO [ReplicaFetcherThread-0-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,190] INFO [ReplicaFetcherThread-0-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,193] INFO [ReplicaFetcherThread-6-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,213] INFO [ReplicaFetcherThread-6-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,213] INFO [ReplicaFetcherThread-6-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,217] INFO [ReplicaFetcherThread-10-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,317] INFO [ReplicaFetcherThread-10-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,317] INFO [ReplicaFetcherThread-10-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,320] INFO [ReplicaFetcherThread-10-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,681] INFO [ReplicaFetcherThread-10-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,681] INFO [ReplicaFetcherThread-10-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,685] INFO [ReplicaFetcherThread-1-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,806] INFO [ReplicaFetcherThread-1-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,806] INFO [ReplicaFetcherThread-1-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,810] INFO [ReplicaFetcherThread-5-12], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,820] INFO [ReplicaFetcherThread-5-12], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,820] INFO [ReplicaFetcherThread-5-12], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,826] INFO [ReplicaFetcherThread-0-12], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:48,884] ERROR [ReplicaFetcherThread-11-14], Error due to
(kafka.server.ReplicaFetcherThread)
kafka.common.KafkaException: error processing data for partition
[webrequest_upload,6] offset 97914864866
at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$2$$anonfun$apply$mcV$sp$1$$anonfun$apply$2.apply(AbstractFetcherThread.scala:147)
at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$2$$anonfun$apply$mcV$sp$1$$anonfun$apply$2.apply(AbstractFetcherThread.scala:122)
at scala.Option.foreach(Option.scala:257)
at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$2$$anonfun$apply$mcV$sp$1.apply(AbstractFetcherThread.scala:122)
at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$2$$anonfun$apply$mcV$sp$1.apply(AbstractFetcherThread.scala:120)
at
scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at
scala.collection.mutable.HashMap$$anonfun$foreach$1.apply(HashMap.scala:99)
at
scala.collection.mutable.HashTable$class.foreachEntry(HashTable.scala:230)
at scala.collection.mutable.HashMap.foreachEntry(HashMap.scala:40)
at scala.collection.mutable.HashMap.foreach(HashMap.scala:99)
at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$2.apply$mcV$sp(AbstractFetcherThread.scala:120)
at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$2.apply(AbstractFetcherThread.scala:120)
at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$2.apply(AbstractFetcherThread.scala:120)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:262)
at
kafka.server.AbstractFetcherThread.processFetchRequest(AbstractFetcherThread.scala:118)
at
kafka.server.AbstractFetcherThread.doWork(AbstractFetcherThread.scala:93)
at kafka.utils.ShutdownableThread.run(ShutdownableThread.scala:63)
Caused by: java.lang.IllegalStateException: Kafka scheduler is not running.
at kafka.utils.KafkaScheduler.ensureRunning(KafkaScheduler.scala:132)
at kafka.utils.KafkaScheduler.schedule(KafkaScheduler.scala:106)
at kafka.log.Log.roll(Log.scala:647)
at kafka.log.Log.maybeRoll(Log.scala:602)
at kafka.log.Log.append(Log.scala:357)
at
kafka.server.ReplicaFetcherThread.processPartitionData(ReplicaFetcherThread.scala:113)
at
kafka.server.ReplicaFetcherThread.processPartitionData(ReplicaFetcherThread.scala:42)
at
kafka.server.AbstractFetcherThread$$anonfun$processFetchRequest$2$$anonfun$apply$mcV$sp$1$$anonfun$apply$2.apply(AbstractFetcherThread.scala:138)
... 16 more
[2016-06-07 17:50:48,975] INFO [ReplicaFetcherThread-11-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,071] INFO [ReplicaFetcherThread-0-12], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,071] INFO [ReplicaFetcherThread-0-12], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,074] INFO [ReplicaFetcherThread-1-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,359] INFO [ReplicaFetcherThread-1-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,359] INFO [ReplicaFetcherThread-1-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,363] INFO [ReplicaFetcherThread-2-12], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,576] INFO [ReplicaFetcherThread-2-12], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,576] INFO [ReplicaFetcherThread-2-12], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,580] INFO [ReplicaFetcherThread-8-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,762] INFO [ReplicaFetcherThread-8-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,762] INFO [ReplicaFetcherThread-8-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,766] INFO [ReplicaFetcherThread-11-12], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,881] INFO [ReplicaFetcherThread-11-12], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,881] INFO [ReplicaFetcherThread-11-12], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:49,884] INFO [ReplicaFetcherThread-0-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,336] INFO [ReplicaFetcherThread-0-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,336] INFO [ReplicaFetcherThread-0-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,339] INFO [ReplicaFetcherThread-5-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,748] INFO [ReplicaFetcherThread-5-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,749] INFO [ReplicaFetcherThread-5-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,751] INFO [ReplicaFetcherThread-4-12], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,849] INFO [ReplicaFetcherThread-4-12], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,849] INFO [ReplicaFetcherThread-4-12], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,851] INFO [ReplicaFetcherThread-11-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,863] INFO [ReplicaFetcherThread-11-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,863] INFO [ReplicaFetcherThread-11-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,866] INFO [ReplicaFetcherThread-3-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,921] INFO [ReplicaFetcherThread-3-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,921] INFO [ReplicaFetcherThread-3-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:50,924] INFO [ReplicaFetcherThread-10-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,050] INFO [ReplicaFetcherThread-10-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,050] INFO [ReplicaFetcherThread-10-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,053] INFO [ReplicaFetcherThread-3-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,054] INFO [ReplicaFetcherThread-3-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,054] INFO [ReplicaFetcherThread-3-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,057] INFO [ReplicaFetcherThread-4-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,073] INFO [ReplicaFetcherThread-4-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,073] INFO [ReplicaFetcherThread-4-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,076] INFO [ReplicaFetcherThread-9-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,279] INFO [ReplicaFetcherThread-9-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,279] INFO [ReplicaFetcherThread-9-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,284] INFO [ReplicaFetcherThread-1-12], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,293] INFO [ReplicaFetcherThread-1-12], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,293] INFO [ReplicaFetcherThread-1-12], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,296] INFO [ReplicaFetcherThread-11-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,296] INFO [ReplicaFetcherThread-11-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,297] INFO [ReplicaFetcherThread-3-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,421] INFO [ReplicaFetcherThread-3-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,421] INFO [ReplicaFetcherThread-3-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,425] INFO [ReplicaFetcherThread-5-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,429] INFO [ReplicaFetcherThread-5-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,429] INFO [ReplicaFetcherThread-5-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,432] INFO [ReplicaFetcherThread-6-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,454] INFO [ReplicaFetcherThread-6-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,454] INFO [ReplicaFetcherThread-6-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,457] INFO [ReplicaFetcherThread-4-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,728] INFO [ReplicaFetcherThread-4-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,728] INFO [ReplicaFetcherThread-4-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:51,731] INFO [ReplicaFetcherThread-7-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,193] INFO [ReplicaFetcherThread-7-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,193] INFO [ReplicaFetcherThread-7-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,198] INFO [ReplicaFetcherThread-9-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,201] INFO [ReplicaFetcherThread-9-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,201] INFO [ReplicaFetcherThread-9-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,202] INFO [ReplicaFetcherThread-8-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,219] INFO [ReplicaFetcherThread-8-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,219] INFO [ReplicaFetcherThread-8-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,220] INFO [ReplicaFetcherThread-1-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,221] INFO [ReplicaFetcherThread-1-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,221] INFO [ReplicaFetcherThread-1-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,222] INFO [ReplicaFetcherThread-5-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,228] INFO [ReplicaFetcherThread-5-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,228] INFO [ReplicaFetcherThread-5-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,229] INFO [ReplicaFetcherThread-9-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,231] INFO [ReplicaFetcherThread-9-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,231] INFO [ReplicaFetcherThread-9-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,232] INFO [ReplicaFetcherThread-2-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,642] INFO [ReplicaFetcherThread-2-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,642] INFO [ReplicaFetcherThread-2-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,643] INFO [ReplicaFetcherThread-7-12], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,884] INFO [ReplicaFetcherThread-7-12], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,884] INFO [ReplicaFetcherThread-7-12], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,886] INFO [ReplicaFetcherThread-2-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,893] INFO [ReplicaFetcherThread-2-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,894] INFO [ReplicaFetcherThread-2-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:52,895] INFO [ReplicaFetcherThread-8-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,198] INFO [ReplicaFetcherThread-8-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,198] INFO [ReplicaFetcherThread-8-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,200] INFO [ReplicaFetcherThread-0-13], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,404] INFO [ReplicaFetcherThread-0-13], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,404] INFO [ReplicaFetcherThread-0-13], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,406] INFO [ReplicaFetcherThread-7-18], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,722] INFO [ReplicaFetcherThread-7-18], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,722] INFO [ReplicaFetcherThread-7-18], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,724] INFO [ReplicaFetcherThread-2-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,795] INFO [ReplicaFetcherThread-2-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,795] INFO [ReplicaFetcherThread-2-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,797] INFO [ReplicaFetcherThread-0-14], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,833] INFO [ReplicaFetcherThread-0-14], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,833] INFO [ReplicaFetcherThread-0-14], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,835] INFO [ReplicaFetcherThread-11-22], Shutting down
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,920] INFO [ReplicaFetcherThread-11-22], Stopped
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,920] INFO [ReplicaFetcherThread-11-22], Shutdown completed
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:50:53,923] INFO [ReplicaFetcherManager on broker 20] shutdown
completed (kafka.server.ReplicaFetcherManager)
[2016-06-07 17:50:53,923] INFO [ExpirationReaper-20], Shutting down
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:50:53,956] INFO [ExpirationReaper-20], Stopped
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:50:53,956] INFO [ExpirationReaper-20], Shutdown completed
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:50:53,956] INFO [ExpirationReaper-20], Shutting down
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:50:54,008] INFO [ExpirationReaper-20], Stopped
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:50:54,008] INFO [ExpirationReaper-20], Shutdown completed
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:50:54,468] INFO [Replica Manager on Broker 20]: Shut down
completely (kafka.server.ReplicaManager)
[2016-06-07 17:50:54,470] INFO Shutting down. (kafka.log.LogManager)
[2016-06-07 17:52:08,442] INFO Shutdown complete. (kafka.log.LogManager)
[2016-06-07 17:52:08,443] INFO [GroupCoordinator 20]: Shutting down.
(kafka.coordinator.GroupCoordinator)
[2016-06-07 17:52:08,444] INFO [ExpirationReaper-20], Shutting down
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:08,622] INFO [ExpirationReaper-20], Stopped
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:08,622] INFO [ExpirationReaper-20], Shutdown completed
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:08,622] INFO [ExpirationReaper-20], Shutting down
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:08,822] INFO [ExpirationReaper-20], Stopped
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:08,822] INFO [ExpirationReaper-20], Shutdown completed
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:08,823] INFO [GroupCoordinator 20]: Shutdown complete.
(kafka.coordinator.GroupCoordinator)
[2016-06-07 17:52:09,958] INFO [Kafka Server 20], shut down completed
(kafka.server.KafkaServer)
{noformat}
and then also the logs during the next startup:
{noformat}
[2016-06-07 17:52:27,489] INFO KafkaConfig values:
request.timeout.ms = 30000
log.roll.hours = 168
inter.broker.protocol.version = 0.9.0.X
log.preallocate = false
security.inter.broker.protocol = PLAINTEXT
controller.socket.timeout.ms = 30000
broker.id.generation.enable = false
ssl.keymanager.algorithm = SunX509
ssl.key.password = null
log.cleaner.enable = true
ssl.provider = null
num.recovery.threads.per.data.dir = 1
background.threads = 10
unclean.leader.election.enable = true
sasl.kerberos.kinit.cmd = /usr/bin/kinit
replica.lag.time.max.ms = 30000
ssl.endpoint.identification.algorithm = null
auto.create.topics.enable = true
zookeeper.sync.time.ms = 2000
ssl.client.auth = none
ssl.keystore.password = null
log.cleaner.io.buffer.load.factor = 0.9
offsets.topic.compression.codec = 0
log.retention.hours = 168
log.dirs =
/var/spool/kafka/a/data,/var/spool/kafka/b/data,/var/spool/kafka/c/data,/var/spool/kafka/d/data,/var/spool/kafka/e/data,/var/spool/kafka/f/data,/var/spool/kafka/g/data,/var/spool/kafka/h/data,/var/spool/kafka/i/data,/var/spool/kafka/j/data,/var/spool/kafka/k/data,/var/spool/kafka/l/data
ssl.protocol = TLS
log.index.size.max.bytes = 10485760
sasl.kerberos.min.time.before.relogin = 60000
log.retention.minutes = null
connections.max.idle.ms = 600000
ssl.trustmanager.algorithm = PKIX
offsets.retention.minutes = 10080
max.connections.per.ip = 2147483647
replica.fetch.wait.max.ms = 500
metrics.num.samples = 2
port = 9092
offsets.retention.check.interval.ms = 600000
log.cleaner.dedupe.buffer.size = 134217728
log.segment.bytes = 536870912
group.min.session.timeout.ms = 6000
producer.purgatory.purge.interval.requests = 1000
min.insync.replicas = 1
ssl.truststore.password = null
log.flush.scheduler.interval.ms = 9223372036854775807
socket.receive.buffer.bytes = 1048576
leader.imbalance.per.broker.percentage = 10
num.io.threads = 12
zookeeper.connect =
conf1001.eqiad.wmnet,conf1002.eqiad.wmnet,conf1003.eqiad.wmnet/kafka/eqiad
queued.max.requests = 500
offsets.topic.replication.factor = 3
replica.socket.timeout.ms = 30000
offsets.topic.segment.bytes = 104857600
replica.high.watermark.checkpoint.interval.ms = 5000
broker.id = 20
ssl.keystore.location = null
listeners = null
log.flush.interval.messages = 10000
principal.builder.class = class
org.apache.kafka.common.security.auth.DefaultPrincipalBuilder
log.retention.ms = null
offsets.commit.required.acks = -1
sasl.kerberos.principal.to.local.rules = [DEFAULT]
group.max.session.timeout.ms = 30000
num.replica.fetchers = 12
advertised.listeners = null
replica.socket.receive.buffer.bytes = 65536
delete.topic.enable = false
log.index.interval.bytes = 4096
metric.reporters = []
compression.type = producer
log.cleanup.policy = delete
controlled.shutdown.max.retries = 3
log.cleaner.threads = 1
quota.window.size.seconds = 1
zookeeper.connection.timeout.ms = 16000
offsets.load.buffer.size = 5242880
zookeeper.session.timeout.ms = 16000
ssl.cipher.suites = null
authorizer.class.name =
sasl.kerberos.ticket.renew.jitter = 0.05
sasl.kerberos.service.name = null
controlled.shutdown.enable = true
offsets.topic.num.partitions = 50
quota.window.num = 11
message.max.bytes = 1000012
log.cleaner.backoff.ms = 15000
log.roll.jitter.hours = 0
log.retention.check.interval.ms = 300000
replica.fetch.max.bytes = 1048576
log.cleaner.delete.retention.ms = 86400000
fetch.purgatory.purge.interval.requests = 1000
log.cleaner.min.cleanable.ratio = 0.5
offsets.commit.timeout.ms = 5000
zookeeper.set.acl = false
log.retention.bytes = -1
offset.metadata.max.bytes = 4096
leader.imbalance.check.interval.seconds = 300
quota.consumer.default = 9223372036854775807
log.roll.jitter.ms = null
reserved.broker.max.id = 1000
replica.fetch.backoff.ms = 1000
advertised.host.name = null
quota.producer.default = 9223372036854775807
log.cleaner.io.buffer.size = 524288
controlled.shutdown.retry.backoff.ms = 5000
log.dir = /tmp/kafka-logs
log.flush.offset.checkpoint.interval.ms = 60000
log.segment.delete.delay.ms = 60000
num.partitions = 1
num.network.threads = 3
socket.request.max.bytes = 104857600
sasl.kerberos.ticket.renew.window.factor = 0.8
log.roll.ms = null
ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
socket.send.buffer.bytes = 1048576
log.flush.interval.ms = 3000
ssl.truststore.location = null
log.cleaner.io.max.bytes.per.second = 1.7976931348623157E308
default.replication.factor = 3
metrics.sample.window.ms = 30000
auto.leader.rebalance.enable = false
host.name =
ssl.truststore.type = JKS
advertised.port = null
max.connections.per.ip.overrides =
replica.fetch.min.bytes = 1
ssl.keystore.type = JKS
(kafka.server.KafkaConfig)
[2016-06-07 17:52:27,636] INFO starting (kafka.server.KafkaServer)
[2016-06-07 17:52:27,646] INFO Connecting to zookeeper on
conf1001.eqiad.wmnet,conf1002.eqiad.wmnet,conf1003.eqiad.wmnet/kafka/eqiad
(kafka.server.KafkaServer)
[2016-06-07 17:52:27,867] INFO Created zookeeper path /kafka/eqiad
(kafka.server.KafkaServer)
[2016-06-07 17:52:28,982] INFO Loading logs. (kafka.log.LogManager)
[2016-06-07 17:52:29,126] INFO Completed load of log webrequest_bits-3 with log
end offset 837954 (kafka.log.Log)
[2016-06-07 17:52:29,126] INFO Completed load of log webrequest_mobile-3 with
log end offset 17894209399 (kafka.log.Log)
[2016-06-07 17:52:29,165] INFO Completed load of log
eventlogging_MobileWikiAppWiktionaryPopup-0 with log end offset 12473
(kafka.log.Log)
[2016-06-07 17:52:29,165] INFO Completed load of log
eventlogging_MobileWikiAppLinkPreview-0 with log end offset 37521991
(kafka.log.Log)
[2016-06-07 17:52:29,165] INFO Completed load of log eventlogging_GeoFeatures-0
with log end offset 14993097 (kafka.log.Log)
[2016-06-07 17:52:29,165] INFO Completed load of log eventlogging-valid-mixed-3
with log end offset 283209869 (kafka.log.Log)
[2016-06-07 17:52:29,165] INFO Completed load of log
eventlogging_GuidedTourInternalLinkActivation-0 with log end offset 935
(kafka.log.Log)
[2016-06-07 17:52:29,165] INFO Completed load of log eventlogging_Edit-0 with
log end offset 429834019 (kafka.log.Log)
[2016-06-07 17:52:29,165] INFO Completed load of log
eventlogging_MobileWikiAppSearch-0 with log end offset 52512455 (kafka.log.Log)
[2016-06-07 17:52:29,174] INFO Completed load of log __consumer_offsets-14 with
log end offset 108 (kafka.log.Log)
[2016-06-07 17:52:29,176] INFO Completed load of log
eventlogging_DeprecatedUsage-0 with log end offset 49676034 (kafka.log.Log)
[2016-06-07 17:52:29,179] INFO Completed load of log webrequest_parsoid-10 with
log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,181] INFO Completed load of log __consumer_offsets-42 with
log end offset 72 (kafka.log.Log)
[2016-06-07 17:52:29,189] INFO Completed load of log
eventlogging_MobileWikiAppArticleSuggestions-0 with log end offset 42821018
(kafka.log.Log)
[2016-06-07 17:52:29,193] INFO Completed load of log eventlogging-client-side-9
with log end offset 261372261 (kafka.log.Log)
[2016-06-07 17:52:29,194] INFO Completed load of log
eventlogging_MobileBetaWatchlist-0 with log end offset 26 (kafka.log.Log)
[2016-06-07 17:52:29,196] INFO Completed load of log
eventlogging_MobileWikiAppFindInPage-0 with log end offset 1429024
(kafka.log.Log)
[2016-06-07 17:52:29,199] INFO Completed load of log
eventlogging_MobileWebInfobox-0 with log end offset 3 (kafka.log.Log)
[2016-06-07 17:52:29,200] INFO Completed load of log eventlogging_DidYouMean-0
with log end offset 3196696 (kafka.log.Log)
[2016-06-07 17:52:29,241] INFO Completed load of log
eventlogging_GuidedTourButtonClick-0 with log end offset 1288131 (kafka.log.Log)
[2016-06-07 17:52:29,241] INFO Completed load of log
eventlogging_ModuleStorage-0 with log end offset 3 (kafka.log.Log)
[2016-06-07 17:52:29,241] INFO Completed load of log mediawiki.page_restore-0
with log end offset 8251 (kafka.log.Log)
[2016-06-07 17:52:29,243] INFO Completed load of log __consumer_offsets-44 with
log end offset 1235 (kafka.log.Log)
[2016-06-07 17:52:29,249] INFO Completed load of log
eventlogging_CompletionSuggestions-0 with log end offset 63504 (kafka.log.Log)
[2016-06-07 17:52:29,399] INFO Completed load of log mediawiki_ApiAction-11
with log end offset 2452741248 (kafka.log.Log)
[2016-06-07 17:52:29,434] INFO Completed load of log
mediawiki_CirrusSearchRequestSet-0 with log end offset 1955701161
(kafka.log.Log)
[2016-06-07 17:52:29,453] INFO Completed load of log webrequest_upload-11 with
log end offset 97894161473 (kafka.log.Log)
[2016-06-07 17:52:29,454] INFO Completed load of log webrequest_bits-2 with log
end offset 835825 (kafka.log.Log)
[2016-06-07 17:52:29,459] INFO Completed load of log
mediawiki_CirrusSearchRequestSet-9 with log end offset 1955047235
(kafka.log.Log)
[2016-06-07 17:52:29,462] INFO Completed load of log mediawiki_ApiAction-6 with
log end offset 2446512781 (kafka.log.Log)
[2016-06-07 17:52:29,464] INFO Completed load of log
mediawiki_CirrusSearchRequestSet-4 with log end offset 1956126367
(kafka.log.Log)
[2016-06-07 17:52:29,466] INFO Completed load of log
eventlogging_MobileWikiAppEdit-0 with log end offset 18302109 (kafka.log.Log)
[2016-06-07 17:52:29,467] INFO Completed load of log
eventlogging_JQMigrateUsage-0 with log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,468] INFO Completed load of log webrequest_maps-10 with
log end offset 34784420 (kafka.log.Log)
[2016-06-07 17:52:29,471] INFO Completed load of log
eventlogging_DiacriticsPoll-0 with log end offset 25913 (kafka.log.Log)
[2016-06-07 17:52:29,473] INFO Completed load of log webrequest_upload-22 with
log end offset 13540016874 (kafka.log.Log)
[2016-06-07 17:52:29,477] INFO Completed load of log
eventlogging_RelatedArticles-0 with log end offset 173127 (kafka.log.Log)
[2016-06-07 17:52:29,482] INFO Completed load of log statsv-4 with log end
offset 264694815 (kafka.log.Log)
[2016-06-07 17:52:29,482] INFO Completed load of log __consumer_offsets-27 with
log end offset 264 (kafka.log.Log)
[2016-06-07 17:52:29,486] INFO Completed load of log webrequest_upload-21 with
log end offset 13541009694 (kafka.log.Log)
[2016-06-07 17:52:29,488] INFO Completed load of log webrequest_maps-5 with log
end offset 34766232 (kafka.log.Log)
[2016-06-07 17:52:29,492] INFO Completed load of log __consumer_offsets-8 with
log end offset 122 (kafka.log.Log)
[2016-06-07 17:52:29,494] INFO Completed load of log statsv-8 with log end
offset 264810362 (kafka.log.Log)
[2016-06-07 17:52:29,501] INFO Completed load of log
eventlogging_MobileWebLanguageSwitcher-0 with log end offset 23772228
(kafka.log.Log)
[2016-06-07 17:52:29,507] INFO Completed load of log mediawiki_avro-0 with log
end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,509] INFO Completed load of log webrequest_upload-12 with
log end offset 13543098479 (kafka.log.Log)
[2016-06-07 17:52:29,510] INFO Completed load of log eventlogging_PageMove-0
with log end offset 1382778 (kafka.log.Log)
[2016-06-07 17:52:29,515] INFO Completed load of log mediawiki_ApiAction-0 with
log end offset 2446407806 (kafka.log.Log)
[2016-06-07 17:52:29,516] INFO Completed load of log __consumer_offsets-2 with
log end offset 110 (kafka.log.Log)
[2016-06-07 17:52:29,518] INFO Completed load of log eventlogging-client-side-5
with log end offset 261352323 (kafka.log.Log)
[2016-06-07 17:52:29,520] INFO Completed load of log __consumer_offsets-31 with
log end offset 268 (kafka.log.Log)
[2016-06-07 17:52:29,521] INFO Completed load of log
eventlogging_MobileWebSearch-0 with log end offset 7810381 (kafka.log.Log)
[2016-06-07 17:52:29,523] INFO Completed load of log __consumer_offsets-12 with
log end offset 57844611 (kafka.log.Log)
[2016-06-07 17:52:29,527] INFO Completed load of log eventlogging_PrefUpdate-0
with log end offset 11280710 (kafka.log.Log)
[2016-06-07 17:52:29,531] INFO Completed load of log test2-0 with log end
offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,534] INFO Completed load of log
eventlogging_MobileWikiAppWidgets-0 with log end offset 2341355 (kafka.log.Log)
[2016-06-07 17:52:29,535] INFO Completed load of log
eventlogging_GettingStartedRedirectImpression-0 with log end offset 1713873
(kafka.log.Log)
[2016-06-07 17:52:29,554] INFO Completed load of log __consumer_offsets-22 with
log end offset 1639 (kafka.log.Log)
[2016-06-07 17:52:29,555] INFO Completed load of log
eventlogging_MobileWikiAppSavedPages-0 with log end offset 24235187
(kafka.log.Log)
[2016-06-07 17:52:29,573] INFO Completed load of log webrequest_maps-3 with log
end offset 34808121 (kafka.log.Log)
[2016-06-07 17:52:29,573] INFO Completed load of log stat1002-krinkle-statsv-0
with log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,574] INFO Completed load of log
eventlogging_MobileWikiAppLangSelect-0 with log end offset 150844
(kafka.log.Log)
[2016-06-07 17:52:29,576] INFO Completed load of log
eventlogging-valid-mixed-10 with log end offset 283209099 (kafka.log.Log)
[2016-06-07 17:52:29,579] INFO Completed load of log webrequest_parsoid-6 with
log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,580] INFO Completed load of log __consumer_offsets-17 with
log end offset 50 (kafka.log.Log)
[2016-06-07 17:52:29,581] INFO Completed load of log statsv-2 with log end
offset 264814934 (kafka.log.Log)
[2016-06-07 17:52:29,581] INFO Completed load of log
eventlogging-NavigationTiming-0 with log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,586] INFO Completed load of log
eventlogging_GuidedTourExternalLinkActivation-0 with log end offset 73654
(kafka.log.Log)
[2016-06-07 17:52:29,600] INFO Completed load of log mediawiki.page_delete-0
with log end offset 674079 (kafka.log.Log)
[2016-06-07 17:52:29,600] INFO Completed load of log
eventlogging_ContentTranslationError-0 with log end offset 861283
(kafka.log.Log)
[2016-06-07 17:52:29,600] INFO Completed load of log statsv-krinkle-3-0 with
log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,607] INFO Completed load of log webrequest_mobile-0 with
log end offset 17891114625 (kafka.log.Log)
[2016-06-07 17:52:29,611] INFO Completed load of log eventlogging_EditEvent-0
with log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,614] INFO Completed load of log webrequest_misc-6 with log
end offset 92201128 (kafka.log.Log)
[2016-06-07 17:52:29,616] INFO Completed load of log webrequest-0 with log end
offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,619] INFO Completed load of log
eventlogging_GatherClicks-0 with log end offset 1197058 (kafka.log.Log)
[2016-06-07 17:52:29,623] INFO Completed load of log webrequest_upload-1 with
log end offset 97898786880 (kafka.log.Log)
[2016-06-07 17:52:29,629] INFO Completed load of log
eventlogging_PageDeletion-0 with log end offset 2998051 (kafka.log.Log)
[2016-06-07 17:52:29,637] INFO Completed load of log __consumer_offsets-28 with
log end offset 504 (kafka.log.Log)
[2016-06-07 17:52:29,640] INFO Completed load of log
eventlogging_NewEditorEdit-0 with log end offset 6387084 (kafka.log.Log)
[2016-06-07 17:52:29,644] INFO Completed load of log
eventlogging_WikipediaZeroUsage-0 with log end offset 16650 (kafka.log.Log)
[2016-06-07 17:52:29,649] INFO Completed load of log
eventlogging_ServerSideAccountCreation-0 with log end offset 3397410
(kafka.log.Log)
[2016-06-07 17:52:29,652] INFO Completed load of log mediawiki_ApiAction-5 with
log end offset 2452802963 (kafka.log.Log)
[2016-06-07 17:52:29,653] INFO Completed load of log __consumer_offsets-7 with
log end offset 52 (kafka.log.Log)
[2016-06-07 17:52:29,658] INFO Completed load of log
eventlogging_MobileWikiAppNavMenu-0 with log end offset 27661241 (kafka.log.Log)
[2016-06-07 17:52:29,658] INFO Completed load of log webrequest_parsoid-0 with
log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,663] INFO Completed load of log
eventlogging_UploadWizardErrorFlowEvent-0 with log end offset 333229
(kafka.log.Log)
[2016-06-07 17:52:29,679] INFO Completed load of log
eventlogging-client-side-10 with log end offset 261460757 (kafka.log.Log)
[2016-06-07 17:52:29,760] INFO Completed load of log webrequest_upload-16 with
log end offset 13541056163 (kafka.log.Log)
[2016-06-07 17:52:29,763] INFO Completed load of log webrequest_bits-7 with log
end offset 835486 (kafka.log.Log)
[2016-06-07 17:52:29,782] INFO Completed load of log
eventlogging_MobileWikiAppShareAFact-0 with log end offset 52712337
(kafka.log.Log)
[2016-06-07 17:52:29,817] INFO Completed load of log webrequest_upload-23 with
log end offset 13540530443 (kafka.log.Log)
[2016-06-07 17:52:29,855] INFO Completed load of log statsv-5 with log end
offset 264438940 (kafka.log.Log)
[2016-06-07 17:52:29,875] INFO Completed load of log
eventlogging_GuidedTourGuiderImpression-0 with log end offset 1913145
(kafka.log.Log)
[2016-06-07 17:52:29,879] INFO Completed load of log webrequest_text-9 with log
end offset 83027843060 (kafka.log.Log)
[2016-06-07 17:52:29,880] INFO Completed load of log webrequest_text-17 with
log end offset 14933154741 (kafka.log.Log)
[2016-06-07 17:52:29,880] INFO Completed load of log
eventlogging_MobileAppLoginAttempts-0 with log end offset 23055 (kafka.log.Log)
[2016-06-07 17:52:29,892] INFO Completed load of log webrequest_mobile-9 with
log end offset 17891981772 (kafka.log.Log)
[2016-06-07 17:52:29,895] INFO Completed load of log eventlogging_SaveTiming-0
with log end offset 66966500 (kafka.log.Log)
[2016-06-07 17:52:29,896] INFO Completed load of log webrequest_text-21 with
log end offset 14932940109 (kafka.log.Log)
[2016-06-07 17:52:29,898] INFO Completed load of log eventlogging-server-side-0
with log end offset 361024567 (kafka.log.Log)
[2016-06-07 17:52:29,910] INFO Completed load of log webrequest_text-15 with
log end offset 14934735785 (kafka.log.Log)
[2016-06-07 17:52:29,911] INFO Completed load of log statsv-9 with log end
offset 264521225 (kafka.log.Log)
[2016-06-07 17:52:29,914] INFO Completed load of log
eventlogging_MobileWikiAppPageScroll-0 with log end offset 43378416
(kafka.log.Log)
[2016-06-07 17:52:29,916] INFO Completed load of log
eventlogging_MobileWebMainMenuClickTracking-0 with log end offset 23974098
(kafka.log.Log)
[2016-06-07 17:52:29,917] INFO Completed load of log
eventlogging_MobileWebBrowse-0 with log end offset 2331909 (kafka.log.Log)
[2016-06-07 17:52:29,921] INFO Completed load of log
eventlogging_MobileAppUploadAttempts-0 with log end offset 11661 (kafka.log.Log)
[2016-06-07 17:52:29,921] INFO Completed load of log __consumer_offsets-32 with
log end offset 84 (kafka.log.Log)
[2016-06-07 17:52:29,926] INFO Completed load of log webrequest_text-7 with log
end offset 82971720060 (kafka.log.Log)
[2016-06-07 17:52:29,926] INFO Completed load of log
eventlogging_GuidedTourGuiderHidden-0 with log end offset 249090 (kafka.log.Log)
[2016-06-07 17:52:29,928] INFO Completed load of log webrequest_text-1 with log
end offset 83030991720 (kafka.log.Log)
[2016-06-07 17:52:29,930] INFO Completed load of log
eventlogging_MobileWebClickTracking-0 with log end offset 380 (kafka.log.Log)
[2016-06-07 17:52:29,937] INFO Completed load of log eventlogging-0 with log
end offset 0 (kafka.log.Log)
[2016-06-07 17:52:29,938] INFO Completed load of log webrequest_misc-4 with log
end offset 92254385 (kafka.log.Log)
[2016-06-07 17:52:29,941] INFO Completed load of log
eventlogging_EditConflict-0 with log end offset 686364 (kafka.log.Log)
[2016-06-07 17:52:29,941] INFO Completed load of log webrequest_text-22 with
log end offset 14932414156 (kafka.log.Log)
[2016-06-07 17:52:29,942] INFO Completed load of log __consumer_offsets-36 with
log end offset 1033 (kafka.log.Log)
[2016-06-07 17:52:29,950] INFO Completed load of log __consumer_offsets-37 with
log end offset 271392534 (kafka.log.Log)
[2016-06-07 17:52:29,952] INFO Completed load of log webrequest_maps-0 with log
end offset 34781439 (kafka.log.Log)
[2016-06-07 17:52:29,952] INFO Completed load of log
eventlogging_UploadWizardStep-0 with log end offset 4072329 (kafka.log.Log)
[2016-06-07 17:52:29,954] INFO Completed load of log webrequest_misc-0 with log
end offset 92211111 (kafka.log.Log)
[2016-06-07 17:52:29,958] INFO Completed load of log eventlogging_Popups-0 with
log end offset 3458193 (kafka.log.Log)
[2016-06-07 17:52:29,964] INFO Completed load of log webrequest_text-20 with
log end offset 14932863637 (kafka.log.Log)
[2016-06-07 17:52:29,965] INFO Completed load of log eventlogging_MediaViewer-0
with log end offset 394907429 (kafka.log.Log)
[2016-06-07 17:52:29,967] INFO Completed load of log webrequest_upload-17 with
log end offset 13541303861 (kafka.log.Log)
[2016-06-07 17:52:29,969] INFO Completed load of log
eventlogging_EditorActivation-0 with log end offset 616117 (kafka.log.Log)
[2016-06-07 17:52:29,969] INFO Completed load of log
eventlogging_MobileAppShareAttempts-0 with log end offset 543 (kafka.log.Log)
[2016-06-07 17:52:29,970] INFO Completed load of log
eventlogging_UniversalLanguageSelector-tofu-0 with log end offset 65
(kafka.log.Log)
[2016-06-07 17:52:29,971] INFO Completed load of log webrequest_misc-9 with log
end offset 92149670 (kafka.log.Log)
[2016-06-07 17:52:29,973] INFO Completed load of log __consumer_offsets-23 with
log end offset 387 (kafka.log.Log)
[2016-06-07 17:52:29,974] INFO Completed load of log webrequest_mobile-8 with
log end offset 17889233207 (kafka.log.Log)
[2016-06-07 17:52:29,977] INFO Completed load of log eventlogging-valid-mixed-5
with log end offset 283209956 (kafka.log.Log)
[2016-06-07 17:52:29,978] INFO Completed load of log
eventlogging_MobileWikiAppStuffHappens-0 with log end offset 659844
(kafka.log.Log)
[2016-06-07 17:52:29,984] INFO Completed load of log
eventlogging_TranslationRecommendationAPIRequests-0 with log end offset 20993
(kafka.log.Log)
[2016-06-07 17:52:29,988] INFO Completed load of log eventlogging-valid-mixed-9
with log end offset 283209797 (kafka.log.Log)
[2016-06-07 17:52:29,990] INFO Completed load of log
eventlogging_MobileWebSectionUsage-0 with log end offset 351146900
(kafka.log.Log)
[2016-06-07 17:52:30,021] INFO Completed load of log webrequest_maps-11 with
log end offset 34810589 (kafka.log.Log)
[2016-06-07 17:52:30,023] INFO Completed load of log __consumer_offsets-47 with
log end offset 101254 (kafka.log.Log)
[2016-06-07 17:52:30,023] INFO Completed load of log webrequest_mobile-6 with
log end offset 17889884609 (kafka.log.Log)
[2016-06-07 17:52:30,024] INFO Completed load of log webrequest_text-16 with
log end offset 14932926783 (kafka.log.Log)
[2016-06-07 17:52:30,027] INFO Completed load of log
eventlogging_MobileWebEditing-0 with log end offset 30692868 (kafka.log.Log)
[2016-06-07 17:52:30,038] INFO Completed load of log
mediawiki.revision_create-0 with log end offset 24529666 (kafka.log.Log)
[2016-06-07 17:52:30,039] INFO Completed load of log
eventlogging_MobileWebLanguageSwitcher_15302503-0 with log end offset 0
(kafka.log.Log)
[2016-06-07 17:52:30,040] INFO Completed load of log webrequest_parsoid-11 with
log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:30,042] INFO Completed load of log webrequest_text-5 with log
end offset 83024258558 (kafka.log.Log)
[2016-06-07 17:52:30,042] INFO Completed load of log webrequet_text-0 with log
end offset 0 (kafka.log.Log)
[2016-06-07 17:52:30,043] INFO Completed load of log eventlogging_GatherFlags-0
with log end offset 287 (kafka.log.Log)
[2016-06-07 17:52:30,047] INFO Completed load of log mediawiki_ApiAction-1 with
log end offset 2443881329 (kafka.log.Log)
[2016-06-07 17:52:30,048] INFO Completed load of log __consumer_offsets-26 with
log end offset 26 (kafka.log.Log)
[2016-06-07 17:52:30,051] INFO Completed load of log webrequest_upload-8 with
log end offset 97924322040 (kafka.log.Log)
[2016-06-07 17:52:30,051] INFO Completed load of log
eventlogging_ImageMetricsLoadingTime-0 with log end offset 3783580
(kafka.log.Log)
[2016-06-07 17:52:30,058] INFO Completed load of log eventlogging-client-side-4
with log end offset 261616892 (kafka.log.Log)
[2016-06-07 17:52:30,062] INFO Completed load of log
mediawiki_CirrusSearchRequestSet-10 with log end offset 1956180386
(kafka.log.Log)
[2016-06-07 17:52:30,065] INFO Completed load of log
mediawiki_CirrusSearchRequestSet-11 with log end offset 1956564790
(kafka.log.Log)
[2016-06-07 17:52:30,066] INFO Completed load of log __consumer_offsets-20 with
log end offset 124 (kafka.log.Log)
[2016-06-07 17:52:30,069] INFO Completed load of log
eventlogging_TranslationRecommendationUserAction-0 with log end offset 109
(kafka.log.Log)
[2016-06-07 17:52:30,071] INFO Completed load of log webrequest_mobile-4 with
log end offset 17888950938 (kafka.log.Log)
[2016-06-07 17:52:30,078] INFO Completed load of log
eventlogging_MobileWikiAppMediaGallery-0 with log end offset 26522493
(kafka.log.Log)
[2016-06-07 17:52:30,080] INFO Completed load of log webrequest_misc-5 with log
end offset 92127194 (kafka.log.Log)
[2016-06-07 17:52:30,084] INFO Completed load of log __consumer_offsets-1 with
log end offset 28 (kafka.log.Log)
[2016-06-07 17:52:30,086] INFO Completed load of log webrequest_upload-2 with
log end offset 97917737974 (kafka.log.Log)
[2016-06-07 17:52:30,089] INFO Completed load of log __consumer_offsets-38 with
log end offset 252 (kafka.log.Log)
[2016-06-07 17:52:30,092] INFO Completed load of log webrequest_upload-0 with
log end offset 97928176556 (kafka.log.Log)
[2016-06-07 17:52:30,092] INFO Completed load of log eventlogging_PersonalBar-0
with log end offset 58 (kafka.log.Log)
[2016-06-07 17:52:30,095] INFO Completed load of log webrequest_bits-6 with log
end offset 833762 (kafka.log.Log)
[2016-06-07 17:52:30,098] INFO Completed load of log webrequest_parsoid-5 with
log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:30,104] INFO Completed load of log eventlogging_EchoMail-0
with log end offset 1979631 (kafka.log.Log)
[2016-06-07 17:52:30,105] INFO Completed load of log
mediawiki_CirrusSearchRequestSet-5 with log end offset 1956622978
(kafka.log.Log)
[2016-06-07 17:52:30,108] INFO Completed load of log webrequest_bits-1 with log
end offset 835897 (kafka.log.Log)
[2016-06-07 17:52:30,111] INFO Completed load of log eventlogging-valid-mixed-8
with log end offset 283209695 (kafka.log.Log)
[2016-06-07 17:52:30,111] INFO Completed load of log webrequest_parsoid-1 with
log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:30,114] INFO Completed load of log webrequest_maps-9 with log
end offset 34762140 (kafka.log.Log)
[2016-06-07 17:52:30,115] INFO Completed load of log
eventlogging-client-side-11 with log end offset 261590956 (kafka.log.Log)
[2016-06-07 17:52:30,118] INFO Completed load of log
eventlogging_MobileWikiAppAppearanceSettings-0 with log end offset 4688554
(kafka.log.Log)
[2016-06-07 17:52:30,118] INFO Completed load of log webrequest_upload-6 with
log end offset 97914864866 (kafka.log.Log)
[2016-06-07 17:52:30,121] INFO Completed load of log
eventlogging_MultimediaViewerDuration-0 with log end offset 3937587
(kafka.log.Log)
[2016-06-07 17:52:30,132] INFO Completed load of log statsv-10 with log end
offset 264614132 (kafka.log.Log)
[2016-06-07 17:52:30,135] INFO Completed load of log __consumer_offsets-6 with
log end offset 36 (kafka.log.Log)
[2016-06-07 17:52:30,166] INFO Completed load of log
eventlogging_TranslationRecommendationUIRequests-0 with log end offset 1417
(kafka.log.Log)
[2016-06-07 17:52:30,166] INFO Completed load of log eventlogging_EventError-0
with log end offset 7410274 (kafka.log.Log)
[2016-06-07 17:52:30,166] INFO Completed load of log mediawiki_ApiAction-10
with log end offset 2449362826 (kafka.log.Log)
[2016-06-07 17:52:30,169] INFO Completed load of log webrequest_bits-8 with log
end offset 838912 (kafka.log.Log)
[2016-06-07 17:52:30,245] INFO Completed load of log webrequest_text-10 with
log end offset 83038575722 (kafka.log.Log)
[2016-06-07 17:52:30,248] INFO Completed load of log
eventlogging_QuickSurveyInstance-0 with log end offset 0 (kafka.log.Log)
[2016-06-07 17:52:30,248] INFO Completed load of log webrequest_text-4 with log
end offset 83038521314 (kafka.log.Log)
[2016-06-07 17:52:30,252] INFO Completed load of log __consumer_offsets-33 with
log end offset 288 (kafka.log.Log)
[2016-06-07 17:52:30,255] INFO Completed load of log
eventlogging_WikimediaBlogVisit-0 with log end offset 1185001 (kafka.log.Log)
[2016-06-07 17:52:30,276] INFO Completed load of log
eventlogging_MobileWikiAppInstallReferrer-0 with log end offset 453724
(kafka.log.Log)
[2016-06-07 17:52:30,280] INFO Completed load of log __consumer_offsets-3 with
log end offset 541 (kafka.log.Log)
[2016-06-07 17:52:30,294] INFO Completed load of log webrequest_misc-10 with
log end offset 92187205 (kafka.log.Log)
[2016-06-07 17:52:30,298] INFO Completed load of log eventlogging-valid-mixed-4
with log end offset 283209759 (kafka.log.Log)
[2016-06-07 17:52:30,311] INFO Completed load of log eventlogging_Analytics-0
with log end offset 2391078 (kafka.log.Log)
[2016-06-07 17:52:30,315] INFO Logs loading complete. (kafka.log.LogManager)
[2016-06-07 17:52:30,405] INFO Starting log cleanup with a period of 300000 ms.
(kafka.log.LogManager)
[2016-06-07 17:52:30,407] INFO Starting log flusher with a default period of
9223372036854775807 ms. (kafka.log.LogManager)
[2016-06-07 17:52:30,719] INFO Awaiting socket connections on 0.0.0.0:9092.
(kafka.network.Acceptor)
[2016-06-07 17:52:30,723] INFO [Socket Server on Broker 20], Started 1 acceptor
threads (kafka.network.SocketServer)
[2016-06-07 17:52:30,765] INFO [ExpirationReaper-20], Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:30,766] INFO [ExpirationReaper-20], Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:30,934] INFO [GroupCoordinator 20]: Starting up.
(kafka.coordinator.GroupCoordinator)
[2016-06-07 17:52:30,936] INFO [ExpirationReaper-20], Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:30,937] INFO [ExpirationReaper-20], Starting
(kafka.server.DelayedOperationPurgatory$ExpiredOperationReaper)
[2016-06-07 17:52:30,937] INFO [GroupCoordinator 20]: Startup complete.
(kafka.coordinator.GroupCoordinator)
[2016-06-07 17:52:30,939] INFO [Group Metadata Manager on Broker 20]: Removed 0
expired offsets in 6 milliseconds. (kafka.coordinator.GroupMetadataManager)
[2016-06-07 17:52:30,956] INFO [ThrottledRequestReaper-Produce], Starting
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-06-07 17:52:30,957] INFO [ThrottledRequestReaper-Fetch], Starting
(kafka.server.ClientQuotaManager$ThrottledRequestReaper)
[2016-06-07 17:52:30,965] INFO Will not load MX4J, mx4j-tools.jar is not in the
classpath (kafka.utils.Mx4jLoader$)
[2016-06-07 17:52:30,990] INFO Creating /brokers/ids/20 (is it secure? false)
(kafka.utils.ZKCheckedEphemeral)
[2016-06-07 17:52:31,057] INFO Result of znode creation is: OK
(kafka.utils.ZKCheckedEphemeral)
[2016-06-07 17:52:31,059] INFO Registered broker 20 at path /brokers/ids/20
with addresses: PLAINTEXT -> EndPoint(kafka1020.eqiad.wmnet,9092,PLAINTEXT)
(kafka.utils.ZkUtils)
[2016-06-07 17:52:31,069] INFO [Kafka Server 20], started
(kafka.server.KafkaServer)
[2016-06-07 17:52:32,548] INFO [ReplicaFetcherManager on broker 20] Removed
fetcher for partitions
[__consumer_offsets,2],[eventlogging_UploadWizardErrorFlowEvent,0],[eventlogging_GuidedTourGuiderHidden,0],[webrequest_upload,8],[eventlogging_UploadWizardStep,0],[webrequest_bits,3],[eventlogging_TranslationRecommendationUserAction,0],[webrequest_text,21],[eventlogging-valid-mixed,9],[__consumer_offsets,38],[__consumer_offsets,31],[eventlogging-client-side,9],[webrequest_parsoid,10],[webrequest_maps,10],[webrequest_maps,5],[webrequest_bits,8],[eventlogging_MobileWebBrowse,0],[mediawiki_avro,0],[eventlogging_GettingStartedRedirectImpression,0],[mediawiki_CirrusSearchRequestSet,5],[eventlogging_EditConflict,0],[webrequest_upload,21],[webrequest_misc,6],[webrequest_bits,1],[eventlogging_Popups,0],[webrequest_parsoid,1],[statsv,2],[webrequest_parsoid,6],[eventlogging_MobileWikiAppLinkPreview,0],[eventlogging_MobileWikiAppNavMenu,0],[eventlogging_SaveTiming,0],[webrequest_upload,22],[webrequest_mobile,4],[webrequest_bits,7],[webrequest_misc,5],[eventlogging_GuidedTourInternalLinkActivation,0],[eventlogging_MobileWikiAppEdit,0],[eventlogging_EditEvent,0],[eventlogging_MobileWebClickTracking,0],[eventlogging_MobileWikiAppPageScroll,0],[eventlogging_MobileWikiAppArticleSuggestions,0],[mediawiki_ApiAction,11],[eventlogging_MobileWebEditing,0],[eventlogging_JQMigrateUsage,0],[webrequest_upload,12],[eventlogging_ContentTranslationError,0],[stat1002-krinkle-statsv,0],[eventlogging_NewEditorEdit,0],[eventlogging_MobileWebInfobox,0],[eventlogging_EventError,0],[eventlogging_MobileWikiAppWidgets,0],[webrequest_upload,6],[eventlogging_ServerSideAccountCreation,0],[eventlogging_GatherFlags,0],[webrequest_maps,3],[webrequest_mobile,8],[eventlogging_GatherClicks,0],[eventlogging_MobileWikiAppSavedPages,0],[webrequest_parsoid,0],[eventlogging_MobileWikiAppStuffHappens,0],[webrequest_misc,9],[eventlogging_UniversalLanguageSelector-tofu,0],[eventlogging_MobileAppShareAttempts,0],[eventlogging_CompletionSuggestions,0],[webrequest_text,4],[eventlogging_QuickSurveyInstance,0],[mediawiki_ApiAction,0],[webrequest_parsoid,11],[__consumer_offsets,22],[eventlogging-valid-mixed,4],[eventlogging-client-side,4],[eventlogging-valid-mixed,5],[eventlogging_Edit,0],[eventlogging_WikimediaBlogVisit,0],[webrequest_upload,17],[statsv,5],[__consumer_offsets,23],[mediawiki_ApiAction,5],[webrequest_text,20],[eventlogging_ImageMetricsLoadingTime,0],[eventlogging_TranslationRecommendationAPIRequests,0],[__consumer_offsets,6],[__consumer_offsets,28],[mediawiki.revision_create,0],[__consumer_offsets,14],[eventlogging_MobileWebSearch,0],[test2,0],[__consumer_offsets,42],[eventlogging_MobileWikiAppShareAFact,0],[eventlogging_MobileWebLanguageSwitcher,0],[__consumer_offsets,1],[eventlogging_EditorActivation,0],[eventlogging_MobileWikiAppMediaGallery,0],[eventlogging_PageDeletion,0],[eventlogging-client-side,11],[webrequest_upload,16],[eventlogging_MobileWikiAppFindInPage,0],[eventlogging_GuidedTourExternalLinkActivation,0],[eventlogging_RelatedArticles,0],[mediawiki.page_restore,0],[__consumer_offsets,33],[mediawiki_CirrusSearchRequestSet,10],[eventlogging_WikipediaZeroUsage,0],[eventlogging-client-side,10],[eventlogging-valid-mixed,10],[webrequest_maps,9],[eventlogging_MobileAppLoginAttempts,0],[eventlogging_PrefUpdate,0],[eventlogging-valid-mixed,3],[webrequest_text,16],[eventlogging-NavigationTiming,0],[eventlogging_PersonalBar,0],[eventlogging_GeoFeatures,0],[eventlogging-server-side,0],[webrequest_text,7],[__consumer_offsets,26],[__consumer_offsets,17],[eventlogging_MobileWikiAppAppearanceSettings,0],[statsv-krinkle-3,0],[webrequest_upload,1],[eventlogging-valid-mixed,8],[__consumer_offsets,47],[statsv,8],[eventlogging_MobileAppUploadAttempts,0],[__consumer_offsets,37],[eventlogging,0],[eventlogging_GuidedTourButtonClick,0],[statsv,9],[eventlogging_MultimediaViewerDuration,0],[mediawiki_CirrusSearchRequestSet,0],[webrequest_mobile,0],[__consumer_offsets,12],[webrequest_upload,0],[webrequest_misc,10],[__consumer_offsets,8],[eventlogging_MediaViewer,0],[webrequest_upload,11],[mediawiki_CirrusSearchRequestSet,11],[eventlogging_MobileWikiAppLangSelect,0],[webrequest_maps,0],[eventlogging_MobileBetaWatchlist,0],[eventlogging_DiacriticsPoll,0],[mediawiki_CirrusSearchRequestSet,4],[webrequet_text,0],[webrequest_parsoid,5],[eventlogging-client-side,5],[eventlogging_MobileWikiAppSearch,0],[webrequest_misc,4],[eventlogging_MobileWikiAppInstallReferrer,0],[eventlogging_GuidedTourGuiderImpression,0],[__consumer_offsets,7],[webrequest_text,5],[webrequest_text,15],[webrequest,0],[webrequest_text,22],[webrequest_mobile,9],[eventlogging_DidYouMean,0],[mediawiki.page_delete,0],[webrequest_mobile,3],[webrequest_text,17],[eventlogging_DeprecatedUsage,0],[statsv,4],[webrequest_upload,23],[eventlogging_MobileWebLanguageSwitcher_15302503,0],[webrequest_text,9],[eventlogging_Analytics,0],[mediawiki_ApiAction,10],[webrequest_upload,2],[eventlogging_PageMove,0],[mediawiki_ApiAction,1],[eventlogging_ModuleStorage,0],[__consumer_offsets,44],[statsv,10],[webrequest_text,1],[__consumer_offsets,36],[__consumer_offsets,27],[webrequest_text,10],[eventlogging_TranslationRecommendationUIRequests,0],[__consumer_offsets,3],[webrequest_bits,2],[mediawiki_ApiAction,6],[webrequest_misc,0],[webrequest_bits,6],[eventlogging_EchoMail,0],[__consumer_offsets,32],[webrequest_maps,11],[eventlogging_MobileWikiAppWiktionaryPopup,0],[mediawiki_CirrusSearchRequestSet,9],[__consumer_offsets,20],[webrequest_mobile,6],[eventlogging_MobileWebSectionUsage,0],[eventlogging_MobileWebMainMenuClickTracking,0]
(kafka.server.ReplicaFetcherManager)
[2016-06-07 17:52:32,574] INFO Truncating log
eventlogging_MobileWikiAppLinkPreview-0 to offset 37521991. (kafka.log.Log)
[2016-06-07 17:52:32,576] INFO Truncating log __consumer_offsets-32 to offset
84. (kafka.log.Log)
[2016-06-07 17:52:32,576] INFO Truncating log
eventlogging_MobileWikiAppWidgets-0 to offset 2341355. (kafka.log.Log)
[2016-06-07 17:52:32,576] INFO Truncating log statsv-8 to offset 264810362.
(kafka.log.Log)
[2016-06-07 17:52:32,576] INFO Truncating log
eventlogging_QuickSurveyInstance-0 to offset 0. (kafka.log.Log)
[2016-06-07 17:52:32,577] INFO Truncating log __consumer_offsets-44 to offset
1235. (kafka.log.Log)
[2016-06-07 17:52:32,577] INFO Truncating log webrequest_mobile-9 to offset
17891981772. (kafka.log.Log)
[2016-06-07 17:52:32,577] INFO Truncating log eventlogging_WikipediaZeroUsage-0
to offset 16650. (kafka.log.Log)
[2016-06-07 17:52:32,577] INFO Truncating log eventlogging-client-side-10 to
offset 261460757. (kafka.log.Log)
[2016-06-07 17:52:32,577] INFO Truncating log webrequest_misc-9 to offset
92149668. (kafka.log.Log)
[2016-06-07 17:52:32,579] INFO Truncating log webrequest_text-16 to offset
14932926769. (kafka.log.Log)
[2016-06-07 17:52:32,580] INFO Truncating log
eventlogging_TranslationRecommendationUserAction-0 to offset 109.
(kafka.log.Log)
[2016-06-07 17:52:32,580] INFO Truncating log webrequest_upload-12 to offset
13543098457. (kafka.log.Log)
[2016-06-07 17:52:32,581] INFO Truncating log __consumer_offsets-28 to offset
504. (kafka.log.Log)
[2016-06-07 17:52:32,581] INFO Truncating log eventlogging_GatherClicks-0 to
offset 1197058. (kafka.log.Log)
[2016-06-07 17:52:32,581] INFO Truncating log
eventlogging_GuidedTourExternalLinkActivation-0 to offset 73654. (kafka.log.Log)
[2016-06-07 17:52:32,581] INFO Truncating log
eventlogging_MobileWebLanguageSwitcher-0 to offset 23772228. (kafka.log.Log)
[2016-06-07 17:52:32,582] INFO Truncating log webrequest_text-10 to offset
83038575626. (kafka.log.Log)
[2016-06-07 17:52:32,583] INFO Truncating log
eventlogging_MobileWikiAppPageScroll-0 to offset 43378416. (kafka.log.Log)
[2016-06-07 17:52:32,583] INFO Truncating log mediawiki_ApiAction-0 to offset
2446407805. (kafka.log.Log)
[2016-06-07 17:52:32,584] INFO Truncating log eventlogging_EditEvent-0 to
offset 0. (kafka.log.Log)
[2016-06-07 17:52:32,584] INFO Truncating log webrequest_bits-1 to offset
835897. (kafka.log.Log)
[2016-06-07 17:52:32,584] INFO Truncating log eventlogging_EditConflict-0 to
offset 686364. (kafka.log.Log)
[2016-06-07 17:52:32,584] INFO Truncating log eventlogging-client-side-4 to
offset 261616892. (kafka.log.Log)
[2016-06-07 17:52:32,585] INFO Truncating log eventlogging_DidYouMean-0 to
offset 3196696. (kafka.log.Log)
[2016-06-07 17:52:32,585] INFO Truncating log
mediawiki_CirrusSearchRequestSet-11 to offset 1956564790. (kafka.log.Log)
[2016-06-07 17:52:32,585] INFO Truncating log
eventlogging_GuidedTourButtonClick-0 to offset 1288131. (kafka.log.Log)
[2016-06-07 17:52:32,585] INFO Truncating log eventlogging_MediaViewer-0 to
offset 394907429. (kafka.log.Log)
[2016-06-07 17:52:32,586] INFO Truncating log
eventlogging_MobileAppUploadAttempts-0 to offset 11661. (kafka.log.Log)
[2016-06-07 17:52:32,586] INFO Truncating log
eventlogging_MobileWikiAppLangSelect-0 to offset 150844. (kafka.log.Log)
[2016-06-07 17:52:32,586] INFO Truncating log webrequest_upload-11 to offset
97894161412. (kafka.log.Log)
[2016-06-07 17:52:32,587] INFO Truncating log __consumer_offsets-17 to offset
50. (kafka.log.Log)
[2016-06-07 17:52:32,587] INFO Truncating log webrequest_upload-1 to offset
97898786880. (kafka.log.Log)
[2016-06-07 17:52:32,587] INFO Truncating log eventlogging_PageDeletion-0 to
offset 2998051. (kafka.log.Log)
[2016-06-07 17:52:32,587] INFO Truncating log eventlogging_SaveTiming-0 to
offset 66966500. (kafka.log.Log)
[2016-06-07 17:52:32,587] INFO Truncating log
eventlogging_UniversalLanguageSelector-tofu-0 to offset 65. (kafka.log.Log)
[2016-06-07 17:52:32,588] INFO Truncating log __consumer_offsets-23 to offset
387. (kafka.log.Log)
[2016-06-07 17:52:32,588] INFO Truncating log __consumer_offsets-7 to offset
52. (kafka.log.Log)
[2016-06-07 17:52:32,588] INFO Truncating log eventlogging_UploadWizardStep-0
to offset 4072329. (kafka.log.Log)
[2016-06-07 17:52:32,588] INFO Truncating log
eventlogging_UploadWizardErrorFlowEvent-0 to offset 333229. (kafka.log.Log)
[2016-06-07 17:52:32,588] INFO Truncating log
eventlogging_MobileWebLanguageSwitcher_15302503-0 to offset 0. (kafka.log.Log)
[2016-06-07 17:52:32,589] INFO Truncating log
eventlogging_MobileWebSectionUsage-0 to offset 351146900. (kafka.log.Log)
[2016-06-07 17:52:32,589] INFO Truncating log eventlogging_NewEditorEdit-0 to
offset 6387084. (kafka.log.Log)
[2016-06-07 17:52:32,589] INFO Truncating log mediawiki_ApiAction-5 to offset
2452802963. (kafka.log.Log)
[2016-06-07 17:52:32,589] INFO Truncating log eventlogging-valid-mixed-8 to
offset 283209695. (kafka.log.Log)
[2016-06-07 17:52:32,590] INFO Truncating log
eventlogging_MobileAppLoginAttempts-0 to offset 23055. (kafka.log.Log)
[2016-06-07 17:52:32,590] INFO Truncating log eventlogging-server-side-0 to
offset 361024567. (kafka.log.Log)
[2016-06-07 17:52:32,590] INFO Truncating log webrequest-0 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,590] INFO Truncating log webrequest_misc-4 to offset
92254385. (kafka.log.Log)
[2016-06-07 17:52:32,590] INFO Truncating log mediawiki_ApiAction-6 to offset
2446512780. (kafka.log.Log)
[2016-06-07 17:52:32,591] INFO Truncating log webrequest_mobile-8 to offset
17889233207. (kafka.log.Log)
[2016-06-07 17:52:32,591] INFO Truncating log
eventlogging_MobileWikiAppWiktionaryPopup-0 to offset 12473. (kafka.log.Log)
[2016-06-07 17:52:32,591] INFO Truncating log webrequest_text-17 to offset
14933154741. (kafka.log.Log)
[2016-06-07 17:52:32,592] INFO Truncating log eventlogging_PrefUpdate-0 to
offset 11280710. (kafka.log.Log)
[2016-06-07 17:52:32,593] INFO Truncating log mediawiki_ApiAction-11 to offset
2452741248. (kafka.log.Log)
[2016-06-07 17:52:32,593] INFO Truncating log
eventlogging_MobileBetaWatchlist-0 to offset 26. (kafka.log.Log)
[2016-06-07 17:52:32,593] INFO Truncating log webrequest_parsoid-5 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,593] INFO Truncating log __consumer_offsets-3 to offset
541. (kafka.log.Log)
[2016-06-07 17:52:32,594] INFO Truncating log eventlogging_RelatedArticles-0 to
offset 173127. (kafka.log.Log)
[2016-06-07 17:52:32,595] INFO Truncating log webrequest_upload-6 to offset
97914864513. (kafka.log.Log)
[2016-06-07 17:52:32,596] INFO Scheduling log segment 97914864866 for log
webrequest_upload-6 for deletion. (kafka.log.Log)
[2016-06-07 17:52:32,599] INFO Truncating log eventlogging_MobileWikiAppEdit-0
to offset 18302109. (kafka.log.Log)
[2016-06-07 17:52:32,599] INFO Truncating log
eventlogging_MobileWikiAppInstallReferrer-0 to offset 453724. (kafka.log.Log)
[2016-06-07 17:52:32,599] INFO Truncating log mediawiki.revision_create-0 to
offset 24529666. (kafka.log.Log)
[2016-06-07 17:52:32,599] INFO Truncating log eventlogging_DiacriticsPoll-0 to
offset 25913. (kafka.log.Log)
[2016-06-07 17:52:32,600] INFO Truncating log webrequest_maps-10 to offset
34784420. (kafka.log.Log)
[2016-06-07 17:52:32,600] INFO Truncating log webrequest_upload-0 to offset
97928176443. (kafka.log.Log)
[2016-06-07 17:52:32,601] INFO Truncating log __consumer_offsets-38 to offset
252. (kafka.log.Log)
[2016-06-07 17:52:32,601] INFO Truncating log
eventlogging_ServerSideAccountCreation-0 to offset 3397410. (kafka.log.Log)
[2016-06-07 17:52:32,601] INFO Truncating log statsv-10 to offset 264614130.
(kafka.log.Log)
[2016-06-07 17:52:32,601] INFO Truncating log
eventlogging_MobileWikiAppMediaGallery-0 to offset 26522493. (kafka.log.Log)
[2016-06-07 17:52:32,601] INFO Truncating log webrequest_upload-23 to offset
13540530443. (kafka.log.Log)
[2016-06-07 17:52:32,602] INFO Truncating log
eventlogging_MobileWikiAppShareAFact-0 to offset 52712337. (kafka.log.Log)
[2016-06-07 17:52:32,602] INFO Truncating log mediawiki_ApiAction-1 to offset
2443881292. (kafka.log.Log)
[2016-06-07 17:52:32,603] INFO Truncating log
mediawiki_CirrusSearchRequestSet-4 to offset 1956126366. (kafka.log.Log)
[2016-06-07 17:52:32,603] INFO Truncating log mediawiki.page_restore-0 to
offset 8251. (kafka.log.Log)
[2016-06-07 17:52:32,603] INFO Truncating log webrequest_parsoid-0 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,603] INFO Truncating log
eventlogging_CompletionSuggestions-0 to offset 63504. (kafka.log.Log)
[2016-06-07 17:52:32,603] INFO Truncating log __consumer_offsets-8 to offset
122. (kafka.log.Log)
[2016-06-07 17:52:32,604] INFO Truncating log webrequest_upload-22 to offset
13540016874. (kafka.log.Log)
[2016-06-07 17:52:32,604] INFO Truncating log eventlogging_JQMigrateUsage-0 to
offset 0. (kafka.log.Log)
[2016-06-07 17:52:32,604] INFO Truncating log
eventlogging_MobileWikiAppSavedPages-0 to offset 24235187. (kafka.log.Log)
[2016-06-07 17:52:32,605] INFO Truncating log statsv-9 to offset 264521224.
(kafka.log.Log)
[2016-06-07 17:52:32,605] INFO Truncating log eventlogging_GatherFlags-0 to
offset 287. (kafka.log.Log)
[2016-06-07 17:52:32,605] INFO Truncating log __consumer_offsets-36 to offset
1033. (kafka.log.Log)
[2016-06-07 17:52:32,605] INFO Truncating log eventlogging_WikimediaBlogVisit-0
to offset 1185001. (kafka.log.Log)
[2016-06-07 17:52:32,605] INFO Truncating log eventlogging-valid-mixed-9 to
offset 283209797. (kafka.log.Log)
[2016-06-07 17:52:32,606] INFO Truncating log
mediawiki_CirrusSearchRequestSet-9 to offset 1955047234. (kafka.log.Log)
[2016-06-07 17:52:32,606] INFO Truncating log eventlogging-0 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,606] INFO Truncating log webrequest_text-20 to offset
14932863560. (kafka.log.Log)
[2016-06-07 17:52:32,608] INFO Truncating log eventlogging_MobileWebBrowse-0 to
offset 2331909. (kafka.log.Log)
[2016-06-07 17:52:32,608] INFO Truncating log webrequest_bits-7 to offset
835486. (kafka.log.Log)
[2016-06-07 17:52:32,608] INFO Truncating log __consumer_offsets-33 to offset
288. (kafka.log.Log)
[2016-06-07 17:52:32,608] INFO Truncating log webrequest_text-7 to offset
82971713296. (kafka.log.Log)
[2016-06-07 17:52:32,610] INFO Truncating log __consumer_offsets-37 to offset
271392534. (kafka.log.Log)
[2016-06-07 17:52:32,611] INFO Truncating log
eventlogging_GuidedTourInternalLinkActivation-0 to offset 935. (kafka.log.Log)
[2016-06-07 17:52:32,611] INFO Truncating log webrequest_mobile-0 to offset
17891114625. (kafka.log.Log)
[2016-06-07 17:52:32,611] INFO Truncating log statsv-5 to offset 264438940.
(kafka.log.Log)
[2016-06-07 17:52:32,611] INFO Truncating log webrequest_upload-16 to offset
13541056163. (kafka.log.Log)
[2016-06-07 17:52:32,612] INFO Truncating log webrequest_misc-0 to offset
92211111. (kafka.log.Log)
[2016-06-07 17:52:32,612] INFO Truncating log webrequest_bits-8 to offset
838912. (kafka.log.Log)
[2016-06-07 17:52:32,612] INFO Truncating log mediawiki_ApiAction-10 to offset
2449362821. (kafka.log.Log)
[2016-06-07 17:52:32,613] INFO Truncating log webrequest_bits-3 to offset
837954. (kafka.log.Log)
[2016-06-07 17:52:32,613] INFO Truncating log eventlogging-NavigationTiming-0
to offset 0. (kafka.log.Log)
[2016-06-07 17:52:32,613] INFO Truncating log
eventlogging_TranslationRecommendationUIRequests-0 to offset 1417.
(kafka.log.Log)
[2016-06-07 17:52:32,613] INFO Truncating log webrequest_text-15 to offset
14934735705. (kafka.log.Log)
[2016-06-07 17:52:32,615] INFO Truncating log webrequest_maps-3 to offset
34808117. (kafka.log.Log)
[2016-06-07 17:52:32,615] INFO Truncating log eventlogging_EchoMail-0 to offset
1979631. (kafka.log.Log)
[2016-06-07 17:52:32,615] INFO Truncating log __consumer_offsets-6 to offset
36. (kafka.log.Log)
[2016-06-07 17:52:32,615] INFO Truncating log webrequest_maps-5 to offset
34766232. (kafka.log.Log)
[2016-06-07 17:52:32,616] INFO Truncating log webrequest_mobile-3 to offset
17894209399. (kafka.log.Log)
[2016-06-07 17:52:32,616] INFO Truncating log
eventlogging_MultimediaViewerDuration-0 to offset 3937587. (kafka.log.Log)
[2016-06-07 17:52:32,616] INFO Truncating log webrequest_maps-11 to offset
34810589. (kafka.log.Log)
[2016-06-07 17:52:32,616] INFO Truncating log webrequest_maps-9 to offset
34762140. (kafka.log.Log)
[2016-06-07 17:52:32,616] INFO Truncating log eventlogging-valid-mixed-4 to
offset 283209759. (kafka.log.Log)
[2016-06-07 17:52:32,616] INFO Truncating log
eventlogging_MobileAppShareAttempts-0 to offset 543. (kafka.log.Log)
[2016-06-07 17:52:32,617] INFO Truncating log webrequest_bits-2 to offset
835825. (kafka.log.Log)
[2016-06-07 17:52:32,617] INFO Truncating log eventlogging-valid-mixed-10 to
offset 283209099. (kafka.log.Log)
[2016-06-07 17:52:32,617] INFO Truncating log
mediawiki_CirrusSearchRequestSet-5 to offset 1956622978. (kafka.log.Log)
[2016-06-07 17:52:32,617] INFO Truncating log webrequest_parsoid-1 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,617] INFO Truncating log eventlogging_Analytics-0 to
offset 2391078. (kafka.log.Log)
[2016-06-07 17:52:32,618] INFO Truncating log statsv-4 to offset 264694814.
(kafka.log.Log)
[2016-06-07 17:52:32,618] INFO Truncating log
mediawiki_CirrusSearchRequestSet-10 to offset 1956180385. (kafka.log.Log)
[2016-06-07 17:52:32,619] INFO Truncating log eventlogging_MobileWebEditing-0
to offset 30692868. (kafka.log.Log)
[2016-06-07 17:52:32,619] INFO Truncating log webrequest_text-22 to offset
14932414156. (kafka.log.Log)
[2016-06-07 17:52:32,620] INFO Truncating log __consumer_offsets-20 to offset
124. (kafka.log.Log)
[2016-06-07 17:52:32,620] INFO Truncating log eventlogging_PersonalBar-0 to
offset 58. (kafka.log.Log)
[2016-06-07 17:52:32,621] INFO Truncating log
eventlogging_MobileWikiAppStuffHappens-0 to offset 659844. (kafka.log.Log)
[2016-06-07 17:52:32,621] INFO Truncating log __consumer_offsets-47 to offset
101254. (kafka.log.Log)
[2016-06-07 17:52:32,621] INFO Truncating log eventlogging_EditorActivation-0
to offset 616117. (kafka.log.Log)
[2016-06-07 17:52:32,621] INFO Truncating log webrequest_parsoid-10 to offset
0. (kafka.log.Log)
[2016-06-07 17:52:32,621] INFO Truncating log __consumer_offsets-2 to offset
110. (kafka.log.Log)
[2016-06-07 17:52:32,622] INFO Truncating log __consumer_offsets-27 to offset
264. (kafka.log.Log)
[2016-06-07 17:52:32,622] INFO Truncating log eventlogging_Edit-0 to offset
429834019. (kafka.log.Log)
[2016-06-07 17:52:32,622] INFO Truncating log webrequest_parsoid-6 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,622] INFO Truncating log
eventlogging_MobileWikiAppAppearanceSettings-0 to offset 4688554.
(kafka.log.Log)
[2016-06-07 17:52:32,622] INFO Truncating log webrequest_misc-6 to offset
92201124. (kafka.log.Log)
[2016-06-07 17:52:32,623] INFO Truncating log eventlogging-valid-mixed-5 to
offset 283209956. (kafka.log.Log)
[2016-06-07 17:52:32,623] INFO Truncating log
eventlogging_ImageMetricsLoadingTime-0 to offset 3783580. (kafka.log.Log)
[2016-06-07 17:52:32,623] INFO Truncating log webrequest_bits-6 to offset
833762. (kafka.log.Log)
[2016-06-07 17:52:32,623] INFO Truncating log __consumer_offsets-22 to offset
1639. (kafka.log.Log)
[2016-06-07 17:52:32,623] INFO Truncating log webrequest_text-9 to offset
83027843060. (kafka.log.Log)
[2016-06-07 17:52:32,625] INFO Truncating log eventlogging_Popups-0 to offset
3458193. (kafka.log.Log)
[2016-06-07 17:52:32,625] INFO Truncating log eventlogging_MobileWebSearch-0 to
offset 7810381. (kafka.log.Log)
[2016-06-07 17:52:32,625] INFO Truncating log __consumer_offsets-42 to offset
72. (kafka.log.Log)
[2016-06-07 17:52:32,625] INFO Truncating log mediawiki.page_delete-0 to offset
674079. (kafka.log.Log)
[2016-06-07 17:52:32,626] INFO Truncating log test2-0 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,626] INFO Truncating log __consumer_offsets-14 to offset
108. (kafka.log.Log)
[2016-06-07 17:52:32,626] INFO Truncating log webrequest_maps-0 to offset
34781439. (kafka.log.Log)
[2016-06-07 17:52:32,626] INFO Truncating log webrequet_text-0 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,626] INFO Truncating log eventlogging-valid-mixed-3 to
offset 283209869. (kafka.log.Log)
[2016-06-07 17:52:32,626] INFO Truncating log eventlogging-client-side-11 to
offset 261590956. (kafka.log.Log)
[2016-06-07 17:52:32,627] INFO Truncating log eventlogging_PageMove-0 to offset
1382778. (kafka.log.Log)
[2016-06-07 17:52:32,627] INFO Truncating log
mediawiki_CirrusSearchRequestSet-0 to offset 1955701160. (kafka.log.Log)
[2016-06-07 17:52:32,627] INFO Truncating log eventlogging_ModuleStorage-0 to
offset 3. (kafka.log.Log)
[2016-06-07 17:52:32,627] INFO Truncating log __consumer_offsets-31 to offset
268. (kafka.log.Log)
[2016-06-07 17:52:32,628] INFO Truncating log webrequest_upload-21 to offset
13541009685. (kafka.log.Log)
[2016-06-07 17:52:32,628] INFO Truncating log webrequest_text-21 to offset
14932940109. (kafka.log.Log)
[2016-06-07 17:52:32,630] INFO Truncating log
eventlogging_MobileWebMainMenuClickTracking-0 to offset 23974098.
(kafka.log.Log)
[2016-06-07 17:52:32,630] INFO Truncating log
eventlogging_GuidedTourGuiderImpression-0 to offset 1913145. (kafka.log.Log)
[2016-06-07 17:52:32,630] INFO Truncating log
eventlogging_ContentTranslationError-0 to offset 861283. (kafka.log.Log)
[2016-06-07 17:52:32,630] INFO Truncating log __consumer_offsets-12 to offset
57844611. (kafka.log.Log)
[2016-06-07 17:52:32,631] INFO Truncating log webrequest_mobile-6 to offset
17889884609. (kafka.log.Log)
[2016-06-07 17:52:32,631] INFO Truncating log webrequest_text-5 to offset
83024258503. (kafka.log.Log)
[2016-06-07 17:52:32,632] INFO Truncating log statsv-2 to offset 264814905.
(kafka.log.Log)
[2016-06-07 17:52:32,633] INFO Truncating log
eventlogging_MobileWebClickTracking-0 to offset 380. (kafka.log.Log)
[2016-06-07 17:52:32,633] INFO Truncating log eventlogging-client-side-5 to
offset 261352322. (kafka.log.Log)
[2016-06-07 17:52:32,633] INFO Truncating log
eventlogging_GettingStartedRedirectImpression-0 to offset 1713873.
(kafka.log.Log)
[2016-06-07 17:52:32,633] INFO Truncating log eventlogging_GeoFeatures-0 to
offset 14993097. (kafka.log.Log)
[2016-06-07 17:52:32,633] INFO Truncating log
eventlogging_TranslationRecommendationAPIRequests-0 to offset 20993.
(kafka.log.Log)
[2016-06-07 17:52:32,634] INFO Truncating log
eventlogging_MobileWikiAppFindInPage-0 to offset 1429024. (kafka.log.Log)
[2016-06-07 17:52:32,634] INFO Truncating log webrequest_upload-8 to offset
97924316479. (kafka.log.Log)
[2016-06-07 17:52:32,635] INFO Truncating log webrequest_text-1 to offset
83030990665. (kafka.log.Log)
[2016-06-07 17:52:32,636] INFO Truncating log __consumer_offsets-1 to offset
28. (kafka.log.Log)
[2016-06-07 17:52:32,637] INFO Truncating log eventlogging_DeprecatedUsage-0 to
offset 49676034. (kafka.log.Log)
[2016-06-07 17:52:32,637] INFO Truncating log eventlogging-client-side-9 to
offset 261372259. (kafka.log.Log)
[2016-06-07 17:52:32,637] INFO Truncating log
eventlogging_GuidedTourGuiderHidden-0 to offset 249090. (kafka.log.Log)
[2016-06-07 17:52:32,637] INFO Truncating log webrequest_upload-2 to offset
97917737974. (kafka.log.Log)
[2016-06-07 17:52:32,638] INFO Truncating log webrequest_text-4 to offset
83038521255. (kafka.log.Log)
[2016-06-07 17:52:32,639] INFO Truncating log __consumer_offsets-26 to offset
26. (kafka.log.Log)
[2016-06-07 17:52:32,639] INFO Truncating log webrequest_parsoid-11 to offset
0. (kafka.log.Log)
[2016-06-07 17:52:32,640] INFO Truncating log stat1002-krinkle-statsv-0 to
offset 0. (kafka.log.Log)
[2016-06-07 17:52:32,640] INFO Truncating log webrequest_upload-17 to offset
13541303802. (kafka.log.Log)
[2016-06-07 17:52:32,640] INFO Truncating log eventlogging_EventError-0 to
offset 7410274. (kafka.log.Log)
[2016-06-07 17:52:32,640] INFO Truncating log
eventlogging_MobileWikiAppSearch-0 to offset 52512455. (kafka.log.Log)
[2016-06-07 17:52:32,641] INFO Truncating log eventlogging_MobileWebInfobox-0
to offset 3. (kafka.log.Log)
[2016-06-07 17:52:32,641] INFO Truncating log mediawiki_avro-0 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,641] INFO Truncating log statsv-krinkle-3-0 to offset 0.
(kafka.log.Log)
[2016-06-07 17:52:32,641] INFO Truncating log
eventlogging_MobileWikiAppNavMenu-0 to offset 27661241. (kafka.log.Log)
[2016-06-07 17:52:32,641] INFO Truncating log webrequest_misc-10 to offset
92187205. (kafka.log.Log)
[2016-06-07 17:52:32,642] INFO Truncating log
eventlogging_MobileWikiAppArticleSuggestions-0 to offset 42821018.
(kafka.log.Log)
[2016-06-07 17:52:32,642] INFO Truncating log webrequest_misc-5 to offset
92127194. (kafka.log.Log)
[2016-06-07 17:52:32,642] INFO Truncating log webrequest_mobile-4 to offset
17888950938. (kafka.log.Log)
[2016-06-07 17:52:33,207] INFO [ReplicaFetcherThread-8-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,248] INFO [ReplicaFetcherThread-6-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,252] INFO [ReplicaFetcherThread-9-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,255] INFO [ReplicaFetcherThread-10-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,259] INFO [ReplicaFetcherThread-11-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,262] INFO [ReplicaFetcherThread-0-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,265] INFO [ReplicaFetcherThread-9-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,268] INFO [ReplicaFetcherThread-5-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,271] INFO [ReplicaFetcherThread-7-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,274] INFO [ReplicaFetcherThread-0-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,277] INFO [ReplicaFetcherThread-5-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,280] INFO [ReplicaFetcherThread-4-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,283] INFO [ReplicaFetcherThread-6-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,286] INFO [ReplicaFetcherThread-6-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,289] INFO [ReplicaFetcherThread-10-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,292] INFO [ReplicaFetcherThread-9-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,295] INFO [ReplicaFetcherThread-3-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,299] INFO [ReplicaFetcherThread-5-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,303] INFO [ReplicaFetcherThread-4-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,307] INFO [ReplicaFetcherThread-10-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,310] INFO [ReplicaFetcherThread-1-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,313] INFO [ReplicaFetcherThread-7-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,317] INFO [ReplicaFetcherThread-9-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,321] INFO [ReplicaFetcherThread-8-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,324] INFO [ReplicaFetcherThread-11-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,328] INFO [ReplicaFetcherThread-0-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,331] INFO [ReplicaFetcherThread-2-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,334] INFO [ReplicaFetcherThread-9-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,340] INFO [ReplicaFetcherThread-7-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,343] INFO [ReplicaFetcherThread-3-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,346] INFO [ReplicaFetcherThread-2-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,349] INFO [ReplicaFetcherThread-2-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,352] INFO [ReplicaFetcherThread-0-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,355] INFO [ReplicaFetcherThread-0-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,358] INFO [ReplicaFetcherThread-10-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,362] INFO [ReplicaFetcherThread-1-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,366] INFO [ReplicaFetcherThread-11-14], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,370] INFO [ReplicaFetcherThread-3-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,373] INFO [ReplicaFetcherThread-11-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,377] INFO [ReplicaFetcherThread-2-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,380] INFO [ReplicaFetcherThread-6-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,383] INFO [ReplicaFetcherThread-4-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,386] INFO [ReplicaFetcherThread-11-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,389] INFO [ReplicaFetcherThread-8-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,396] INFO [ReplicaFetcherThread-1-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,401] INFO [ReplicaFetcherThread-1-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,407] INFO [ReplicaFetcherThread-8-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,412] INFO [ReplicaFetcherThread-10-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,417] INFO [ReplicaFetcherThread-3-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,422] INFO [ReplicaFetcherThread-6-22], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,429] INFO [ReplicaFetcherThread-3-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,435] INFO [ReplicaFetcherThread-5-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,438] INFO [ReplicaFetcherThread-2-12], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,442] INFO [ReplicaFetcherThread-7-13], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,445] INFO [ReplicaFetcherThread-4-18], Starting
(kafka.server.ReplicaFetcherThread)
[2016-06-07 17:52:33,453] INFO [ReplicaFetcherManager on broker 20] Added
fetcher for partitions List([[eventlogging_MobileWikiAppLinkPreview,0],
initOffset 37521991 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[__consumer_offsets,32], initOffset 84 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppWidgets,0], initOffset 2341355 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[statsv,8], initOffset
264810362 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_QuickSurveyInstance,0], initOffset 0 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[__consumer_offsets,44],
initOffset 1235 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[webrequest_mobile,9], initOffset 17891981772 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[eventlogging_WikipediaZeroUsage,0], initOffset 16650 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging-client-side,10], initOffset 261460757 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_misc,9],
initOffset 92149668 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[webrequest_text,16], initOffset 14932926769 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_TranslationRecommendationUserAction,0], initOffset 109 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_upload,12],
initOffset 13543098457 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)]
, [[__consumer_offsets,28], initOffset 504 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_GatherClicks,0], initOffset 1197058 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[eventlogging_GuidedTourExternalLinkActivation,0], initOffset 73654 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWebLanguageSwitcher,0], initOffset 23772228 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[webrequest_text,10],
initOffset 83038575626 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)]
, [[eventlogging_MobileWikiAppPageScroll,0], initOffset 43378416 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[mediawiki_ApiAction,0],
initOffset 2446407805 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)]
, [[eventlogging_EditEvent,0], initOffset 0 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_bits,1],
initOffset 835897 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_EditConflict,0], initOffset 686364 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[eventlogging-client-side,4],
initOffset 261616892 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_DidYouMean,0], initOffset 3196696 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[mediawiki_CirrusSearchRequestSet,11], initOffset 1956564790 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_GuidedTourButtonClick,0], initOffset 1288131 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[eventlogging_MediaViewer,0],
initOffset 394907429 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_MobileAppUploadAttempts,0], initOffset 11661 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppLangSelect,0], initOffset 150844 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_upload,11],
initOffset 97894161412 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)]
, [[__consumer_offsets,17], initOffset 50 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_upload,1],
initOffset 97898786880 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)]
, [[eventlogging_PageDeletion,0], initOffset 2998051 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[eventlogging_SaveTiming,0],
initOffset 66966500 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_UniversalLanguageSelector-tofu,0], initOffset 65 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[__consumer_offsets,23],
initOffset 387 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[__consumer_offsets,7], initOffset 52 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_UploadWizardStep,0], initOffset 4072329 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_UploadWizardErrorFlowEvent,0], initOffset 333229 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWebLanguageSwitcher_15302503,0], initOffset 0 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWebSectionUsage,0], initOffset 351146900 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_NewEditorEdit,0], initOffset 6387084 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[mediawiki_ApiAction,5],
initOffset 2452802963 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)]
, [[eventlogging-valid-mixed,8], initOffset 283209695 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_MobileAppLoginAttempts,0], initOffset 23055 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[eventlogging-server-side,0],
initOffset 361024567 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[webrequest,0], initOffset 0 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[webrequest_misc,4],
initOffset 92254385 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[mediawiki_ApiAction,6], initOffset 2446512780 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[webrequest_mobile,8],
initOffset 17889233207 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)]
, [[eventlogging_MobileWikiAppWiktionaryPopup,0], initOffset 12473 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_text,17],
initOffset 14933154741 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)]
, [[eventlogging_PrefUpdate,0], initOffset 11280710 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[mediawiki_ApiAction,11],
initOffset 2452741248 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)]
, [[eventlogging_MobileBetaWatchlist,0], initOffset 26 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_parsoid,5],
initOffset 0 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[__consumer_offsets,3], initOffset 541 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_RelatedArticles,0], initOffset 173127 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_upload,6],
initOffset 97914864513 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)]
, [[eventlogging_MobileWikiAppEdit,0], initOffset 18302109 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppInstallReferrer,0], initOffset 453724 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[mediawiki.revision_create,0], initOffset 24529666 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_DiacriticsPoll,0], initOffset 25913 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_maps,10],
initOffset 34784420 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[webrequest_upload,0], initOffset 97928176443 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[__consumer_offsets,38],
initOffset 252 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_ServerSideAccountCreation,0], initOffset 3397410 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[statsv,10], initOffset
264614130 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppMediaGallery,0], initOffset 26522493 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_upload,23],
initOffset 13540530443 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)]
, [[eventlogging_MobileWikiAppShareAFact,0], initOffset 52712337 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[mediawiki_ApiAction,1],
initOffset 2443881292 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)]
, [[mediawiki_CirrusSearchRequestSet,4], initOffset 1956126366 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[mediawiki.page_restore,0],
initOffset 8251 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[webrequest_parsoid,0], initOffset 0 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_CompletionSuggestions,0], initOffset 63504 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[__consumer_offsets,8],
initOffset 122 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[webrequest_upload,22], initOffset 13540016874 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_JQMigrateUsage,0], initOffset 0 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppSavedPages,0], initOffset 24235187 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[statsv,9], initOffset
264521224 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_GatherFlags,0], initOffset 287 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[__consumer_offsets,36],
initOffset 1033 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_WikimediaBlogVisit,0], initOffset 1185001 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[eventlogging-valid-mixed,9],
initOffset 283209797 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[mediawiki_CirrusSearchRequestSet,9], initOffset 1955047234 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[eventlogging,0], initOffset
0 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[webrequest_text,20], initOffset 14932863560 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWebBrowse,0], initOffset 2331909 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[webrequest_bits,7],
initOffset 835486 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[__consumer_offsets,33], initOffset 288 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[webrequest_text,7],
initOffset 82971713296 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)]
, [[__consumer_offsets,37], initOffset 271392534 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_GuidedTourInternalLinkActivation,0], initOffset 935 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_mobile,0],
initOffset 17891114625 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)]
, [[statsv,5], initOffset 264438940 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_upload,16],
initOffset 13541056163 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)]
, [[webrequest_misc,0], initOffset 92211111 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_bits,8],
initOffset 838912 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[mediawiki_ApiAction,10], initOffset 2449362821 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_bits,3],
initOffset 837954 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging-NavigationTiming,0], initOffset 0 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_TranslationRecommendationUIRequests,0], initOffset 1417 to
broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_text,15],
initOffset 14934735705 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)]
, [[webrequest_maps,3], initOffset 34808117 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[eventlogging_EchoMail,0],
initOffset 1979631 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[__consumer_offsets,6], initOffset 36 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[webrequest_maps,5],
initOffset 34766232 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[webrequest_mobile,3], initOffset 17894209399 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[eventlogging_MultimediaViewerDuration,0], initOffset 3937587 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_maps,11],
initOffset 34810589 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[webrequest_maps,9], initOffset 34762140 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[eventlogging-valid-mixed,4],
initOffset 283209759 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_MobileAppShareAttempts,0], initOffset 543 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_bits,2],
initOffset 835825 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging-valid-mixed,10], initOffset 283209099 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[mediawiki_CirrusSearchRequestSet,5], initOffset 1956622978 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_parsoid,1],
initOffset 0 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_Analytics,0], initOffset 2391078 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[statsv,4], initOffset
264694814 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[mediawiki_CirrusSearchRequestSet,10], initOffset 1956180385 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWebEditing,0], initOffset 30692868 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[webrequest_text,22],
initOffset 14932414156 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)]
, [[__consumer_offsets,20], initOffset 124 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[eventlogging_PersonalBar,0],
initOffset 58 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppStuffHappens,0], initOffset 659844 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[__consumer_offsets,47],
initOffset 101254 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[eventlogging_EditorActivation,0], initOffset 616117 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_parsoid,10],
initOffset 0 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[__consumer_offsets,2], initOffset 110 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[__consumer_offsets,27],
initOffset 264 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_Edit,0], initOffset 429834019 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] , [[webrequest_parsoid,6],
initOffset 0 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppAppearanceSettings,0], initOffset 4688554 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_misc,6],
initOffset 92201124 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[eventlogging-valid-mixed,5], initOffset 283209956 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_ImageMetricsLoadingTime,0], initOffset 3783580 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_bits,6],
initOffset 833762 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[__consumer_offsets,22], initOffset 1639 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[webrequest_text,9],
initOffset 83027843060 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)]
, [[eventlogging_Popups,0], initOffset 3458193 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWebSearch,0], initOffset 7810381 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[__consumer_offsets,42],
initOffset 72 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[mediawiki.page_delete,0], initOffset 674079 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[test2,0], initOffset 0 to
broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[__consumer_offsets,14], initOffset 108 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_maps,0],
initOffset 34781439 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[webrequet_text,0], initOffset 0 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[eventlogging-valid-mixed,3],
initOffset 283209869 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging-client-side,11], initOffset 261590956 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[eventlogging_PageMove,0],
initOffset 1382778 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[mediawiki_CirrusSearchRequestSet,0], initOffset 1955701160 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_ModuleStorage,0], initOffset 3 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[__consumer_offsets,31],
initOffset 268 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[webrequest_upload,21], initOffset 13541009685 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_text,21],
initOffset 14932940109 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)]
, [[eventlogging_MobileWebMainMenuClickTracking,0], initOffset 23974098 to
broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_GuidedTourGuiderImpression,0], initOffset 1913145 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_ContentTranslationError,0], initOffset 861283 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] , [[__consumer_offsets,12],
initOffset 57844611 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[webrequest_mobile,6], initOffset 17889884609 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_text,5],
initOffset 83024258503 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)]
, [[statsv,2], initOffset 264814905 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWebClickTracking,0], initOffset 380 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[eventlogging-client-side,5],
initOffset 261352322 to broker BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] ,
[[eventlogging_GettingStartedRedirectImpression,0], initOffset 1713873 to
broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_GeoFeatures,0], initOffset 14993097 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_TranslationRecommendationAPIRequests,0], initOffset 20993 to
broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppFindInPage,0], initOffset 1429024 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_upload,8],
initOffset 97924316479 to broker BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)]
, [[webrequest_text,1], initOffset 83030990665 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[__consumer_offsets,1],
initOffset 28 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_DeprecatedUsage,0], initOffset 49676034 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[eventlogging-client-side,9],
initOffset 261372259 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[eventlogging_GuidedTourGuiderHidden,0], initOffset 249090 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[webrequest_upload,2],
initOffset 97917737974 to broker BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)]
, [[webrequest_text,4], initOffset 83038521255 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[__consumer_offsets,26],
initOffset 26 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[webrequest_parsoid,11], initOffset 0 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[stat1002-krinkle-statsv,0],
initOffset 0 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[webrequest_upload,17], initOffset 13541303802 to broker
BrokerEndPoint(22,kafka1022.eqiad.wmnet,9092)] , [[eventlogging_EventError,0],
initOffset 7410274 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppSearch,0], initOffset 52512455 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWebInfobox,0], initOffset 3 to broker
BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[mediawiki_avro,0],
initOffset 0 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[statsv-krinkle-3,0], initOffset 0 to broker
BrokerEndPoint(12,kafka1012.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppNavMenu,0], initOffset 27661241 to broker
BrokerEndPoint(13,kafka1013.eqiad.wmnet,9092)] , [[webrequest_misc,10],
initOffset 92187205 to broker BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] ,
[[eventlogging_MobileWikiAppArticleSuggestions,0], initOffset 42821018 to
broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] , [[webrequest_misc,5],
initOffset 92127194 to broker BrokerEndPoint(18,kafka1018.eqiad.wmnet,9092)] ,
[[webrequest_mobile,4], initOffset 17888950938 to broker
BrokerEndPoint(14,kafka1014.eqiad.wmnet,9092)] )
(kafka.server.ReplicaFetcherManager)
{noformat}
(sorry for all the extraneous topic/partition info :) )
> log mtimes reset on broker restart
> ----------------------------------
>
> Key: KAFKA-3802
> URL: https://issues.apache.org/jira/browse/KAFKA-3802
> Project: Kafka
> Issue Type: Bug
> Affects Versions: 0.9.0.1
> Reporter: Andrew Otto
>
> Folks over in
> http://mail-archives.apache.org/mod_mbox/kafka-users/201605.mbox/%3CCAO8=cz0ragjad1acx4geqcwj+rkd1gmdavkjwytwthkszfg...@mail.gmail.com%3E
> are commenting about this issue.
> In 0.9, any data log file that was on
> disk before the broker has it's mtime modified to the time of the broker
> restart.
> This causes problems with log retention, as all the files then look like
> they contain recent data to kafka. We use the default log retention of 7
> days, but if all the files are touched at the same time, this can cause us
> to retain up to 2 weeks of log data, which can fill up our disks.
> This happens *most* of the time, but seemingly not all. We have seen broker
> restarts where mtimes were not changed.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
