Hi, all
Recently, I upgrade my Kafka cluster to 0.8.1.1 and set replication with
num.replica.fetchers=5. Last night, there's something wrong with the
network. Soon, I found the server.log files (not data log!) on every node
reached 4GB in an hour.
I am not sure if it's my inappropriate configuration or other reason. Can
anybody help me with this. Thanks~
log file tail
============================================
[2014-10-16 20:59:59,994] ERROR Closing socket for /192.168.1.66 because of
error (kafka.network.Processor)
kafka.common.KafkaException: This operation cannot be completed on a
complete request.
at
kafka.network.Transmission$class.expectIncomplete(Transmission.scala:34)
at
kafka.api.FetchResponseSend.expectIncomplete(FetchResponse.scala:191)
at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:214)
at kafka.network.Processor.write(SocketServer.scala:375)
at kafka.network.Processor.run(SocketServer.scala:247)
at java.lang.Thread.run(Thread.java:745)
[2014-10-16 20:59:59,994] ERROR Closing socket for /192.168.1.66 because of
error (kafka.network.Processor)
kafka.common.KafkaException: This operation cannot be completed on a
complete request.
at
kafka.network.Transmission$class.expectIncomplete(Transmission.scala:34)
at
kafka.api.FetchResponseSend.expectIncomplete(FetchResponse.scala:191)
at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:214)
at kafka.network.Processor.write(SocketServer.scala:375)
at kafka.network.Processor.run(SocketServer.scala:247)
at java.lang.Thread.run(Thread.java:745)
[2014-10-16 20:59:59,994] ERROR Closing socket for /192.168.1.65 because of
error (kafka.network.Processor)
kafka.common.KafkaException: This operation cannot be completed on a
complete request.
at
kafka.network.Transmission$class.expectIncomplete(Transmission.scala:34)
at
kafka.api.FetchResponseSend.expectIncomplete(FetchResponse.scala:191)
at kafka.api.FetchResponseSend.writeTo(FetchResponse.scala:214)
at kafka.network.Processor.write(SocketServer.scala:375)
at kafka.network.Processor.run(SocketServer.scala:247)
at java.lang.Thread.run(Thread.java:745)
--
*Xingcan*
