My broker logs are full of messages of the following type of log message:
INFO [kafka-network-thread-9092-1 ] [kafka.network.Processor
]: Closing socket connection to /some_ip_that_I_know.
I see at least one every 4-5 seconds. Something I identified was that the
ip of the closed clients was always from one class of application. This
application mostly consumes kafka partitions (rarely produces) and it uses
the SimpleConsumer to consume data, make requests about partition
leadership (to keep it up to date) and to also make requests about the
latest offset in a set of partitions (for metrics).
The data consumption happens with long running consumers, but the one off
requests like partition leadership requests and offset queries happen with
short-lived consumers that are closed after a request is served. However
the volume of closing "Closing socket connection" log messages is higher
than what I think the rate of these short lived requests should be. My
guess is that something else is going on.
Is there a way for me to track what client is exactly having its connection
closed? Each of my SimpleConsumer clients uses a particular client name
when connecting to the broker. Is there a way to enable additional logging
which would give me this data along with the "Closing socket connection"
message?
Thanks,
Rajiv
