[
https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14239063#comment-14239063
]
Bhavesh Mistry edited comment on KAFKA-1642 at 12/9/14 6:53 AM:
----------------------------------------------------------------
[~stevenz3wu],
0.8.2 is very well tested and worked well under heavy load. This bug is rare
only happen when broker or network has issue. We have been producing about 7
to 10 TB per day using this new producer, so 0.8.2 is very safe to use in
production. It has survived pick traffic of the year on large e-commerce
site. So I am fairly confident that New Java API is indeed does true
round-robin and much faster than Scala Based API.
[~ewencp], I will verify the patch by end of this Friday, but do let me know
your understanding based on my last comment. The goal is to rest this issue and
cover all the use case.
Thanks,
Bhavesh
was (Author: bmis13):
[~stevenz3wu],
0.8.2 is very well tested and worked well under heavy load. This bug is rare
only happen when broker or network has issue. We have been producing about 7
to 10 TB per day using this new producer, so 0.8.2 is very safe to use in
production. It has survived pick traffic of the year on large e-commerce
site. So I am fairly confident that New Java API is indeed does true
round-robin and much faster than Scala Based API.
[~ewencp], I will verify the patch by end of this Friday, but do let me know
your understanding based on my last comment.
Thanks,
Bhavesh
> [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network
> connection is lost
> ---------------------------------------------------------------------------------------
>
> Key: KAFKA-1642
> URL: https://issues.apache.org/jira/browse/KAFKA-1642
> Project: Kafka
> Issue Type: Bug
> Components: producer
> Affects Versions: 0.8.2
> Reporter: Bhavesh Mistry
> Assignee: Ewen Cheslack-Postava
> Priority: Blocker
> Fix For: 0.8.2
>
> Attachments:
> 0001-Initial-CPU-Hish-Usage-by-Kafka-FIX-and-Also-fix-CLO.patch,
> KAFKA-1642.patch, KAFKA-1642.patch, KAFKA-1642_2014-10-20_17:33:57.patch,
> KAFKA-1642_2014-10-23_16:19:41.patch
>
>
> I see my CPU spike to 100% when network connection is lost for while. It
> seems network IO thread are very busy logging following error message. Is
> this expected behavior ?
> 2014-09-17 14:06:16.830 [kafka-producer-network-thread] ERROR
> org.apache.kafka.clients.producer.internals.Sender - Uncaught error in kafka
> producer I/O thread:
> java.lang.IllegalStateException: No entry found for node -2
> at
> org.apache.kafka.clients.ClusterConnectionStates.nodeState(ClusterConnectionStates.java:110)
> at
> org.apache.kafka.clients.ClusterConnectionStates.disconnected(ClusterConnectionStates.java:99)
> at
> org.apache.kafka.clients.NetworkClient.initiateConnect(NetworkClient.java:394)
> at
> org.apache.kafka.clients.NetworkClient.maybeUpdateMetadata(NetworkClient.java:380)
> at org.apache.kafka.clients.NetworkClient.poll(NetworkClient.java:174)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:175)
> at org.apache.kafka.clients.producer.internals.Sender.run(Sender.java:115)
> at java.lang.Thread.run(Thread.java:744)
> Thanks,
> Bhavesh
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
