Hi,
I'm trying to run some performance tests with the Kafka Producer. I could find the following six different types of repeated errors in the logs. However, the messages are successfully sent to the kafka brokers. NETWORK_EXCEPTION: kafka-producer-network-thread | producer-1 WARN Sender:637 - [Producer clientId=producer-1] Got error produce response with correlation id 110416 on topic-partition EVALT-0000-1, retrying (2147483646 attempts left). Error: NETWORK_EXCEPTION kafka-producer-network-thread | producer-1 WARN Sender:682 - [Producer clientId=producer-1] Received invalid metadata error in produce request on partition EVALT-0000-7 due to org.apache.kafka.common.errors.NetworkException: The server disconnected before a response was received.. Going to request metadata update now Error: NOT_ENOUGH_REPLICAS kafka-producer-network-thread | producer-1 WARN Sender:637 - [Producer clientId=producer-1] Got error produce response with correlation id 54229 on topic-partition EVALT-0000-5, retrying (2147483646 attempts left). Error: NOT_ENOUGH_REPLICAS Error: NOT_ENOUGH_REPLICAS_AFTER_APPEND kafka-producer-network-thread | producer-1 WARN Sender:637 - [Producer clientId=producer-1] Got error produce response with correlation id 56325 on topic-partition EVALT-0000-0, retrying (2147483646 attempts left). Error: NOT_ENOUGH_REPLICAS_AFTER_APPEND Error: OUT_OF_ORDER_SEQUENCE_NUMBER kafka-producer-network-thread | producer-1 WARN Sender:637 - [Producer clientId=producer-1] Got error produce response with correlation id 57852 on topic-partition EVALT-0000-3, retrying (2147483646 attempts left). Error: OUT_OF_ORDER_SEQUENCE_NUMBER Error: REQUEST_TIMED_OUT kafka-producer-network-thread| producer-1 WARN Sender:637 - [Producer clientId=producer-1] Got error produce response with correlation id 108943 on topic-partition EVALT-0000-1, retrying (2147483646 attempts left). Error: REQUEST_TIMED_OUT I’ve three kafka brokers and three zookeepers running. I’m running the tests against a single topic(partitions=8, min ISR=2 and replication factor=3). Topic is created at the beginning of the tests and deleted at the end of the tests. Could anyone help me in understanding these errors and suggest ways to mitigate them?. Thanks, Sugadev
