Dear all: flink version is 1.12.4,kafka version is 1.1.1。topology is very simple ,source-->flatmap--->sink ,enable checkpoint,job will fail after a few hours 。 the error message is
Caused by: org.apache.flink.streaming.connectors.kafka.FlinkKafkaException: Failed to send data to Kafka: The broker received an out of order sequence number. at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.checkErroneous(FlinkKafkaProducer.java:1392) at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.invoke(FlinkKafkaProducer.java:850) at org.apache.flink.streaming.connectors.kafka.FlinkKafkaProducer.invoke(FlinkKafkaProducer.java:99) product's properties is simle , using defalut AT_LEAST_ONCE semantic properties.setProperty(ProducerConfig.COMPRESSION_TYPE_CONFIG, "lz4"); properties.setProperty(ProducerConfig.RETRIES_CONFIG, "5"); properties.setProperty(ProducerConfig.MAX_IN_FLIGHT_REQUESTS_PER_CONNECTION, "1"); properties.setProperty(ProducerConfig.RETRY_BACKOFF_MS_CONFIG, "2000"); properties.setProperty(ProducerConfig.BATCH_SIZE_CONFIG, "524288"); properties.setProperty(ProducerConfig.LINGER_MS_CONFIG, "100"); properties.setProperty(ProducerConfig.REQUEST_TIMEOUT_MS_CONFIG, "60000"); My questions is how to deal with ?