[ https://issues.apache.org/jira/browse/KAFKA-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905837#comment-15905837 ]
Apurva Mehta commented on KAFKA-4574: ------------------------------------- >From the server logs, we see that the logs were truncated to offset 1497 on >two separate brokers within 10ms of each other. Would this affect offset 1496? {noformat} amehta-macbook-pro:KafkaService-0-140193561885648 apurva$ for i in `find . -name "server.log"`; do grep -Hni "Truncating log" $i | grep test_topic-2; done | grep "/info/" ./worker2/info/server.log:649:[2017-03-09 05:20:43,539] INFO Truncating log test_topic-2 to offset 946. (kafka.log.Log) ./worker2/info/server.log:968:[2017-03-09 05:20:51,132] INFO Truncating log test_topic-2 to offset 946. (kafka.log.Log) ./worker2/info/server.log:1121:[2017-03-09 05:20:51,639] INFO Truncating log test_topic-2 to offset 946. (kafka.log.Log) ./worker2/info/server.log:1488:[2017-03-09 05:21:11,054] INFO Truncating log test_topic-2 to offset 1497. (kafka.log.Log) ./worker2/info/server.log:1807:[2017-03-09 05:21:18,212] INFO Truncating log test_topic-2 to offset 1497. (kafka.log.Log) ./worker6/info/server.log:192:[2017-03-09 05:20:07,587] INFO Truncating log test_topic-2 to offset 0. (kafka.log.Log) ./worker6/info/server.log:1201:[2017-03-09 05:20:59,970] INFO Truncating log test_topic-2 to offset 1165. (kafka.log.Log) ./worker6/info/server.log:1473:[2017-03-09 05:21:11,066] INFO Truncating log test_topic-2 to offset 1497. (kafka.log.Log) ./worker6/info/server.log:1990:[2017-03-09 05:21:25,433] INFO Truncating log test_topic-2 to offset 1722. (kafka.log.Log) ./worker6/info/server.log:2049:[2017-03-09 05:21:25,684] INFO Truncating log test_topic-2 to offset 1722. (kafka.log.Log) ./worker8/info/server.log:196:[2017-03-09 05:20:07,581] INFO Truncating log test_topic-2 to offset 0. (kafka.log.Log) ./worker8/info/server.log:873:[2017-03-09 05:20:43,768] INFO Truncating log test_topic-2 to offset 669. (kafka.log.Log) ./worker8/info/server.log:1007:[2017-03-09 05:20:44,397] INFO Truncating log test_topic-2 to offset 669. (kafka.log.Log) ./worker8/info/server.log:1435:[2017-03-09 05:20:59,003] INFO Truncating log test_topic-2 to offset 1379. (kafka.log.Log) ./worker8/info/server.log:1900:[2017-03-09 05:21:11,134] INFO Truncating log test_topic-2 to offset 1496. (kafka.log.Log) ./worker8/info/server.log:2441:[2017-03-09 05:21:25,751] INFO Truncating log test_topic-2 to offset 1948. (kafka.log.Log) {noformat} > Transient failure in ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade > with security_protocol = SASL_PLAINTEXT, SSL > ----------------------------------------------------------------------------------------------------------------------- > > Key: KAFKA-4574 > URL: https://issues.apache.org/jira/browse/KAFKA-4574 > Project: Kafka > Issue Type: Test > Components: system tests > Reporter: Shikhar Bhushan > Assignee: Apurva Mehta > > http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2016-12-29--001.1483003056--apache--trunk--dc55025/report.html > {{ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade}} failed with these > {{security_protocol}} parameters > {noformat} > ==================================================================================================== > test_id: > kafkatest.tests.core.zookeeper_security_upgrade_test.ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade.security_protocol=SASL_PLAINTEXT > status: FAIL > run time: 3 minutes 44.094 seconds > 1 acked message did not make it to the Consumer. They are: [5076]. We > validated that the first 1 of these missing messages correctly made it into > Kafka's data files. This suggests they were lost on their way to the consumer. > Traceback (most recent call last): > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", > line 123, in run > data = self.run_test() > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", > line 176, in run_test > return self.test_context.function(self.test) > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/mark/_mark.py", > line 321, in wrapper > return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/core/zookeeper_security_upgrade_test.py", > line 117, in test_zk_security_upgrade > self.run_produce_consume_validate(self.run_zk_migration) > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/produce_consume_validate.py", > line 101, in run_produce_consume_validate > self.validate() > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/produce_consume_validate.py", > line 163, in validate > assert success, msg > AssertionError: 1 acked message did not make it to the Consumer. They are: > [5076]. We validated that the first 1 of these missing messages correctly > made it into Kafka's data files. This suggests they were lost on their way to > the consumer. > {noformat} > {noformat} > ==================================================================================================== > test_id: > kafkatest.tests.core.zookeeper_security_upgrade_test.ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade.security_protocol=SSL > status: FAIL > run time: 3 minutes 50.578 seconds > 1 acked message did not make it to the Consumer. They are: [3559]. We > validated that the first 1 of these missing messages correctly made it into > Kafka's data files. This suggests they were lost on their way to the consumer. > Traceback (most recent call last): > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", > line 123, in run > data = self.run_test() > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py", > line 176, in run_test > return self.test_context.function(self.test) > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/mark/_mark.py", > line 321, in wrapper > return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/core/zookeeper_security_upgrade_test.py", > line 117, in test_zk_security_upgrade > self.run_produce_consume_validate(self.run_zk_migration) > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/produce_consume_validate.py", > line 101, in run_produce_consume_validate > self.validate() > File > "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/produce_consume_validate.py", > line 163, in validate > assert success, msg > AssertionError: 1 acked message did not make it to the Consumer. They are: > [3559]. We validated that the first 1 of these missing messages correctly > made it into Kafka's data files. This suggests they were lost on their way to > the consumer. > {noformat} > Previously: KAFKA-3985 -- This message was sent by Atlassian JIRA (v6.3.15#6346)