[ 
https://issues.apache.org/jira/browse/KAFKA-4574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15905837#comment-15905837
 ] 

Apurva Mehta commented on KAFKA-4574:
-------------------------------------

>From the server logs, we see that the logs were truncated to offset 1497 on 
>two separate brokers within 10ms of each other. Would this affect offset 1496?

{noformat}
amehta-macbook-pro:KafkaService-0-140193561885648 apurva$ for i in `find . 
-name "server.log"`; do grep -Hni "Truncating log" $i | grep test_topic-2; done 
| grep "/info/"
./worker2/info/server.log:649:[2017-03-09 05:20:43,539] INFO Truncating log 
test_topic-2 to offset 946. (kafka.log.Log)
./worker2/info/server.log:968:[2017-03-09 05:20:51,132] INFO Truncating log 
test_topic-2 to offset 946. (kafka.log.Log)
./worker2/info/server.log:1121:[2017-03-09 05:20:51,639] INFO Truncating log 
test_topic-2 to offset 946. (kafka.log.Log)
./worker2/info/server.log:1488:[2017-03-09 05:21:11,054] INFO Truncating log 
test_topic-2 to offset 1497. (kafka.log.Log)
./worker2/info/server.log:1807:[2017-03-09 05:21:18,212] INFO Truncating log 
test_topic-2 to offset 1497. (kafka.log.Log)
./worker6/info/server.log:192:[2017-03-09 05:20:07,587] INFO Truncating log 
test_topic-2 to offset 0. (kafka.log.Log)
./worker6/info/server.log:1201:[2017-03-09 05:20:59,970] INFO Truncating log 
test_topic-2 to offset 1165. (kafka.log.Log)
./worker6/info/server.log:1473:[2017-03-09 05:21:11,066] INFO Truncating log 
test_topic-2 to offset 1497. (kafka.log.Log)
./worker6/info/server.log:1990:[2017-03-09 05:21:25,433] INFO Truncating log 
test_topic-2 to offset 1722. (kafka.log.Log)
./worker6/info/server.log:2049:[2017-03-09 05:21:25,684] INFO Truncating log 
test_topic-2 to offset 1722. (kafka.log.Log)
./worker8/info/server.log:196:[2017-03-09 05:20:07,581] INFO Truncating log 
test_topic-2 to offset 0. (kafka.log.Log)
./worker8/info/server.log:873:[2017-03-09 05:20:43,768] INFO Truncating log 
test_topic-2 to offset 669. (kafka.log.Log)
./worker8/info/server.log:1007:[2017-03-09 05:20:44,397] INFO Truncating log 
test_topic-2 to offset 669. (kafka.log.Log)
./worker8/info/server.log:1435:[2017-03-09 05:20:59,003] INFO Truncating log 
test_topic-2 to offset 1379. (kafka.log.Log)
./worker8/info/server.log:1900:[2017-03-09 05:21:11,134] INFO Truncating log 
test_topic-2 to offset 1496. (kafka.log.Log)
./worker8/info/server.log:2441:[2017-03-09 05:21:25,751] INFO Truncating log 
test_topic-2 to offset 1948. (kafka.log.Log)
{noformat}

> Transient failure in ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade 
> with security_protocol = SASL_PLAINTEXT, SSL
> -----------------------------------------------------------------------------------------------------------------------
>
>                 Key: KAFKA-4574
>                 URL: https://issues.apache.org/jira/browse/KAFKA-4574
>             Project: Kafka
>          Issue Type: Test
>          Components: system tests
>            Reporter: Shikhar Bhushan
>            Assignee: Apurva Mehta
>
> http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2016-12-29--001.1483003056--apache--trunk--dc55025/report.html
> {{ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade}} failed with these 
> {{security_protocol}} parameters 
> {noformat}
> ====================================================================================================
> test_id:    
> kafkatest.tests.core.zookeeper_security_upgrade_test.ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade.security_protocol=SASL_PLAINTEXT
> status:     FAIL
> run time:   3 minutes 44.094 seconds
>     1 acked message did not make it to the Consumer. They are: [5076]. We 
> validated that the first 1 of these missing messages correctly made it into 
> Kafka's data files. This suggests they were lost on their way to the consumer.
> Traceback (most recent call last):
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py",
>  line 123, in run
>     data = self.run_test()
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py",
>  line 176, in run_test
>     return self.test_context.function(self.test)
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/mark/_mark.py",
>  line 321, in wrapper
>     return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/core/zookeeper_security_upgrade_test.py",
>  line 117, in test_zk_security_upgrade
>     self.run_produce_consume_validate(self.run_zk_migration)
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/produce_consume_validate.py",
>  line 101, in run_produce_consume_validate
>     self.validate()
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/produce_consume_validate.py",
>  line 163, in validate
>     assert success, msg
> AssertionError: 1 acked message did not make it to the Consumer. They are: 
> [5076]. We validated that the first 1 of these missing messages correctly 
> made it into Kafka's data files. This suggests they were lost on their way to 
> the consumer.
> {noformat}
> {noformat}
> ====================================================================================================
> test_id:    
> kafkatest.tests.core.zookeeper_security_upgrade_test.ZooKeeperSecurityUpgradeTest.test_zk_security_upgrade.security_protocol=SSL
> status:     FAIL
> run time:   3 minutes 50.578 seconds
>     1 acked message did not make it to the Consumer. They are: [3559]. We 
> validated that the first 1 of these missing messages correctly made it into 
> Kafka's data files. This suggests they were lost on their way to the consumer.
> Traceback (most recent call last):
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py",
>  line 123, in run
>     data = self.run_test()
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/tests/runner_client.py",
>  line 176, in run_test
>     return self.test_context.function(self.test)
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.6.0-py2.7.egg/ducktape/mark/_mark.py",
>  line 321, in wrapper
>     return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/core/zookeeper_security_upgrade_test.py",
>  line 117, in test_zk_security_upgrade
>     self.run_produce_consume_validate(self.run_zk_migration)
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/produce_consume_validate.py",
>  line 101, in run_produce_consume_validate
>     self.validate()
>   File 
> "/var/lib/jenkins/workspace/system-test-kafka/kafka/tests/kafkatest/tests/produce_consume_validate.py",
>  line 163, in validate
>     assert success, msg
> AssertionError: 1 acked message did not make it to the Consumer. They are: 
> [3559]. We validated that the first 1 of these missing messages correctly 
> made it into Kafka's data files. This suggests they were lost on their way to 
> the consumer.
> {noformat}
> Previously: KAFKA-3985



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to