[ https://issues.apache.org/jira/browse/KAFKA-3256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15155835#comment-15155835 ]
Jiangjie Qin commented on KAFKA-3256: ------------------------------------- Yes, fix to those tests are obvious. I am looking at the other two types of failure. {noformat} No JSON object could be decoded Traceback (most recent call last): File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/tests/runner.py", line 102, in run_all_tests result.data = self.run_single_test() File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/tests/runner.py", line 154, in run_single_test return self.current_test_context.function(self.current_test) File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/mark/_mark.py", line 331, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/tests/kafkatest/tests/connect_test.py", line 85, in test_file_source_and_sink actual = json.dumps([decoder(x) for x in self.consumer_validator.messages_consumed[1]]) File "/usr/lib/python2.7/json/__init__.py", line 338, in loads return _default_decoder.decode(s) File "/usr/lib/python2.7/json/decoder.py", line 366, in decode obj, end = self.raw_decode(s, idx=_w(s, 0).end()) File "/usr/lib/python2.7/json/decoder.py", line 384, in raw_decode raise ValueError("No JSON object could be decoded") {noformat} And {noformat} Consumer failed to start in a reasonable amount of time. Traceback (most recent call last): File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/tests/runner.py", line 102, in run_all_tests result.data = self.run_single_test() File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/tests/runner.py", line 154, in run_single_test return self.current_test_context.function(self.current_test) File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/venv/local/lib/python2.7/site-packages/ducktape-0.3.10-py2.7.egg/ducktape/mark/_mark.py", line 331, in wrapper return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs) File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/tests/kafkatest/tests/mirror_maker_test.py", line 139, in test_simple_end_to_end self.run_produce_consume_validate(core_test_action=self.wait_for_n_messages) File "/var/lib/jenkins/workspace/kafka_system_tests/kafka/tests/kafkatest/tests/produce_consume_validate.py", line 79, in run_produce_consume_validate raise e {noformat} I am not super familiar with those tests, so might it might take me some time to check. It looks we have problem when starting validating consumer. > Large number of system test failures > ------------------------------------ > > Key: KAFKA-3256 > URL: https://issues.apache.org/jira/browse/KAFKA-3256 > Project: Kafka > Issue Type: Bug > Reporter: Geoff Anderson > Assignee: Jiangjie Qin > > Confluent's nightly run of the kafka system tests reported a large number of > failures beginning 2/20/2016 > Test run: 2016-02-19--001.1455897182--apache--trunk--eee9522/ > Link: > http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2016-02-19--001.1455897182--apache--trunk--eee9522/report.html > Pass: 136 > Fail: 0 > Test run: 2016-02-20--001.1455979842--apache--trunk--5caa800/ > Link: > http://confluent-kafka-system-test-results.s3-us-west-2.amazonaws.com/2016-02-20--001.1455979842--apache--trunk--5caa800/report.html > Pass: 72 > Fail: 64 > I.e. trunk@eee9522 was the last passing run, and trunk@5caa800 had a large > number of failures. > Given its complexity, the most likely culprit is 45c8195fa, and I confirmed > this is the first commit with failures on a small number of tests. > [~becket_qin] do you mind investigating? > {code} > commit 5caa800e217c6b83f62ee3e6b5f02f56e331b309 > Author: Jun Rao <jun...@gmail.com> > Date: Fri Feb 19 09:40:59 2016 -0800 > trivial fix to authorization CLI table > commit 45c8195fa14c766b200c720f316836dbb84e9d8b > Author: Jiangjie Qin <becket....@gmail.com> > Date: Fri Feb 19 07:56:40 2016 -0800 > KAFKA-3025; Added timetamp to Message and use relative offset. > commit eee95228fabe1643baa016a2d49fb0a9fe2c66bd > Author: Yasuhiro Matsuda <yasuh...@confluent.io> > Date: Thu Feb 18 09:39:30 2016 +0800 > MINOR: remove streams config params from producer/consumer configs > {code} -- This message was sent by Atlassian JIRA (v6.3.4#6332)