Hello! Any feedback on this? What I should additionally do to prepare system tests migration?
> 24 авг. 2020 г., в 11:17, Nikolay Izhikov <nizhikov....@gmail.com> написал(а): > > Hello. > > PR [1] is ready. > Please, review. > > But, I need help with the two following questions: > > 1. We need a new release of ducktape which includes fixes [2], [3] for > python3. > I created the issue in ducktape repo [4]. > Can someone help me with the release? > > 2. I know that some companies run system tests for the trunk on a regular > bases. > Can someone show me some results of these runs? > So, I can compare failures in my PR and in the trunk. > > Results [5] of run all for my PR available in the ticket [6] > > ``` > SESSION REPORT (ALL TESTS) > ducktape version: 0.8.0 > session_id: 2020-08-23--002 > run time: 1010 minutes 46.483 seconds > tests run: 684 > passed: 505 > failed: 9 > ignored: 170 > ``` > > [1] https://github.com/apache/kafka/pull/9196 > [2] > https://github.com/confluentinc/ducktape/commit/23bd5ab53802e3a1e1da1ddf3630934f33b02305 > [3] > https://github.com/confluentinc/ducktape/commit/bfe53712f83b025832d29a43cde3de3d7803106f > [4] https://github.com/confluentinc/ducktape/issues/245 > [5] https://issues.apache.org/jira/secure/attachment/13010366/report.txt > [6] https://issues.apache.org/jira/browse/KAFKA-10402 > >> 14 авг. 2020 г., в 21:26, Ismael Juma <ism...@juma.me.uk> написал(а): >> >> +1 >> >> On Fri, Aug 14, 2020 at 7:42 AM John Roesler <vvcep...@apache.org> wrote: >> >>> Thanks Nikolay, >>> >>> No objection. This would be very nice to have. >>> >>> Thanks, >>> John >>> >>> On Fri, Aug 14, 2020, at 09:18, Nikolay Izhikov wrote: >>>> Hello. >>>> >>>>> If anyone's interested in porting it to Python 3 it would be a good >>> change. >>>> >>>> I’ve created a ticket [1] to upgrade system tests to python3. >>>> Does someone have any additional inputs or objections for this change? >>>> >>>> [1] https://issues.apache.org/jira/browse/KAFKA-10402 >>>> >>>> >>>>> 1 июля 2020 г., в 00:26, Gokul Ramanan Subramanian < >>> gokul24...@gmail.com> написал(а): >>>>> >>>>> Thanks Colin. >>>>> >>>>> While at the subject of system tests, there are a few times I see tests >>>>> timed out (even on a large machine such as m5.4xlarge EC2 with Linux). >>> Are >>>>> there any knobs that system tests provide to control timeouts / >>> throughputs >>>>> across all tests? >>>>> Thanks. >>>>> >>>>> On Tue, Jun 30, 2020 at 6:32 PM Colin McCabe <cmcc...@apache.org> >>> wrote: >>>>> >>>>>> Ducktape runs on Python 2. You can't use it with Python 3, as you are >>>>>> trying to do here. >>>>>> >>>>>> If anyone's interested in porting it to Python 3 it would be a good >>> change. >>>>>> >>>>>> Otherwise, using docker as suggested here seems to be the best way to >>> go. >>>>>> >>>>>> best, >>>>>> Colin >>>>>> >>>>>> On Mon, Jun 29, 2020, at 02:14, Gokul Ramanan Subramanian wrote: >>>>>>> Hi. >>>>>>> >>>>>>> Has anyone had luck running Kafka system tests on a Mac. I have a >>> MacOS >>>>>>> Mojave 10.14.6. I got Python 3.6.9 using pyenv. However, the command >>>>>>> *ducktape tests/kafkatest/tests* yields the following error, making >>> it >>>>>> look >>>>>>> like some Python incompatibility issue. >>>>>>> >>>>>>> $ ducktape tests/kafkatest/tests >>>>>>> Traceback (most recent call last): >>>>>>> File "/Users/gokusubr/.pyenv/versions/3.6.9/bin/ducktape", line 11, >>> in >>>>>>> <module> >>>>>>> load_entry_point('ducktape', 'console_scripts', 'ducktape')() >>>>>>> File >>>>>>> >>>>>> >>> "/Users/gokusubr/.pyenv/versions/3.6.9/lib/python3.6/site-packages/pkg_resources/__init__.py", >>>>>>> line 487, in load_entry_point >>>>>>> return get_distribution(dist).load_entry_point(group, name) >>>>>>> File >>>>>>> >>>>>> >>> "/Users/gokusubr/.pyenv/versions/3.6.9/lib/python3.6/site-packages/pkg_resources/__init__.py", >>>>>>> line 2728, in load_entry_point >>>>>>> return ep.load() >>>>>>> File >>>>>>> >>>>>> >>> "/Users/gokusubr/.pyenv/versions/3.6.9/lib/python3.6/site-packages/pkg_resources/__init__.py", >>>>>>> line 2346, in load >>>>>>> return self.resolve() >>>>>>> File >>>>>>> >>>>>> >>> "/Users/gokusubr/.pyenv/versions/3.6.9/lib/python3.6/site-packages/pkg_resources/__init__.py", >>>>>>> line 2352, in resolve >>>>>>> module = __import__(self.module_name, fromlist=['__name__'], >>>>>>> level=0) >>>>>>> File >>>>>>> >>>>>> >>> "/Users/gokusubr/.pyenv/versions/3.6.9/lib/python3.6/site-packages/ducktape-0.7.6-py3.6.egg/ducktape/command_line/main.py", >>>>>>> line 127 >>>>>>> print "parameters are not valid json: " + str(e.message) >>>>>>> ^ >>>>>>> SyntaxError: invalid syntax >>>>>>> >>>>>>> I followed the instructions in tests/README.md to setup a cluster of >>> 9 >>>>>>> worker machines. That worked well. When I ran *python setup.py >>> develop* >>>>>> to >>>>>>> install the necessary dependencies (including ducktape), I got >>> similar >>>>>>> errors to above, but the overall command completed successfully. >>>>>>> >>>>>>> Any help appreciated. >>>>>>> >>>>>>> Thanks. >>>>>>> >>>>>> >>>> >>>> >>> >
