Re: Running system tests on mac

2020-06-30 Thread Gokul Ramanan Subramanian
Thanks Colin. While at the subject of system tests, there are a few times I see tests timed out (even on a large machine such as m5.4xlarge EC2 with Linux). Are there any knobs that system tests provide to control timeouts / throughputs across all tests? Thanks. On Tue, Jun 30, 2020 at 6:32 PM Co

Re: Running system tests on mac

2020-06-30 Thread Colin McCabe
Ducktape runs on Python 2. You can't use it with Python 3, as you are trying to do here. If anyone's interested in porting it to Python 3 it would be a good change. Otherwise, using docker as suggested here seems to be the best way to go. best, Colin On Mon, Jun 29, 2020, at 02:14, Gokul Rama

Re: Running system tests on mac

2020-06-29 Thread Nikolay Izhikov
Hello. > Is this common? At this rate, the tests would take about 2 days to complete > and there'd probably be lots of failures. Yes. System tests are heavy and resource expensive. You can run a single test with the TC_PATH environment variable. ``` TC_PATHS="tests/kafkatest/tests/client/plugga

Re: Running system tests on mac

2020-06-29 Thread Gokul Ramanan Subramanian
I have been running the tests for over 5 hours now, and only 60 or so out of the 600 tests are through. Many tests are timing out. For example: [INFO:2020-06-29 07:52:54,606]: RunnerClient: kafkatest.tests.streams.streams_cooperative_rebalance_upgrade_test.StreamsCooperativeRebalanceUpgradeTest.te

Re: Running system tests on mac

2020-06-29 Thread Gokul Ramanan Subramanian
Thanks. This worked. I had to use the Docker desktop app, not docker-machine, with which it gave errors around permissions setting up /etc/hosts. On Mon, Jun 29, 2020 at 10:24 AM Nikolay Izhikov wrote: > Hello, > > I successfully run system tests on Mac with Docker. > I followed the instruction

Re: Running system tests on mac

2020-06-29 Thread Nikolay Izhikov
Hello, I successfully run system tests on Mac with Docker. I followed the instruction on [1] and it works like a charm. [1] https://github.com/apache/kafka/tree/trunk/tests#running-tests-using-docker > 29 июня 2020 г., в 12:14, Gokul Ramanan Subramanian > написал(а): > > Hi. > > Has anyone

Running system tests on mac

2020-06-29 Thread Gokul Ramanan Subramanian
Hi. Has anyone had luck running Kafka system tests on a Mac. I have a MacOS Mojave 10.14.6. I got Python 3.6.9 using pyenv. However, the command *ducktape tests/kafkatest/tests* yields the following error, making it look like some Python incompatibility issue. $ ducktape tests/kafkatest/tests Tra