Re: Kafka tests on a remote cluster

2019-01-01 Thread Pere Urbón Bayes
Hi, if I understand your question properly you are aiming to validate failure scenarios. I usually see this done for learning purposes, basically to answer how Kafka would react to such and such situation? or to validate the current setup / configuration an Organisation have. For the first one, o

Re: Kafka tests on a remote cluster

2018-12-27 Thread Parviz deyhim
+d...@kafka.apache.org On Wed, Dec 26, 2018 at 8:53 PM Parviz deyhim wrote: > Thanks fair points. Probably best if I simplify the question: How does > Kafka community run tests besides using mocked local Kafka components? > Surely there are tests to confirm different failure scenarios such as >

Re: Kafka tests on a remote cluster

2018-12-26 Thread Parviz deyhim
Thanks fair points. Probably best if I simplify the question: How does Kafka community run tests besides using mocked local Kafka components? Surely there are tests to confirm different failure scenarios such as losing a broker in a real clustered environment (multi node cluster with Ip, port, host

Re: Kafka tests on a remote cluster

2018-12-26 Thread Stephen Powis
Without looking into how the integration tests work my best guess is within the context they were written to run in, it doesn't make sense to run them against a remote cluster. The "internal" cluster is running the same code, so why require having to coordinate with an external dependency? For th

Kafka tests on a remote cluster

2018-12-26 Thread Parviz deyhim
Hi, I'm looking to see who has done this before and get some guidance. On frequent basis I like to run basic tests on a remote Kafka cluster while some random chaos/faults are being performed. In other words I like to run chaos engineering tasks (network outage, disk outage, etc) and see how Kafka