Re: [DISCUSS] KIP-25 System test improvements

2015-06-11 Thread Geoffrey Anderson
___ > From: Geoffrey Anderson [ge...@confluent.io] > Sent: Monday, June 08, 2015 10:56 PM > To: dev@kafka.apache.org > Subject: Re: [DISCUSS] KIP-25 System test improvements > > Hi KIP-25 thread, > > I consolidated some of the questions from this thread and elsewhere. >

RE: [DISCUSS] KIP-25 System test improvements

2015-06-11 Thread Aditya Auradkar
: Monday, June 08, 2015 10:56 PM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-25 System test improvements Hi KIP-25 thread, I consolidated some of the questions from this thread and elsewhere. Q: Can we see a map of what system-test currently tests, which ones we want to replace and JIRAs for

Re: [DISCUSS] KIP-25 System test improvements

2015-06-08 Thread Geoffrey Anderson
Hi KIP-25 thread, I consolidated some of the questions from this thread and elsewhere. Q: Can we see a map of what system-test currently tests, which ones we want to replace and JIRAs for replacing? A: Initial draft here: https://cwiki.apache.org/confluence/display/KAFKA/Roadmap+-+port+existing+s

Re: [DISCUSS] KIP-25 System test improvements

2015-06-08 Thread Geoffrey Anderson
Hi Gwen, I don't see any problem with this as long as we're convinced there's a good use case, which seems to be true. Cheers, Geoff On Thu, Jun 4, 2015 at 5:20 PM, Gwen Shapira wrote: > Not completely random places :) > People may use Cloudera / HWX distributions which include Kafka, but want

Re: [DISCUSS] KIP-25 System test improvements

2015-06-04 Thread Gwen Shapira
Not completely random places :) People may use Cloudera / HWX distributions which include Kafka, but want to verify that these bits match a specific upstream release. I think having the tests separately will be useful for this. In this case, finding the tests are not a big issue - we'll add a down

Re: [DISCUSS] KIP-25 System test improvements

2015-06-04 Thread Jiangjie Qin
Hey Gwen, Currently the test and code are downloaded at the same time. Supposedly the tests in the same repository should cover match the code. Are you saying people downloaded a release from some random place and want to verify it? If that is the case, does that mean people still need to find the

Re: [DISCUSS] KIP-25 System test improvements

2015-06-04 Thread Gwen Shapira
Hi, Reviving the discussion a bit :) I think it will be nice if each Kafka version that we release will also have a separate "tests" artifact that users can download, untar and easily run against a Kafka cluster of the same version. The idea is that if someone downloads packages that claim to co

Re: [DISCUSS] KIP-25 System test improvements

2015-05-21 Thread Geoffrey Anderson
Hi Ashish, Looks like Ewen already hit the main points, but a few additions: 1. ducktape repo is here: https://github.com/confluentinc/ducktape ducktape itself will be pip installable in the near future, and Kafka system tests will be able to depend on a particular version of ducktape. 2. The r

Re: [DISCUSS] KIP-25 System test improvements

2015-05-21 Thread Ewen Cheslack-Postava
Ashish, 1. That was the plan. We put some effort into cleanly separating the framework so it would be reusable across many projects. 2. I think you're seeing a test in progress where the final report hasn't been created yet. If you visit one of the older ones you'll see it has a landing page with

Re: [DISCUSS] KIP-25 System test improvements

2015-05-21 Thread Ashish Singh
Geoffrey, This looks great! A few questions. 1. Will ducktape be maintained separately as a github repo? 2. How easy is viewing the test results and logs. The link in KIP, http://testing.confluent.io/confluent_platform/latest/, lists a bunch of files and dirs. Could you add to KIP how the result

Re: [DISCUSS] KIP-25 System test improvements

2015-05-21 Thread Geoffrey Anderson
Great, I'll work on putting together a more detailed map of this replacement process. On Thu, May 21, 2015 at 11:13 AM, Gwen Shapira wrote: > Love this idea :) > > I took a look at Ducktape API and it looks like a good fit - clean API, > extensible, easy to use and powerful enough for our use-ca

Re: [DISCUSS] KIP-25 System test improvements

2015-05-21 Thread Gwen Shapira
Love this idea :) I took a look at Ducktape API and it looks like a good fit - clean API, extensible, easy to use and powerful enough for our use-case. Something I'd like to see as part of the KIP is a map of what system-test currently tests, which ones we want to replace and a JIRA for replacing