Re: [Openstack-qa-team] Policy for Tests linked to existing Bugs

2012-05-07 Thread David Kranz
On 5/7/2012 2:29 PM, Venkatesan, Ravikumar wrote: On 5/4/2012 9:08 AM, Jay Pipes wrote: On 05/04/2012 06:14 AM, Karajgi, Rohit wrote: Hi, What is the policy that we should or are following for test cases that fail due to an existing Open Bug in Launchpad? For eg: https://github.com/openstack/

Re: [Openstack-qa-team] Policy for Tests linked to existing Bugs

2012-05-07 Thread Venkatesan, Ravikumar
On 5/4/2012 9:08 AM, Jay Pipes wrote: > On 05/04/2012 06:14 AM, Karajgi, Rohit wrote: >> Hi, >> >> What is the policy that we should or are following for test cases that >> fail due to an existing Open Bug in Launchpad? >> >> For eg: >> https://github.com/openstack/tempest/blob/master/tempest/test

Re: [Openstack-qa-team] Policy for Tests linked to existing Bugs

2012-05-04 Thread David Kranz
Yes, I suppose it depends on how development teams think about tempest. In an ideal world, with complete test coverage of everything, any commit that fixes a bug would also have to unskip or change some test. But we can't expect developers to run tempest before a commit in the same way they wou

Re: [Openstack-qa-team] Policy for Tests linked to existing Bugs

2012-05-04 Thread Jay Pipes
On 05/04/2012 09:28 AM, David Kranz wrote: On 5/4/2012 9:08 AM, Jay Pipes wrote: On 05/04/2012 06:14 AM, Karajgi, Rohit wrote: Hi, What is the policy that we should or are following for test cases that fail due to an existing Open Bug in Launchpad? For eg: https://github.com/openstack/tempest

Re: [Openstack-qa-team] Policy for Tests linked to existing Bugs

2012-05-04 Thread David Kranz
On 5/4/2012 9:08 AM, Jay Pipes wrote: On 05/04/2012 06:14 AM, Karajgi, Rohit wrote: Hi, What is the policy that we should or are following for test cases that fail due to an existing Open Bug in Launchpad? For eg: https://github.com/openstack/tempest/blob/master/tempest/tests/test_list_floatin

Re: [Openstack-qa-team] Policy for Tests linked to existing Bugs

2012-05-04 Thread Jay Pipes
On 05/04/2012 06:14 AM, Karajgi, Rohit wrote: Hi, What is the policy that we should or are following for test cases that fail due to an existing Open Bug in Launchpad? For eg: https://github.com/openstack/tempest/blob/master/tempest/tests/test_list_floating_ips.py#L64 skips the test and posts t

[Openstack-qa-team] Policy for Tests linked to existing Bugs

2012-05-04 Thread Karajgi, Rohit
Hi, What is the policy that we should or are following for test cases that fail due to an existing Open Bug in Launchpad? For eg: https://github.com/openstack/tempest/blob/master/tempest/tests/test_list_floating_ips.py#L64 skips the test and posts the Bug ID in the message. Do we submit the te