Re: automated tests or builds for d-i

2012-11-18 Thread Holger Levsen
Hi Luca, On Mittwoch, 7. November 2012, Luca Favatella wrote: > Can you please add a link to Ubuntu's Jenkins in > http://jenkins.debian.net/userContent/about.html ? The link is: > https://jenkins.qa.ubuntu.com/view/Precise/view/ISO%20Testing%20Dashboard/ I don't see much value adding this link t

Re: automated tests or builds for d-i

2012-11-18 Thread Holger Levsen
Hi intrigeri, On Sonntag, 4. November 2012, intrigeri wrote: > On Sun, Nov 04, 2012 at 02:00:06PM +0100, Holger Levsen wrote: > > i do plan to installs of various cd media and to do installs in > We're working on similar stuff at Tails, based on some integration > between that Cucumber thing the y

Re: automated tests or builds for d-i

2012-11-18 Thread Holger Levsen
Hi Martin, thanks for these infos and sorry that it took me so long to get back to this..! On Sonntag, 4. November 2012, Martin Pitt wrote: [packages with autopkg-tests] > Indeed, our goal is to get a lot more of them. We currently have some > 20 [1], but at the last UDS we had a little competit

Re: automated tests or builds for d-i

2012-11-06 Thread Luca Favatella
Hello Holger, Can you please add a link to Ubuntu's Jenkins in http://jenkins.debian.net/userContent/about.html ? The link is: https://jenkins.qa.ubuntu.com/view/Precise/view/ISO%20Testing%20Dashboard/ As Ubuntu QA already uses Jenkins for testing cd images with d-i, perhaps we could reuse some

Re: automated tests or builds for d-i

2012-11-04 Thread intrigeri
Hi, On Sun, Nov 04, 2012 at 02:00:06PM +0100, Holger Levsen wrote: > i do plan to installs of various cd media and to do installs in > various languages (+other task testing), but for that i will first > need to write code to to fire up VM instances and delete them > again... Excellent! We're wo

Re: automated tests or builds for d-i

2012-11-04 Thread Holger Levsen
On Sonntag, 4. November 2012, Stefano Zacchiroli wrote: > the missing headers. For Jenkins integration, I suggest to rely on the > header even if it is currently under used; I'd rather fix the > corresponding bugs than working around them relying on Content. my current TODO has a job comparing th

Re: automated tests or builds for d-i

2012-11-04 Thread Stefano Zacchiroli
On Sun, Nov 04, 2012 at 05:21:43PM +0100, Holger Levsen wrote: > > There aren't that many packages in the Debian archive with autopkgtest > > tests. On my machine I obtain only ~10 packages with the following: > > in my my sid chroot I only see three?! Wrapping up the discussion we've just had on

Re: automated tests or builds for d-i

2012-11-04 Thread Martin Pitt
Stefano Zacchiroli [2012-11-04 14:51 +0100]: > AFAIK in Ubuntu they've glue code that hooks autopkgtest tests into > jenkins. I don't know where the code is or how Ubuntu-specific it is, > but it is worth investigating. It'd be awesome to make it as > distro-agnostic as possible, enabling all deriv

Re: automated tests or builds for d-i

2012-11-04 Thread Holger Levsen
Hi zack, On Sonntag, 4. November 2012, Stefano Zacchiroli wrote: > > What's the best way to get a list of packages with have autopkgtests? thanks for all the info, for now I've just added a link to your mail to my TODO, but at least this has become a useful starting point. It now reads: === Te

Re: automated tests or builds for d-i

2012-11-04 Thread Holger Levsen
Hi Christian, On Sonntag, 4. November 2012, Christian PERRIER wrote: > Quoting Holger Levsen (hol...@layer-acht.org): > > so i'm lucking for an easier target first: automatic d-i-manual builds > > triggered on every commit to svn trunk? would that be useful? > *that* is definitely useful. ok, so

Re: automated tests or builds for d-i

2012-11-04 Thread Jakub Wilk
* Holger Levsen , 2012-11-04, 15:09: What's the best way to get a list of packages with have autopkgtests? wget -q http://http.debian.net/debian/dists/unstable/main/Contents-source.gz -O- | zgrep -m1 -E '^debian/tests/control\s' -- Jakub Wilk -- To UNSUBSCRIBE, email to debian-qa-requ...@li

Re: automated tests or builds for d-i

2012-11-04 Thread Christian PERRIER
Quoting Holger Levsen (hol...@layer-acht.org): > so i'm lucking for an easier target first: automatic d-i-manual builds > triggered on every commit to svn trunk? would that be useful? *that* is definitely useful. Along with failure reports sent to -boot, that would be perfect. Another interesti

Re: automated tests or builds for d-i

2012-11-04 Thread Stefano Zacchiroli
On Sun, Nov 04, 2012 at 03:09:45PM +0100, Holger Levsen wrote: > > autopkgtest runs come to mind, as we don't have yet a test runner > > running the actual tests. And without it, it's hard to motivate people > > to actually develop more autopkgtest tests. > > right. This was mentioned on #debian-q

Re: automated tests or builds for d-i

2012-11-04 Thread Holger Levsen
Hi, On Sonntag, 4. November 2012, Stefano Zacchiroli wrote: > On Sun, Nov 04, 2012 at 02:00:06PM +0100, Holger Levsen wrote: > > so http://jenkins.debian.net is setup up now, with autogenerated > > jobs and mostly doing installation tests in chroots at the moment. (*) > Ooooh, awesome! Thanks

Re: automated tests or builds for d-i

2012-11-04 Thread Stefano Zacchiroli
On Sun, Nov 04, 2012 at 02:00:06PM +0100, Holger Levsen wrote: > so http://jenkins.debian.net is setup up now, with autogenerated > jobs > and mostly doing installation tests in chroots at the moment. (*) Ooooh, awesome! Thanks! > so i'm wondering what i can run there to test d-i developm

automated tests or builds for d-i

2012-11-04 Thread Holger Levsen
Hi, so http://jenkins.debian.net is setup up now, with autogenerated jobs and mostly doing installation tests in chroots at the moment. (*) so i'm wondering what i can run there to test d-i development. i do plan to installs of various cd media and to do installs in various languages (+other