Re: piuparts PTS integration

2009-03-20 Thread Holger Levsen
Hi Stefano, On Dienstag, 17. März 2009, Stefano Zacchiroli wrote: > Not a big deal. The PTS has always had maps between binary and source > packages. So if you prefer to produce result ordered per binary > packages that is fine too; we'll load them, associate them to binary > packages and link to

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, I've found a false positive...: piuparts: holger * r275 /trunk/ (piuparts.py debian/changelog): piuparts: ignore modifications of /etc/shadow* as /etc/passwd* and /etc/group* are piuparts: ignored too. gotta delete some logfiles :) number of piuparts logs with state "pass": 5898 numb

Re: piuparts PTS integration

2009-03-17 Thread Stefano Zacchiroli
On Tue, Mar 17, 2009 at 07:45:16PM +0100, Holger Levsen wrote: > Heh, cool! :-) Faster than you can think ;) > Hm. That will need some changes. There are no logfiles for source > packages. Hm. I could probably create them as meta-pages linking to > the real logfile(s). Not a big deal. The PTS h

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Holger Levsen wrote: > All true, but that requires more code. The way piuparts-master currently > works is that the logfiles are used to keep state for the master. Thats a > quite clever design, but requires being able to have access as master user. That might actu

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Stefano Zacchiroli wrote: > Actually, the PTS side should be already working since about one > year. I implemented it after we discussed the API. Heh, cool! :-) > (so yes, *source* packages here). Ok. > Then, for each matching packages which reports a failure an

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Raphael Geissert wrote: > By the way, why are the amd64 packages being tested? i386 covers even more > (not that it is a bad idea testing archs other than the "well tested" > i386). Because that the arch piatti runs :-) Support for setting up slaves on other archs

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Lucas Nussbaum wrote: > > Yes. Once it's more ready I plan to request access for all qa-team > > members to piatti and the piupartsm account, to be able to process > > logfiles on the host. > > It might be more useful to start a new group specifically for that. > Al

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Lucas Nussbaum wrote: > That's why I'd like it to be confirmed that the rate of > false positives is more like 5% or 10% than like 90% or 95%, before a > link is added on the PTS. In my experience, it was more like 95%, > especially for upgrade tests. It seems you

Re: piuparts PTS integration

2009-03-17 Thread Lucas Nussbaum
On 17/03/09 at 11:27 -0600, Raphael Geissert wrote: > Hi, > > Holger Levsen wrote: > > > Hi, > > > > On Dienstag, 17. März 2009, Lucas Nussbaum wrote: > >> > Is this something that could be outsourced to Grid5000 to speed it up? > > > > Besides what Lucas pointed out (going through the logs is

Re: piuparts PTS integration

2009-03-17 Thread Raphael Geissert
Hi, Holger Levsen wrote: > Hi, > > On Dienstag, 17. März 2009, Lucas Nussbaum wrote: >> > Is this something that could be outsourced to Grid5000 to speed it up? > > Besides what Lucas pointed out (going through the logs is most of the > work), piuparts does support several slaves (aka clients i

Re: piuparts PTS integration

2009-03-17 Thread Stefano Zacchiroli
On Tue, Mar 17, 2009 at 04:26:54PM +0100, Lucas Nussbaum wrote: > I'm mainly concerned about the fact that if it mostly reports false > positives, people will just ignore it, and it will be a missed > opportunity. That's why I'd like it to be confirmed that the rate of > false positives is more lik

Re: piuparts PTS integration

2009-03-17 Thread Lucas Nussbaum
On 17/03/09 at 15:51 +0100, Stefano Zacchiroli wrote: > I don't understand all the fuss about adding it in the PTS: it is > completely orthogonal to reporting the corresponding RC bug. Then, we > can decide how "strong" can be the way the PTS show the info. > > If there are really a lot of potenti

Re: piuparts PTS integration

2009-03-17 Thread Stefano Zacchiroli
On Mon, Mar 16, 2009 at 11:07:48PM +0100, Holger Levsen wrote: > http://piuparts.debian.org is more or less back, (a bit polishing is > still on my todo before I'm comfortable announcing it on d-d-a) and > I'm wondering how to do the PTS integration. Actually, the PTS side should be already workin

Re: piuparts PTS integration

2009-03-17 Thread Lucas Nussbaum
On 17/03/09 at 14:38 +0100, Holger Levsen wrote: > On Dienstag, 17. März 2009, Lucas Nussbaum wrote: > > It's not necessarily a bad idea to run the tests on piuparts.debian.org, > > even if it is slower, if there are more people to care about it :-) > > Yes. Once it's more ready I plan to request

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Montag, 16. März 2009, Holger Levsen wrote: > /results-per-binary.txt > %s pass $URL2MATCHINGLOG > %s fail $URL2MATCHINGLOG There are two more states: %s fuzzy $URLto_stats_page (like http://piuparts.debian.org/lenny2squeeze/state-waiting-for-dependency-to-be-tested.html) And r

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Lucas Nussbaum wrote: > > Is this something that could be outsourced to Grid5000 to speed it up? Besides what Lucas pointed out (going through the logs is most of the work), piuparts does support several slaves (aka clients in other contexts), so I think adding a

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Paul Wise wrote: > > This involves filing bugs, I don't want to do that automatically ;-) > Err, no it doesn't, it was specifically for stuff that shouldn't > nessecarily have bugs filed. Right, thanks for pointing this out. My memory (I read the bug an hour before

Re: piuparts PTS integration

2009-03-17 Thread Lucas Nussbaum
On 17/03/09 at 21:04 +0900, Paul Wise wrote: > On Tue, Mar 17, 2009 at 9:00 PM, Holger Levsen wrote: > > > The problem is, a piuparts run on all packages in a distro now takes 4-6 > > weeks, and Debian changes a lot, so there are bugs to be filed constantly. > > Is this something that could be o

Re: piuparts PTS integration

2009-03-17 Thread Paul Wise
On Tue, Mar 17, 2009 at 9:00 PM, Holger Levsen wrote: > The problem is, a piuparts run on all packages in a distro now takes 4-6 > weeks, and Debian changes a lot, so there are bugs to be filed constantly. Is this something that could be outsourced to Grid5000 to speed it up? -- bye, pabs htt

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Lucas Nussbaum wrote: > I am really not sure that putting piuparts results on the PTS is the way > to go right now. Right, we are certainly not there yet, but IMO we are getting close. > First, real piuparts failures are usually real RC bugs. If they are only > re

Re: piuparts PTS integration

2009-03-17 Thread Paul Wise
On Tue, Mar 17, 2009 at 8:44 PM, Holger Levsen wrote: > On Dienstag, 17. März 2009, Paul Wise wrote: >> I'd like to see such integration more generalised: >> http://bugs.debian.org/509416 > > This involves filing bugs, I don't want to do that automatically ;-) Err, no it doesn't, it was specific

Re: piuparts PTS integration

2009-03-17 Thread Lucas Nussbaum
On 17/03/09 at 12:44 +0100, Holger Levsen wrote: > Hi, > > On Dienstag, 17. März 2009, Paul Wise wrote: > > I'd like to see such integration more generalised: > > http://bugs.debian.org/509416 > > This involves filing bugs, I don't want to do that automatically ;-) The trick is to write tools to

Re: piuparts PTS integration

2009-03-17 Thread Holger Levsen
Hi, On Dienstag, 17. März 2009, Paul Wise wrote: > I'd like to see such integration more generalised: > http://bugs.debian.org/509416 This involves filing bugs, I don't want to do that automatically ;-) > This way anyone can create quality metrics and have them published on > PTS pages. Where th

Re: piuparts PTS integration

2009-03-17 Thread Lucas Nussbaum
On 17/03/09 at 10:14 +0100, Loïc Minier wrote: > On Tue, Mar 17, 2009, Lucas Nussbaum wrote: > > First, real piuparts failures are usually real RC bugs. If they are only > > reported to the PTS, they won't be properly tracked by the release team, > > for example. Are you planning to actively report

Re: piuparts PTS integration

2009-03-17 Thread Loïc Minier
On Tue, Mar 17, 2009, Lucas Nussbaum wrote: > First, real piuparts failures are usually real RC bugs. If they are only > reported to the PTS, they won't be properly tracked by the release team, > for example. Are you planning to actively report bugs on piuparts > failures in addition to reporting t

Re: piuparts PTS integration

2009-03-16 Thread Lucas Nussbaum
On 16/03/09 at 23:07 +0100, Holger Levsen wrote: > Hi, > > http://piuparts.debian.org is more or less back, (a bit polishing is still on > my todo before I'm comfortable announcing it on d-d-a) and I'm wondering how > to do the PTS integration. > > http://wiki.debian.org/piuparts#PiupartsandPTS

Re: piuparts PTS integration

2009-03-16 Thread Paul Wise
On Tue, Mar 17, 2009 at 7:07 AM, Holger Levsen wrote: > http://piuparts.debian.org is more or less back, (a bit polishing is still on > my todo before I'm comfortable announcing it on d-d-a) and I'm wondering how > to do the PTS integration. > > http://wiki.debian.org/piuparts#PiupartsandPTSinteg

piuparts PTS integration

2009-03-16 Thread Holger Levsen
Hi, http://piuparts.debian.org is more or less back, (a bit polishing is still on my todo before I'm comfortable announcing it on d-d-a) and I'm wondering how to do the PTS integration. http://wiki.debian.org/piuparts#PiupartsandPTSintegrationsuggestion has a quite specific and easy to follow