On Thu, 27 Nov 2014, Gareth France wrote:
> the hex seems different for each one which is strange.

The results are within 1% (std dev 0.5) and this is significantly
better than the +/-5% given in the specification for the Seaward PAT
testing units.  The PAT tester is effectively a giant multi-meter, and
just like using a multi-meter, sampling the properties of real world
physics gives jitter in the results.  This is entirely expected.

> On 27/11/14 13:49, Paul Sladen wrote:
> > In this case, this is above >99.99, which the new meter shows as
> > '99.99' so we need to cap it with the minimum function:
> >    python -c 'print bool(not 0x48db>>15),min(99.99,0.01*(0x48db&0x7fff))'
> >    True 99.99
> The 42.79 works great but the 99.99 results don't co-operate.
> Some of these were duplicated but they are all results that came up as 
> 99.99. I've played round with all sorts of combinations but can't come 
> up with anything that works. Any ideas appreciated.

We can use min(99.99, ...) to limit the values over 99.99 to be 99.99.

        -Paul


-- 
ubuntu-uk@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-uk
https://wiki.ubuntu.com/UKTeam/

Reply via email to