Yo Hal! On Sat, 25 Mar 2017 15:07:18 -0700 Hal Murray <[email protected]> wrote:
> Isn't that as simple as convert a 64 bit integer to float and divide
> by 1<<32 to get the right scale?
Nope. Loss of precision. A double only has 52 bits of significant
digits. A float only 23. To fully encode a 64 bit int you need
a long double with (usually) 80 significant bits.
Most Intel CPUs can do long double in hardware, so available for you
without much penalty.
RGDS
GARY
---------------------------------------------------------------------------
Gary E. Miller Rellim 109 NW Wilmington Ave., Suite E, Bend, OR 97703
[email protected] Tel:+1 541 382 8588
Veritas liberabit vos. -- Quid est veritas?
"If you can’t measure it, you can’t improve it." - Lord Kelvin
pgpsf7cH86Vs_.pgp
Description: OpenPGP digital signature
_______________________________________________ devel mailing list [email protected] http://lists.ntpsec.org/mailman/listinfo/devel
