They diverge at the 15th decimal digit. That is about where the 64 bit format runs out of mantissa precision. You only get about 7 with the 32 bit format. .Jerry
> On Mar 17, 2015, at 6:55 PM, Peter W A Wood <peterwaw...@gmail.com> wrote: > > Mike > > This explanation from Mark Waddingham confirms that numbers are held in IEEE > 754 format - http://quality.runrev.com/show_bug.cgi?id=9349 > > I’m pretty sure it is 64-bit. I tried multiplying a value of Pi with more > significant digits than a 32 bit number can hold in the message box: > > Code: > put format ("%.30g",3.14159265358979323846264338327950 * 1.0) > > Result: > 3.14159265358979311599796346854 > > Hope this helps > > Peter > > >> On 18 Mar 2015, at 06:21, Michael Doub <miked...@gmail.com> wrote: >> >> Can anyone point me to a reference that discusses the precision of >> livecode's math calculations? Is it doing IEEE 754 64-bit floating point >> under the covers? >> >> Thanks >> Mike >> >> _______________________________________________ >> use-livecode mailing list >> use-livecode@lists.runrev.com >> Please visit this url to subscribe, unsubscribe and manage your subscription >> preferences: >> http://lists.runrev.com/mailman/listinfo/use-livecode > > > _______________________________________________ > use-livecode mailing list > use-livecode@lists.runrev.com > Please visit this url to subscribe, unsubscribe and manage your subscription > preferences: > http://lists.runrev.com/mailman/listinfo/use-livecode _______________________________________________ use-livecode mailing list use-livecode@lists.runrev.com Please visit this url to subscribe, unsubscribe and manage your subscription preferences: http://lists.runrev.com/mailman/listinfo/use-livecode
