Raymond Hettinger <raymond.hettin...@gmail.com> added the comment:
Added a revised script for testing accuracy measured in ULPs. It shows an improvement for all dimensions tested, with the best for 2 dimensions. Also, the maximum error is now 1 ulp; formerly, it was 2 ulps. ======== 2 dimensions ======== div-by-max: [(-2.0, 14), (-1.0, 1721), (0.0, 6533), (1.0, 1722), (2.0, 10)] scaled-by-2: [(-1.0, 841), (0.0, 8339), (1.0, 820)] ======== 3 dimensions ======== div-by-max: [(-2.0, 3), (-1.0, 1525), (0.0, 6933), (1.0, 1535), (2.0, 4)] scaled-by-2: [(-1.0, 739), (0.0, 8515), (1.0, 746)] ======== 5 dimensions ======== div-by-max: [(-2.0, 2), (-1.0, 1377), (0.0, 7263), (1.0, 1358)] scaled-by-2: [(-1.0, 695), (0.0, 8607), (1.0, 698)] ======== 10 dimensions ======== div-by-max: [(-2.0, 13), (-1.0, 1520), (0.0, 6873), (1.0, 1580), (2.0, 14)] scaled-by-2: [(-1.0, 692), (0.0, 8605), (1.0, 703)] ======== 20 dimensions ======== div-by-max: [(-1.0, 1285), (0.0, 7310), (1.0, 1405)] scaled-by-2: [(-1.0, 555), (0.0, 8822), (1.0, 623)] ---------- _______________________________________ Python tracker <rep...@bugs.python.org> <https://bugs.python.org/issue41513> _______________________________________ _______________________________________________ Python-bugs-list mailing list Unsubscribe: https://mail.python.org/mailman/options/python-bugs-list/archive%40mail-archive.com
