"Tom Lane" <[EMAIL PROTECTED]> writes: > Gregory Stark <[EMAIL PROTECTED]> writes: >> The source of the problem is the floating point arithmetic which is used to >> do >> the individual steps in the long division. > > I don't think so. The ultimate source of the problem is that div_var > can only report a finite number of digits.
In the case reported div_var was getting 70/70 = 0.99999. Which is really just wrong. The only reason was because 1.0/70 isn't representable so (1.0/70) * 70 is slightly more than 1 which ... div_var really ought not have any trouble representing an integer even in its finite number of digits. -- Gregory Stark EnterpriseDB http://www.enterprisedb.com ---------------------------(end of broadcast)--------------------------- TIP 6: explain analyze is your friend