Rounding Problem
Mike wrote:
Thanks for the explanation.
Glad to hear it helped. Just to clarify....
I wrote:
Consequently, the Single sum of binary
powers may be truncated when it is stored into a Double
I probably should have said: the sum of binary powers may be truncated
when stored into a Single, and that truncation is carried forward when
the Single is stored into Double, which (I presume) is how Excel stores
numeric cell values.
|