View Single Post
  #4   Report Post  
Don S
 
Posts: n/a
Default

On Thu, 14 Apr 2005 19:48:02 -0700, Overlanda
wrote:

Put this into a cell and change the format of the cell to number with 16
decimal places...

=1131.97-1123

The answer is 8.9700000000000300

Notice the 3 at the 14th place after the decimal.

Haha what a joke.

I have tried on two Excel 2003 boxes - one with SP1 and one without. Both
calculated it incorrectly



I'm not a math wiz, but I think it has something to do with binary
(computer) calculation of decimal (base 10) numbers. Use
=round(toberounded) & you'll have fewer "errors".

Don S