View Single Post
  #2   Report Post  
Posted to microsoft.public.excel.worksheet.functions
JE McGimpsey JE McGimpsey is offline
external usenet poster
 
Posts: 4,624
Default wrong result if function values over 256

In article ,
abracadabra wrote:

What the hell is going on ? It does not help to format the cell's.
Have i found a bug, and if it is i will call it a MAJOR BUG which could be
the reson of world economic crisis ;o)


This isn't a bug, it's a byproduct of using binary math that nearly
every spreadsheet exhibits (granted, users who don't know how their
tools work may contribute to the world economic crisis, but that's a
different story..).

See:

http://www.cpearson.com/excel/rounding.htm


What you're seeing is a small rounding error. If you need to compare
numbers, it's much better to use a range. e.g.:

E1: =IF(ABS(C1-D1)<0.000000001, "OK", "NOT OK")

Adjust the 0.0000000001 to suit. Of course, if you need better precision
than XL's 15 internal digits, you should be using a different package.