Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1   Report Post  
Posted to microsoft.public.excel.misc
external usenet poster
 
Posts: 837
Default excel cannot count: 4513,77-4500.It shows 13,77 but < 13,77.Try!

Try =4513,77-4500 and format to 13 decimal places. You will get
13,7700000000004
which is why Excel returns False for =4513,77-4500=13,77

In problems like this, where you know where the last figure should be,
rounding can avoid surprises. Excel will return True for
=ROUND(4513,77-4500;2)=13,77

As others have noted, this is due to Excel (and almost all other computer
software) doing binary math. In binary, there are only 4 2-decimal place
fractions that can be exactly represented ( ,00 ,25 ,50 ,75 ) all others must
be approximated (just as 1/3 can only be approximated as a decimal fraction).
What you are seeing is the the unavoidable consequence of the initial binary
approximation to 4513,77. That approximation has a decimal value of
4513.77000000000043655745685100555419921875
which you don't directly see because Excel displays no more that 15 digits
of a number (as documented in Help).

Jerry

"mik" wrote:

lets try to compare the result
write to cell:
=4513,77-4500=13,77
its true or false?
(excel 2003 Sp1 professional)
do i need a coproccessor? :)


----------------
This post is a suggestion for Microsoft, and Microsoft responds to the
suggestions with the most votes. To vote for this suggestion, click the "I
Agree" button in the message pane. If you do not see the button, follow this
link to open the suggestion in the Microsoft Web-based Newsreader and then
click "I Agree" in the message pane.

http://www.microsoft.com/office/comm...lic.excel.misc

Reply
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Excel 2003 FAILS, but Excel 2000 SUCCEEDS ??? Richard Excel Discussion (Misc queries) 2 May 13th 23 11:46 AM
TRYING TO SET UP EXCEL SPREADSHEET ON MY COMPUTER MEGTOM New Users to Excel 5 October 27th 05 03:06 AM
Excel Range Value issue (Excel 97 Vs Excel 2003) Keeno Excel Discussion (Misc queries) 2 June 13th 05 02:01 PM
excel should have a function to count sheets carlos sosa Excel Worksheet Functions 7 April 24th 05 08:29 PM
How can I use count function in excel where I have several criter. Princess V Excel Worksheet Functions 14 November 3rd 04 10:18 PM


All times are GMT +1. The time now is 04:34 AM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"