LinkBack Thread Tools Search this Thread Display Modes
Prev Previous Post   Next Post Next
  #3   Report Post  
JE McGimpsey
 
Posts: n/a
Default

What's happening is an inherent limitation in IEEE Double Precision
Floating Point math (which nearly all spreadsheets use):

http://cpearson.com/excel/rounding.htm


To prevent it, you can use explicit rounding:

=ROUND(1282.4-1282.39,2)

or you can use the global Tools/Options/Calculation/Precision as
Displayed, which will truncate all your values to what is displayed.

In article ,
Mike A <Mike wrote:

In Excel if I subtract, for example, 1282.39 from 1282.40, and the answer
cell is displayed with 14 or more decimal places, the result displays as
0.00999999999999, when in fact the correct result, obviously, is exactly
0.01. What's happening here, and how do I prevent it?

 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
What formula is used for subtracting a range of different cells f. tim Excel Worksheet Functions 3 April 21st 23 10:07 PM
change 5523.44 to 552344 no decimals kim12372ingram Excel Worksheet Functions 4 May 26th 05 09:02 PM
No decimals and leading zeroes gcotterl Excel Discussion (Misc queries) 2 April 18th 05 06:50 AM
Decimals separation by . or , giovdett Excel Discussion (Misc queries) 0 March 30th 05 07:54 AM
Aligning decimals in Excel ... hogon Excel Discussion (Misc queries) 1 February 15th 05 03:48 PM


All times are GMT +1. The time now is 06:00 PM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"