LinkBack Thread Tools Search this Thread Display Modes
Prev Previous Post   Next Post Next
  #1   Report Post  
Posted to microsoft.public.excel.misc
nsc
 
Posts: n/a
Default Extra 1 showing up in 15th decimal place


I'm using Excel 2000 with SR-1.

I enter a value of 9.1173 in cell A1, and 9.3213 in B1.

I set C1 equal to B1 - A1.

I select the entire sheet, format cells as numbers with 4 decimal
places.

I highlight column C, and conditional format it with two conditions. If
the cell value equals .204 the cell should color itself green, if the
cell value does not equal .204 the cell should color itself red.

The cell is colored red.

Expanding the number of decimal places for the entire worksheet shows
me a 1 in the fifteenth decimal place of cell C1.

This happens for a whole range of values that I'm using. The all should
end up being .204 when the subtraction is done, but over half of them
are doing the same thing.

Additionally, if you enter A1 as 24.324 and B1 as 24.528, the
subtraction calculation for C1 will result in .2039999999999970 and it
should be .204.

Anybody know what's going on here?


--
nsc
------------------------------------------------------------------------
nsc's Profile: http://www.excelforum.com/member.php...o&userid=29648
View this thread: http://www.excelforum.com/showthread...hreadid=493565

 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
extract decimal place digit craig_100 Excel Worksheet Functions 3 November 29th 05 06:59 PM
Custom formatting to force a decimal place Mike K Excel Discussion (Misc queries) 3 July 31st 05 10:56 AM
How do I get rid of infinite numbers past the decimal place? hd Excel Worksheet Functions 1 June 1st 05 08:55 PM
excel validation to 1 decimal place Tracy New Users to Excel 4 February 23rd 05 11:09 PM
How do I override fixed decimal place settings in EXcel 2003? jroyv Excel Worksheet Functions 2 February 11th 05 06:07 PM


All times are GMT +1. The time now is 08:43 PM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"