Home |
Search |
Today's Posts |
|
#1
![]()
Posted to microsoft.public.excel.misc
|
|||
|
|||
![]()
PS....
On Nov 24, 4:44*pm, I wrote: In your example, the problemmatic numbers are in A3:B3. *16.1 and 15.6 are stored internally as exactly 16.10000000000000142108547152020037174224853515625 and 15.59999999999999964472863211994990706443786621093 75. I did not intend to imply that the numbers in A1:B2 are stored exactly. In fact, they are not. But coincidentally, their difference is exactly 0.5, even when we put parentheses around the expression, which side-steps Excel's attempt to ameliorate such numerical "errors", and even when we do the computation in VBA. I want to reiterate that is purely by coincidental. The result of B3- A3 is much more common. PS: I also notice that I computed A3-B3, not B3-A3 as you did. That does not make any difference other than the sign of the result. |
#2
![]()
Posted to microsoft.public.excel.misc
|
|||
|
|||
![]() "joeu2004" wrote: PS.... On Nov 24, 4:44 pm, I wrote: In your example, the problemmatic numbers are in A3:B3. 16.1 and 15.6 are stored internally as exactly 16.10000000000000142108547152020037174224853515625 and 15.59999999999999964472863211994990706443786621093 75. I did not intend to imply that the numbers in A1:B2 are stored exactly. In fact, they are not. But coincidentally, their difference is exactly 0.5, even when we put parentheses around the expression, which side-steps Excel's attempt to ameliorate such numerical "errors", and even when we do the computation in VBA. I understood your intention. I took programming courses ages and ages ago and was familiar with how computers stored numbers but that knowledge was forgotten quite some time ago. This experience has been a refresher. :) I want to reiterate that is purely by coincidental. The result of B3- A3 is much more common. PS: I also notice that I computed A3-B3, not B3-A3 as you did. That does not make any difference other than the sign of the result. |
Reply |
Thread Tools | Search this Thread |
Display Modes | |
|
|
![]() |
||||
Thread | Forum | |||
Rounding errors when a "5" is the third decimal place using formul | Excel Discussion (Misc queries) | |||
How do I correct rounding errors in Excel formulas? | Excel Worksheet Functions | |||
Excel Throwing Circular Errors When No Errors Exist | Excel Worksheet Functions | |||
Can rounded numbers be summed without rounding errors? | Excel Discussion (Misc queries) | |||
Rounding Errors Help | Excel Discussion (Misc queries) |