ExcelBanter

ExcelBanter (https://www.excelbanter.com/)
-   Excel Discussion (Misc queries) (https://www.excelbanter.com/excel-discussion-misc-queries/)
-   -   Excel calculation error? (https://www.excelbanter.com/excel-discussion-misc-queries/92861-excel-calculation-error.html)

Mike

Excel calculation error?
 
Hi all,
Excel 2K SP3, Win2kSP4, Pentium4

I have the following formula in a workbook of mine:
=((CE145-CJ145)+(IF(BY145=0,0,BT145/BY145)-(IF(BZ145=0,0,BU145/BZ145))))*CS1
45

including all significant (non zero) decimal places, CE145 and CJ145 are
both 1.564, BY145 and BZ145 are 39, BT145 & BU145 are both 0, and CS145 is
26400.

the answer should be 0. However, the answer is
apparently -7.34412530789541E-12 (-0.000000000007344..)

when I go through the formula a reference at a time F9'ing everything, it
turns out to be 0. But when I F9 on (CE145-CJ145), I get a very small
negative number (-2.77555756156289E-17). if I F9 on CE145-CJ145 (not
including the brackets this time) I get 0.

I realize that the brackets around CE145-CJ145 are slightly extraneous, but
if I remove those brackets, (and the extra brackets around the IFs and the
second IF) so that the formula is
=(CE145-CJ145+IF(BY145=0,0,BT145/BY145)-IF(BZ145=0,0,BU145/BZ145))*CS145
and I evaluate everything before *CS145 (whether or not I include the
brackets), I get that tiny little number

WTF?

I mean I can fix the formula to ignore tiny little numbers, but what's going
on? This is a spreadsheet app that my company uses and I'm responsible for
updating, so when one of the users showed me this I had to scramble to
figure out that Excel is (apparently) tripping up here.



Mike

Excel calculation error?
 
As a extra note, if I change the formula to (CE145-CJ145)*CS145 +
(IF(...)-IF(...))*CS145, the answer is 0.

"Mike" wrote in message
...
Hi all,
Excel 2K SP3, Win2kSP4, Pentium4

I have the following formula in a workbook of mine:

=((CE145-CJ145)+(IF(BY145=0,0,BT145/BY145)-(IF(BZ145=0,0,BU145/BZ145))))*CS1
45

including all significant (non zero) decimal places, CE145 and CJ145 are
both 1.564, BY145 and BZ145 are 39, BT145 & BU145 are both 0, and CS145 is
26400.

the answer should be 0. However, the answer is
apparently -7.34412530789541E-12 (-0.000000000007344..)

when I go through the formula a reference at a time F9'ing everything, it
turns out to be 0. But when I F9 on (CE145-CJ145), I get a very small
negative number (-2.77555756156289E-17). if I F9 on CE145-CJ145 (not
including the brackets this time) I get 0.

I realize that the brackets around CE145-CJ145 are slightly extraneous,

but
if I remove those brackets, (and the extra brackets around the IFs and the
second IF) so that the formula is
=(CE145-CJ145+IF(BY145=0,0,BT145/BY145)-IF(BZ145=0,0,BU145/BZ145))*CS145
and I evaluate everything before *CS145 (whether or not I include the
brackets), I get that tiny little number

WTF?

I mean I can fix the formula to ignore tiny little numbers, but what's

going
on? This is a spreadsheet app that my company uses and I'm responsible

for
updating, so when one of the users showed me this I had to scramble to
figure out that Excel is (apparently) tripping up here.






All times are GMT +1. The time now is 03:30 AM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
ExcelBanter.com