ExcelBanter

ExcelBanter (https://www.excelbanter.com/)
-   Excel Worksheet Functions (https://www.excelbanter.com/excel-worksheet-functions/)
-   -   excel formula calculations are wrong (https://www.excelbanter.com/excel-worksheet-functions/69741-excel-formula-calculations-wrong.html)

Shamroq

excel formula calculations are wrong
 
typical:
Cell A1 I have 0.2
Cell B1 I have 0.22
Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct
However, in Cell D1, I have a formula: +Power(c1,2), and the answer is
0.0005, WRONG,
The correct answer is of course 0.0004, but all simailar calculations are in
error.
I even put in the formula for D1 as +(c1*c1) and I still get the same WRONG
answer. Please advise

Ian

excel formula calculations are wrong
 
Could this be a rounding error? Are you values in A1 & B1 exact, or are they
rounded to 1 or 2 decimal places.

eg A1=0.20, B1=0.222. With A1 to C1 formatted to 2dp and D1 formatted to
4dp, you will see the problem you describe.
--
Ian
--
"Shamroq" wrote in message
...
typical:
Cell A1 I have 0.2
Cell B1 I have 0.22
Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct
However, in Cell D1, I have a formula: +Power(c1,2), and the answer is
0.0005, WRONG,
The correct answer is of course 0.0004, but all simailar calculations are
in
error.
I even put in the formula for D1 as +(c1*c1) and I still get the same
WRONG
answer. Please advise




Jerry W. Lewis

excel formula calculations are wrong
 
I cannot reproduce your results. Format A1:B1 to show 15 decimal places. If
you still think Excel has made an error, then post the full precision values.

Jerry

"Shamroq" wrote:

typical:
Cell A1 I have 0.2
Cell B1 I have 0.22
Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct
However, in Cell D1, I have a formula: +Power(c1,2), and the answer is
0.0005, WRONG,
The correct answer is of course 0.0004, but all simailar calculations are in
error.
I even put in the formula for D1 as +(c1*c1) and I still get the same WRONG
answer. Please advise


Ron Rosenfeld

excel formula calculations are wrong
 
On Sun, 5 Feb 2006 10:53:28 -0800, "Shamroq"
wrote:

typical:
Cell A1 I have 0.2
Cell B1 I have 0.22
Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct
However, in Cell D1, I have a formula: +Power(c1,2), and the answer is
0.0005, WRONG,
The correct answer is of course 0.0004, but all simailar calculations are in
error.
I even put in the formula for D1 as +(c1*c1) and I still get the same WRONG
answer. Please advise


Most likely, you don't really have 0.2 in A1 and/or 0.22 in B1.

Are these values the results of formulas? If so, then you are seeing a rounded
result, which does not truly reflect the contents of those cells.

Reformat those cells as Number with 15 decimal places, and see what is really
there.
--ron

Shamroq

excel formula calculations are wrong
 
The numbers I put in are exact. I, me, personally, put in those digits. I
actually went on google, put in my complaint and searched. I got several
hits, and they told me to go to "tools" and change the precision. It
corrected the problem.

"Ian" wrote:

Could this be a rounding error? Are you values in A1 & B1 exact, or are they
rounded to 1 or 2 decimal places.

eg A1=0.20, B1=0.222. With A1 to C1 formatted to 2dp and D1 formatted to
4dp, you will see the problem you describe.
--
Ian
--
"Shamroq" wrote in message
...
typical:
Cell A1 I have 0.2
Cell B1 I have 0.22
Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct
However, in Cell D1, I have a formula: +Power(c1,2), and the answer is
0.0005, WRONG,
The correct answer is of course 0.0004, but all simailar calculations are
in
error.
I even put in the formula for D1 as +(c1*c1) and I still get the same
WRONG
answer. Please advise






All times are GMT +1. The time now is 02:45 PM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
ExcelBanter.com