Home |
Search |
Today's Posts |
#1
Posted to microsoft.public.excel.worksheet.functions
|
|||
|
|||
excel formula calculations are wrong
typical:
Cell A1 I have 0.2 Cell B1 I have 0.22 Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct However, in Cell D1, I have a formula: +Power(c1,2), and the answer is 0.0005, WRONG, The correct answer is of course 0.0004, but all simailar calculations are in error. I even put in the formula for D1 as +(c1*c1) and I still get the same WRONG answer. Please advise |
#2
Posted to microsoft.public.excel.worksheet.functions
|
|||
|
|||
excel formula calculations are wrong
Could this be a rounding error? Are you values in A1 & B1 exact, or are they
rounded to 1 or 2 decimal places. eg A1=0.20, B1=0.222. With A1 to C1 formatted to 2dp and D1 formatted to 4dp, you will see the problem you describe. -- Ian -- "Shamroq" wrote in message ... typical: Cell A1 I have 0.2 Cell B1 I have 0.22 Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct However, in Cell D1, I have a formula: +Power(c1,2), and the answer is 0.0005, WRONG, The correct answer is of course 0.0004, but all simailar calculations are in error. I even put in the formula for D1 as +(c1*c1) and I still get the same WRONG answer. Please advise |
#3
Posted to microsoft.public.excel.worksheet.functions
|
|||
|
|||
excel formula calculations are wrong
I cannot reproduce your results. Format A1:B1 to show 15 decimal places. If
you still think Excel has made an error, then post the full precision values. Jerry "Shamroq" wrote: typical: Cell A1 I have 0.2 Cell B1 I have 0.22 Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct However, in Cell D1, I have a formula: +Power(c1,2), and the answer is 0.0005, WRONG, The correct answer is of course 0.0004, but all simailar calculations are in error. I even put in the formula for D1 as +(c1*c1) and I still get the same WRONG answer. Please advise |
#4
Posted to microsoft.public.excel.worksheet.functions
|
|||
|
|||
excel formula calculations are wrong
On Sun, 5 Feb 2006 10:53:28 -0800, "Shamroq"
wrote: typical: Cell A1 I have 0.2 Cell B1 I have 0.22 Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct However, in Cell D1, I have a formula: +Power(c1,2), and the answer is 0.0005, WRONG, The correct answer is of course 0.0004, but all simailar calculations are in error. I even put in the formula for D1 as +(c1*c1) and I still get the same WRONG answer. Please advise Most likely, you don't really have 0.2 in A1 and/or 0.22 in B1. Are these values the results of formulas? If so, then you are seeing a rounded result, which does not truly reflect the contents of those cells. Reformat those cells as Number with 15 decimal places, and see what is really there. --ron |
#5
Posted to microsoft.public.excel.worksheet.functions
|
|||
|
|||
excel formula calculations are wrong
The numbers I put in are exact. I, me, personally, put in those digits. I
actually went on google, put in my complaint and searched. I got several hits, and they told me to go to "tools" and change the precision. It corrected the problem. "Ian" wrote: Could this be a rounding error? Are you values in A1 & B1 exact, or are they rounded to 1 or 2 decimal places. eg A1=0.20, B1=0.222. With A1 to C1 formatted to 2dp and D1 formatted to 4dp, you will see the problem you describe. -- Ian -- "Shamroq" wrote in message ... typical: Cell A1 I have 0.2 Cell B1 I have 0.22 Cell C1 I have formula : +(B1-A1), and the answer is 0.02, correct However, in Cell D1, I have a formula: +Power(c1,2), and the answer is 0.0005, WRONG, The correct answer is of course 0.0004, but all simailar calculations are in error. I even put in the formula for D1 as +(c1*c1) and I still get the same WRONG answer. Please advise |
Reply |
Thread Tools | Search this Thread |
Display Modes | |
|
|
Similar Threads | ||||
Thread | Forum | |||
Formula Problem - interrupted by #VALUE! in other cells!? | Excel Worksheet Functions | |||
How wrong can you be with your NPV and MIRR functions in EXCel | Excel Worksheet Functions | |||
Excel Range Value issue (Excel 97 Vs Excel 2003) | Excel Discussion (Misc queries) | |||
Formula checking multiple worksheets | Excel Worksheet Functions | |||
In excel the formula bar behaves differently on different machines | Excel Discussion (Misc queries) |