ExcelBanter

ExcelBanter (https://www.excelbanter.com/)
-   Excel Discussion (Misc queries) (https://www.excelbanter.com/excel-discussion-misc-queries/)
-   -   [newbie] rounding anomaly (https://www.excelbanter.com/excel-discussion-misc-queries/227407-%5Bnewbie%5D-rounding-anomaly.html)

Jon

[newbie] rounding anomaly
 
I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)



Sheeloo[_5_]

[newbie] rounding anomaly
 
Formatting a cell to 3 decimals does not change the underlying value...You
can see the underlying value in the FORMULA bar or by increasing the decimal
places in the format.

So even when you see 12.683 the actual value might be something like
12.68350023457

The underlying value is used in calculations and not the displayed value
hence the difference...
--
Pl click the ''''Yes'''' button
(if you see it - don''''t worry if you don''''t),
if this answer was helpful.



"Jon" wrote:

I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)



Jon

[newbie] rounding anomaly
 
I'm aware of that, but still I'm not sure why the answer was 'rounded up';
maybe my calculator is incorrect? :)

"Sheeloo" wrote:

Formatting a cell to 3 decimals does not change the underlying value...You
can see the underlying value in the FORMULA bar or by increasing the decimal
places in the format.

So even when you see 12.683 the actual value might be something like
12.68350023457

The underlying value is used in calculations and not the displayed value
hence the difference...
--
Pl click the ''''Yes'''' button
(if you see it - don''''t worry if you don''''t),
if this answer was helpful.



"Jon" wrote:

I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)



Sheeloo[_5_]

[newbie] rounding anomaly
 
For =(35000 + (0.1 * 50000)) * 0.012683
I get 507.32 with Excel as well as my calculator..

Regarding
NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products


This is the behavior I get in FIREFOX.. Internet Explorer works fine.
I use IE Tab addon for Firefox
https://addons.mozilla.org/en-US/firefox/addon/1419

It renders the page with IE engine within Firefox...


--
Pl click the ''''Yes'''' button
(if you see it - don''''t worry if you don''''t),
if this answer was helpful.



"Jon" wrote:

I'm aware of that, but still I'm not sure why the answer was 'rounded up';
maybe my calculator is incorrect? :)

"Sheeloo" wrote:

Formatting a cell to 3 decimals does not change the underlying value...You
can see the underlying value in the FORMULA bar or by increasing the decimal
places in the format.

So even when you see 12.683 the actual value might be something like
12.68350023457

The underlying value is used in calculations and not the displayed value
hence the difference...
--
Pl click the ''''Yes'''' button
(if you see it - don''''t worry if you don''''t),
if this answer was helpful.



"Jon" wrote:

I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)



Joe User

[newbie] rounding anomaly
 
"Jon" wrote:
Is this a bug?


Most likely your misunderstanding, not a bug. But....


cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and
is formatted as a percentage with 3 d.p.
Value = 12.683


.....It is difficult to offer assistance without knowing what is in D76 and
D82 -- the exactly values, not the what you might see displayed. If D76 and
D82 are formulas, not constants that you entered, then at a minimum, format
D76, D82 and D80 as Scientific with 14 dp, and post the values that you see.


cell D81 =(D79+(D78*D75))*D80
The answer comes up as 5073, whilst when working
out cell D81 manually:
35000 + (0.10 * 50000)) * .012683 = 5073.20


(I assume you mean 0.12683, which is 12.683%.)

First, 35000, 0.10 and 50000 might not be the exactly values in the cells,
merely the displayed values.

Second, the displayed value in D80, 12.683%, might really be any value
between 12.6825% and about 12.683499...%. In another posting, you say you
understand that. But....

In fact, with 12.6825% in D80, I get 5073.000000 using the other constants
as you specified them. So I suspect that is the real value in D80. Format
with 4 or more dp to see this.

PS: I confirm that with 12.683% and the other constants as you specified
them, I get 5073.20, as you did.


----- original message ----

"Jon" wrote in message
...
I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)






All times are GMT +1. The time now is 01:11 AM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
ExcelBanter.com