Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1   Report Post  
Posted to microsoft.public.excel.misc
Jon Jon is offline
external usenet poster
 
Posts: 183
Default [newbie] rounding anomaly

I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)


  #2   Report Post  
Posted to microsoft.public.excel.misc
external usenet poster
 
Posts: 248
Default [newbie] rounding anomaly

Formatting a cell to 3 decimals does not change the underlying value...You
can see the underlying value in the FORMULA bar or by increasing the decimal
places in the format.

So even when you see 12.683 the actual value might be something like
12.68350023457

The underlying value is used in calculations and not the displayed value
hence the difference...
--
Pl click the ''''Yes'''' button
(if you see it - don''''t worry if you don''''t),
if this answer was helpful.



"Jon" wrote:

I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)


  #3   Report Post  
Posted to microsoft.public.excel.misc
Jon Jon is offline
external usenet poster
 
Posts: 183
Default [newbie] rounding anomaly

I'm aware of that, but still I'm not sure why the answer was 'rounded up';
maybe my calculator is incorrect? :)

"Sheeloo" wrote:

Formatting a cell to 3 decimals does not change the underlying value...You
can see the underlying value in the FORMULA bar or by increasing the decimal
places in the format.

So even when you see 12.683 the actual value might be something like
12.68350023457

The underlying value is used in calculations and not the displayed value
hence the difference...
--
Pl click the ''''Yes'''' button
(if you see it - don''''t worry if you don''''t),
if this answer was helpful.



"Jon" wrote:

I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)


  #4   Report Post  
Posted to microsoft.public.excel.misc
external usenet poster
 
Posts: 248
Default [newbie] rounding anomaly

For =(35000 + (0.1 * 50000)) * 0.012683
I get 507.32 with Excel as well as my calculator..

Regarding
NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products


This is the behavior I get in FIREFOX.. Internet Explorer works fine.
I use IE Tab addon for Firefox
https://addons.mozilla.org/en-US/firefox/addon/1419

It renders the page with IE engine within Firefox...


--
Pl click the ''''Yes'''' button
(if you see it - don''''t worry if you don''''t),
if this answer was helpful.



"Jon" wrote:

I'm aware of that, but still I'm not sure why the answer was 'rounded up';
maybe my calculator is incorrect? :)

"Sheeloo" wrote:

Formatting a cell to 3 decimals does not change the underlying value...You
can see the underlying value in the FORMULA bar or by increasing the decimal
places in the format.

So even when you see 12.683 the actual value might be something like
12.68350023457

The underlying value is used in calculations and not the displayed value
hence the difference...
--
Pl click the ''''Yes'''' button
(if you see it - don''''t worry if you don''''t),
if this answer was helpful.



"Jon" wrote:

I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)


  #5   Report Post  
Posted to microsoft.public.excel.misc
external usenet poster
 
Posts: 10
Default [newbie] rounding anomaly

"Jon" wrote:
Is this a bug?


Most likely your misunderstanding, not a bug. But....


cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and
is formatted as a percentage with 3 d.p.
Value = 12.683


.....It is difficult to offer assistance without knowing what is in D76 and
D82 -- the exactly values, not the what you might see displayed. If D76 and
D82 are formulas, not constants that you entered, then at a minimum, format
D76, D82 and D80 as Scientific with 14 dp, and post the values that you see.


cell D81 =(D79+(D78*D75))*D80
The answer comes up as 5073, whilst when working
out cell D81 manually:
35000 + (0.10 * 50000)) * .012683 = 5073.20


(I assume you mean 0.12683, which is 12.683%.)

First, 35000, 0.10 and 50000 might not be the exactly values in the cells,
merely the displayed values.

Second, the displayed value in D80, 12.683%, might really be any value
between 12.6825% and about 12.683499...%. In another posting, you say you
understand that. But....

In fact, with 12.6825% in D80, I get 5073.000000 using the other constants
as you specified them. So I suspect that is the real value in D80. Format
with 4 or more dp to see this.

PS: I confirm that with 12.683% and the other constants as you specified
them, I get 5073.20, as you did.


----- original message ----

"Jon" wrote in message
...
I've formatted a cell as a percentage column with a precision of 3 d.p.
However, when I work out the average, the answer is inaccurately.

So,

cell D80 =POWER((1 + D76/$D$82),$D$82)-1 and is formatted as a percentage
with 3 d.p.

Value = 12.683

cell D81 =(D79+(D78*D75))*D80

The answer comes up as 5073, whilst when working out cell D81 manually:

35000 + (0.10 * 50000)) * .012683 = 5073.20

Is this a bug?


MS Excel 2007

NOTE: It is noted when selecting the 'Excel' link within these discussion
groups, the user (me) is directed to a page where I have to select the
appropriate forum from a list of Microsoft products, rather than being
directed directly (excuse the pun) to the Excel discussion groups
(http://www.microsoft.com/office/comm...ang=e n&cr=US)
(http://www.microsoft.com/office/comm...verview.mspx#2)




Reply
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Combo Box Anomaly Garyw Excel Discussion (Misc queries) 2 June 23rd 08 09:03 PM
Date anomaly HaoHoaMastercard Excel Discussion (Misc queries) 4 October 11th 07 08:05 PM
Sort anomaly supersheet Excel Worksheet Functions 0 August 28th 07 06:57 PM
Real Newbie newbie question Dave New Users to Excel 0 January 10th 07 07:55 PM
VLOOKUP Anomaly Tosca Excel Worksheet Functions 6 May 8th 05 09:08 AM


All times are GMT +1. The time now is 12:51 PM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"