Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1   Report Post  
Posted to microsoft.public.excel.worksheet.functions
Chris W
 
Posts: n/a
Default Precision in formulas?

I have a formula as follows:
C1=A1*B1 (assume A1=$482,933 and B1=0.9695)
My expected result is $468,203. However the actual result shown in C1 is
$468,181.
It appears as though the value used in B1 to derive the result is accurate
to a greater precision (i.e. 0.9695?????) than the 4 decimal places displayed
in cell B1.
Is there a way I can force the formula to use a specfic precision or some
other solution to my porblem?
TIA. Chris.

  #2   Report Post  
Posted to microsoft.public.excel.worksheet.functions
David Billigmeier
 
Posts: n/a
Default Precision in formulas?

C1=A1*ROUND(B1,4)

-OR-

<Tools<Options
Calculation Tab
Check "Precision as displayed"... This option will use the precision as
displayed in the cell to calculate on, instead of the actual value stored in
that cell.

Does that help?
--
Regards,
Dave


"Chris W" wrote:

I have a formula as follows:
C1=A1*B1 (assume A1=$482,933 and B1=0.9695)
My expected result is $468,203. However the actual result shown in C1 is
$468,181.
It appears as though the value used in B1 to derive the result is accurate
to a greater precision (i.e. 0.9695?????) than the 4 decimal places displayed
in cell B1.
Is there a way I can force the formula to use a specfic precision or some
other solution to my porblem?
TIA. Chris.

  #3   Report Post  
Posted to microsoft.public.excel.worksheet.functions
tony h
 
Posts: n/a
Default Precision in formulas?


Always difficult using binary for decimal calculations. Who remembers
BCD?

You will find your answer in a formula such as
=ROUND(A9*ROUND(B9,4),0)

but whether you use round , rounddown, int, floor, ceiling etc really
depends on your data

hope this helps


--
tony h
------------------------------------------------------------------------
tony h's Profile: http://www.excelforum.com/member.php...o&userid=21074
View this thread: http://www.excelforum.com/showthread...hreadid=500163

  #4   Report Post  
Posted to microsoft.public.excel.worksheet.functions
Chris W
 
Posts: n/a
Default Precision in formulas?

Just what I was looking for. Thanks for your help!

"David Billigmeier" wrote:

C1=A1*ROUND(B1,4)

-OR-

<Tools<Options
Calculation Tab
Check "Precision as displayed"... This option will use the precision as
displayed in the cell to calculate on, instead of the actual value stored in
that cell.

Does that help?
--
Regards,
Dave


"Chris W" wrote:

I have a formula as follows:
C1=A1*B1 (assume A1=$482,933 and B1=0.9695)
My expected result is $468,203. However the actual result shown in C1 is
$468,181.
It appears as though the value used in B1 to derive the result is accurate
to a greater precision (i.e. 0.9695?????) than the 4 decimal places displayed
in cell B1.
Is there a way I can force the formula to use a specfic precision or some
other solution to my porblem?
TIA. Chris.

  #5   Report Post  
Posted to microsoft.public.excel.worksheet.functions
Chris W
 
Posts: n/a
Default Precision in formulas?

Thanks for your help.

"tony h" wrote:


Always difficult using binary for decimal calculations. Who remembers
BCD?

You will find your answer in a formula such as
=ROUND(A9*ROUND(B9,4),0)

but whether you use round , rounddown, int, floor, ceiling etc really
depends on your data

hope this helps


--
tony h
------------------------------------------------------------------------
tony h's Profile: http://www.excelforum.com/member.php...o&userid=21074
View this thread: http://www.excelforum.com/showthread...hreadid=500163


Reply
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Countif formulas change after doing a sort Bob Smith Excel Worksheet Functions 3 January 3rd 06 11:17 PM
Array Formulas take waaaay too long... belly0fdesire Excel Worksheet Functions 7 August 8th 05 10:11 PM
Need Formulas for counting multiple conditions OrdOff Excel Worksheet Functions 4 July 3rd 05 06:12 PM
Problem with named formula's nathan Excel Worksheet Functions 0 January 21st 05 04:07 PM
calculating formulas for all workbooks in a folder Chad Excel Worksheet Functions 3 November 13th 04 05:22 PM


All times are GMT +1. The time now is 02:47 PM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"