Rounding
I am having to use a complicated user function to 'apply the result to my
worksheet'.
A simplified version is:
Public Function UserFunc(Widgets As Integer, ResourceA As Single)
UserFunc = Widgets / (Int(ResourceA) * 6 + (ResourceA - Int(ResourceA))
* 10)
End Function
if you use =UserFunc(A1, A2), where cells A1 = 21, A2 = 16.4, you will see
my problem - what you get on the worksheet is 0.21000001
"Ron Rosenfeld" wrote in message
...
On Sat, 7 Jan 2006 23:47:24 -0000, "Paul W Smith"
wrote:
Resouce A
16.0 = 16 big units or 96 small units
16.4 = 16 big units and 4 small units, total 100 small units
I am trying to find some averages, and having troubles!.
If 21 wigets cost 16.4 (100 small units), simple math tells me that each
small unit = 0.21 wigets. However Excel, calculating with VBA I get
2.0999999905 - at least that is what I get when I apply result onto my
worksheet.
I am using:
widgets / (Int(Resouce A) * 6 + (Resouce A - Int(Resouce A)) * 10)
I don't know what "apply result onto my worksheet" means ???
But I get 0.21 with VBA using *your* formula. So the problem lies
elsewhere.
Maybe in the "apply result onto my worksheet step", or maybe in something
else
that you have not shared with us thinking it irrelevant.
====================
sub foo()
Dim CostPerWidget As Double
Const ResourceA As Double = 16.4
Const Widgets As Double = 21
CostPerWidget = Widgets / (Int(ResourceA) * 6 _
+ (ResourceA - Int(ResourceA)) * 10)
Debug.Print CostPerWidget
End Sub
=======================
0.21
======================
--ron
|