Problem with rounding?
Great, thanks for the answers. That does appear to reslove my issue.
I guess the excel glitch that causes the 0.0300000000000011 answer will
never be overcome though... ;-)
"Mike H" wrote:
Hi,
If you do the calculation without rounding and expand the field of decimal
places you will see that the answer is :-
0.0300000000000011
Which looks like it is rounding up to 0.04
Mike
"AmImad?" wrote:
Hi
I use excel for calculating calibration errors based on range/target
value/actual value, and then round the answers to two decimal places. I have
noticed some errors where the figures are being rounded too high. Please see
example below:
Range 0 - 200
Target Value: 100
Input Value: 99.94
Actual error: -0.06
Error as % of range: -0.03
Using the formula: ROUNDUP((((100-99.94)/200)*100),2)
I get the answer -0.04
Can you tell me if I'm doing something wrong?!
Thank you.
|