| Home |
| Search |
| Today's Posts |
|
#2
Posted to microsoft.public.excel.misc
|
|||
|
|||
Unacceptable floating point errors
You will have to take it up with IEEE (Institute of Electrical and
Electronics Engineers). It is the international standard for floating point arithmetic. XL complies with this standard. Once you have convinced them that they are wrong I am sure the XL will fix your issue. -- HTH... Jim Thomlinson "Jeff in GA" wrote: This is NOT some calculation to the nth place or an atomic weight. This is: .29 - .28 Instead of returning the correct answer of 0.01, Microsoft Excel returns 0.00999999999999995 This floating point excuse for can not be blamed for poor product quality. Does Microsoft ever plan to repair its product, or should it only be used for calculating federal budget numbers? |
| Thread Tools | Search this Thread |
| Display Modes | |
|
|
Similar Threads
|
||||
| Thread | Forum | |||
| Convert floating point to Hours and Minutes ?? | Excel Discussion (Misc queries) | |||
| Excel Throwing Circular Errors When No Errors Exist | Excel Worksheet Functions | |||
| Converting 2-place decimal value to floating point decimal number with leading zero | Excel Discussion (Misc queries) | |||
| setting a floating decimel point | New Users to Excel | |||
| Unresolved Errors in IF Statements - Errors do not show in results | Excel Worksheet Functions | |||
Threaded Mode
