Home |
Search |
Today's Posts |
#1
Posted to microsoft.public.excel.worksheet.functions
|
|||
|
|||
MOD function not returning exact zero
Hi there!
I am working with the excel MOD function. MOD(n,d) n = 2929.68750000 d = 418.5267857 I expect the answer to be zero. However, Excel is returning: -5.68434E-14 I have numerous incidences of this in my spreadsheet and these values are messing up the worksheet How does this occur and, more importantly, is there any way to resolve this? Regards SB |
#2
Posted to microsoft.public.excel.worksheet.functions
|
|||
|
|||
MOD function not returning exact zero
It occurs because, just as most numbers cannot be exactly represented by
a fixed number of decimal digits, most numbers cannot be exactly represented by a fixed number of binary digits, which is what XL (and every other spreadsheet) uses to store and calculate with. You can use =ROUND(MOD(n,d),x) to fix the problem with an arbitrary precision (e.g., x=10 rounds to the tenth decimal place). See here for mo http://cpearson.com/excel/rounding.aspx In article . com, SB wrote: Hi there! I am working with the excel MOD function. MOD(n,d) n = 2929.68750000 d = 418.5267857 I expect the answer to be zero. However, Excel is returning: -5.68434E-14 I have numerous incidences of this in my spreadsheet and these values are messing up the worksheet How does this occur and, more importantly, is there any way to resolve this? Regards SB |
#3
Posted to microsoft.public.excel.worksheet.functions
|
|||
|
|||
MOD function not returning exact zero
Hit the comma button in your menu bar and it should return it as 0, if not
you will have to round. -- -John Please rate when your question is answered to help us and others know what is helpful. "SB" wrote: Hi there! I am working with the excel MOD function. MOD(n,d) n = 2929.68750000 d = 418.5267857 I expect the answer to be zero. However, Excel is returning: -5.68434E-14 I have numerous incidences of this in my spreadsheet and these values are messing up the worksheet How does this occur and, more importantly, is there any way to resolve this? Regards SB |
Reply |
Thread Tools | Search this Thread |
Display Modes | |
|
|
Similar Threads | ||||
Thread | Forum | |||
Insert row to EXACT function | Excel Worksheet Functions | |||
Function to find only exact matches in spreadsheets? | Excel Worksheet Functions | |||
EXACT function | Excel Discussion (Misc queries) | |||
MATCH function - 2 columns w/ SIMILAR, not EXACT data | Excel Worksheet Functions | |||
Use of Exact(or other) function for alternate rows? | Excel Worksheet Functions |