Reply
 
LinkBack Thread Tools Search this Thread Display Modes
  #1   Report Post  
Posted to microsoft.public.excel.misc
external usenet poster
 
Posts: 1
Default Two values not adding correctly

In Excel 2003 and 2007, why, when adding 664,199.05 and negative 582,911.61
the answer comes out 81,287.4400000001? Why is there a 1 at the end? This
causes issues when building formulas to control two sets of information that
should equal one another.
  #2   Report Post  
Posted to microsoft.public.excel.misc
external usenet poster
 
Posts: 2,389
Default Two values not adding correctly

That's the way computers work. They work in binary, we work in decimal.
There are imprecisions in the translation process, as you've found out. If
you want a specific precision, use the Round function, as in:
=round(yourformula,2)

Regards,
Fred


"chitown29" wrote in message
...
In Excel 2003 and 2007, why, when adding 664,199.05 and negative
582,911.61
the answer comes out 81,287.4400000001? Why is there a 1 at the end?
This
causes issues when building formulas to control two sets of information
that
should equal one another.


  #3   Report Post  
Posted to microsoft.public.excel.misc
external usenet poster
 
Posts: 4,393
Default Two values not adding correctly

Never test if two values are equal with formulas like
=A1=B1
But use
=ROUND(A1-B1,12)=0
or
ABS(A1-B1)<1e-12

This will get around the IEEE rounding errors

If you want to delve deeper:

Chip's clear explanation
http://www.cpearson.com/excel/rounding.htm

Floating-point arithmetic may give inaccurate results in Excel
http://support.microsoft.com/kb/78113/en-us

(Complete) Tutorial to Understand IEEE Floating-Point Errors
http://support.microsoft.com/kb/42980

What Every Computer Scientist Should Know About Floating Point
http://docs.sun.com/source/806-3568/ncg_goldberg.html
http://www.cpearson.com/excel/rounding.htm

Visual Basic and Arithmetic Precision
http://support.microsoft.com/default...NoWebContent=1

Good reading from T Valko
http://blogs.msdn.com/excel/archive/...g-answers.aspx

Others:
http://support.microsoft.com/kb/214118

http://docs.sun.com/source/806-3568/ncg_goldberg.html

best wishes
--
Bernard Liengme
Microsoft Excel MVP
people.stfx.ca/bliengme
email address: remove uppercase characters

REMEMBER: Microsoft is closing the newsgroups; We will all meet again at
http://answers.microsoft.com/en-us/o...ult.aspx#tab=4

"chitown29" wrote in message
...
In Excel 2003 and 2007, why, when adding 664,199.05 and negative
582,911.61
the answer comes out 81,287.4400000001? Why is there a 1 at the end?
This
causes issues when building formulas to control two sets of information
that
should equal one another.


  #4   Report Post  
Posted to microsoft.public.excel.misc
external usenet poster
 
Posts: 11,058
Default Two values not adding correctly

This is a common problem called rounding error. It can be avoided as follows:

=ROUND(664199.05-582911.61,2)

--
Gary''s Student - gsnu201003


"chitown29" wrote:

In Excel 2003 and 2007, why, when adding 664,199.05 and negative 582,911.61
the answer comes out 81,287.4400000001? Why is there a 1 at the end? This
causes issues when building formulas to control two sets of information that
should equal one another.

Reply
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Why is the sum formula is not adding correctly? justmeamw70 Excel Worksheet Functions 3 July 1st 08 04:13 AM
why are my columns not adding correctly Cathie Excel Worksheet Functions 4 August 12th 07 03:06 AM
Row of numbers not adding correctly Dale Excel Discussion (Misc queries) 2 April 8th 07 03:27 AM
Numbers not adding together correctly Andy Bleese Excel Worksheet Functions 0 November 3rd 06 03:08 PM
adding days correctly wistfulee Excel Worksheet Functions 4 April 19th 06 03:13 AM


All times are GMT +1. The time now is 09:36 PM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"