LinkBack Thread Tools Search this Thread Display Modes
Prev Previous Post   Next Post Next
  #2   Report Post  
Posted to microsoft.public.excel.programming
external usenet poster
 
Posts: 4,624
Default bad arithmetic

Take a look he

http://cpearson.com/excel/rounding.htm


The problem *is* rounding, but it's inherent in the way IEEE double
precision floating point math is done (on all spreadsheets).

In article ,
pod wrote:


To test, type in a value in cell A1, and then click on the first button to
spread the values, and then the second button to compare the results of A1
with A3. One number in particular that doesn't work is 12.825. (I know that
some other numbers don't work because of rounding, and I can get around
that,...but there is no rounding involved when using 12.825).

 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Date arithmetic Terry Pinnell Excel Discussion (Misc queries) 6 December 31st 08 02:53 PM
About arithmetic Formulas Ravindrapawanbindabinurajendradhamidevfa Excel Discussion (Misc queries) 2 August 13th 06 05:03 PM
Simple arithmetic Ron Rosenfeld Excel Discussion (Misc queries) 1 January 24th 05 08:35 PM
Simple arithmetic - take 2 Pat Excel Discussion (Misc queries) 1 January 24th 05 08:15 PM
formula arithmetic R Excel Programming 1 June 28th 04 03:52 PM


All times are GMT +1. The time now is 10:54 PM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"