LinkBack Thread Tools Search this Thread Display Modes
Prev Previous Post   Next Post Next
  #1   Report Post  
Posted to microsoft.public.excel.programming
external usenet poster
 
Posts: 75
Default Floating point problem??

Hi all,

I have a fairly mysterious problem.

It is hard to explain here, but basically what I did is declare a variable X
as single, then assign a cell content containing decimal digits to X, then
write X back to another cell.

Problem is, let say, suppose the original cell contains 0.0111773. After
transferring this number to X and then copy back to another cell, that cell
now contains 0.0111772995442152. Though the cell content is very near to the
original one, but it does cause problem to me. Anybody can guess what
actually happened and what is the solution? Thanks a lot.

Frederick Chow


 
Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules

Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are On


Similar Threads
Thread Thread Starter Forum Replies Last Post
Unacceptable floating point errors Jeff in GA Excel Discussion (Misc queries) 32 September 25th 09 11:26 AM
Convert floating point to Hours and Minutes ?? [email protected] Excel Discussion (Misc queries) 1 August 19th 06 02:26 AM
setting a floating decimel point Rose New Users to Excel 2 April 29th 05 06:10 PM
Floating Point Functions Joel Excel Programming 6 March 30th 05 10:29 PM
Handle Floating point rounding errors, efficiently Peter T Excel Programming 6 December 19th 04 04:34 PM


All times are GMT +1. The time now is 12:04 AM.

Powered by vBulletin® Copyright ©2000 - 2025, Jelsoft Enterprises Ltd.
Copyright ©2004-2025 ExcelBanter.
The comments are property of their posters.
 

About Us

"It's about Microsoft Excel"