Posted to microsoft.public.excel.worksheet.functions

David K

Posts: n/a

Rounding error in Stdev function result.

the function
=STDEV(1.4434,1.4434,1.4434)
gives
2.98023E-08
(at least on my computer using Excel 2002, sp3)

Is this just rounding error due to IEEE double precision. It seems pretty
large.

-David

Reply With Quote

Thread Tools	Search this Thread
Show Printable Version	Search this Thread: Advanced Search
Display Modes
Switch to Linear Mode Switch to Hybrid Mode Threaded Mode

Posting Rules
Smilies are On [IMG] code is On HTML code is Off Trackbacks are On Pingbacks are On Refbacks are On

Similar Threads
Thread	Thread Starter	Forum	Replies	Last Post
Rounding up the result of an IF function	donnaK	Excel Worksheet Functions	3	December 8th 05 10:15 PM
RSQ function gives incorrect result	imurch	Excel Worksheet Functions	1	November 4th 05 01:35 PM
convert numbers to text	bellman	Excel Discussion (Misc queries)	0	October 4th 05 10:28 PM
excel	melissa	Excel Worksheet Functions	2	August 19th 05 09:46 PM
Amount or Numbers in Words	ron	New Users to Excel	6	December 24th 04 07:32 PM

All times are GMT +1. The time now is 11:55 PM.

About Us

"It's about Microsoft Excel"

Menu

About Us