View Single Post
  #13   Report Post  
Posted to microsoft.public.excel.misc
Greg Lovern Greg Lovern is offline
external usenet poster
 
Posts: 224
Default Cosine Function Returns Wrong Answer!

On Jul 5, 3:30 pm, Gordon Arnaut
wrote:
The cosine function returns the wrong answer for the cosine of 90 degrees.
The right answer is zero, of course, but Excel insists on returning a very
small number, 6e-17.



My Excel add-in, xlPrecision, returns exactly zero:

=xlpCOS(xlpRADIANS(90))

Returns:

0


That example omits the optional significant digits arguments, which
default to 100 significant digits if omitted. Depending on the edition
of xlPrecision, you can specifiy up to 2,147,483,648 (over 2 billion)
significant digits:

=xlpCOS(xlpRADIANS(90,2147483648),2147483648)


The free edition (use it as long as you like) of xlPrecision allows up
to 150 significant digits:

=xlpCOS(xlpRADIANS(90,150),150)


You can download the free edition he

http://precisioncalc.com/Free.html


Thanks,

Greg Lovern
http://PrecisionCalc.com
More Power In Excel