View Single Post
  #2   Report Post  
Posted to microsoft.public.excel,microsoft.public.excel.programming
GS[_2_] GS[_2_] is offline
external usenet poster
 
Posts: 3,514
Default Excel is messing with the math coprocessor

Lynn McGuire was thinking very hard :
I have just noticed that Excel is changing the floating
point round off handling in the math coprocessor for my
C++ and Fortran DLL. Has anyone run into this ? I am
getting ready to try venturing into _Control87 calls
when my DLL is called from Excel.

I have verified this problem in both Excel 2003 and 2010.

Thanks,
Lynn


Excel has its own method of handling floating point rounding and so
expect it to be different compared to another methodology.

--
Garry

Free usenet access at http://www.eternal-september.org
ClassicVB Users Regroup!
comp.lang.basic.visual.misc
microsoft.public.vb.general.discussion