MC or Intel precision?

Jeanne A. E. DeVoto jeanne at runrev.com
Sun Aug 10 18:02:01 EDT 2003


At 7:33 AM -0700 8/10/03, MisterX wrote:
>put 2 ^ .5 = 1.414214
>put pi = 3.14159265358979323846
>put pi * 1 = 3.141593 --- ooops...
>put 0.0005 * 0.0005 = 0
>
>Other than start writting out externals,
>is there a way to use "Real" math precision?


The numberFormat property sets the precision of reported arithmetic results:

  set the numberFormat to ".############"
  put pi * 1 -- reports 3.14159265359

--
Jeanne A. E. DeVoto ~ jeanne at runrev.com
Runtime Revolution Limited - Software at the Speed of Thought
http://www.runrev.com/





More information about the metacard mailing list