Math issue, isn't it?

Colin Holgate coiin at rcn.com
Fri May 8 15:18:48 EDT 2009


On May 8, 2009, at 3:00 PM, Giovanni Cannizzaro wrote:

> It's surely false ('cause 283.67-150.00-133.67 it' equal to 0)
> but Revolution says me it's TRUE!
> Can u confirm this?
> What's the matter? Why this strange behavior?


You might think that it equals zero, but it doesn't. Try this test:

set the numberformat to "#.00000000000000000"
put 283.67-150.00-133.67

you get 0.00000000000002842

I'm guessing it's something to do with the limitations of 32 bit  
arithmetic.





More information about the use-livecode mailing list