Math issue, isn't it?

Bob Sneidar bobs at twft.com
Fri May 8 16:06:00 EDT 2009


OK That is scary. 32 bit or no that should not be happening.

Bob Sneidar
IT Manager
Logos Management
Calvary Chapel CM

On May 8, 2009, at 12:18 PM, Colin Holgate wrote:

>
> On May 8, 2009, at 3:00 PM, Giovanni Cannizzaro wrote:
>
>> It's surely false ('cause 283.67-150.00-133.67 it' equal to 0)
>> but Revolution says me it's TRUE!
>> Can u confirm this?
>> What's the matter? Why this strange behavior?
>
>
> You might think that it equals zero, but it doesn't. Try this test:
>
> set the numberformat to "#.00000000000000000"
> put 283.67-150.00-133.67
>
> you get 0.00000000000002842
>
> I'm guessing it's something to do with the limitations of 32 bit
> arithmetic.
>
>
> _______________________________________________
> use-revolution mailing list
> use-revolution at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your  
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-revolution





More information about the use-livecode mailing list