Math issue, isn't it?

[Mark Swindell]

set the numberFormat to 0.##
put 283.67-150.00-133.67

returns 0
_______

set the numberFormat to 0.##
put 283.67-150.00-133.67>0

returns true
________

put 0 > 0

returns false



On May 8, 2009, at 12:18 PM, Colin Holgate wrote:

>
> On May 8, 2009, at 3:00 PM, Giovanni Cannizzaro wrote:
>
>> It's surely false ('cause 283.67-150.00-133.67 it' equal to 0)
>> but Revolution says me it's TRUE!
>> Can u confirm this?
>> What's the matter? Why this strange behavior?
>
>
> You might think that it equals zero, but it doesn't. Try this test:
>
> set the numberformat to "#.00000000000000000"
> put 283.67-150.00-133.67
>
> you get 0.00000000000002842
>
> I'm guessing it's something to do with the limitations of 32 bit  
> arithmetic.
>
>
> _______________________________________________
> use-revolution mailing list
> use-revolution at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your  
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-revolution