Trunc Error

Jim Ault jimaultwins at yahoo.com
Tue Mar 2 12:17:32 EST 2010


This has been covered extensively in the past 6 months and several  
solutions proposed, depending on your project requirements.

go to
http://search.gmane.org/?query=trunc&group=gmane.comp.ide.revolution.user
put 'trunc' into the search for field
then       'gmane.comp.ide.revolution.user'  into the group field
sort by 'newest'  then search

You will find many posts, some are directly related to using 'step'  
and its limitations.

Jim Ault
Las Vegas

On Mar 2, 2010, at 8:33 AM, Schwartz, Jonathan L. wrote:

> I just found the following result.
>
> (1.2 - 0.8)/0.2              = 2
> trunc( (1.2 - 0.8)/0.2)  = 1
>
> --
> I have previously reported the following:
>
> on mouseUp
>   repeat with n = 0 to 1 step 0.1
>      put n&"," after aList
>   end repeat
>   put aList
> end mouseUp
>
> returns:  0,0.1,0.2,0.3,0.4,0.5,0.6,0.7,0.8,0.9,1,1.1,
> It should stop at 1
>
> Also 0 to 0.8 step 0.1 stops at 0.9   ... there are others
>
> The use of the increment is consistent with the documentation.
>
>
> Are there other similar problems that users are aware of ?
>
> When applied properly, these can produce false results and make  
> analysis using runRev questionable.
>
>
> I have reported these in the Rev Quality Control Center.






More information about the use-livecode mailing list