Is 0.000001 as small a number as can be worked with?

dunbarx at aol.com dunbarx at aol.com
Wed Dec 4 18:56:21 EST 2013


I think what Jerry meant was:


set the numberformat to "0.00000000000000000000" or whatever.



Craig


-----Original Message-----
From: Jerry Jensen <jhj at jhj.com>
To: How to use LiveCode <use-livecode at lists.runrev.com>
Sent: Wed, Dec 4, 2013 4:09 pm
Subject: Re: Is 0.000001 as small a number as can be worked with?


In the multi-line message box try:

set the numberformat to "0.##########"
put 0.000001 / 1000

Note that the numberformat needs to be in quotes so the first # isn't 
interpreted as the start of a comment. Otherwise it seems to use the default 
which is 0.###### .
.Jerry

On Dec 4, 2013, at 12:54 PM, Geoff Canyon <gcanyon at gmail.com> wrote:

> I find that any calculation that would result in a number smaller than
> 0.000001 either rounds up to 0.000001 or down to 0. Since numerics are
> accurate up to about 10^15, what gives with the fairly limited decimal
> portion?
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your subscription 
preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode


_______________________________________________
use-livecode mailing list
use-livecode at lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription 
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode

 



More information about the Use-livecode mailing list