Is 0.000001 as small a number as can be worked with?
dunbarx at aol.com
dunbarx at aol.com
Wed Dec 4 18:56:21 EST 2013
I think what Jerry meant was:
set the numberformat to "0.00000000000000000000" or whatever.
Craig
-----Original Message-----
From: Jerry Jensen <jhj at jhj.com>
To: How to use LiveCode <use-livecode at lists.runrev.com>
Sent: Wed, Dec 4, 2013 4:09 pm
Subject: Re: Is 0.000001 as small a number as can be worked with?
In the multi-line message box try:
set the numberformat to "0.##########"
put 0.000001 / 1000
Note that the numberformat needs to be in quotes so the first # isn't
interpreted as the start of a comment. Otherwise it seems to use the default
which is 0.###### .
.Jerry
On Dec 4, 2013, at 12:54 PM, Geoff Canyon <gcanyon at gmail.com> wrote:
> I find that any calculation that would result in a number smaller than
> 0.000001 either rounds up to 0.000001 or down to 0. Since numerics are
> accurate up to about 10^15, what gives with the fairly limited decimal
> portion?
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your subscription
preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
_______________________________________________
use-livecode mailing list
use-livecode at lists.runrev.com
Please visit this url to subscribe, unsubscribe and manage your subscription
preferences:
http://lists.runrev.com/mailman/listinfo/use-livecode
More information about the use-livecode
mailing list