Is 0.000001 as small a number as can be worked with?
Jerry Jensen
jhj at jhj.com
Wed Dec 4 16:08:31 EST 2013
In the multi-line message box try:
set the numberformat to "0.##########"
put 0.000001 / 1000
Note that the numberformat needs to be in quotes so the first # isn't interpreted as the start of a comment. Otherwise it seems to use the default which is 0.###### .
.Jerry
On Dec 4, 2013, at 12:54 PM, Geoff Canyon <gcanyon at gmail.com> wrote:
> I find that any calculation that would result in a number smaller than
> 0.000001 either rounds up to 0.000001 or down to 0. Since numerics are
> accurate up to about 10^15, what gives with the fairly limited decimal
> portion?
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
More information about the use-livecode
mailing list