Is 0.000001 as small a number as can be worked with?

Jerry Jensen jhj at jhj.com
Wed Dec 4 16:08:31 EST 2013


In the multi-line message box try:

set the numberformat to "0.##########"
put 0.000001 / 1000

Note that the numberformat needs to be in quotes so the first # isn't interpreted as the start of a comment. Otherwise it seems to use the default which is 0.###### .
.Jerry

On Dec 4, 2013, at 12:54 PM, Geoff Canyon <gcanyon at gmail.com> wrote:

> I find that any calculation that would result in a number smaller than
> 0.000001 either rounds up to 0.000001 or down to 0. Since numerics are
> accurate up to about 10^15, what gives with the fairly limited decimal
> portion?
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode





More information about the use-livecode mailing list