Is 0.000001 as small a number as can be worked with?
Geoff Canyon
gcanyon at gmail.com
Thu Dec 5 05:06:11 EST 2013
Gah! I wish I'd known this last week…
Well, maybe not -- the acceleration due to Deimos's gravity at a distance
of 100,000,000,000 meters is 0.000000003432397^2 meters per second^2, and
not even "0.###############" turns that into other than 0.0
On Wed, Dec 4, 2013 at 5:56 PM, <dunbarx at aol.com> wrote:
> I think what Jerry meant was:
>
>
> set the numberformat to "0.00000000000000000000" or whatever.
>
>
>
> Craig
>
>
> -----Original Message-----
> From: Jerry Jensen <jhj at jhj.com>
> To: How to use LiveCode <use-livecode at lists.runrev.com>
> Sent: Wed, Dec 4, 2013 4:09 pm
> Subject: Re: Is 0.000001 as small a number as can be worked with?
>
>
> In the multi-line message box try:
>
> set the numberformat to "0.##########"
> put 0.000001 / 1000
>
> Note that the numberformat needs to be in quotes so the first # isn't
> interpreted as the start of a comment. Otherwise it seems to use the
> default
> which is 0.###### .
> .Jerry
>
> On Dec 4, 2013, at 12:54 PM, Geoff Canyon <gcanyon at gmail.com> wrote:
>
> > I find that any calculation that would result in a number smaller than
> > 0.000001 either rounds up to 0.000001 or down to 0. Since numerics are
> > accurate up to about 10^15, what gives with the fairly limited decimal
> > portion?
> > _______________________________________________
> > use-livecode mailing list
> > use-livecode at lists.runrev.com
> > Please visit this url to subscribe, unsubscribe and manage your
> subscription
> preferences:
> > http://lists.runrev.com/mailman/listinfo/use-livecode
>
>
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription
> preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>
>
> _______________________________________________
> use-livecode mailing list
> use-livecode at lists.runrev.com
> Please visit this url to subscribe, unsubscribe and manage your
> subscription preferences:
> http://lists.runrev.com/mailman/listinfo/use-livecode
>
More information about the use-livecode
mailing list