<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 3.2//EN">
<HTML>
<HEAD>
<META HTTP-EQUIV="Content-Type" CONTENT="text/html; charset=iso-8859-1">
<META NAME="Generator" CONTENT="MS Exchange Server version 6.0.5762.3">
<TITLE>RE: numerical bug -- a better example</TITLE>
</HEAD>
<BODY>
<!-- Converted from text/plain format -->
<P><FONT SIZE=2> try this:</FONT>
</P>
<P><FONT SIZE=2>on test1</FONT>
<BR><FONT SIZE=2> set the numberFormat to "0.#################"</FONT>
<BR><FONT SIZE=2> put 25000000/.99 into zNumber</FONT>
<BR><FONT SIZE=2> put 10^-4 into roundFactor</FONT>
<BR><FONT SIZE=2> put round(zNumber*roundFactor)/roundFactor into zNumber</FONT>
<BR><FONT SIZE=2> put zNumber</FONT>
<BR><FONT SIZE=2>end test1</FONT>
</P>
<P><FONT SIZE=2>...yields the expected result. However:</FONT>
</P>
<P><FONT SIZE=2>on test2</FONT>
<BR><FONT SIZE=2> set the numberFormat to "0.#################"</FONT>
<BR><FONT SIZE=2> put 25000000/.99 into zNumber</FONT>
<BR><FONT SIZE=2> put 10^-5 into roundFactor</FONT>
<BR><FONT SIZE=2> put round(zNumber*roundFactor)/roundFactor into zNumber</FONT>
<BR><FONT SIZE=2> put zNumber</FONT>
<BR><FONT SIZE=2>end test2</FONT>
</P>
<P><FONT SIZE=2>...yields extraneous digits at the end.</FONT>
</P>
<P><FONT SIZE=2>I'm running 1.1.1 on Mac OS X.</FONT>
</P>
<P><FONT SIZE=2>-----Original Message-----</FONT>
<BR><FONT SIZE=2>From: Ivers, Doug E</FONT>
<BR><FONT SIZE=2>To: use-revolution@lists.runrev.com</FONT>
<BR><FONT SIZE=2>Sent: 3/30/2002 10:30 AM</FONT>
<BR><FONT SIZE=2>Subject: numerical bug</FONT>
</P>
<P><FONT SIZE=2>Please be aware that put 10^-1 </FONT>
</P>
<P><FONT SIZE=2>yields </FONT>
</P>
<P><FONT SIZE=2>0.10000000000000000555 </FONT>
</P>
<P><FONT SIZE=2>There is a similar problem with 10^-2 and 10^-3. </FONT>
</P>
<P><FONT SIZE=2>This is a bug. I'll code a workaround for now and assume that this will</FONT>
<BR><FONT SIZE=2>be fixed in the next release of Rev. </FONT>
</P>
<BR>
<P><FONT SIZE=2>-- D </FONT>
</P>
</BODY>
</HTML>