+- Tvlax Forums (http://www.tvalx.com/mybb)
+-- Forum: Support (/forumdisplay.php?fid=3)
+--- Forum: Support (/forumdisplay.php?fid=4)
+--- Thread: Scientific Calculator Math Center 2 Precision Question (/showthread.php?tid=5)
Scientific Calculator Math Center 2 Precision Question - Bradford - 07-17-2010 06:07 PM
Using Scientific Calculator Math Center Level 2, I sometimes get
results that differ from the exact results by more than 10^(-15). Isn't
the precision of Scientific calculator 15 digits?
RE: Scientific Calculator Math Center 2 Precision Question - admin - 07-19-2010 02:17 AM
When math software (including hand-held calculators) developers declare that precision of calculations is n digits, that means precision of 'standalone' arithmetic operations and standard functions. Most of hand-held calculators do just standalone calculations. Even a brief sequence of operations can lead to rounding error accumulation. Consider (1/3)*3. The exact result is 1. But in 5 digits calculator (1/3)*3=(3.3333E-1)*3=9.9999E-1. The most of calculators apply some guessing techniques which catch such situations and give exact numbers. In a long sequences of operations rounding errors can accumulate. For example, 1.0001 - (4.0000E-5)- (4.0000E-5) - (4.0000E-5) = 1.0001 - (4.0000E-5) - (4.0000E-5) = 1.0001 - (4.0000E-5) = 1.0001 and -(4.0000E-5) - (4.0000E-5) - (4.0000E-5) + 1.0001 = -(8.0000E-5) - (4.0000E-5) + 1.0001 = -(1.2000E-4) + 1.0001 = 1.0000 . It is supposed that rounding errors cancel each other in long sequences. It would be in purely stochastic (random) world. But in our reality patterns occur. Some very long sequences get very big rounding errors. Since functions are calculated with help of Taylor series, which are long sequences of arithmetic calculations, rounding errors are a serious problem for math software developers. In order to get desired precision for standard functions, developers use greater precision for arithmetic operations. Usually such precision is hidden for users and is named 'internal precision'.
de même qu jeu gratuit pourrez y effectuer - jeux flash gaspard - 04-03-2011 08:07 PM
http://www.weplayflash.fr/
http://www.weplayflash.fr/
RE: Scientific Calculator Math Center 2 Precision Question - admin - 04-04-2011 02:11 AM
jeux flash, I appreciate your effort to promote your website here, but could you place your messege on French sub-forum?