Post Reply 
How does the DM42 accuracy compare to other calculators ?
12-22-2017, 05:50 AM
Post: #15
RE: How does the DM42 accuracy compare to other calculators ?
Claudio, you make an interesting point.

When a calculation goes to N digits, the result is typically truncated to M digits where (M < N) and the final digits determine whether to round UP or DOWN the M'th digit. This gives an error range.
When a value is passed to a second function, it would be interesting to [optionally] see that error range used to produce a range of outputs, OR for the final range to be specified:

X_min = -5.2067615373...E-12
X_max = 4.7932384626...E-12
OR :
X = 0 +/- 5.2 E-12
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: How does the DM42 accuracy compare to other calculators ? - sa-penguin - 12-22-2017 05:50 AM



User(s) browsing this thread: 1 Guest(s)