How does the DM42 accuracy compare to other calculators ?
|
12-22-2017, 05:50 AM
Post: #15
|
|||
|
|||
RE: How does the DM42 accuracy compare to other calculators ?
Claudio, you make an interesting point.
When a calculation goes to N digits, the result is typically truncated to M digits where (M < N) and the final digits determine whether to round UP or DOWN the M'th digit. This gives an error range. When a value is passed to a second function, it would be interesting to [optionally] see that error range used to produce a range of outputs, OR for the final range to be specified: X_min = -5.2067615373...E-12 X_max = 4.7932384626...E-12 OR : X = 0 +/- 5.2 E-12 |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 4 Guest(s)