Search
Member List
Calendar
Help
|
ACURACY
|
|
06-23-2016, 07:49 AM
(This post was last modified: 06-23-2016 07:53 AM by Dieter.)
Post: #8
|
|||
|
|||
RE: ACURACY
(06-22-2016 11:44 PM)RPL Calcs Wrote: The emulator is Free42. You´re RIGHT. 9 9 - returns -6.2466E-29 Sure. A little bit of calculus shows that about six digits are lost. So this is the expected result. BTW the WP34s returns virtually the same result, here the difference is 6,2465 E–29. You obviously use Free42 Decimal which AFAIK is based on the same 34-digit floating point library. Dieter |
|||
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
RE: ACURACY - dalupus - 06-22-2016, 05:51 PM
RE: ACURACY - Dieter - 06-23-2016, 08:05 AM
RE: ACURACY - ijabbott - 06-25-2016, 06:44 PM
RE: ACURACY - RPL Calcs - 06-22-2016, 06:18 PM
RE: ACURACY - Jake Schwartz - 06-22-2016, 07:08 PM
RE: ACURACY - Dieter - 06-22-2016, 10:35 PM
RE: ACURACY - Gerson W. Barbosa - 06-22-2016, 11:18 PM
RE: ACURACY - RPL Calcs - 06-22-2016, 11:44 PM
RE: ACURACY - Dieter - 06-23-2016 07:49 AM
RE: ACURACY - Paul Dale - 06-25-2016, 11:09 PM
|
User(s) browsing this thread: 1 Guest(s)