HP41: accuracy of 13-digit routines
|
09-02-2015, 10:18 AM
Post: #4
|
|||
|
|||
RE: HP41: accuracy of 13-digit routines
(09-02-2015 04:45 AM)Thomas Klemm Wrote: Thus the internal 13-digit result isn't rounded correctly but cut off. (09-02-2015 06:11 AM)Joe Horn Wrote: Thomas is correct. Thank you very much. So the 13-digit routines truncate after 13 digits. I assume this also applies to the transcendental functions (log, exp, trig etc.). Now if I set a WP34s to RM 4 (truncate) and apply a RSD 13 to every result, this should yield the same result as the 41's 13-digit routines? The reason I'm asking this is testing a Lanczos Gamma approximation with an optimized coefficient set, cf. the recent thread in the HP41 software library. Dieter |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 4 Guest(s)