Post Reply 
HP41: accuracy of 13-digit routines
09-25-2015, 11:33 PM
Post: #19
RE: HP41: accuracy of 13-digit routines
(09-25-2015 10:46 PM)Dieter Wrote:  it seems that rounding is done by doubling the last three (guard) digits:

Code:
   10.499 54995 499
=> 10.499 54995 998
=> 10.499 54995

Yeah, that's probably easier than adding 500. The result is of course the same. Thanks for the refresher.

Cheers
Thomas
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: HP41: accuracy of 13-digit routines - Thomas Klemm - 09-25-2015 11:33 PM



User(s) browsing this thread: 1 Guest(s)