Post Reply 
H->HMS conversion HP-15C vs. HP42S vs HP67
09-08-2018, 02:35 PM (This post was last modified: 09-08-2018 02:45 PM by Thomas Okken.)
Post: #28
RE: H->HMS conversion HP-15C vs. HP42S vs HP67
It doesn't multiply the entire number by 10^12, just the fractional part. But, yes, with a case like that, numerical cancellation will cause the binary round-off to mess up the result. Avoiding that is possible but ugly (I think the 33S does this).

This is why Free42 Decimal exists. Smile

UPDATE: Hadn't read your post carefully enough. Better binary-to-decimal does sound like a good idea. I'll look into it sometime after my vacation...
Visit this user's website Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: H->HMS conversion HP-15C vs. HP42S vs HP67 - Thomas Okken - 09-08-2018 02:35 PM



User(s) browsing this thread: 12 Guest(s)