H->HMS conversion HP-15C vs. HP42S vs HP67
|
09-08-2018, 02:35 PM
(This post was last modified: 09-08-2018 02:45 PM by Thomas Okken.)
Post: #28
|
|||
|
|||
RE: H->HMS conversion HP-15C vs. HP42S vs HP67
It doesn't multiply the entire number by 10^12, just the fractional part. But, yes, with a case like that, numerical cancellation will cause the binary round-off to mess up the result. Avoiding that is possible but ugly (I think the 33S does this).
This is why Free42 Decimal exists. UPDATE: Hadn't read your post carefully enough. Better binary-to-decimal does sound like a good idea. I'll look into it sometime after my vacation... |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 12 Guest(s)