Post Reply 
H->HMS conversion HP-15C vs. HP42S vs HP67
09-06-2018, 05:14 PM
Post: #12
RE: H->HMS conversion HP-15C vs. HP42S vs HP67
(09-06-2018 05:01 PM)Dieter Wrote:  If one of your simulators returns 146,5456 it would be interesting to know the intermediate results. I can't believe there is such a big roundoff error. So would you please post the results after each step?

183,38 →H gives 183,6333333
0,8 × this is 149,9066666 (last digit rounded down to 6)
→H.MS then returns 146,5424000

Now, what do you get?

Dieter

I think you have a typo above. For Step 2, I think you probably actually got 146,9066666. The 149.xxxx you show would be way off...

Results following are with my Retro15C app (simulator probably) on iOS. I'm not sure which app the original poster uses, but my results with this one was the same as what he originally enquired about.

183,38 →H gives 183.6444444 (Ahah...Most singular, Dr. Watson!)
0,8 × this is 146.9155555 (looks OK, given the bad result in Step 1)
→H.MS then returns 146,545600 (OK, given the prior results)

So the problem is right in step 1, wherein it errs by 0.0111111.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: H->HMS conversion HP-15C vs. HP42S vs HP67 - burkhard - 09-06-2018 05:14 PM



User(s) browsing this thread: 20 Guest(s)