HP 12C (Metric to Standard Conversion)

[Dieter]

(08-15-2017 11:32 AM)Gamo Wrote:  I'm only amateur and start to play around with this HP 12C program and your advice is very welcome.

Great.

(08-15-2017 11:32 AM)Gamo Wrote:  I though that the four digits fraction will get 9 decimal accuracy internally so I used fraction (make division) instead of using specific fix number. I try to check all the units and it give accuracy above 6 decimal place.

That's six digit accuracy from eight digits. ;-)
I'd say the best you can get is 1471/3243 resp. 8044/2125 (error in both cases < 2 E–8).
With one more digit there is 7658/16883 which is off by ~1 E–9.

In any case it takes 2x 10 steps to obtain the conversion factors. Simply using the exact values does not require more (9+11) and returns an exact result. So for sure this is the preferred method.

Dieter