Prime: Fraction dependent on FIX setting
|
12-22-2013, 10:30 PM
Post: #2
|
|||
|
|||
RE: Prime: Fraction dependent on FIX setting
The issue is the documentation does not mention that the current digits setting impacts the way the key works. This allows you to control how you are calculating the fractional item. This is kind of similar to how changing the fix setting would make the evaluated integral precision change in older hp calcs. Change it to FIX 3 and it would returns what you expect (basically, rounds to 1 less then the digits setting).
The display of the item does not do anything to the underlying number and just flags it as "display with a fraction". Hence when you convert it to dms it works as expected. Nothing is lost and it is purely a display thing. TW Although I work for HP, the views and opinions I post here are my own. |
|||
« Next Oldest | Next Newest »
|
Messages In This Thread |
Prime: Fraction dependent on FIX setting - Terje Vallestad - 12-22-2013, 02:33 PM
RE: Prime: Fraction dependent on FIX setting - Tim Wessman - 12-22-2013 10:30 PM
RE: Prime: Fraction dependent on FIX setting - Terje Vallestad - 01-01-2014, 01:58 PM
RE: Prime: Fraction dependent on FIX setting - Michael de Estrada - 01-01-2014, 02:49 PM
RE: Prime: Fraction dependent on FIX setting - patrice - 01-01-2014, 09:13 PM
RE: Prime: Fraction dependent on FIX setting - Terje Vallestad - 01-01-2014, 10:36 PM
|
User(s) browsing this thread: 1 Guest(s)