Precision

[C.Ret]

(02-13-2022 10:39 AM)kuenze Wrote:  The textbook I am working with shows the following result for the expression mentioned later: M= 350 °.1010164
with the HP Prime I get:
M=(357.52772+35999.05034*0.139780971+0.04106667845*14.39333329) mod360
M= 350°.10101799

Your notation is illegal, you may have express M as dd.ddddddd° or dd°mm'ss.sss"
I am not sure I correctly interpret your strange notation !?

The result you get completely agree the inputs you give.
At least, you can manage to better use the internal precision of the HP Prime by extracting the fractional parts of the arguments with FP().

[attachment=10363]

This way you may indirectly get M = 350.10101799004° or 350°06'03.66476"
But nothing closer to the textbook result 350°.1010164 (aka 350.1010164° or 350°06'03.65904" )
Note that if THIS is the notation used in your textbook, please close it and go buying a better one.

Are you sure you are using the exact inputs from the book (with the same exactly full precision ?). Ins't any rounding or hidden decimals in the printed values in the book ?

Another question, is it of a great importance that you get an error in the range of 5/10³ of a second ?
I am really curious the name and the price of the astrological instrument you are currently planning to use ?