Numerical accuracy on the HP Prime (in Python, Home, and CAS)

[ftneek]

Thank you parisse. Rounding error is bound to happen when working with limited precision, the results of such a computation are expected to have different error margin in different precision environments.

For clarification, I did not mean to imply the result of limited precision float arithmetic was incorrect. Part of my curiosity was to see if someone would be able to simulate 'extended precision' for a MOD operation through a user program, perhaps using strings even if inefficient, simply for novelty or amusement.

I was confused about the operator precedence at first, and added a suggestion regarding placing parenthesis around MOD when in textbook display mode.

Another reason for the thread was to note some differences between Python and the MicroPython implementation on the Prime, so that users might be able to adjust their scripts accordingly if necessary.