NumWorks open source calculator

[Namir]

(09-06-2017 05:59 PM)Chasfield Wrote:  The calculator forensics calculation returns 8.966758 (for 9 degrees) on this device and it seems to always display results to 7 significant figures. Calculation precision seems therefore to be on the low side.

Is it perhaps squandering higher levels of precision by carrying forward rounded up/down display values rather than underlying register values?

I tested the expression:

(355/113 - pi)/pi * 1e9

I got a unit 2 days ago!! I was able to update the firmware version this morning.

The new firmware version of 1.1.0 gave 84.91xxxx which is good. The previous firmware version of 1.0.3 gave a higher number (did not think to record it) which reflected poorer accuracy. SO it seems the new firmware version has enhanced accuracy.

Namir