TI59 Diagnostic forensics

[rprosperi]

(07-28-2020 08:49 PM)Pjwum Wrote:  

(07-28-2020 07:01 PM)rprosperi Wrote:  [Actually of course after POL(REC(30,5)), X contains 30.00012692.

I believe the 67 uses 15 internal digits, as do all Woodstocks.

Actually the TI diagnostic programme multiplies the result of your keystroke listing by 1E10 before testing it. See my first post, 2nd inequality. Thus the 67 would output 1.2692E6 versus 0.7 with the 59.

Wow! I just checked again, result is -0.7 after multiplication with 1E10. The programme precisely tests if integer(error x 1E10)=0, thus taking the absolute error value.

So, all that makes sense as I've thought the 59 had better accuracy than the 67.

I don't have the 59 listing handy, so was not sure what that was about, and missed the initial comments about multiplying the result. So, actually less impressive than I initially thought; I presumed they were manipulating numbers to actually come up with the -.888888888 result.