Numerical implementations

[nickapos]

(08-22-2023 06:16 AM)Steve Simpkin Wrote:  

(08-22-2023 05:16 AM)nickapos Wrote:  I think this is a problem that exists with most tools, when you try to exceed their designed accuracy.
...

I found it interesting the most of the recent Casio and TI scientific non-graphing calculators that I tested with came up with the exact same answer to the above referenced quadratic regression problem as Excel did. So far only the HP Prime in Home mode had less-accurate answers. It appears that the Casio's I tried have a resolution of 15-significant digits. The TI's have either 13 or 14 digits. The HP Prime has 12 digits, the same as the Saturn based HPs. I also found it interesting that the HP-48/49/50 series did not have the option to calculate quadratic regression built-in to their feature set. TI graphing models have had this ability since the TI-82 introduced in 1993.

Yeah if i understand the evolution correctly, home of HP Prime is a direct descendant of older HP calculators (although i am not a historian to point out the exact models, i would assume HP 39 etc) and the CAS has a superior engine in almost any way developed independently.
I remember Tim Wessman mentioning in a post that Prime is superior in almost every way from HP 50g, and I think he had this in mind. Prime CAS is superior than 50g cas.
In any case it is good to know your tools and their limits.