Accuracy Management of early HPs
|
09-10-2022, 08:11 PM
Post: #7
|
|||
|
|||
RE: Accuracy Management of early HPs
(09-10-2022 07:22 PM)Matt Agajanian Wrote: SNIP I may not have a complete understanding of what is going on internally but I believe the sequence is more like the following: (Step 1) An "intermediate" calculation is carried out to 13 places. I believe this can be done even though the HP hardware only allows the storage of 10-digit numbers since the algorithms are working on a 4-bit BCD digit at a time. (Step 2) This calculated result is rounded to 10 digits and is stored as a 10-digit number. This number is also displayed as a 10-digit number. Keep in mind the the HP hardware has 56-bit data registers that can only store 10-digit BCD numbers (10 digit mantissa, a 2 digit exponent and signs for the mantissa and exponent). (Step 3) The next calculation uses the 10 digit stored numbers, since that is all that is available with 56-bit registers. (Step 4) Go back to Step 1. I Believe the TI calculators used more than 56-bits in their data registers so they could actually store the 13 (or higher) digit results of calculations, even if they only displayed 10 (or less) rounded digits of that register. |
|||
« Next Oldest | Next Newest »
|
Messages In This Thread |
Accuracy Management of early HPs - Matt Agajanian - 09-09-2022, 11:36 PM
RE: Accuracy Management of early HPs - Kostas Kritsilas - 09-10-2022, 02:09 AM
RE: Accuracy Management of early HPs - Steve Simpkin - 09-10-2022, 04:49 AM
RE: Accuracy Management of early HPs - Matt Agajanian - 09-10-2022, 07:22 PM
RE: Accuracy Management of early HPs - Steve Simpkin - 09-10-2022 08:11 PM
RE: Accuracy Management of early HPs - Maximilian Hohmann - 09-10-2022, 08:18 PM
RE: Accuracy Management of early HPs - EdS2 - 09-10-2022, 07:48 AM
RE: Accuracy Management of early HPs - toml_12953 - 09-10-2022, 08:44 AM
RE: Accuracy Management of early HPs - EdS2 - 09-11-2022, 08:06 AM
RE: Accuracy Management of early HPs - Matt Agajanian - 09-11-2022, 08:44 PM
RE: Accuracy Management of early HPs - Steve Simpkin - 09-12-2022, 12:07 AM
|
User(s) browsing this thread: 1 Guest(s)