Discrepancy between HP 50g and DM42
|
03-13-2021, 01:51 PM
(This post was last modified: 03-13-2021 01:52 PM by PukkaJ.)
Post: #8
|
|||
|
|||
RE: Discrepancy between HP 50g and DM42
Just for clarification: 5.67E-8 has 2 decimals in the mantissa, but doesn’t that internally become 0.0000000567 so you really end up with 10 decimals (so you can round the result to a higher precision then when you use say 5.67, all depending on the other parameters involved of course)?
|
|||
« Next Oldest | Next Newest »
|
Messages In This Thread |
Discrepancy between HP 50g and DM42 - PukkaJ - 03-11-2021, 10:05 PM
RE: Discrepancy between HP 50g and DM42 - Joe Horn - 03-11-2021, 11:19 PM
RE: Discrepancy between HP 50g and DM42 - PukkaJ - 03-11-2021, 11:24 PM
RE: Discrepancy between HP 50g and DM42 - berndpr - 03-12-2021, 03:36 AM
RE: Discrepancy between HP 50g and DM42 - PukkaJ - 03-12-2021, 07:17 AM
RE: Discrepancy between HP 50g and DM42 - aurelio - 03-13-2021, 08:57 AM
RE: Discrepancy between HP 50g and DM42 - Thomas Okken - 03-13-2021, 01:04 AM
RE: Discrepancy between HP 50g and DM42 - PukkaJ - 03-13-2021 01:51 PM
RE: Discrepancy between HP 50g and DM42 - Albert Chan - 03-13-2021, 02:49 PM
|
User(s) browsing this thread: 1 Guest(s)