Free42 possible accuracy flaw
|
03-27-2022, 10:58 PM
Post: #32
|
|||
|
|||
RE: Free42 possible accuracy flaw
(03-25-2022 08:35 AM)Thomas Okken Wrote: Now I am curious what makes that [3^729] an interesting test case, though! For 34 decimal digits, 3^729 is close to half-way. round38(3^729) = 6.6281860542418717610517286421447974859E+347 However, Intel Decimal get this right really by luck. (see previous post) The flawed step, correction *after* rounded exponential, does not hurt the result. round38(log3 * 729) = 800.88835843905196502713377771652123869 800.8883584390519650271337777165212 E^X → 6.628186054241871761051728642144541e347 3.869E-32 X<>Y * LASTX + → 6.628186054241871761051728642144797e347 |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)