Free42 possible accuracy flaw
|
03-30-2022, 08:04 AM
Post: #33
|
|||
|
|||
RE: Free42 possible accuracy flaw
(03-25-2022 07:03 AM)Werner Wrote: Congatulations, Thomas! Found the reference (In 'Mathemathics written in Sand', pg 27), and as usual, I misremembered ;-) The actual calculations are 729^33.5 vs. 3^201 Where on 10-digit machines the latter has an error of more than one ulp, that could only be avoided using more than three extra digits in the intermediary calculations. Equivalent numbers for Free42 would be 531441^1072.5 vs 9^6435 The former is off by 2 ulps. (I must confess I'm a bit puzzled by the fact that in this case it is the one with the larger base that is off - which goes against my original reasoning. I'm sure Albert will come to the rescue ;-)) Cheers, Werner 41CV†,42S,48GX,49G,DM42,DM41X,17BII,15CE,DM15L,12C,16CE |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)