Free42 possible accuracy flaw

03302022, 08:04 AM
Post: #33




RE: Free42 possible accuracy flaw
(03252022 07:03 AM)Werner Wrote: Congatulations, Thomas! Found the reference (In 'Mathemathics written in Sand', pg 27), and as usual, I misremembered ;) The actual calculations are 729^33.5 vs. 3^201 Where on 10digit machines the latter has an error of more than one ulp, that could only be avoided using more than three extra digits in the intermediary calculations. Equivalent numbers for Free42 would be 531441^1072.5 vs 9^6435 The former is off by 2 ulps. (I must confess I'm a bit puzzled by the fact that in this case it is the one with the larger base that is off  which goes against my original reasoning. I'm sure Albert will come to the rescue ;)) Cheers, Werner 41CVâ€ ,42S,48GX,49G,DM42,DM41X,17BII,15CE,DM15L,12C,16CE 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)