Free42 possible accuracy flaw
|
03-22-2022, 10:08 PM
Post: #7
|
|||
|
|||
RE: Free42 possible accuracy flaw
10^2 = 99.99999999999999999999999999999999
That's just the first one of many where bid128_pow() returns an inexact result for an easy case... Figuring out where the point is where repeated squaring becomes inferior will be the next challenge. And looking at powers of other small integers. |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)