Free42 possible accuracy flaw
|
03-22-2022, 04:31 PM
Post: #2
|
|||
|
|||
RE: Free42 possible accuracy flaw
https://github.com/thomasokken/free42/bl...at.cc#L649
Code: // Integral power. bid128_pow doesn't handle these very well, I would have reduce integer exponent range a bit, possibly remove it. For exponent 1e8, that is already 27 squaring's, plus many multiplies ! No wonder the result is off. Let's bypass the integer squaring part, and see what happen. 1 1e-8 + 32e8 Y^X → 78962947548608.16088504664995794553 √ √ √ √ √ → 2.718281814867636217652977243009177 |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)