Is super-accuracy matters?
|
10-13-2023, 07:28 PM
Post: #20
|
|||
|
|||
RE: Is super-accuracy matters?
(10-13-2023 03:08 PM)dm319 Wrote:(10-11-2023 12:21 AM)Albert Chan Wrote: lua> x = 1e308 If we try hexfloat, which lua actually get, it matched. bc s(x) internal use about scale*1.1 digits for pi/4 scale=308 should give us good FIX20 of sin(x = float(1e308)) bc Wrote:ibase = 16 |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 2 Guest(s)