Post Reply 
Is super-accuracy matters?
10-13-2023, 07:28 PM
Post: #20
RE: Is super-accuracy matters?
(10-13-2023 03:08 PM)dm319 Wrote:  
(10-11-2023 12:21 AM)Albert Chan Wrote:  lua> x = 1e308
lua> sin(x), dtoh(x)
0.4533964905016491             +0x1.1ccf385ebc8a0p+1023

BC isn't agreeing.

If we try hexfloat, which lua actually get, it matched.

bc s(x) internal use about scale*1.1 digits for pi/4
scale=308 should give us good FIX20 of sin(x = float(1e308))
bc Wrote:ibase = 16
x = 11CCF385EBC8A0
ibase = A
x = x * 2^(1023-52)
scale = 308
y = s(x)
scale = 20
y/1
.45339649050164911655
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
Is super-accuracy matters? - Albert Chan - 10-06-2023, 04:36 PM
RE: Is super-accuracy matters? - Jlouis - 10-06-2023, 04:42 PM
RE: Is super-accuracy matters? - Jlouis - 10-06-2023, 05:05 PM
RE: Is super-accuracy matters? - EdS2 - 10-07-2023, 07:00 AM
RE: Is super-accuracy matters? - EdS2 - 10-07-2023, 07:24 AM
RE: Is super-accuracy matters? - KeithB - 10-24-2023, 01:33 PM
RE: Is super-accuracy matters? - vaklaff - 10-24-2023, 03:38 PM
RE: Is super-accuracy matters? - johnb - 10-24-2023, 03:46 PM
RE: Is super-accuracy matters? - johnb - 10-09-2023, 07:12 PM
RE: Is super-accuracy matters? - Johnh - 10-08-2023, 04:37 AM
RE: Is super-accuracy matters? - johnb - 10-09-2023, 07:24 PM
RE: Is super-accuracy matters? - dm319 - 10-13-2023, 03:08 PM
RE: Is super-accuracy matters? - Albert Chan - 10-13-2023 07:28 PM
RE: Is super-accuracy matters? - dm319 - 10-10-2023, 07:33 PM
RE: Is super-accuracy matters? - KeithB - 10-13-2023, 03:21 PM
RE: Is super-accuracy matters? - johnb - 10-13-2023, 03:36 PM
RE: Is super-accuracy matters? - johnb - 10-14-2023, 03:38 AM
RE: Is super-accuracy matters? - KeithB - 10-13-2023, 08:57 PM
RE: Is super-accuracy matters? - DA74254 - 10-20-2023, 07:02 AM
RE: Is super-accuracy matters? - mfleming - 10-20-2023, 12:07 PM
RE: Is super-accuracy matters? - EdS2 - 10-20-2023, 08:55 AM
RE: Is super-accuracy matters? - johnb - 10-20-2023, 04:40 PM
RE: Is super-accuracy matters? - Johnh - 10-20-2023, 07:48 PM
RE: Is super-accuracy matters? - dm319 - 10-30-2023, 11:46 AM
RE: Is super-accuracy matters? - EdS2 - 10-20-2023, 09:06 PM
RE: Is super-accuracy matters? - EdS2 - 10-24-2023, 05:20 PM
RE: Is super-accuracy matters? - EdS2 - 11-18-2023, 09:13 AM
RE: Is super-accuracy matters? - klesl - 11-18-2023, 09:24 AM
RE: Is super-accuracy matters? - Johnh - 11-18-2023, 11:11 AM
RE: Is super-accuracy matters? - johnb - 11-20-2023, 11:41 PM
RE: Is super-accuracy matters? - nickapos - 11-18-2023, 05:24 PM
RE: Is super-accuracy matters? - Pekis - 11-19-2023, 08:44 PM
RE: Is super-accuracy matters? - klesl - 11-18-2023, 01:53 PM



User(s) browsing this thread: 2 Guest(s)