Post Reply 
Let's vote for suggestions and bugs
09-23-2018, 04:05 PM (This post was last modified: 09-23-2018 04:23 PM by sasa.)
Post: #70
RE: Let's vote for suggestions and bugs
(09-23-2018 01:17 PM)Albert Chan Wrote:  
(09-23-2018 09:20 AM)CyberAngel Wrote:  Joe insists that all the dec digits represents the pi approximation exactly.

To be precise, replace "Pi approximation" to "best double precision value of Pi, truncated to 48 bits mantissa"

Best double precision value of Pi = 0x0.c90fdaa22168c0P+2
Truncated 48 bits mantissa, float = 0x0.c90fdaa22168P+2
Convert to decimal, you get "3.1415926535897824578569270670413970947265625" ... Exactly

I believe we all understand each other perfectly. Actually, you will see similar with every programming language displaying any float with format which overestimate its actual precision. Usually, basic display format is regarding its precision. In that case displaying "3.1415926535897824578569270670413970947265625" for 48-bits mantissa float is overestimate, inaccurate, impractical and confusing for people expecting correctly rounded value.

After I have looked at Joe's function, I have noticed it is used basic algorithm without any rounding mechanism and formatting regarding current CAS settings, or user parameters. Perhaps few more tweaks are needed only in order to make it more flexible.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Let's vote for suggestions and bugs - sasa - 09-23-2018 04:05 PM
BREAK still reboot the calc - Oulan - 07-21-2019, 09:12 AM



User(s) browsing this thread: 1 Guest(s)