Post Reply 
Let's vote for suggestions and bugs
09-23-2018, 06:33 PM (This post was last modified: 09-23-2018 09:35 PM by Albert Chan.)
Post: #71
RE: Let's vote for suggestions and bugs
(09-23-2018 04:05 PM)sasa Wrote:  displaying "3.1415926535897824578569270670413970947265625" for 48-bits mantissa float is
overestimate, inaccurate, impractical and confusing for people expecting correctly rounded value.

dec() is designed to show exact conversion, http://www.hpmuseum.org/forum/thread-3571.html

Why call dec() to get exact conversion, and then complain about it, for doing exact conversion ?
When using dec(), user should expect exact result, not rounded value.

BTW, a correctly rounded value meant round-up value (because CAS drop last 5 bits)
For above case, shortest decimals = 3.14159265358979 = original CAS float
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Let's vote for suggestions and bugs - Albert Chan - 09-23-2018 06:33 PM
BREAK still reboot the calc - Oulan - 07-21-2019, 09:12 AM



User(s) browsing this thread: 2 Guest(s)