Let's vote for suggestions and bugs
|
09-23-2018, 06:33 PM
(This post was last modified: 09-23-2018 09:35 PM by Albert Chan.)
Post: #71
|
|||
|
|||
RE: Let's vote for suggestions and bugs
(09-23-2018 04:05 PM)sasa Wrote: displaying "3.1415926535897824578569270670413970947265625" for 48-bits mantissa float is dec() is designed to show exact conversion, http://www.hpmuseum.org/forum/thread-3571.html Why call dec() to get exact conversion, and then complain about it, for doing exact conversion ? When using dec(), user should expect exact result, not rounded value. BTW, a correctly rounded value meant round-up value (because CAS drop last 5 bits) For above case, shortest decimals = 3.14159265358979 = original CAS float |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)