Post Reply 
Let's vote for suggestions and bugs
09-23-2018, 01:33 AM
Post: #61
RE: Let's vote for suggestions and bugs
(09-22-2018 10:10 AM)CyberAngel Wrote:  Approximation... rounded to 14 digits it's correct.

Yes. Or, more precisely, a binary floating-point approximation of pi truncated to 48 bits (which is what reals in CAS are limited to), it's the closest CAS can get to pi, and the 'dec' program reveals exactly what that approximation is equal to.

If you understand the above, you can answer both of these questions:
(1) Why doesn't dec(0.1) return a "clean" decimal result?
(2) Why DOES dec(0.5) return a "clean" decimal result?

<0|ΙΈ|0>
-Joe-
Visit this user's website Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Let's vote for suggestions and bugs - Joe Horn - 09-23-2018 01:33 AM
BREAK still reboot the calc - Oulan - 07-21-2019, 09:12 AM



User(s) browsing this thread: 12 Guest(s)