Post Reply 
CASIO fx-G50 Python
10-06-2021, 09:07 PM
Post: #1
CASIO fx-G50 Python
I noticed that the manual for the CASIO fx-CG50 states that the accuracy of calculations utilizing Python differs from that of the calculator. How it differs was not stated. Does anyone on the forum know?
Find all posts by this user
Quote this message in a reply
10-06-2021, 10:07 PM
Post: #2
RE: CASIO fx-G50 Python
I think the MicroPython port uses IEEE-754 double precision binary format.

Here's an example calculation:
Code:
>>>1.0000000000000002-1
2.22044604925031e-16
(The given result is 2^-52)

— Ian Abbott
Find all posts by this user
Quote this message in a reply
Post Reply 




User(s) browsing this thread: 1 Guest(s)