Post Reply 
Seriously? Only 12 digits precision? o_O
02-09-2014, 02:32 AM
Post: #1
Seriously? Only 12 digits precision? o_O
I just noticed that the numeric calculations in the Prime only have 12 digits precision.
I found that kind of disappointing and astonishing. For comparison: Even my 20€ calculator uses 14 digits precision. And the standard Android calculator app uses even more digits.
(And no, the "arbitrary" precision in CAS Mode is no help in these case where a floating point number is involved in the calculation.)

So why the heck doesn't the Prime use more digits? I understand that you have to cut of somewhere, but I would expect a couple of more digits from a calculator which is a magnitude higher in price than a simple school calculator.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
Seriously? Only 12 digits precision? o_O - Stefan - 02-09-2014 02:32 AM



User(s) browsing this thread: 1 Guest(s)