50 digits precision handheld calculator is it achievable or not?
|
01-19-2014, 02:21 AM
Post: #16
|
|||
|
|||
RE: 50 digits precision handheld calculator is it achievable or not?
The 34S exposes a 34 digit double precision real to the user, as was noted earlier.
Internally, most operations on the 34S are performed using 39 digits. A number of operations (e.g. complex multiplication) were easiest to perform using 72 digit numbers rather than try to cleverly work around possible cancellation issues. Then we get onto the huge stuff. Modulo reduction is done using 450 digits due to the way the decNumber library does this operation. Modulo reduction of radian arguments to trigonometric functions is done using 820 digits -- this guarantees the correct reduction of all single precision arguments but not all double precision ones. Reduction in gradians and degrees modes are done before conversion to radians and avoid this expensive step. So, the answer to your question is yes it would be possible. The cost is memory -- the 34S firmware couldn't increase the number of carried digits without running out of RAM for some operations. A little more memory would make a big difference here. - Pauli |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 2 Guest(s)