Algorithm accuracy vs calculator precision
|
11-12-2024, 06:33 PM
(This post was last modified: 11-12-2024 06:37 PM by Commie.)
Post: #5
|
|||
|
|||
RE: Algorithm accuracy vs calculator precision
Hi,
As far as I am aware, mathematical transcandential functions are calculated using polynomial approximations for a given function. If a high digit count is used, the designer/programmer needs to increase the degree of the polynomial in order to take advantage of the high precision and thereby achieving high accuracy, generally, this means using more terms in the said polynomial.The downside of this, is bloated firmware, more iterations and slower calculations. Obviously, bcd should be implemented. Cheers Darren |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 2 Guest(s)