Post Reply 
Calculation of determinant on HP-15C
03-10-2021, 03:44 PM
Post: #5
RE: Calculation of determinant on HP-15C
Only if you mean "numeric" as opposed to "symbolic." The algorithms are not approximations in the sense of numerical iterative methods; in infinite precision, they would be exact. But with finite precision, you will get results that aren't exact even if the algorithm is exact in principle. This is essentially the same phenomenon as what causes 1 ENTER 3 / 3 * 1 - to return a nonzero result.
Visit this user's website Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Calculation of determinant on HP-15C - Thomas Okken - 03-10-2021 03:44 PM



User(s) browsing this thread: 1 Guest(s)