Unexpected result calculating the determinant of a singular matrix (42S)
|
10-22-2019, 12:13 PM
Post: #23
|
|||
|
|||
RE: Unexpected result calculating the determinant of a singular matrix (42S)
Yes; the 48S used the same algorithm as the 42S (so only dot products accumulated with 15 digits), but the 48G and onwards expand the whole matrix to 15 digits, perform all calculations and then truncate or round back to 12 digits (don't remember which. I think it truncates).
Cheers, Werner 41CV†,42S,48GX,49G,DM42,DM41X,17BII,15CE,DM15L,12C,16CE |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 18 Guest(s)