Post Reply 
Unexpected result calculating the determinant of a singular matrix (42S)
10-22-2019, 12:13 PM
Post: #23
RE: Unexpected result calculating the determinant of a singular matrix (42S)
Yes; the 48S used the same algorithm as the 42S (so only dot products accumulated with 15 digits), but the 48G and onwards expand the whole matrix to 15 digits, perform all calculations and then truncate or round back to 12 digits (don't remember which. I think it truncates).

Cheers,
Werner

41CV†,42S,48GX,49G,DM42,DM41X,17BII,15CE,DM15L,12C,16CE
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Unexpected result calculating the determinant of a singular matrix (42S) - Werner - 10-22-2019 12:13 PM



User(s) browsing this thread: 18 Guest(s)