Calculation of determinant on HP-15C

[Werner]

(03-10-2021 08:36 PM)J-F Garnier Wrote:  I got 1E-12 for this matrix on the 42S, same on the 75C Math ROM, the 71B Math ROM 1A and

Yes it’s 1e-12, the -2e-12 was from another matrix

Quote:The 42S has another quirk, that I didn't find in any other Saturn-based machines:
Try:
[[ 1E10 0 0 ]
[ 0 0 0 ]
[ 0 0 1E10 ]]
DET is 1E-492. This is the result of 1E10 x 1E-512 x 1E10.

This is the same adjustment at work: (guessing) it is proportional to the max value of the row, which is zero here, resulting in the smallest (denormalised) number that can be represented, which I thought was 1e-511, but my thoughts are becoming less and less reliable ;-).
Should be the same in the 48S? Can’t verify myself anymore.

Cheers, Werner