3421A CAL RAM

[djd328]

(04-04-2017 05:16 PM)Dave Frederickson Wrote:  Here's what I've learned about the cal data for the 3468.
...
It looks like the first 7 nibbles in each row are the Zero, the next 5 the Gain, and the last 4 the checksums.

Dave, thanks for working this out. Did you investigate further?

I've been staring at the hexdumps for a little while, the 9999s jump out at me. Maybe an artifact of the parity algorithm? Assuming you are correct about the nibbles, from my 3468B:

Code:

RRRR YYYYYYY GGGGG SSSS

     0000000 00000 ffff
0.3v 9999974 f5d05 1968
3v   9999998 f45de fa53
30v  0000004 f43c2 fd58
300v 0000000 f4024 f2d0
acv  0000240 f3b2f 95eb
300r 0000000 01e11 f0c3
3kr  0000000 01cd5 fad7
30kr 0000000 002b5 f3e7
300k 0000000 00121 fde0
3Mr  0000000 0005c f6ff
30M  0000000 012ee fcc3
3A   0000016 02d04 e2cf
     0000000 00000 ffff
...
     0000000 00000 000