You've Got Mail.........DM42L

[Paul Dale]

The calculator forensics example in the video differs from the 34S's result in the last digit. The question is which one is rounding incorrectly and where?

Code:

sin  9                                          0.1564344650402308690101053194671668 9231389989208566
cos  0.1564344650402308690101053194671669       0.9999962727428850241175162050113502 4868632901799155
tan  0.9999962727428850241175162050113502       0.01745499985548866079139414092834846 834926109460325
atan 0.01745499985548866079139414092834847      0.9999962727428850241175162050113502 9455156466832379
acos 0.9999962727428850241175162050113503       0.1564344650402308690101053194660900 7173080649072903
asin 0.1564344650402308690101053194660901       8.999999999999999999999999999937535 3009012793999439
9 -  8.999999999999999999999999999937535        -6.2465E-29

This matches the 34S's result

The video of the DL42L shows -6.2466E-29 so it is off by at best 1 ULP somewhere.

And yes, this should have been done in radians not degrees...


- Pauli