Torture tests: what do they mean?
|
05-14-2014, 06:30 AM
(This post was last modified: 05-14-2014 06:31 AM by Paul Dale.)
Post: #9
|
|||
|
|||
RE: Torture tests: what do they mean?
(05-14-2014 05:35 AM)DavidM Wrote: I wonder how much more interesting Pauli's table would be with \(\pi\)/2 as the target of the TAN function? Assuming the 34S calculates accurately this close to the pole: Code: digits pi/2 tan(col #2) rounded(pi)/2 tan (col #4) The second column is round(pi/2). The fourth is round(round(pi)/2) but only where it is different. The difference for fifteen digits from the above is that 1.57079632679489 isn't correctly rounded As Deiter wrote, we're really in a steep part of the tan function here. - Pauli |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)