Post Reply 
@Thomas Klemm -> CORDIC Article
06-04-2014, 09:41 PM
Post: #41
RE: @Thomas Klemm -> CORDIC Article
The first is mine (decNumber, I have to check the rounding settings) the second one is wp32s double precision (pauli did).
Find all posts by this user
Quote this message in a reply
06-04-2014, 09:50 PM (This post was last modified: 06-04-2014 11:14 PM by pito.)
Post: #42
RE: @Thomas Klemm -> CORDIC Article
My dusty (34digits for all operations):
Code:
0.1570796326794896619231321691639752    +1
0.1564344650402308690101053194671670    +2
0.9877890614843210265922459718568865    +1
1.516357552591207213695274523631413     0
0.9877890614843210265922459718568860    -4
0.156434465040230869010105319467171    +5
0.1570796326794896619231321691639791   +43
9.000000000000000000000000000000227   +247
Find all posts by this user
Quote this message in a reply
06-04-2014, 10:46 PM (This post was last modified: 06-04-2014 11:25 PM by pito.)
Post: #43
RE: @Thomas Klemm -> CORDIC Article
WP34s emulator 3.3.3605 (34digits double + !39digits for trigo ):
Code:
0.1570796326794896619231321691639752  +1
0.1564344650402308690101053194671669    +1
0.9877890614843210265922459718568864   0
1.516357552591207213695274523631413     0
0.9877890614843210265922459718568864    0
0.1564344650402308690101053194671666    0
0.1570796326794896619231321691639748    0
8.999999999999999999999999999999979   -1

I do not know how Pauli came to his result.. Old firmware?? Smile

(06-02-2014 10:26 PM)Paul Dale Wrote:  
(06-02-2014 10:13 PM)pito Wrote:  Therefore I've ordered the 30b today - I've always been interested to have a pocket calculator which returns 9.0 with the 9 degree trigo test Smile

The 34S returns 9.000000000029361 in single precision mode which is the proper correctly rounded result. It returns 8.999999999999999999999999999937535 in double precision, I don't know if this is correctly rounded or not.


- Pauli
Find all posts by this user
Quote this message in a reply
Post Reply 




User(s) browsing this thread: 1 Guest(s)