Post Reply 
@Thomas Klemm -> CORDIC Article
06-02-2014, 10:26 PM (This post was last modified: 06-02-2014 10:26 PM by Paul Dale.)
Post: #12
RE: @Thomas Klemm -> CORDIC Article
(06-02-2014 10:13 PM)pito Wrote:  Therefore I've ordered the 30b today - I've always been interested to have a pocket calculator which returns 9.0 with the 9 degree trigo test Smile

The 34S returns 9.000000000029361 in single precision mode which is the proper correctly rounded result. It returns 8.999999999999999999999999999937535 in double precision, I don't know if this is correctly rounded or not.


- Pauli
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
@Thomas Klemm -> CORDIC Article - Tugdual - 05-31-2014, 08:00 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-01-2014, 08:28 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-02-2014, 10:13 PM
RE: @Thomas Klemm -> CORDIC Article - Paul Dale - 06-02-2014 10:26 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-02-2014, 10:58 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-02-2014, 11:05 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-02-2014, 11:20 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-03-2014, 02:02 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 02:52 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 06:06 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 06:30 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 06:45 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 07:16 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 07:30 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 07:51 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 08:12 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 08:34 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 09:21 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 09:33 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 09:41 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 09:50 PM
RE: @Thomas Klemm -> CORDIC Article - pito - 06-04-2014, 10:46 PM



User(s) browsing this thread: 2 Guest(s)