@Thomas Klemm -> CORDIC Article
|
06-02-2014, 11:05 PM
Post: #15
|
|||
|
|||
RE: @Thomas Klemm -> CORDIC Article
Quote:It returns 8.999 999 999 999 999 999 999 999 999 937 535 in double precision, I don't know if this is correctly rounded or not.With 34-39digits (or more with trigo) precision set in decNumber library you have to get better result with 9deg test. |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 10 Guest(s)