Post Reply 
Free42 with IEEE 754-2008 decimal floating-point -- interested in a sneak preview?
03-02-2014, 11:06 AM
Post: #28
RE: Free42 with IEEE 754-2008 decimal floating-point -- interested in a sneak preview?
The 34S comes up with ...502 following that sequence too so I kind of suspect that that the is the correctly rounded answer in 34 digit precision. Not that I trust the 34S's result in double precision mode all that much, but two separate implementations attempting to do the right thing coming up with the same answer is compelling to some degree.

I just checked with wolfram alpha and ACOS(0) ends ...751(44) so the correctly rounded result will be ...502. The joys of two rounding steps Smile


- Pauli
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Free42 with IEEE 754-2008 decimal floating-point -- interested in a sneak preview? - Paul Dale - 03-02-2014 11:06 AM



User(s) browsing this thread: 13 Guest(s)