Search
Member List
Calendar
Help
HP Forums
/
Not HP Calculators
/
Not quite HP Calculators - but related 
/
Free42 with IEEE 754-2008 decimal floating-point -- interested in a sneak preview?
/
Free42 with IEEE 754-2008 decimal floating-point -- interested in a sneak preview?
|
Free42 with IEEE 754-2008 decimal floating-point -- interested in a sneak preview?
|
|
03-04-2014, 09:35 AM
(This post was last modified: 03-04-2014 09:41 AM by Werner.)
Post: #51
|
|||
|
|||
RE: Free42 with IEEE 754-2008 decimal floating-point -- interested in a sneak preview?
(03-04-2014 09:17 AM)J-F Garnier Wrote: and to check the *absolute* accuracy:That's actually as good as it can get.. SQRT(163) and PI are correctly rounded to 34 digits, and their product is one ULP short of the true (but unobtainable) value. 1 ULP here is 10^-32, so the result is 2.6*10^17*10^-32 = 2.6*10^-15 off, exactly what we observe. Werner 41CV†,42S,48GX,49G,DM42,DM41X,17BII,15CE,DM15L,12C,16CE |
|||
|
|
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 5 Guest(s)