What's today's most accurate production retail calculator?
|
02-18-2014, 11:34 AM
Post: #12
|
|||
|
|||
RE: What's today's most accurate production retail calculator?
(02-17-2014 11:59 AM)walter b Wrote: Watch it! A result of 9 doesn't have to be perfect in this case. For finite precision calculators (as all of the test objects are), the perfect result depends on their precision. IIRC, Dieter posted once about that topic.Looked it up and found an interesting post from Rodger Rosenbaum: "It appears that whenever the digits after the decimal point are greater than .9999999995 or less than .0000000005, they get dropped--at least as a result of a trig calculation [...]" From: http://www.hpmuseum.org/cgi-sys/cgiwrap/...read=85973 |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 1 Guest(s)