Post Reply 
What's today's most accurate production retail calculator?
02-18-2014, 11:34 AM
Post: #12
RE: What's today's most accurate production retail calculator?
(02-17-2014 11:59 AM)walter b Wrote:  Watch it! A result of 9 doesn't have to be perfect in this case. For finite precision calculators (as all of the test objects are), the perfect result depends on their precision. IIRC, Dieter posted once about that topic.
Looked it up and found an interesting post from Rodger Rosenbaum:

"It appears that whenever the digits after the decimal point are greater than .9999999995 or less than .0000000005, they get dropped--at least as a result of a trig calculation [...]"

From: http://www.hpmuseum.org/cgi-sys/cgiwrap/...read=85973
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: What's today's most accurate production retail calculator? - Thomas Radtke - 02-18-2014 11:34 AM



User(s) browsing this thread: 1 Guest(s)