Post Reply 
[WP34s] Unexpected results in fraction mode
06-12-2014, 12:15 PM
Post: #9
RE: [WP34s] Unexpected results in fraction mode
(06-11-2014 06:14 PM)Joe Horn Wrote:  For reference only, here's what the Prime's fraction button yields in Home view (rev 6030 only):

FIX 11 mode: 400,000,000,001 / 66,666,666,667 (or 5 + 66,666,666,666 / 66,666,666,667).
This is the simplest fraction that rounds to 5.99999999999.

Here we see what can be done with sufficiently large denominators. ;-) The usual midrange calculators as well as the 34s are limited to values like 4095 or 9999.

Quote:I think Prime is the only calculator in the world that finds this result, due to its superior fraction algorithm. Wink

I suppose it's simply the larger denominator. <8)

Quote:STD or FIX 10 (or less): 6.
As expected.

Now that's an interesting point. Do the Prime's results in fraction mode depend on the display setting? This would make some sense ("show the best fraction that agrees with X rounded to four places").

Dieter
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: [WP34s] Unexpected results in fraction mode - Dieter - 06-12-2014 12:15 PM



User(s) browsing this thread: 5 Guest(s)