Post Reply 
HP Prime Miscalculating
11-01-2015, 01:16 PM
Post: #20
RE: HP Prime Miscalculating
Here's one I like to show my students each year. In Excel, enter the following:

=(4/3-1)*3-1

You should get zero. (On the Prime you get −1.42108547152e−14.) Now put an extra set of parentheses around the whole thing in Excel:

=((4/3-1)*3-1)

You now get -2.22045E-16.

To see the significance of these two values, try

=((4/3-1)*3-1)*2^52 in Excel and ((4/3-1)*3-1)*2^46 on the Prime.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
HP Prime Miscalculating - luc4as - 10-23-2015, 02:35 AM
RE: HP Prime Miscalculating - Joe Horn - 10-23-2015, 05:41 AM
RE: HP Prime Miscalculating - retoa - 10-24-2015, 12:48 PM
RE: HP Prime Miscalculating - parisse - 10-25-2015, 09:13 AM
RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 02:54 PM
RE: HP Prime Miscalculating - retoa - 10-23-2015, 04:43 PM
RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 04:54 PM
RE: HP Prime Miscalculating - Archanus - 10-23-2015, 07:38 PM
RE: HP Prime Miscalculating - Nigel (UK) - 10-23-2015, 10:12 PM
RE: HP Prime Miscalculating - Wes Loewer - 11-01-2015 01:16 PM
RE: HP Prime Miscalculating - Vtile - 11-01-2015, 02:05 PM
RE: HP Prime Miscalculating - Wes Loewer - 11-04-2015, 05:57 PM
RE: HP Prime Miscalculating - Vtile - 11-04-2015, 08:36 PM
RE: HP Prime Miscalculating - CyberAngel - 09-02-2018, 04:32 PM
RE: HP Prime Miscalculating - retoa - 10-23-2015, 09:33 PM
RE: HP Prime Miscalculating - retoa - 10-23-2015, 10:04 PM
RE: HP Prime Miscalculating - Archanus - 10-24-2015, 02:20 AM
RE: HP Prime Miscalculating - parisse - 10-24-2015, 06:37 AM
RE: HP Prime Miscalculating - dan_h - 10-24-2015, 02:14 PM
RE: HP Prime Miscalculating - retoa - 10-30-2015, 01:34 PM
RE: HP Prime Miscalculating - parisse - 10-31-2015, 06:34 AM
RE: HP Prime Miscalculating - Vtile - 10-31-2015, 10:50 AM
RE: HP Prime Miscalculating - Joe Horn - 11-01-2015, 02:12 AM
RE: HP Prime Miscalculating - parisse - 11-06-2015, 07:55 AM



User(s) browsing this thread: 1 Guest(s)