HP Prime Miscalculating
11-01-2015, 01:16 PM
Post: #20
 Wes Loewer Senior Member Posts: 416 Joined: Jan 2014
RE: HP Prime Miscalculating
Here's one I like to show my students each year. In Excel, enter the following:

=(4/3-1)*3-1

You should get zero. (On the Prime you get −1.42108547152e−14.) Now put an extra set of parentheses around the whole thing in Excel:

=((4/3-1)*3-1)

You now get -2.22045E-16.

To see the significance of these two values, try

=((4/3-1)*3-1)*2^52 in Excel and ((4/3-1)*3-1)*2^46 on the Prime.
 « Next Oldest | Next Newest »

 Messages In This Thread HP Prime Miscalculating - luc4as - 10-23-2015, 02:35 AM RE: HP Prime Miscalculating - Joe Horn - 10-23-2015, 05:41 AM RE: HP Prime Miscalculating - retoa - 10-24-2015, 12:48 PM RE: HP Prime Miscalculating - parisse - 10-25-2015, 09:13 AM RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 02:54 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 04:43 PM RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 04:54 PM RE: HP Prime Miscalculating - Archanus - 10-23-2015, 07:38 PM RE: HP Prime Miscalculating - Nigel (UK) - 10-23-2015, 10:12 PM RE: HP Prime Miscalculating - Wes Loewer - 11-01-2015 01:16 PM RE: HP Prime Miscalculating - Vtile - 11-01-2015, 02:05 PM RE: HP Prime Miscalculating - Wes Loewer - 11-04-2015, 05:57 PM RE: HP Prime Miscalculating - Vtile - 11-04-2015, 08:36 PM RE: HP Prime Miscalculating - CyberAngel - 09-02-2018, 04:32 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 09:33 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 10:04 PM RE: HP Prime Miscalculating - Archanus - 10-24-2015, 02:20 AM RE: HP Prime Miscalculating - parisse - 10-24-2015, 06:37 AM RE: HP Prime Miscalculating - dan_h - 10-24-2015, 02:14 PM RE: HP Prime Miscalculating - cyrille de brébisson - 10-26-2015, 06:25 AM RE: HP Prime Miscalculating - retoa - 10-30-2015, 01:34 PM RE: HP Prime Miscalculating - parisse - 10-31-2015, 06:34 AM RE: HP Prime Miscalculating - Vtile - 10-31-2015, 10:50 AM RE: HP Prime Miscalculating - Joe Horn - 11-01-2015, 02:12 AM RE: HP Prime Miscalculating - parisse - 11-06-2015, 07:55 AM

User(s) browsing this thread: 1 Guest(s)