HP Prime Miscalculating

11012015, 01:16 PM
Post: #20




RE: HP Prime Miscalculating
Here's one I like to show my students each year. In Excel, enter the following:
=(4/31)*31 You should get zero. (On the Prime you get −1.42108547152e−14.) Now put an extra set of parentheses around the whole thing in Excel: =((4/31)*31) You now get 2.22045E16. To see the significance of these two values, try =((4/31)*31)*2^52 in Excel and ((4/31)*31)*2^46 on the Prime. 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)