HP Prime Miscalculating
11-04-2015, 05:57 PM
Post: #22
 Wes Loewer Senior Member Posts: 416 Joined: Jan 2014
RE: HP Prime Miscalculating
(11-01-2015 02:05 PM)Vtile Wrote:  If so why the UI is not designed to solve the issues related to engine, like that it can not solve the most simplistic elementary school level calculus correctly, makes me wonder.

Well, that's the nature of any numeric calculation which uses finite precision. Since the values are not stored exactly, you cannot expect to get exact results. The fact that ((4.0/3.0-1.0)*3.0-1.0) does not result in zero does not mean that the software is faulty. The "incorrect" result is simply an artifact of the way numbers are stored.

Here are a few different results:
Binary Storage:
Prime-CAS: -1.42108547152e-14 = -(2^-46)
MS Excel: -2.22045E-16 = -(2^-52)
Maxima (50 decimals): -2.67276...e-51 = -(2^-168)

Decimal Storage:
Prime-Home: -1.0e-11
HP-50g: : -1.0e-11
TI-Npsire: -1.0e-13

(11-01-2015 02:05 PM)Vtile Wrote:  SIN(Pi/2) should be precisely 0 and the answer...

You probably meant COS(Pi/2)=0 or SIN(Pi) = 0. (SIN(Pi/2) = 1) This is a good example how how some calculators "lie" when they give you what you expect, not what the calculated result really is.

On the ti calculators, the numeric value of pi is 3.1415926535898. The actual result of sin(3.1415926535898) is about -6.76e-15, but when the calculator sees this special value, it returns the value 0 because that's what students expect/want to see.

In other words, sometimes calculators attempt to hide the artifacts of finite precision. That's probably good for students, but it does drive numerical purists crazy.

A simpler example is 1.0/3.0*3.0 . The exact result is 1 of course, but a finite precision calculation will result in something like 0.999999999 .
 « Next Oldest | Next Newest »

 Messages In This Thread HP Prime Miscalculating - luc4as - 10-23-2015, 02:35 AM RE: HP Prime Miscalculating - Joe Horn - 10-23-2015, 05:41 AM RE: HP Prime Miscalculating - retoa - 10-24-2015, 12:48 PM RE: HP Prime Miscalculating - parisse - 10-25-2015, 09:13 AM RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 02:54 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 04:43 PM RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 04:54 PM RE: HP Prime Miscalculating - Archanus - 10-23-2015, 07:38 PM RE: HP Prime Miscalculating - Nigel (UK) - 10-23-2015, 10:12 PM RE: HP Prime Miscalculating - Wes Loewer - 11-01-2015, 01:16 PM RE: HP Prime Miscalculating - Vtile - 11-01-2015, 02:05 PM RE: HP Prime Miscalculating - Wes Loewer - 11-04-2015 05:57 PM RE: HP Prime Miscalculating - Vtile - 11-04-2015, 08:36 PM RE: HP Prime Miscalculating - CyberAngel - 09-02-2018, 04:32 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 09:33 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 10:04 PM RE: HP Prime Miscalculating - Archanus - 10-24-2015, 02:20 AM RE: HP Prime Miscalculating - parisse - 10-24-2015, 06:37 AM RE: HP Prime Miscalculating - dan_h - 10-24-2015, 02:14 PM RE: HP Prime Miscalculating - cyrille de brĂ©bisson - 10-26-2015, 06:25 AM RE: HP Prime Miscalculating - retoa - 10-30-2015, 01:34 PM RE: HP Prime Miscalculating - parisse - 10-31-2015, 06:34 AM RE: HP Prime Miscalculating - Vtile - 10-31-2015, 10:50 AM RE: HP Prime Miscalculating - Joe Horn - 11-01-2015, 02:12 AM RE: HP Prime Miscalculating - parisse - 11-06-2015, 07:55 AM

User(s) browsing this thread: 1 Guest(s)