HP Prime Miscalculating
10-26-2015, 06:25 AM
Post: #15
 cyrille de brĂ©bisson Senior Member Posts: 1,047 Joined: Dec 2013
RE: HP Prime Miscalculating
Hello,

>Why does prime only have 48 bits of mantissa for doubles?

Le me expand on what Bernard is saying.
The CAS does use a 8 bytes data structure to save a mathematical object.
The first 5 bits (Least significant bits) of this structure is the object type (real, integer, vector...), the rest of free for use for each possible individual type.

In the case of a structure being a real, then the rest of the 64 bits is the double. BUT since 5 bits are already used for the type, this double is truncated by 5 bits (which have been stolen to indicate the type). Hence the 48 bits of mantissa (the other bits being the sign and exponent).

One could wonder: Why make real less precise? But remember that in CAS worlds, precision is achieved through "perfect" integers, not through floating points numbers, so the reasoning is quire sound. If you want precision: use integers as floating points will ALWAYS be inaccurate, regardless of the mantissa size. hence it it not a problem to remove 5 bits of precision.

Cyrille

Although I work for the HP calculator group, the views and opinions I post here are my own. I do not speak for HP.
 « Next Oldest | Next Newest »

 Messages In This Thread HP Prime Miscalculating - luc4as - 10-23-2015, 02:35 AM RE: HP Prime Miscalculating - Joe Horn - 10-23-2015, 05:41 AM RE: HP Prime Miscalculating - retoa - 10-24-2015, 12:48 PM RE: HP Prime Miscalculating - parisse - 10-25-2015, 09:13 AM RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 02:54 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 04:43 PM RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 04:54 PM RE: HP Prime Miscalculating - Archanus - 10-23-2015, 07:38 PM RE: HP Prime Miscalculating - Nigel (UK) - 10-23-2015, 10:12 PM RE: HP Prime Miscalculating - Wes Loewer - 11-01-2015, 01:16 PM RE: HP Prime Miscalculating - Vtile - 11-01-2015, 02:05 PM RE: HP Prime Miscalculating - Wes Loewer - 11-04-2015, 05:57 PM RE: HP Prime Miscalculating - Vtile - 11-04-2015, 08:36 PM RE: HP Prime Miscalculating - CyberAngel - 09-02-2018, 04:32 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 09:33 PM RE: HP Prime Miscalculating - retoa - 10-23-2015, 10:04 PM RE: HP Prime Miscalculating - Archanus - 10-24-2015, 02:20 AM RE: HP Prime Miscalculating - parisse - 10-24-2015, 06:37 AM RE: HP Prime Miscalculating - dan_h - 10-24-2015, 02:14 PM RE: HP Prime Miscalculating - cyrille de brĂ©bisson - 10-26-2015 06:25 AM RE: HP Prime Miscalculating - retoa - 10-30-2015, 01:34 PM RE: HP Prime Miscalculating - parisse - 10-31-2015, 06:34 AM RE: HP Prime Miscalculating - Vtile - 10-31-2015, 10:50 AM RE: HP Prime Miscalculating - Joe Horn - 11-01-2015, 02:12 AM RE: HP Prime Miscalculating - parisse - 11-06-2015, 07:55 AM