Post Reply 
HP Prime Miscalculating
10-26-2015, 06:25 AM
Post: #15
RE: HP Prime Miscalculating
Hello,

>Why does prime only have 48 bits of mantissa for doubles?

Le me expand on what Bernard is saying.
The CAS does use a 8 bytes data structure to save a mathematical object.
The first 5 bits (Least significant bits) of this structure is the object type (real, integer, vector...), the rest of free for use for each possible individual type.

In the case of a structure being a real, then the rest of the 64 bits is the double. BUT since 5 bits are already used for the type, this double is truncated by 5 bits (which have been stolen to indicate the type). Hence the 48 bits of mantissa (the other bits being the sign and exponent).

One could wonder: Why make real less precise? But remember that in CAS worlds, precision is achieved through "perfect" integers, not through floating points numbers, so the reasoning is quire sound. If you want precision: use integers as floating points will ALWAYS be inaccurate, regardless of the mantissa size. hence it it not a problem to remove 5 bits of precision.

Cyrille

Although I work for the HP calculator group, the views and opinions I post here are my own. I do not speak for HP.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
HP Prime Miscalculating - luc4as - 10-23-2015, 02:35 AM
RE: HP Prime Miscalculating - Joe Horn - 10-23-2015, 05:41 AM
RE: HP Prime Miscalculating - retoa - 10-24-2015, 12:48 PM
RE: HP Prime Miscalculating - parisse - 10-25-2015, 09:13 AM
RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 02:54 PM
RE: HP Prime Miscalculating - retoa - 10-23-2015, 04:43 PM
RE: HP Prime Miscalculating - Tim Wessman - 10-23-2015, 04:54 PM
RE: HP Prime Miscalculating - Archanus - 10-23-2015, 07:38 PM
RE: HP Prime Miscalculating - Nigel (UK) - 10-23-2015, 10:12 PM
RE: HP Prime Miscalculating - Wes Loewer - 11-01-2015, 01:16 PM
RE: HP Prime Miscalculating - Vtile - 11-01-2015, 02:05 PM
RE: HP Prime Miscalculating - Wes Loewer - 11-04-2015, 05:57 PM
RE: HP Prime Miscalculating - Vtile - 11-04-2015, 08:36 PM
RE: HP Prime Miscalculating - CyberAngel - 09-02-2018, 04:32 PM
RE: HP Prime Miscalculating - retoa - 10-23-2015, 09:33 PM
RE: HP Prime Miscalculating - retoa - 10-23-2015, 10:04 PM
RE: HP Prime Miscalculating - Archanus - 10-24-2015, 02:20 AM
RE: HP Prime Miscalculating - parisse - 10-24-2015, 06:37 AM
RE: HP Prime Miscalculating - dan_h - 10-24-2015, 02:14 PM
RE: HP Prime Miscalculating - cyrille de brébisson - 10-26-2015 06:25 AM
RE: HP Prime Miscalculating - retoa - 10-30-2015, 01:34 PM
RE: HP Prime Miscalculating - parisse - 10-31-2015, 06:34 AM
RE: HP Prime Miscalculating - Vtile - 10-31-2015, 10:50 AM
RE: HP Prime Miscalculating - Joe Horn - 11-01-2015, 02:12 AM
RE: HP Prime Miscalculating - parisse - 11-06-2015, 07:55 AM



User(s) browsing this thread: