Post Reply 
Pioneer vs RPL precision
06-08-2022, 05:12 AM (This post was last modified: 06-08-2022 05:16 AM by Marco Polo.)
Post: #9
RE: Pioneer vs RPL precision
(06-07-2022 11:12 PM)Joe Horn Wrote:  
(06-07-2022 08:05 PM)Marco Polo Wrote:  Exactly what I think about it....

Please help me understand what you mean. Are you saying that you want FIX 5 to act like TRUNCATE 5, not ROUND 5? (I'm not trying to be obtuse... I really am not sure what you mean here).
Using FIX 5 i expect to see 5 decimals.
The number is rounded for any FIX value,
In the specific case the calculators gives a "wrong" information, displaying a rounded (to zero decimals) number instead the expected five decimals.
I am not a mathematician nor an expert of calculators principles, so I may be wrong, but as an engineer I find this behavior quite disturbing.
Strangely, I never noted it since 1989....
.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
Pioneer vs RPL precision - Marco Polo - 06-07-2022, 02:26 PM
RE: Pioneer vs RPL precision - Marco Polo - 06-07-2022, 04:09 PM
RE: Pioneer vs RPL precision - Joe Horn - 06-07-2022, 05:12 PM
RE: Pioneer vs RPL precision - Marco Polo - 06-07-2022, 08:05 PM
RE: Pioneer vs RPL precision - Joe Horn - 06-07-2022, 11:12 PM
RE: Pioneer vs RPL precision - Marco Polo - 06-08-2022 05:12 AM
RE: Pioneer vs RPL precision - Marco Polo - 06-08-2022, 07:55 AM
RE: Pioneer vs RPL precision - ijabbott - 06-08-2022, 07:46 PM
RE: Pioneer vs RPL precision - Marco Polo - 06-08-2022, 06:07 AM
RE: Pioneer vs RPL precision - Marco Polo - 06-08-2022, 06:04 AM



User(s) browsing this thread: 1 Guest(s)