Post Reply 
Maths/Stats challenge - 1 of 2 - polls
05-25-2022, 08:11 PM
Post: #18
RE: Maths/Stats challenge - 1 of 2 - polls
(05-25-2022 06:57 PM)John Keith Wrote:  
(05-25-2022 01:29 PM)Albert Chan Wrote:  0.125 5E9 + 5E9 -      → 0.12

What you are describing is Truncate, not Round. RND rounds to nearest digit, so .125 2 RND returns .13

It is not trucation, just seems like it, because last kept digit, 2 is even.
Adding and subtract the big number forced system to use its current rounding mode.
Banker's rounding in this case.

>B=5E9
>.125+B-B, .175+B-B
  .12            .18
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Maths/Stats challenge - 1 of 2 - polls - Albert Chan - 05-25-2022 08:11 PM



User(s) browsing this thread: 1 Guest(s)