Search
Member List
Calendar
Help
|
ROUND() Results
|
|
04-07-2022, 10:26 PM
(This post was last modified: 04-07-2022 10:27 PM by Joe Horn.)
Post: #2
|
|||
|
|||
|
RE: ROUND() Results
Yes, that is the expected result. Here's why. 7979*464664664 = 3707559354056, which is a 13-digit integer, as can be verified in CAS. Home view rounds all numeric calculations to a 12-digit mantissa, which as you saw is 3.70755935406 × 10^12. Rounding this to "two decimal places" has no effect, since it has no fractional part. If you want to round it to two significant digits instead, use -2 instead of 2 in the ROUND command.
<0|ɸ|0> -Joe- |
|||
|
|
« Next Oldest | Next Newest »
|
| Messages In This Thread |
|
ROUND() Results - matalog - 04-07-2022, 09:09 PM
RE: ROUND() Results - Joe Horn - 04-07-2022 10:26 PM
RE: ROUND() Results - matalog - 04-07-2022, 10:41 PM
RE: ROUND() Results - Joe Horn - 04-08-2022, 04:21 AM
|
User(s) browsing this thread: 1 Guest(s)