ROUND() Results

04072022, 09:09 PM
Post: #1




ROUND() Results
In Home view on my G2, ROUND(7979*464664664,2) Results in 3.70755935406E12.
That seems a rather long result for a figure rounded to 2 dp. Is that ROUND working as expected? 

04072022, 10:26 PM
(This post was last modified: 04072022 10:27 PM by Joe Horn.)
Post: #2




RE: ROUND() Results
Yes, that is the expected result. Here's why. 7979*464664664 = 3707559354056, which is a 13digit integer, as can be verified in CAS. Home view rounds all numeric calculations to a 12digit mantissa, which as you saw is 3.70755935406 × 10^12. Rounding this to "two decimal places" has no effect, since it has no fractional part. If you want to round it to two significant digits instead, use 2 instead of 2 in the ROUND command.
<0ɸ0> Joe 

04072022, 10:41 PM
Post: #3




RE: ROUND() Results
It seems then that in this case, I want to round the scientific notation to 2 decimal places. Is that possible?


04082022, 04:21 AM
Post: #4




RE: ROUND() Results
(04072022 10:41 PM)matalog Wrote: It seems then that in this case, I want to round the scientific notation to 2 decimal places. Is that possible? Yes: ROUND(n,3) Suggestion: Type ROUND and then, while the cursor is still blinking there, press the Help key, it'll tell you all you want to know about the ROUND function. Ditto for other functions and operators. <0ɸ0> Joe 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)