Post Reply 
Native mode of trig functions?
10-11-2024, 12:59 PM
Post: #8
RE: Native mode of trig functions?
(10-11-2024 11:57 AM)Thomas Klemm Wrote:  5
SQRT
1
+
4
/

0.8090169943
[/font]
Both results using COS are rounded correctly while the "exact" value using SQRT is not.

No, because you have two rounding operations introducing errors.
If you calculate it as SQRT(5/16) + 0.25, you only have one, and get 0.8090169944 as well.

Cheers, Werner

41CV†,42S,48GX,49G,DM42,DM41X,17BII,15CE,DM15L,12C,16CE
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
Native mode of trig functions? - naddy - 10-10-2024, 10:04 PM
RE: Native mode of trig functions? - Johnh - 10-10-2024, 11:00 PM
RE: Native mode of trig functions? - naddy - 10-10-2024, 11:37 PM
RE: Native mode of trig functions? - dm319 - 10-11-2024, 01:56 PM
RE: Native mode of trig functions? - dm319 - 10-15-2024, 07:21 PM
RE: Native mode of trig functions? - Werner - 10-11-2024 12:59 PM



User(s) browsing this thread: 1 Guest(s)