Post Reply 
(Free42) roundoff for complex SQRT
04-10-2018, 07:14 AM
Post: #12
RE: (Free42) roundoff for complex SQRT
Sadly, the Intel decimal floating-point library does not provide an extended format beyond 34 digits (double), so in Free42 the last digit of transcendental functions may be off, complex operations may exhibit (more) roundoff and there is no gain to be had in matrix dot products.
Werner
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: (Free42) roundoff for complex SQRT - Werner - 04-10-2018 07:14 AM



User(s) browsing this thread: 1 Guest(s)