Post Reply 
(Free42) roundoff for complex SQRT
04-03-2018, 01:44 PM
Post: #2
RE: (Free42) roundoff for complex SQRT
(04-03-2018 01:28 PM)Werner Wrote:  The 12-digit 42S gets the exact result - it must have special code for a=0, and return SQRT(ABS(b)/2)*(1+i*SIGN(b)) in that case - even when b/2 would underflow.

It must have some kind of special code. I had the same artifacts and had to add special code in newRPL to detect tiny values in the imaginary part. If found, then the real part is tried by itself as a root, and if it satisfies the equation the real root is returned instead (sort of "snap" to the real axis).
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: (Free42) roundoff for complex SQRT - Claudio L. - 04-03-2018 01:44 PM



User(s) browsing this thread: 1 Guest(s)