Post Reply 
Accuracy and the power function
02-23-2014, 02:19 PM
Post: #14
RE: Accuracy and the power function
(02-21-2014 07:11 AM)Werner Wrote:  That's where the Sticky Bit comes in

I see. So this sticky bit avoids some errors caused by simple truncation.

Since you seem to know the internals quite well: do you know of some kind of reference or summary regarding the accuracy of the internal 15-digit functions? I recently learned that the natural log may be more than 1 ULP off, so I wonder how accurate (or not) the other functions may be.

I would also be interested very much in information on this matter regarding 10-digit devices with 13-digit internal precision, for instance the 41-series.

Dieter
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
Accuracy and the power function - Dieter - 02-16-2014, 02:43 PM
RE: Accuracy and the power function - Dieter - 02-23-2014 02:19 PM



User(s) browsing this thread: 1 Guest(s)