Round off error calculation example

[Dieter]

(07-23-2017 06:32 PM)Mark Hardman Wrote:  

(07-23-2017 05:07 PM)Dieter Wrote:  BTW the Windows calculator works with 30+ digits, so it returns 1 here. ;-)

As does the SwissMicros DM42 and Free42 decimal.

Let's not forget the WP34s (double precision mode), and even the 31s internally uses (at least) 34 digits.

BTW, Free42 has 34 digit BCD precision, but as far as I remember not all functions deliver results with that accuracy. This also is not guaranteed for the WP34s.

Dieter