A quick precision test

[pito]

(06-05-2014 09:07 PM)walter b Wrote:  

(06-05-2014 08:49 PM)pito Wrote:  FYI - a quick test done in the shop with cheapo Canon X Mark I Pro:

Code:

674530.4707
When subtracting 674530
0.4707399243

A little bit better than wp34 with single precision.

No idea what you're referring to. BTW, after some 40 posts, would you please learn to use <Quote> to indicate the post you're responding? Thanks in advance.

d

Dear Walter, I've just added an info to the topic I started.
BTW, you contributed to this thread with 4 absolutely unrelated postings