PC-1211, PC-1250, etc. TVM
|
06-22-2024, 12:12 PM
Post: #47
|
|||
|
|||
RE: PC-1211, PC-1250, etc. TVM
Very intereting Rob and Albert.
That's a good point about using cents. I only realised yesterday that Excel and LO Calc use double binary rather than decimal, which surprised me because I know Excel is established in finance. It looks like the display value is rounded, so I'm sure most accountants wouldn't notice this. Also interesting re: the rounding. Is the rounding done beyond the last digit? I.e. if you're rounding to the precision available, that implies you've calculated to beyond that? I'm still slightly unsure I get the concept of ULP 'accuracy'. Whereas, as you mention Rob, absolute and relative error seems a sensible approach. |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 19 Guest(s)