Post Reply 
FORTRAN floating point accuracy problems
04-03-2016, 05:17 PM
Post: #26
RE: FORTRAN floating point accuracy problems
Again, I am only carrying 6 decimal places of expected results although I am displaying 7.

Thanks, I'll try your suggestions. But first I'm going to try to write an assembler subroutine for DINT. Then I can use your rounding routine which would really be great.

It ain't OVER 'till it's 2 PICK
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: FORTRAN floating point accuracy problems - HP67 - 04-03-2016 05:17 PM



User(s) browsing this thread: 7 Guest(s)