Post Reply 
I->R and R->I without (rounding) errors
08-04-2021, 07:18 AM
Post: #6
RE: I->R and R->I without (rounding) errors
(08-04-2021 04:47 AM)cahlucas Wrote:  
(08-03-2021 09:21 PM)Joe Horn Wrote:  Please give us some examples of where the built-in R->I and I->R functions fail, and of course please accompany each example with the output that you would prefer. Thanks!

Dear Mr. Horn,
Here is an example from your own creations (B->I and I->B):
2 41 ^ --> 2199023255552
2199023255552 0. + --> 2.19902325555E12 (or I->R)
2.19902325555E12 R->I --> 2199023255550
This should actually return the original number, but the last 2 have become a 0.
Dear cahlucas,
Unfortunately real on 50g has only 12 digit precision. So after you convert integer to real, last digit is lost. There is no way to get digit beyond 12 digits on real.

S.Korean / HP-50G | fx-570EX | fx-570CW | HP-200LX
Visit this user's website Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: I->R and R->I without (rounding) errors - BINUBALL - 08-04-2021 07:18 AM



User(s) browsing this thread: 2 Guest(s)