I->R and R->I without (rounding) errors
|
08-04-2021, 07:42 AM
Post: #7
|
|||
|
|||
RE: I->R and R->I without (rounding) errors
(08-04-2021 07:18 AM)BINUBALL Wrote:(08-04-2021 04:47 AM)cahlucas Wrote: Dear Mr. Horn,Dear cahlucas, Binuball is correct. It is not the fault of I->R that you see roundoff errors when converting 2^41 to a real. The roundoff is caused by the limitations of reals themselves in RPL. They cannot have more than 12 mantissa digits, no matter what. No amount of System RPL or anything else can change that fact. If you need more than 12 digits of accuracy, then you MUST use some other object type than reals. <0|ΙΈ|0> -Joe- |
|||
« Next Oldest | Next Newest »
|
User(s) browsing this thread: 3 Guest(s)