Post Reply 
Improper Integrals with the HP-15C LE & CE
11-18-2023, 02:16 AM
Post: #50
RE: Improper Integrals with the HP-15C LE & CE
(11-17-2023 09:11 PM)Voldemar Wrote:  HP 50g
1,99998390078

Other results on a 50g:

\begin{array}{clrr}
\hline
{\textbf{FIX}} & {\textbf{Rounded Result}} & {\textbf{Actual Result}} & {\textbf{IERR}} \\
\hline
0 & 2. & 1.86741548121 & 1.80693901574 \\
1 & 1.9 & 1.86741548121 & .180693901574 \\
2 & 1.98 & 1.98343207731 & 1.97334339834E-2 \\
3 & 1.999 & 1.99894753972 & 1.99831015657E-3 \\
4 & 1.9999 & 1.99987053054 & 1.99978859323E-4 \\
5 & 1.99998 & 1.99998381632 & 1.9999735715E-5 \\
6 & 1.999984 & 1.99998390078 & -1.9999735715E-6 \\
7 & 1.9999839 & 1.99998390078 & -1.9999735715E-7 \\
8 & 1.99998390 & 1.99998390078 & -1.9999735715E-8 \\
9 & 1.999983901 & 1.99998390078 & -1.9999735715E-9 \\
10 & 1.9999839008 & 1.99998390078 & -1.9999735715E-10 \\
11 & 1.99998390078 & 1.99998390078 & -1.9999735715E-11 \\
\end{array}

So whichever method is used in the 50g, it doesn't appear that there's much value trying to go above FIX 6 for the display mode. At least for this example. I'll leave it to those much more knowledgeable than me for what this actually means in practice.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Improper Integrals with the HP-15C LE & CE - DavidM - 11-18-2023 02:16 AM



User(s) browsing this thread: 18 Guest(s)