Post Reply 
[WP34s] Regularized incomplete Beta function
05-06-2014, 12:54 AM
Post: #35
RE: [WP34s] Regularized incomplete Beta function
(05-05-2014 11:09 PM)Dieter Wrote:  In other words, even if the last correction was 1E–12, it looks like we can expect 32...34 valid digits. So I assume a test against 1E–14 should be on the safe side.

Wouldn't we have to force one additional iteration after achieving the convergence precision to guarantee this level of accuracy? A value that differed from the previous by, say, 1E-15, would pass the convergence test yet not be good.

I'm thinking along the lines of:

Code:
FS? .02
JMP exit
CNVG? 00
SF .02

instead of the:

Code:
CNVG? 00
JMP exit


- Pauli
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: [WP34s] Regularized incomplete Beta function - Paul Dale - 05-06-2014 12:54 AM



User(s) browsing this thread: 1 Guest(s)