Post Reply 
Flawed prime factorization program and unexpected 15C simulator behaviour
11-18-2015, 10:34 PM
Post: #4
RE: Flawed prime factorization program and unexpected 15C simulator behaviour
(11-18-2015 05:53 PM)Marcus von Cube Wrote:  
(11-18-2015 02:54 PM)Harald Wrote:  Reason being that 9876543210 Enter 2 / FRAC returns 4294967296?!?
What is going on here? Am I making a mistake somewhere? Or is this a bug?
I added a division sign before FRAC. I assume you just forgot it.

Now back to your question. If it's a simulator it might just use binary arithmetic which can produce strange results.

Thanks Marcus, I just forgot it. It is there in the program though.
Find all posts by this user
Quote this message in a reply
Post Reply 


Messages In This Thread
RE: Flawed prime factorization program and unexpected 15C simulator behaviour - Harald - 11-18-2015 10:34 PM



User(s) browsing this thread: 1 Guest(s)