Post Reply 
Dedekind Sums
02-26-2024, 09:47 PM (This post was last modified: 02-26-2024 09:49 PM by johnb.)
Post: #2
RE: Dedekind Sums
(02-26-2024 02:28 PM)Eddie W. Shore Wrote:  

I don't have a prime, so I don't recall whether it uses a IEEE-754 binary floating point, or a BCD representation, so I may be off-base here. If it's any "binary, mantissa+exponent" representation, then 0.5 is not exactly the same thing as 1/2.

You might squeeze an extra ULP or two out of your answer by computing 'a' and 'b' as twice their values and subtract 1, then return (s/2).

Oops. LOL! Let this be a lesson to my fellow amateur mathematicians: do not attempt what you think are reversible transformations in the real domain when discontinuous functions are involved!

FLOOR(2x) / 2 ≠ FLOOR(x)

[crawling back into my hole in the ground...]

Daily drivers: 15c, 32sII, 35s, 41cx, 48g, WP 34s/31s. Favorite: 16c.
Latest: 15ce, 48s, 50g. Gateway drug: 28s found in yard sale ~2009.
Find all posts by this user
Quote this message in a reply
Post Reply 

Messages In This Thread
Dedekind Sums - Eddie W. Shore - 02-26-2024, 02:28 PM
RE: Dedekind Sums - johnb - 02-26-2024 09:47 PM

User(s) browsing this thread: 1 Guest(s)