Improving FIX mode
|
10-16-2023, 01:28 PM
Post: #2
|
|||
|
|||
RE: Improving FIX mode
I think in FIX mode, we are not supposed to see "E"
Scientific notation switch really signals FIX conversion failed. (Either overflowed limited display or underflow to 0.000...) https://github.com/c3d/DB48X-on-DM42/issues/412 Wrote:// Also, since DB48X can compute on 34 digits, and counting zeroes To count zeroes, I found that normalized mode is better: 0.1 ≤ |mantissa| < 1 see IEEE Standard for Floating Point Numbers, by V Rajaraman 12345000 --> 0.12345e+008 --> 8 digits integer part 0.0012345 --> 0.12345e-002 --> 2 0's after decimal point. |
|||
« Next Oldest | Next Newest »
|
Messages In This Thread |
Improving FIX mode - c3d - 10-16-2023, 12:08 PM
RE: Improving FIX mode - Albert Chan - 10-16-2023 01:28 PM
RE: Improving FIX mode - c3d - 10-16-2023, 08:27 PM
RE: Improving FIX mode - Pyjam - 10-20-2023, 08:07 AM
RE: Improving FIX mode - Albert Chan - 10-20-2023, 10:59 AM
RE: Improving FIX mode - c3d - 10-20-2023, 05:07 PM
RE: Improving FIX mode - c3d - 10-20-2023, 04:51 PM
RE: Improving FIX mode - c3d - 10-20-2023, 05:58 PM
RE: Improving FIX mode - Pyjam - 10-20-2023, 11:17 AM
RE: Improving FIX mode - Albert Chan - 10-20-2023, 02:00 PM
RE: Improving FIX mode - c3d - 10-21-2023, 08:53 AM
RE: Improving FIX mode - Pyjam - 10-21-2023, 10:24 AM
RE: Improving FIX mode - c3d - 10-21-2023, 11:26 AM
RE: Improving FIX mode - Pyjam - 10-20-2023, 02:25 PM
RE: Improving FIX mode - agarza - 10-20-2023, 02:56 PM
RE: Improving FIX mode - Pyjam - 10-20-2023, 03:38 PM
RE: Improving FIX mode - agarza - 10-20-2023, 04:39 PM
RE: Improving FIX mode - Pyjam - 10-20-2023, 05:36 PM
|
User(s) browsing this thread: 4 Guest(s)