CAS: Keyed in 1 SHIFT x 90 but did not get (0,1)

12292022, 02:05 PM
Post: #1




CAS: Keyed in 1 SHIFT x 90 but did not get (0,1)
Hello all. I keyed in 1 angle 90 degree in CAS but did not get (0,1). But i got (1.25e14,1). Is this a bug. I have latest FW on my G2. Thanks.


12292022, 03:02 PM
Post: #2




RE: CAS: Keyed in 1 SHIFT x 90 but did not get (0,1)
(12292022 02:05 PM)akmarul Wrote: Hello all. I keyed in 1 angle 90 degree in CAS but did not get (0,1). But i got (1.25e14,1). Is this a bug. I have latest FW on my G2. Thanks. This is a result of floating point rounding. Most calculators and computers have it. It's not a bug, just a limitation on numeric representation. 1.25e14 is so close to 0 that in real life you'd never notice the difference. Some calculators try to give you the answer you expect rather than what's actually calculated and so introduce errors of their own. 0.0000000000000125 is pretty small! Tom L Cui bono? 

12292022, 11:15 PM
Post: #3




RE: CAS: Keyed in 1 SHIFT x 90 but did not get (0,1)
Thanks Tom L. I don't see the same rounding in HOME (nonCAS). If I key in 1 angle 90degree, I will get (0,1). Is this intended? Thanks.


12302022, 07:03 AM
Post: #4




RE: CAS: Keyed in 1 SHIFT x 90 but did not get (0,1)
(12292022 03:02 PM)toml_12953 Wrote:(12292022 02:05 PM)akmarul Wrote: Hello all. I keyed in 1 angle 90 degree in CAS but did not get (0,1). But i got (1.25e14,1). Is this a bug. I have latest FW on my G2. Thanks. Thanks Tom. In HOME, I don't see the same issue. How is HOME different on this? Thanks. 

« Next Oldest  Next Newest »

User(s) browsing this thread: 1 Guest(s)