Hi,
When I do the following calc on my smartcalc I get the wrong ansswer. Any ideas anyone?
The calc is 78724*pi*.075^2*.5
I get an answer of 800 instead of around 695.
Thanks
Scott
HP300s smartcalc error

01052010, 12:31 AM
Hi, When I do the following calc on my smartcalc I get the wrong ansswer. Any ideas anyone? The calc is 78724*pi*.075^2*.5 I get an answer of 800 instead of around 695. Thanks Scott
01052010, 12:42 AM
further to this if I multiply by .500000001 instead of 0.5 I get the correct answer. Looks like I am back to my 48 or 30s
01052010, 11:31 AM
Hi, With my 300s I get 221*(329/800)*PI, which converts with S<=>D to 695.5839564 Hubert
01052010, 01:49 PM
Funny, For 221*(329/800)*PI I get 285.527... Did you copy something down wrong?
01052010, 04:36 PM
Hi Guys, I too get 285.382 from the above formula. I have done this eqn over and over again on my 300s and always get 800. I have even saved intermediate values in registers and still get the wrong answer. My 38G gives me the correct answers, so too does my 35s and 48. Looks like I got a dud.
01052010, 07:26 PM
I repeated it on my emulator. I'm not sure if it is the actual code used in the unit though, or a reimplementation. . . I suspect it is a setting of some kind causing the problems. Not sure which one though. TW
01062010, 12:56 PM
Hi, Edited: 6 Jan 2010, 1:00 p.m.
01062010, 01:13 PM
Quote:Does this mean this device is unable to calculate 1391.167193 / 2 ? That's elementary math! :( Hard to believe.
01062010, 03:58 PM
Sorry, I had not checked what I wrote! The correct term is (221+329/800)*PI, which results in 695.58...
The error depends on the setting of the fraction mode (SET UP/down). setting ab/c (Mixed) gives 695.58... setting d/c (improper) gives 800, thats the erroneus display. Hubert
Edited: 7 Jan 2010, 11:27 a.m. 
« Next Oldest  Next Newest »
