Which of the HP calculators uses the highest precision?
calc precision
|
02-10-2003, 09:51 AM
02-10-2003, 10:03 AM
HP30S (24 digits), except for square root (12 digits)
02-10-2003, 02:15 PM
>>HP30S (24 digits), except for square Wow. Why is sqrt(x) lagging? Common square root algorithms work very similarly to division & reciprocal algorithms. Unless they totally ran out of ROM space and picked a reduction in sqrt(X) precision as the best compromise, this looks like an oversight. I believe - it's been awhile - that there's a CORDIC-like shift/add algorithm for square root too - each iteration would deliver one digit (either binary bit, hex digit or BCD digit, according to base of numeration system and algorithm flavora) of result. Square root is fairly well-behaved too - unlike asymptotic tan(x) near 90deg and log(x), ln(x) near 0.
Bill Wiese
02-11-2003, 07:58 AM
nt
02-13-2003, 07:50 PM
i have also noticed square root is less accurate. if you root with logs you can get more accuracy that the built in square root. |
« Next Oldest | Next Newest »
|