Hi Folks,
There is still room for improvement  THIS $15.95 calculator checked out with 18 (!) digits of resolution and reported an unparalleled result of:
9.00000000000072767
Yes, TWELVE ZEROES behind the decimal point.
Cheers,
Joerg
Mike Sebastian's Calculator Forensics


« Next Oldest  Next Newest »

▼
03082011, 08:03 AM
Hi Folks, There is still room for improvement  THIS $15.95 calculator checked out with 18 (!) digits of resolution and reported an unparalleled result of:
Cheers, Joerg ▼
03082011, 09:49 AM
Wow! Does it glow in the dark? ;)
▼
03082011, 10:05 AM
No, but in the US you'll see only this bright lime green. In UK they have wonderful teal and pink versions, too. All made of recycled photocopiers and antibacterial keyboards ;))
Regards,
03082011, 11:31 AM
when doing your time travel calculations and including the expansion of the universe with appropriate accuracy to not miss the bus.
03082011, 11:39 AM
Hi Jörg, can you let it calculate tan 89.999999 degrees? There is a recent discussion about trig precision near discontinuities which revealed some astonishing results.
▼
03082011, 12:15 PM
tan (89.999999) = 57295779.51... like my TI36X on the desk, too.
Rgeards, ▼
03082011, 12:36 PM
Thanks Jörg! What do you get if you subtract the integer part? ▼
03082011, 04:08 PM
57295779.5130823151 on the Canon and 57295779.5132 on the TI36X Joerg
03092011, 01:10 AM
The 34s only gets 10 zeros after the decimal:
9.000000000029361 This is, however, the correctly rounded result for devices with sixteen digits. I.e. each operation correctly rounded its answer.
▼
03092011, 02:03 AM
Pauli, that's the point. The forensics is not meant to highlight the accuracy of a certain calculator but to identify identical algorithms and/or calculator chips. ▼
03092011, 02:56 AM
Quote:True for this level of precision we're talking about here. In general, however, the forensics sheds some light on the reliability of calculation results. Think of error propagation in iterative computations ...
03092011, 08:21 AM
Paul, The WP34s displays 9.00000000003, that is, the internal result is rounded to the number of digits of the display. HP used to round the result and truncate it to the number of digits in the display at the end of each operation. Thus, the HP42S displays 8.99999864267. HP's method makes sense because the results of the operations are coherent to the actual figures of the operands the user has access to (by examining their mantissas, for instance). I assume the 34s is a 16digit device, but the calculations are carried out with extra guard digits, otherwise it wouldn't achieve the correct rounded 16digit result we see. Another reason to get the WP34s as soon it's available :) Correct result for various numbers of digits in this old thread. Regards,
▼
03092011, 04:02 PM
Gerson, wp34s *is* on the agenda. :)
03102011, 01:33 AM
Try subtracting 9 from that result :) Yes, the 34s is a 16 digit device. Registers are IEEE 854 64 bit packed decimals. As you guessed, internal calculations are in higher precision using unpacked decimal numbers. I could round to the display size (12 digits) easily enough. For a variety of reason I didn't.  Pauli
Edited: 10 Mar 2011, 1:34 a.m. 