HP Prime: Rounding error in determinant « Next Oldest | Next Newest »

 ▼ Stephan Matthys Junior Member Posts: 20 Threads: 4 Joined: Aug 2013 10-25-2013, 08:49 AM Let's assume the following matrix: [[4 5 7] [8 9 0] [5 6 2]] The determinant (as given by my Prime (hardware & emulator, both running version 2013 8 13. Rev:5016)) is 13. The transposed matrix is: [[4 8 5] [5 9 6] [7 0 2]] The corresponding determinant is 13.0000000002 Why? Shouldn't they be the same? btw: my HP15C also makes a small error (-2e-8) in the determinant of the transposed matrix... ▼ Eddie W. Shore Posting Freak Posts: 764 Threads: 118 Joined: Aug 2007 10-25-2013, 09:38 AM Short Answer: Floating Point Computations (I think) Gilles Carpentier Senior Member Posts: 468 Threads: 17 Joined: May 2011 10-25-2013, 07:14 PM Hi In CAS mode you will get the same and exact result. Probably some rounding effect in HOME By the way the HP50 give 13 both in exact and approx mode Edited: 25 Oct 2013, 7:16 p.m. Walter B Posting Freak Posts: 4,587 Threads: 105 Joined: Jul 2005 10-25-2013, 09:29 PM FWIW, the WP 34S returns exact 13 for both the original and its transposed. d:-)

 Possibly Related Threads... Thread Author Replies Views Last Post [HP Prime] "Error while checking exact value with approximate value, returning both!" Chris Pem10 13 957 12-06-2013, 05:12 AM Last Post: parisse MS advert shows spreadsheet with obvious error BruceH 3 408 11-14-2013, 09:50 AM Last Post: Bill (Smithville, NJ) HP Prime program: rounding to a fraction Patrice 3 294 10-31-2013, 06:16 AM Last Post: Joe Horn HP Prime Error: Summation Upper Bound > 1000 HP Pioneer 2 263 10-25-2013, 11:32 AM Last Post: steindid Prime Error or Mine? toml_12953 12 777 10-22-2013, 10:35 AM Last Post: toml_12953 Explaination on How to Reset Caculator in Users guie: error Harold A Climer 5 444 10-15-2013, 02:11 AM Last Post: cyrille de Brébisson Repair of HP-34C - Error 0 and Error 9 Jeff Kearns 3 310 10-11-2013, 12:29 PM Last Post: Randy Do You Think a Listing Error Was Made? Jim Johnson 13 761 09-04-2013, 09:23 AM Last Post: Eddie W. Shore Rounding of 10^x Olivier De Smet 8 470 08-28-2013, 06:33 AM Last Post: Dieter HP Prime: Error reports : Here Patrice 111 3,719 07-24-2013, 05:52 PM Last Post: Thomas Klemm

Forum Jump: