HP Prime: Rounding error in determinant



#5

Let's assume the following matrix:

[[4 5 7] [8 9 0] [5 6 2]]

The determinant (as given by my Prime (hardware & emulator, both running version 2013 8 13. Rev:5016)) is 13.

The transposed matrix is:

[[4 8 5] [5 9 6] [7 0 2]]

The corresponding determinant is 13.0000000002


Why? Shouldn't they be the same?

btw: my HP15C also makes a small error (-2e-8) in the determinant of the transposed matrix...


#6

Short Answer: Floating Point Computations (I think)

#7

Hi

In CAS mode you will get the same and exact result.

Probably some rounding effect in HOME

By the way the HP50 give 13 both in exact and approx mode

Edited: 25 Oct 2013, 7:16 p.m.

#8

FWIW, the WP 34S returns exact 13 for both the original and its transposed.

d:-)


Possibly Related Threads…
Thread Author Replies Views Last Post
  [HP Prime] "Error while checking exact value with approximate value, returning both!" Chris Pem10 13 5,199 12-06-2013, 05:12 AM
Last Post: parisse
  MS advert shows spreadsheet with obvious error BruceH 3 2,254 11-14-2013, 09:50 AM
Last Post: Bill (Smithville, NJ)
  HP Prime program: rounding to a fraction Patrice 3 1,775 10-31-2013, 06:16 AM
Last Post: Joe Horn
  HP Prime Error: Summation Upper Bound > 1000 HP Pioneer 2 1,432 10-25-2013, 11:32 AM
Last Post: steindid
  Prime Error or Mine? toml_12953 12 3,809 10-22-2013, 10:35 AM
Last Post: toml_12953
  Explaination on How to Reset Caculator in Users guie: error Harold A Climer 5 2,653 10-15-2013, 02:11 AM
Last Post: cyrille de Brébisson
  Repair of HP-34C - Error 0 and Error 9 Jeff Kearns 3 1,755 10-11-2013, 12:29 PM
Last Post: Randy
  Do You Think a Listing Error Was Made? Jim Johnson 13 3,986 09-04-2013, 09:23 AM
Last Post: Eddie W. Shore
  Rounding of 10^x Olivier De Smet 8 2,662 08-28-2013, 06:33 AM
Last Post: Dieter
  HP Prime: Error reports : Here Patrice 111 24,095 07-24-2013, 05:52 PM
Last Post: Thomas Klemm

Forum Jump: