HP Prime: Rounding error in determinant  Printable Version + HP Forums (https://archived.hpcalc.org/museumforum) + Forum: HP Museum Forums (https://archived.hpcalc.org/museumforum/forum1.html) + Forum: Old HP Forum Archives (https://archived.hpcalc.org/museumforum/forum2.html) + Thread: HP Prime: Rounding error in determinant (/thread253842.html) 
HP Prime: Rounding error in determinant  Stephan Matthys  10252013 Let's assume the following matrix: [[4 5 7] [8 9 0] [5 6 2]] The determinant (as given by my Prime (hardware & emulator, both running version 2013 8 13. Rev:5016)) is 13. The transposed matrix is: [[4 8 5] [5 9 6] [7 0 2]] The corresponding determinant is 13.0000000002
btw: my HP15C also makes a small error (2e8) in the determinant of the transposed matrix...
Re: HP Prime: Rounding error in determinant  Eddie W. Shore  10252013 Short Answer: Floating Point Computations (I think)
Re: HP Prime: Rounding error in determinant  Gilles Carpentier  10252013 Hi In CAS mode you will get the same and exact result. Probably some rounding effect in HOME By the way the HP50 give 13 both in exact and approx mode
Edited: 25 Oct 2013, 7:16 p.m.
Re: HP Prime: Rounding error in determinant  Walter B  10252013 FWIW, the WP 34S returns exact 13 for both the original and its transposed.
d:)
