HP Prime: Rounding error in determinant - Printable Version +- HP Forums (https://archived.hpcalc.org/museumforum) +-- Forum: HP Museum Forums (https://archived.hpcalc.org/museumforum/forum-1.html) +--- Forum: Old HP Forum Archives (https://archived.hpcalc.org/museumforum/forum-2.html) +--- Thread: HP Prime: Rounding error in determinant (/thread-253842.html) HP Prime: Rounding error in determinant - Stephan Matthys - 10-25-2013 Let's assume the following matrix: [[4 5 7] [8 9 0] [5 6 2]] The determinant (as given by my Prime (hardware & emulator, both running version 2013 8 13. Rev:5016)) is 13. The transposed matrix is: [[4 8 5] [5 9 6] [7 0 2]] The corresponding determinant is 13.0000000002 Why? Shouldn't they be the same? btw: my HP15C also makes a small error (-2e-8) in the determinant of the transposed matrix... Re: HP Prime: Rounding error in determinant - Eddie W. Shore - 10-25-2013 Short Answer: Floating Point Computations (I think) Re: HP Prime: Rounding error in determinant - Gilles Carpentier - 10-25-2013 Hi In CAS mode you will get the same and exact result. Probably some rounding effect in HOME By the way the HP50 give 13 both in exact and approx mode Edited: 25 Oct 2013, 7:16 p.m. Re: HP Prime: Rounding error in determinant - Walter B - 10-25-2013 FWIW, the WP 34S returns exact 13 for both the original and its transposed. d:-)