The Condition Number of a Matrix


I have heard of the Condition Number of a Matrix in the past and have not paid much attention to this matrix property, until recently. I have been playing with a search algorithm that solves iteratively systems of linear equations. After the basic testing, I moved to more involved testing that uses random matrices. I began to notice that the number of iterations (for a fixed number of equations) varied widely!! I wrote my Matlab and Excel VBA code such that I can watch the progress of conversion to the solution. I noticed that in some cases the solution converged faster than other cases, where the iteration seem to struggle. I first looked at the value of the determinant of the matrix as a possible indicator for how easy or difficult to work with a articular matrix. I then came across internet articles that talked about the condition number of a matrix as being a good indicator for the ease or difficulty of solving linear equations with a matrix [bold]regardless of the algorithm used and the precision of the computation[/bold]. I find this to be somewhat of a revelation since most numerical analysis books rarely mention the condition number of a matrix as an indicator for the level of ease to solve linear equations.


Edited: 8 Feb 2012, 9:50 a.m.


Condition Number
is defined as the product of the norm of A and the norm of A-inverse.

If we use the usual Euclidean norm on vectors and the associated matrix norm, then the condition number is the ratio of the largest singular value of matrix A to the smallest. (Singular values are computed by process called SVD - Singular Value Decomposition and in Matlab the calculation is simply invoked by command svd).

Condition number depends on the underlying norm. However, regardless of the norm, it is always greater or equal to 1. If it is close to one, the matrix is well conditioned which means its inverse can be computed with good accuracy. If the condition number is large, then the matrix is said to be ill-conditioned. Practically, such a matrix is almost singular, and the computation of its inverse, or solution of a linear system of equations is prone to large numerical errors. A matrix that is not invertible has the condition number equal to infinity.


Right on Jeff!!!

Possibly Related Threads…
Thread Author Replies Views Last Post
  AFTER HP-Prime update, Shift+Matrix CRASHES Joseph Ec 3 2,058 12-06-2013, 11:06 AM
Last Post: Joseph Ec
  HP Prime Matrix TERRIBLE bug and question uklo 19 5,174 11-25-2013, 12:10 PM
Last Post: Mic
  HP Prime: editing a matrix Alberto Candel 6 2,350 11-20-2013, 06:26 PM
Last Post: Helge Gabert
  Absolute Value and Matrix BruceTTT 5 2,145 11-11-2013, 11:52 PM
Last Post: Walter B
  The worst condition 15C? Keith Midson 8 2,636 10-16-2013, 10:41 AM
Last Post: walter b
  WP-34S Matrix operations with routine-local registers? Tom Grydeland 1 1,200 09-04-2013, 10:46 AM
Last Post: Marcus von Cube, Germany
  Matrix Characteristic Polynomial - Reloaded. Ángel Martin 12 3,483 08-22-2013, 05:33 PM
Last Post: Thomas Klemm
  Matrix Richard Berler 3 1,447 08-18-2013, 06:24 PM
Last Post: Paul Dale
  Advantage/CCD Matrix Challenge Ángel Martin 1 1,177 08-09-2013, 06:22 PM
Last Post: Thomas Klemm
  [HP -Prime CAS] List, Matrix, Vector as one Array? CompSystems 0 1,000 07-26-2013, 05:22 PM
Last Post: CompSystems

Forum Jump: