

Matrix Size & Validation
Vector Algebra What is Vector? Vector Norm Unit Vector Vector Addition Vector Subtraction Vector Scalar Multiple Vector Multiplication Vector Inner Product Vector Outer Product Vector Cross Product Vector Triple Cross Product Vector Triple Dot Product Scalar Triple Product Orthogonal & Orthonormal Vector Cos Angle of Vectors Scalar and Vector Projection Matrix Algebra What is a matrix? Special Matrices Matrix One Null Matrix Matrix Diagonal Is Diagonal Matrix? Identity Matrix Matrix Determinant Matrix Sum Matrix Trace Matrix Basic Operation Is Equal Matrix? Matrix Transpose Matrix Addition Matrix Subtraction Matrix Multiplication Matrix Scalar Multiple Hadamard Product Horizontal Concatenation Vertical Concatenation Elementary Row Operations Matrix RREF Finding inverse using RREF (GaussJordan) Finding Matrix Rank using RREF Matrix Inverse Is Singular Matrix? Linear Transformation Matrix Generalized Inverse Solving System of Linear Equations Linear combination, Span & Basis Vector Linearly Dependent & Linearly Independent Change of basis Matrix Rank Matrix Range Matrix Nullity & Null Space Eigen System Matrix Eigen Value & Eigen Vector Symmetric Matrix Matrix Eigen Value & Eigen Vector for Symmetric Matrix Similarity Transformation and Matrix Diagonalization Matrix Power Orthogonal Matrix Spectral Decomposition Singular Value Decomposition Resources on Linear Algebra 
Matrix Generalized Inverse Let us recalled how we define the matrix inverse. A matrix inverse is defined as a matrix that produces identity matrix when we multiply with the original matrix that is we define. Matrix inverse exists only for square matrices. Real world data is not always square. Furthermore, real world data is not always consistent and might contain many repetitions. To deal with real world data, generalized inverse for rectangular matrix is needed. Generalized inverse matrix is defined as. Notice that the usual matrix inverse is covered by this definition because. We use term “generalized” inverse for a general rectangular matrix and to distinguish from inverse matrix that is for a square matrix. Generalized inverse is also called pseudo inverse. Unfortunately there are many types of generalized inverse. Most of generalized inverse are not unique. Some of generalized inverse are reflexive and some are not reflexive. In this linear algebra tutorial, we will only discuss a few of them that often used in many practical applications.
Left Inverse and Right InverseThe usual matrix inverse is defined as twosided inverse because we can multiply the inverse matrix from the left or from the right of matrix and we still get the identity matrix. This property is only true for a square matrix. For a rectangular matrix, we may have generalized left inverse or left inverse for short when we multiply the inverse from the left to get identity matrix. Similarly, we may have generalized right inverse or right inverse for short when we multiply the inverse from the right to get identity matrix. In general, left inverse is not equal to the right inverse. Generalized inverse of a rectangular matrix is connected with solving of system linear equations. The solution to normal equation is which is equal to. The term is often called as generalized left inverse. Still another pseudo inverse can also be obtained by multiplying the transpose matrix from the right and this is called generalized right inverse.
MoorePenrose InverseIt is possible to obtain unique generalized matrix. To distinguish unique generalized inverse from other nonunique generalized inverses, we use symbol. The unique generalized inverse is called Moore Penrose inverse. It is defined using 4 conditions: The first condition is the definition of generalized inverse. Together with the first condition, the second condition indicates the generalized inverse is reflexive (). Together with the first condition, the third condition indicates the generalized inverse is the least square solution that minimizes the norm of error. The four conditions above make the generalized inverse unique. MoorePenrose inverse can be obtained through Singular Value Decomposition (SVD): such that. Given a rectangular matrix, the interactive program below produces MoorePenrose generalized inverse. The Random Example button will generate random matrix. Additionally, the output also include several matrices to let you test the 4 Moore Penrose conditions (,,,) and generalized left inverse or right inverse or matrix inverse depending on the input matrix size. The results can be shown in either rational format or decimal format. Yes, this program is a free educational program!! Please don't forget to tell your friends and teacher about this awesome program! PropertiesSome important properties of matrix generalized inverse are
See also: Solving System of Linear Equations, Singular Value Decomposition, matrix Inverse, matrix transpose Rate this tutorial or give your comments about this tutorial Preferable reference for this tutorial is Teknomo, Kardi (2011) Linear Algebra tutorial. http:\\people.revoledu.com\kardi\ tutorial\LinearAlgebra\ 



