Consistency Index and Consistency Ratio

< Previous | Next | Contents >

Read this tutorial off-line, click here to purchase the e-book of this AHP tutorial.

How to Measure Consistency?

What is the meaning that our opinion is consistent? How do we measure the consistency of subjective judgment? At the end of this section will be able to answer those questions.

Let us look again on John's judgment that we discussed in the previous section . Is John judgment consistent or not?

First he prefers Banana to Apple. Thus we say that for John, Banana has greater value than Apple. We write it as .

Next, he prefers Apple to Cherry. For him, Apple has greater value than Cherry. We write it as .

Since and , logically, we hope that or Banana must be preferable than Cherry. This logic of preference is called transitive property. If John answers in the last comparison is transitive (that he like Banana more than Cherry), then his judgment is consistent. On the contrary, if John prefers Cherry to Banana then his answer is inconsistent. Thus consistency is closely related to the transitive property.

A comparison matrix is said to be consistent if for all , and . However, we shall not force the consistency. For example, has value and has value , we shall not insist that must have value . This too much consistency is undesirable because we are dealing with human judgment. To be called consistent , the rank can be transitive but the values of judgment are not necessarily forced to multiplication formula .

Prof. Saaty proved that for consistent reciprocal matrix, the largest Eigen value is equal to the size of comparison matrix, or . Then he gave a measure of consistency, called Consistency Index as deviation or degree of consistency using the following formula

Thus, in our previous example, we have and the size of comparison matrix is , thus the consistency index is

Knowing the Consistency Index, the next question is how do we use this index? Again, Prof. Saaty proposed that we use this index by comparing it with the appropriate one. The appropriate Consistency index is called Random Consistency Index ( ).

He randomly generated reciprocal matrix using scale , , ..., , ...,8, 9 (similar to the idea of Bootstrap) and get the random consistency index to see if it is about 10% or less. The average random consistency index of sample size 500 matrices is shown in the table below

Table 8: Random Consistency Index ( )

Then, he proposed what is called Consistency Ratio, which is a comparison between Consistency Index and Random Consistency Index, or in formula

If the value of Consistency Ratio is smaller or equal to 10%, the inconsistency is acceptable. If the Consistency Ratio is greater than 10%, we need to revise the subjective judgment.

For our previous example, we have and for is 0.58, then we have . Thus, John's subjective evaluation about his fruit preference is consistent.

So far, in AHP we are only dealing with paired comparison of criteria or alternative but not both. In next section, I show an example to use both criteria and alternative in two levels of AHP.

< Previous | Next | Contents >

Click here to buy the PDF copy of this AHP tutorial in a nice format.

These tutorial is copyrighted .

Do you have question regarding this AHP tutorial? Ask your question here

Preferable reference for this tutorial is

Teknomo, Kardi. (2006) Analytic Hierarchy Process (AHP) Tutorial .
http://people.revoledu.com/kardi/tutorial/AHP/