Kardi Teknomo
Kardi Teknomo Kardi Teknomo Kardi Teknomo
   
 
  Research
  Publications
  Tutorials
  Resume
  Resources
  Contact

 

Linkages between Objects

By Kardi Teknomo, PhD.

clustering

< Previous | Next | Content>

The rule of hierarchical clustering lie on how objects should be grouped into clusters. Given a distance matrix, linkages between objects can be computed through a criterion to compute distance between groups. Most common & basic criteria are

•  Single Linkage: minimum distance criterion

Complete Linkage Single Linkage

•  Complete Linkage: maximum distance criterion

Centroid Linkage Average Linkage

•  Average Group: average distance criterion

Formula Linkages Formula Linkages

•  Centroid distance criterion

Formula Linkages Formula Linkages

•  Ward: minimize variance of the merge cluster

Jain and Dubes (1988) showed general formula that first proposed by Lance & William (1967) to include most of the most commonly referenced hierarchical clustering called SAHN (sequential, agglomerative, hierarchical and nonoverlapping) clustering method. Distance between existing cluster k with Formula Linkages objects and newly formed cluster (r, s) is given as

Formula Linkages

The values of the parameters are given in the table below.

Clustering method

Formula Linkages

Formula Linkages

Formula Linkages

Formula Linkages

Single Link

½

½

0

Complete Link

½

½

0

½

Unweighted pair group method average (UPGMA)

Formula Linkages

Formula Linkages

0

0

weighted pair group method average (WPGMA)

½

½

0

0

unweighted pair group method centroid (UPGMC)

Formula Linkages

Formula Linkages

Formula Linkages

0

weighted pair group method centroid (WPGMC)

½

½

0

Ward's method

Formula Linkages

Formula Linkages

Formula Linkages

0

(After Jain & Dubes, 1988)


In the next section, I will show how to compute hierarchical clustering using Single Linkage Hierarchical Clustering. Other methods of linkages have similar computation with only different in the computational formula.

< Previous | Next | Content>

This tutorial is copyrighted.

Preferable reference for this tutorial is

Teknomo, Kardi. (2009) Hierarchical Clustering Tutorial.
http://people.revoledu.com/kardi/tutorial/clustering/

 

 
© 2007 Kardi Teknomo. All Rights Reserved.
Designed by CNV Media