How to Generate a Decision Tree?

By Kardi Teknomo, PhD.

< Previous | Next| Content>

In this section, you will learn how to generate a decision tree. This approach is sometimes called decision tree inductive because the decision tree are build and trained based on data. I will show the manual computation step by step such that you can check using calculator or spreadsheet.

Before I discuss about decision tree algorithm, it would be better if you familiar yourself with several measures of impurity. Therefore, the topics in this section are:

How to measure impurity?

Entropy
Gini Index
Classification error

How a decision tree algorithm work?

Information Gain
Second Iteration
Third Iteration

 

< Previous | Next | Content>

This tutorial is copyrighted.

Preferable reference for this tutorial is

Teknomo, Kardi. (2009) Tutorial on Decision Tree.
http://people.revoledu.com/kardi/tutorial/DecisionTree/