Decision Tree Inductive
In this section, you will learn how to generate a decision tree. This approach is sometimes called decision tree inductive because the decision tree are build and trained based on data. I will show the manual computation step by step such that you can check using calculator or spreadsheet.
Before I discuss about decision tree algorithm, it would be better if you familiar yourself with several measures of impurity. Therefore, the topics in this section are:
How to measure impurity?
How a decision tree algorithm work?
Preferable reference for this tutorial is
Teknomo, Kardi. (2009) Tutorial on Decision Tree. http://people.revoledu.com/kardi/tutorial/DecisionTree/