Click here to purchase the complete E-book of this tutorial
Decision Tree Inductive
In this section, you will learn how to generate a decision tree. This approach is sometimes called decision tree inductive because the decision tree are build and trained based on data. I will show the manual computation step by step such that you can check using calculator or spreadsheet.
Section Topics
Before I discuss about decision tree algorithm, it would be better if you familiar yourself with several measures of impurity. Therefore, the topics in this section are:
How to measure impurity?
EntropyHow a decision tree algorithm work?
Gini Index
Classification error
Information Gain
Second Iteration
Third Iteration
This tutorial is copyrighted .
Preferable reference for this tutorial is
Teknomo, Kardi. (2009) Tutorial on Decision Tree. http://people.revoledu.com/kardi/tutorial/DecisionTree/