Resources on Decision Tree

<Previous | Next | Contents>

After reading my Decision Tree tutorial, in this section you will find external links to many resources on Decision Tree. Please note that there are many types of decision tree (data structure, financial analysis, machine learning) and this resources covers only the machine learning (or data mining) part of decision tree.

Books
Online papers
Software/Codes
Applications
Tutorials

Books

• Machine Learning by Tom M. Mitchell
• Pattern Recognition and Machine Learning by Christopher M. Bishop
• Data Mining: Practical Machine Learning Tools and Techniques by Eibe Frank
• The Elements of Statistical Learning: Data Mining, Inference, and Prediction by Trevor Hastie
• Data Mining with Decision Trees: Theory and Applications (Machine Perception and Artificial Intelligence) by Lior Rokach
• James F. Smith (2002), Data Mining for Fuzzy Decision Tree Structure with a Genetic Program
• Decision Trees for Business Intelligence and Data Mining: Using SAS Enterprise Miner by Barry De Ville
• Classification and Regression Trees by Leo Breiman

Online papers

• Padraic G. Neville (1999) Decision Trees for Predictive Modeling

Software/Codes

• ID3 Decision Tree Algorithm in C# by Roosevelt
• Java implementation of ID3 was written in KD Key forum
• ID3 in Common Lisp by Tom M. Mitchell
• ID3 in C
• Code for C4.5 was implemented in C by Quinlan
• Java applet of decision tree is provided by University of Alberta. The code can be downloaded here
• WEKA has many nice implementation of decision tree (ID3, C4.5, Random forest and many more)
• Decision Tree in Perl
• ID3 in Prolog is provided by Stanford University
• Decision Trees and Predictive Models with cross-validation and ROC analysis plot using Matlab by Andrea Padoan
  

Applications

• Khalid Sheikh, Using Decision Trees to predict customer behaviour
• Max Dama, Automated Trading using Decision Tree Bagging System (using R)

Tutorials

• Building Decision Trees in Python by Christopher Roach. Check also the addendum
• Machine Learning with ID3 Decision Trees in Ruby
  

<Contents | Previous | Next >

These tutorial is copyrighted.

Preferable reference for this tutorial is

Teknomo, Kardi. (2009) Tutorial on Decision Tree.
http://people.revoledu.com/kardi/tutorial/DecisionTree/