Resources for K Nearest Neighbors Algorithm

Aside from my tutorial on K nearest Neighbor, there are many good Internet resources discuss about K-Nearest Neighbor (KNN) algorithm. Below I selected a few good list that you may consider to probe further. I welcome any feedback and input about other good resources that you want to include in this list; please tell me about it.

<Previous | Next | Contents>

Softwares/Codes

• Auton Project provide free software of Dense K nearest neighbor for Windows and Linux (registration is needed to download)
• Xlminer (using MS Excel add Ins- Commercial ). See its online help. Check also my free Excel tutorial for K nearest Neighbor (you may also download the worksheet program)
• Agent Building and Learning Environment (ABLE) Java framework contains K nearest neighbor . Download Java code from Alphawork IBM research
• Nearest Neighbor Java Applet (with Java source code)
• BioPython contain KNN code in Python
• ANN - Approximate Nearest Neighbor Searching contain C++ code (under GNU)
• Roger Jang provide Matlab code for both Fuzzy Nearest Neighbor and K nearest neighbor
• Analytic 1305 is using cloud to implement Nearest Neighbor (free for academic use)

Other Tutorials

• Instance-based learning and k-Nearest neighbor algorithm
• Greg Grudic lecture note on Nearest Neighbor Learning (PDF)
• Tsechansky lecture note on Data Mining (PPT)
• Stefan Carlsson lecture note on Nearest Neighbor density estimation (PDF)

Downloadable Technical Papers

• K-Local Hyperplane and Convex Distance Nearest Neighbor Algorithms by Pascal Vincent and Yoshua Bengio: Compare K nearest neighbor with Vector Support Machine (SVM)
• An Investigation of Practical Approximate Nearest Neighbor Algorithms by Ting Liu, Andrew W. Moore, Alexander Gray and Ke Yang (PDF): k-NN search algorithm using Locally sensitive hashing
• A Fast Algorithm for Finding k-Nearest Neighbors with Non-metric Dissimilarity by Bin Zhang and Sargur N. Srihari
• An Enhancement of k-Nearest Neighbor Classification Using Genetic Algorithm by Anupam Kumar Nath Syed M. Rahman Akram Salah (PDF)
• K-Nearest Neighbor Search for Moving Query Point by Zhexuan Song and Nick Roussopoulos (PDF)

Applications

• Chinese text categorization using K nearest neighbor (PDF) by Li Baoli, Yu Shiwen, and Lu Qin
• Profiles and fuzzy k-nearest neighbor algorithm for protein secondary structure prediction by Rajkumar Bondugula, Ognen Duzlevski, and Dong Xu (PDF): application of fuzzy k-nearest neighbor to prediction of protein structure
• Exemplar-based learning in adaptive optical music recognition system by Ichiro Fujinaga (PDF): Using K nearest Neighbor and Genetic Algorithm to recognize music
• Application of Genetic Algorithm/K-Nearest Neighbor Method to the Classification of Renal Cell Carcinoma by Dongqing Liu et al (PDF): Using K nearest neighbor and GA to classify tumor cells
• Voronoi-Based K Nearest Neighbor Search for Spatial Network Databases by Mohammad Kolahdouzan and Cyrus Shahabi (PDF): K nearest neighbor for spatial analysis

Books and References of this tutorial

• Mitchell, Tom M. Machine Learning , Mc Graw Hill
• Read futher about machine learning books from Google Print

<Contents | Previous | Next >