By Kardi Teknomo, PhD.

Q-Learning e-book

What is Q-Learning?

In this tutorial, you will learn step by step how a single agent learns through training without teacher (unsupervised) in an unknown environment. You will find out part of reinforcement learning algorithm called Q-learning. Reinforcement learning algorithm has been widely used for many applications such as robotics, multi agent system, navigation, motion planning, game, etc.

Instead of learning the theory of reinforcement that you can read it from many books and other web sites, this tutorial will introduce the concept through simple but comprehensive numerical examples. When you purchase this tutorial, you will also receive the spreadsheet companion of this tutorial together with Matlab codes.

Your Benefit

You have read our sample of FREE tutorial this far. Our tutorial has given you FAST and SIMPLE understanding about the topic. Unlike many other books and tutorials out there, we only serve you the main course. Our tutorials always have comprehensive examples that teach you step by step on how to do it. Do you want to gain BETTER understanding about this topic? Do you want to know more on how to do it on your own? You need to download the companion file of this tutorial. You need to download the full version of this tutorial.

Why do you need to download this e-book and its companion files NOW?

  • Gain full understanding . Your memory about your new understanding about this fascinating topic is still fresh. If you download it now, you will easily understand the detail of the tutorial. If you do it next time, you might have forgotten the understanding that has gained today.
  • Save your learning time . Your time is very valuable. It saves a lot of your time to do self study on this topic.
  • Understanding this topic will enhance your study , your work, and your research. Eventually you can develop it further to get more money for your future.
  • Tired of ads? By purchasing the FULL tutorial, you will be able to read tutorial in a very nice PDF format without advertising . You can zoom in and out to see the formulas clearly. You can read in any computing device (phone, tablet, PC, laptop, Mac, iPad).
  • The full tutorial also comes in e-book together with the companion files . This option will give you an eye opener to this fascinating topic. It enhances your understanding. The complete tutorial will be your self-study guide to improve your learning process. You can read it off-line anywhere anytime even when you don't have internet connection.

What you will get when you download it NOW?

In this Q-Learning Tutorial e-book you will learn, you will learn the following fascinating topics in a very SHORT TIME:

  • How to model the environment into Reward graph? q-learning e-book
  • How to model Agent's States and Actions into Reward matrix?
  • What is Q Learning?
  • How to do Q Learning Algorithm?
  • Comprehensive Example of performing Q Learning Numerically
  • How to solve Tower of Hanoi using Q-Learning?
  • How to do Q Learning using Matlab?
  • How to compute Q Learning by Microsoft Excel without any programming?
  • How the spreadsheet Q learning works?

See the comparison table below for the options.



Only Companion File

Complete Tutorial (Best Buy)

Two MS Excel Workbooks on Q-Learning for

  • Evacuation Agent
  • Tower of Hanoi



Two files of Matlab codes



Free 1 year update of companion files



Free 1 year update of Q-Learning Tutorial


Nice format of e-book of Q-Learning Tutorial in PDF format


Discounted Price

ONLY $3.49

ONLY $4.99

Buy Now (secure purchase through PayPal)

For your convenience to ease the process to download the tutorial, if you don't have PayPal account, please register in PayPal before you purchase it. PayPal registration is free of charge .

The price of our tutorial is so cheap that it is probably even cheaper than the cost of your lunch.

How to purchase this tutorial?

    1. Click "Buy Now" button above. You will be redirected to PayPal web site for payment.
    2. Register your email in PayPal (if you have not done it yet). You can purchase without PayPal registration but it will take at least 24 hours to get your tutorial.
    3. After your payment, PayPal will give you automatic redirect link to the download page of the tutorial. You can get the e-book and the companion files immediately after the purchase.

    Teachers who want to use this e-book or the companion files for students in a class can contact us to purchase the e-book license in bulk.

    By downloading our product or applying our service you agreed to our term of service .

    If you have any problem regarding your order, please contact us .

    Do you have question regarding this Q-Learning tutorial? Ask your question here !


    A few comments from customers who bought this tutorial

    Great explanations I am now confident in doing Q learning! < Sarah-Alhawi >

    It was a very helpful tutorial as I'm doing a project based on the q-learning algorithm <Favas Ali>

    I was looking for an introductory reinforcment learning tutorial. I've a Engineering Laurea degree with a Robotic thesis but many of the found document was too complicated to start. Your tutorial is perfect ! <Paolo Poletti>