Concept of Decision Tree Classification | Machine Learning | Data Science | Mathematics

Concept of Decision Tree Algorithm | Machine Learning | Data Science | Mathematics Decision Tree Algorithm for Classification Decision Tree Algorithm is one of the most popular algorithms and widely used in machine learning. It is a type of supervised learning-based algorithm, can be used for both classification and regression. Photo by Fabrice Villard on Unsplash Let's see first how it works? A simple decision tree example So, now we are enough aware of the decision tree, so let's get deeper. Impurity It is a measurement that how much our data is impure, means how much homogeneity is present in your data. Image Source: Research Gate For measuring impurity we have several measures from which we will learn these two: 1. Entropy: Entropy is nothing but the randomness in your dataset. Which increase predictability. It is directly proportional to the non-homogeneity in your dataset. It measures the purity of the split. Use: We analyse the entropy on every node in the decision tr...