Lecture 36: Decision Tree classifier, ID3 algorithm in Machine Learning | Artificial Intelligence

decision tree:

A decision tree takes in a set of attribute values and outputs .
Tuples flow along the tree structure Internal node denotes an attribute
Branch represents the values of the node attribute
Leaf nodes represent class labels or class distribution
Example of Playing Tennis

ID3 algorithm:
A mathematical algorithm for building the decision tree.
Invented by J. Ross Quinlan in 1979.
Uses Information Theory invented by Shannon in 1948.
Builds the tree from the top down, with no backtracking.
Information Gain is used to select the most useful attribute for classification.
The nodes are selected by choosing features of the training data set that provide the most information about the data and turning those features into questions.
Information gain use entropy

#DecisionTreeclassifier #ID3algorithminMachineLearning #classification #supervisedLearning

Видео Lecture 36: Decision Tree classifier, ID3 algorithm in Machine Learning | Artificial Intelligence канала Muhammad Umar Farooq