Information Gain and Entropy: An overview
In information theory, machine learning, and data science, information gain (IG) measures how much information a feature provides about a class. IG helps to determine the order of attributes in the nodes of a decision tree. The primary node is the parent node, whereas the sub-nodes are child nodes.
