What is Mutual Information?
31/03/2021
In the field of machine learning, when it comes to extracting relationships between variables, we often use Pearson correlation. The problem is that this measure only finds linear relationships, which can lead sometimes to a bad interpretation of the relation between two variables. Nevertheless, other statistics measure non-linear relationships, such as mutual information.
Therefore, in this post, we are going to explain mutual information, how it is calculated, and an example of its use.
Read more