entropy is the heart of machine learning (opens in new tab)

shannon entropy and cross entropy loss. shannon entropy is the measure of how surprised you are by the outcome, on average. another way…