Entropy

concepts · 2 notes linked

Related: Information Theory · Kullback Leibler Divergence · Wordle · New York Times · Combinatorics

Notes

• Information Theory Finds the Best Wordle Starting Words — Using Shannon entropy to optimize Wordle opening word selection
• Intuitive Explanation of the Kullback-Leibler Divergence — KL divergence measures extra bits lost approximating one probability distribution with another