About this question

Entropy of a Fair Die

Medium · Probability & Statistics · Quant Trader interview question · probability, entropy, information-theory, logarithm, mental-math

A fair six-sided die is rolled. Each face has an equal probability of landing face up. Calculate the Shannon entropy of the outcome, expressed in bits. The Shannon entropy $H(X)$ is defined as: $H(X) = - \sum p_i \log_2 p_i$, where $p_i$ is the probability of outcome $i$.