under certain conditions.
What makes it awesome IMO is that it is very intuitive, and like
-thermodynamics in Physics it give exact bounds about what is possible
+thermodynamics in Physics, it gives exact bounds about what is possible
or not.
\section{Shannon's Entropy}
H(p) = - \sum_k p(k) \log_2 p(k)
\]
%
-where by convention $o \log_2 0 = 0$.
+where by convention $0 \log_2 0 = 0$.
It is often seen as a measure of randomness since the more
deterministic the distribution is, the less you have to emit.