a discrete memoryless source has an alphabet a1 a2 a3 a4 as a6 with co
Question
A discrete memoryless source has an alphabet (a1, a2, a3, a4, as, a6) with corre-
sponding probabilities (0.1, 0.2, 0.3, 0.05, 0.15, 0.2). Find the entropy of this source.
Compare this entropy with the entropy of a uniformly distributed source with the
same alphabet.