In fact, the topic is to examine information and its sources. Is the knowledge of communication principles.

Symbolic probability of information source

An information source is composed of four symbols, A, B, C and D, and their occurrence probabilities are 3/8, 1/4, 1/8 respectively, and the appearance of each symbol is independent.

Information sequence statistics

In the information sequence output by the source, A: 23 times, B: 14 times, C: 13 times and D: 7 times, and there are 57 * * *.

Information computing

The information content of A is 23 log28/3 = 32 (bits); The information of b is 14Log24/ 1 = 28 (bits); The information content of C is 13Log24/ 1 = 26 (bits); The information content of d is 7log28/ 1 =2 1 (bits).