Z-channel (information Theory) - Capacity

Capacity

The capacity of the Z-channel with the crossover 1 → 0 probability p, when the input random variable X is distributed according to the Bernoulli distribution with probability α for the occurrence of 0, is calculated as follows.

where is the binary entropy function.

The maximum is attained for

yielding the following value of as a function of p

For small p, the capacity is approximated by

as compared to the capacity of the binary symmetric channel with crossover probability p.

Read more about this topic:  Z-channel (information Theory)

Famous quotes containing the word capacity:

    What, then, is the basic difference between today’s computer and an intelligent being? It is that the computer can be made to see but not to perceive. What matters here is not that the computer is without consciousness but that thus far it is incapable of the spontaneous grasp of pattern—a capacity essential to perception and intelligence.
    Rudolf Arnheim (b. 1904)

    That way of life against which my generation rebelled had given us grim courage, fortitude, self-discipline, a sense of individual responsibility, and a capacity for relentless hard work.
    Rose Wilder Lane (1886–1968)

    Managing a tantrum involves nothing less than the formation of character. Even the parent’s capacity to cope well with conflict can improve with this experience. When a parent knows he is right and does not give in for the sake of temporary peace, everybody wins. The parent learns that denying some pleasure does not create a neurotic child and the child learns that she can survive momentary frustration.
    Alicia F. Lieberman (20th century)