Z-channel (information Theory) - Capacity

Capacity

The capacity of the Z-channel with the crossover 1 → 0 probability p, when the input random variable X is distributed according to the Bernoulli distribution with probability α for the occurrence of 0, is calculated as follows.

where is the binary entropy function.

The maximum is attained for

yielding the following value of as a function of p

For small p, the capacity is approximated by

as compared to the capacity of the binary symmetric channel with crossover probability p.

Read more about this topic:  Z-channel (information Theory)

Famous quotes containing the word capacity:

    “It is part of the educator’s responsibility to see equally to two things: First, that the problem grows out of the conditions of the experience being had in the present, and that it is within the range of the capacity of students; and, secondly, that it is such that it arouses in the learner an active quest for information and for production of new ideas. The new facts and new ideas thus obtained become the ground for further experiences in which new problems are presented.”
    —John Dewey (1859–1952)

    “A creative writer must study carefully the works of his rivals, including the Almighty. He must possess the inborn capacity not only of recombining but of re-creating the given world. In order to do this adequately, avoiding duplication of labor, the artist should know the given world.”
    —Vladimir Nabokov (1899–1977)

    “Has the art of politics no apparent utility? Does it appear to be unqualifiedly ratty, raffish, sordid, obscene, and low down, and its salient virtuosi a gang of unmitigated scoundrels? Then let us not forget its high capacity to soothe and tickle the midriff, its incomparable services as a maker of entertainment.”
    —H.L. (Henry Lewis)