Z-channel (information Theory) - Capacity

Capacity

The capacity of the Z-channel with the crossover 1 → 0 probability p, when the input random variable X is distributed according to the Bernoulli distribution with probability α for the occurrence of 0, is calculated as follows.

where is the binary entropy function.

The maximum is attained for

yielding the following value of as a function of p

For small p, the capacity is approximated by

as compared to the capacity of the binary symmetric channel with crossover probability p.

Read more about this topic:  Z-channel (information Theory)

Famous quotes containing the word capacity:

    A creative writer must study carefully the works of his rivals, including the Almighty. He must possess the inborn capacity not only of recombining but of re-creating the given world. In order to do this adequately, avoiding duplication of labor, the artist should know the given world.
    Vladimir Nabokov (1899–1977)

    Taste is nothing but an enlarged capacity for receiving pleasure from works of imagination.
    William Hazlitt (1778–1830)

    Lords and Commoners of England, consider what nation it is whereof ye are, and whereof ye are the governors; a nation not slow and dull, but of a quick, ingenious and piercing spirit, acute to invent, subtle and sinewy to discourse, not beneath the reach of any point the highest that human capacity can soar to.
    John Milton (1608–1674)