Z-channel (information Theory) - Capacity

Capacity

The capacity of the Z-channel with the crossover 1 → 0 probability p, when the input random variable X is distributed according to the Bernoulli distribution with probability α for the occurrence of 0, is calculated as follows.

where is the binary entropy function.

The maximum is attained for

yielding the following value of as a function of p

For small p, the capacity is approximated by

as compared to the capacity of the binary symmetric channel with crossover probability p.

Read more about this topic:  Z-channel (information Theory)

Famous quotes containing the word capacity:

    The legacies that parents and church and teachers left to my generation of Black children were priceless but not material: a living faith reflected in daily service, the discipline of hard work and stick-to-itiveness, and a capacity to struggle in the face of adversity.
    Marian Wright Edelman (20th century)

    Where mass opinion dominates the government, there is a morbid derangement of the true functions of power. The derangement brings about the enfeeblement, verging on paralysis, of the capacity to govern. This breakdown in the constitutional order is the cause of the precipitate and catastrophic decline of Western society. It may, if it cannot be arrested and reversed, bring about the fall of the West.
    Walter Lippmann (1889–1974)

    Taste is nothing but an enlarged capacity for receiving pleasure from works of imagination.
    William Hazlitt (1778–1830)