Jensen's Inequality - Proofs

Proofs

Jensen's inequality can be proved in several ways, and three different proofs corresponding to the different statements above will be offered. Before embarking on these mathematical derivations, however, it is worth analyzing an intuitive graphical argument based on the probabilistic case where X is a real number (see figure). Assuming a hypothetical distribution of X values, one can immediately identify the position of and its image in the graph. Noticing that for convex mappings the corresponding distribution of Y values is increasingly "stretched out" for increasing values of X, it is easy to see that the distribution of Y is broader in the interval corresponding to X > X0 and narrower in X < X0 for any X0; in particular, this is also true for . Consequently, in this picture the expectation of Y will always shift upwards with respect to the position of, and this "proves" the inequality, i.e.

with equality when φ(X) is not strictly convex, e.g. when it is a straight line, or when X follows a degenerate distribution (i.e. is a constant).

The proofs below formalize this intuitive notion.

Read more about this topic:  Jensen's Inequality

Famous quotes containing the word proofs:

    Trifles light as air
    Are to the jealous confirmation strong
    As proofs of holy writ.
    William Shakespeare (1564–1616)

    I do not think that a Physician should be admitted into the College till he could bring proofs of his having cured, in his own person, at least four incurable distempers.
    Philip Dormer Stanhope, 4th Earl Chesterfield (1694–1773)

    A man’s women folk, whatever their outward show of respect for his merit and authority, always regard him secretly as an ass, and with something akin to pity. His most gaudy sayings and doings seldom deceive them; they see the actual man within, and know him for a shallow and pathetic fellow. In this fact, perhaps, lies one of the best proofs of feminine intelligence, or, as the common phrase makes it, feminine intuition.
    —H.L. (Henry Lewis)