Hessian Matrix - Second Derivative Test

Second Derivative Test

The following test can be applied at a non-degenerate critical point x. If the Hessian is positive definite at x, then f attains a local minimum at x. If the Hessian is negative definite at x, then f attains a local maximum at x. If the Hessian has both positive and negative eigenvalues then x is a saddle point for f (this is true even if x is degenerate). Otherwise the test is inconclusive.

Note that for positive semidefinite and negative semidefinite Hessians the test is inconclusive (yet a conclusion can be made that f is locally convex or concave respectively). However, more can be said from the point of view of Morse theory.

In view of what has just been said, the second derivative test for functions of one and two variables is simple. In one variable, the Hessian contains just one second derivative; if it is positive then x is a local minimum, if it is negative then x is a local maximum; if it is zero then the test is inconclusive. In two variables, the determinant can be used, because the determinant is the product of the eigenvalues. If it is positive then the eigenvalues are both positive, or both negative. If it is negative then the two eigenvalues have different signs. If it is zero, then the second derivative test is inconclusive.

More generally, the second-order conditions that are sufficient for a local minimum or maximum can be expressed in terms of the sequence of principal (upper-leftmost) minors (determinants of sub-matrices) of the Hessian; these conditions are a special case of those given in the next section for bordered Hessians for constrained optimization—the case in which the number of constraints is zero.

Read more about this topic:  Hessian Matrix

Famous quotes containing the words derivative and/or test:

    When we say “science” we can either mean any manipulation of the inventive and organizing power of the human intellect: or we can mean such an extremely different thing as the religion of science the vulgarized derivative from this pure activity manipulated by a sort of priestcraft into a great religious and political weapon.
    Wyndham Lewis (1882–1957)

    I am willing, for a money consideration, to test this physical strength, this nervous force, and muscular power with which I’ve been gifted, to show that they will bear a certain strain. If I break down, if my brain gives way under want of sleep, my heart ceases to respond to the calls made on my circulatory system, or the surcharged veins of my extremities burst—if, in short, I fall helpless, or it may be, dead on the track, then I lose my money.
    Ada Anderson (1860–?)