Conjugate Gradient and Method of Steepest Descent

• We can complete the square

  

• where

• Note that if

  

  

• This is Poor Person's Conjugate Gradient or when applied to minimization, the method of steepest descent. It is called this because we move from along direction ---the direction along which F varies most rapidly.