A textbook for an optimization course for graduates and senior undergraduates. It describes optimization theory and several powerful methods. It discusses an idea's motivation, studies the derivation, establishes the global and local convergence, describes algorithmic steps, and discusses the numerical performance.