This book covers both the methods, including standard regularization theory, Fejer processes for linear and nonlinear problems, the balancing principle, extrapolated regularization, nonstandard regularization, nonlinear gradient method, the nonmonotone gradient method, subspace method and Lie group method;