Newton's method is an iterative numerical technique for locating zeros (roots) of a real- or complex-valued function. It uses local linear approximation — the tangent line — at a current estimate to produce a new, typically more accurate estimate. The approach is often called the Newton–Raphson method, acknowledging historical contributions by Sir Isaac Newton and Joseph Raphson. In practice the method is valued for its fast convergence near simple roots and for its conceptual simplicity.

Basic formula and geometric idea

Starting from an initial guess x0, each iteration computes x_{n+1} = x_n - f(x_n)/f'(x_n), where f' denotes the function's derivative. Geometrically, one draws the tangent to the graph y = f(x) at x = x_n and takes the x-intercept of that tangent as the next estimate x_{n+1}. Repeat this process until successive values change by less than a chosen tolerance or until a maximum number of iterations is reached. The method therefore requires that the derivative be evaluable at each iterate.

Algorithm steps

  • Choose an initial guess x0 near the suspected root.
  • Compute f(x_n) and f'(x_n).
  • Form the next estimate x_{n+1} = x_n - f(x_n)/f'(x_n).
  • Stop if |x_{n+1}-x_n| or |f(x_{n+1})| is below a tolerance; otherwise set n:=n+1 and repeat.

Convergence, strengths and limitations

When f has a simple root and the initial guess is sufficiently close, Newton's method typically converges quadratically: the number of correct digits roughly doubles with each iteration. This rapid local convergence is its principal advantage in root-finding and optimization. However, the method can fail or behave poorly when:

  1. The derivative is zero or nearly zero at an iterate (division by a small number causes large jumps).
  2. The iteration lands in a cycle or diverges because the initial guess is too far from any root.
  3. The root is multiple (has multiplicity greater than one), in which case convergence is generally only linear unless the method is modified.

Common remedies include choosing better initial guesses, using safeguards such as step damping or line searches, switching to bracketing methods for global reliability, or applying modified Newton formulas for multiple roots.

Extensions and applications

Newton's method generalizes to systems of equations via the Jacobian matrix: for a vector-valued function F(x) one solves J_F(x_n) s = -F(x_n) and sets x_{n+1}=x_n+s. This multivariate Newton method is widely used in nonlinear equations, optimization (finding stationary points), and computational mechanics. Variants such as quasi-Newton methods approximate derivatives to reduce cost, while complex-plane iterations reveal fractal basins of attraction around roots.

Historical note and practical use

The technique has roots in 17th- and 18th-century analysis and remains a staple of numerical mathematics because of its efficiency near solutions. In modern computing it is implemented in scientific libraries, interactive solvers and optimization routines; users should balance its speed with caution about initial guesses and derivative evaluation. For implementations and deeper theory see resources on numerical analysis and algorithms (for example, introductory texts and online references: roots overview, historical references).