Skip to content

Forward difference

Estimate a derivative by stepping forward, and see how curvature, bump size and numerical noise change a price sensitivity.

A forward difference compares a function at xx with its value one positive step ahead, x+hx+h. The raw difference is Δhf(x)=f(x+h)−f(x)\Delta_h f(x)=f(x+h)-f(x). Dividing by the step gives the forward-difference approximation to the derivative:
Dh+f(x)=f(x+h)−f(x)h,h>0.D_h^+f(x)=\frac{f(x+h)-f(x)}{h},\qquad h>0.
In risk calculations, this is the basic “bump up and reprice” operation. For a price V(S)V(S), the quotient [V(S+h)−V(S)]/h[V(S+h)-V(S)]/h estimates delta while holding the other model inputs fixed. If the base price is already available, it needs one additional valuation. “Forward” describes the direction of the input step; it does not mean a forecast of a future price.

A slope with some curvature left in it

Use the dimensionless test function f(x)=x2f(x)=x^2 at x=3x=3. Its derivative is f′(3)=6f'(3)=6. With h=0.1h=0.1,
D0.1+f(3)=3.12−320.1=9.61−90.1=6.1.D_{0.1}^+f(3)=\frac{3.1^2-3^2}{0.1} =\frac{9.61-9}{0.1}=6.1.

The secant measures the average slope across the interval from 33 to 3.13.1. The quadratic is getting steeper over that interval, so the result exceeds the tangent slope at its left endpoint.

Step hhBumped value f(3+h)f(3+h)Forward slopeSigned error: approximation minus 66
0.10.19.619.616.16.1+0.1+0.1
0.050.059.30259.30256.056.05+0.05+0.05

Here the arithmetic is exact in decimal notation. Expanding the square shows why halving the step halves the error:

(x+h)2−x2h=2x+h.\frac{(x+h)^2-x^2}{h}=2x+h.
Exact dimensionless quadratic at x=3: forward slopes 6.1 and 6.05 have signed errors plus 0.1 and plus 0.05 for steps 0.1 and 0.05; the true derivative is 6.
Exact dimensionless quadratic at x=3: forward slopes 6.1 and 6.05 have signed errors plus 0.1 and plus 0.05 for steps 0.1 and 0.05; the true derivative is 6.
Original exact quadratic example. The straight error line is specific to this model; it is not an observed market relationship.

Why the two-point formula is first order

If ff has a continuous second derivative on the interval, Taylor's theorem gives

Dh+f(x)−f′(x)=h2f′′(ξ),x<ξ<x+h.D_h^+f(x)-f'(x)=\frac{h}{2}f''(\xi), \qquad x<\xi<x+h.
If ∣f′′∣≤M|f''|\le M throughout a fixed neighbourhood of xx, the absolute truncation error is at most Mh/2Mh/2. This is first-order accuracy: the error is O(h)O(h) as hh shrinks. An approximately twofold reduction on halving hh is expected when the leading curvature term is nonzero and truncation dominates. A straight-line function has zero truncation error already.
The error's sign follows the curvature. A convex smooth price function gives an upward-biased forward slope relative to its derivative at the base point; concavity reverses that comparison. If both sides of the input are admissible, a central difference cancels the leading curvature term and normally has O(h2)O(h^2) truncation error under sufficient smoothness.

Choosing the step in a pricing calculation

A smaller bump reduces truncation error, but it also makes the numerator a subtraction of closer prices. Floating-point arithmetic, solver tolerances and valuation noise can then dominate. Even the sample point can disappear: in ordinary binary64 arithmetic, 3+10−183+10^{-18} rounds to 33. The direct quadratic quotient then returns zero because the two computed nodes coincide, although the derivative is 66.

With exact sample locations, if each evaluated function value has an absolute error bounded by ε\varepsilon, their contribution to the quotient error is bounded by 2ε/h2\varepsilon/h. A Monte Carlo standard error is a stochastic scale, not such a deterministic bound. Compare several meaningful bump sizes and account separately for simulation uncertainty; the smallest representable step offers no accuracy guarantee.

Keep the bump's units explicit. A quotient has units of output per unit input; a volatility input recorded as a decimal requires a bump in decimal volatility units. At a lower domain boundary a forward stencil can be convenient; at an upper boundary, a backward difference may be the admissible choice. At a kink, a forward quotient may approach a right derivative even when a two-sided derivative does not exist. It cannot certify smoothness or the stability of a full differential-equation solver.
The Numerical Differentiation lesson develops the Taylor formulas, Greek bumps and step-size trade-off. The preview is public; the full lesson requires membership.

Sources

Last updated
  • forward difference
  • numerical differentiation
  • finite differences
  • greeks
  • truncation error
← Back to the glossaryBack to top ↑