Skip to content

Consistent estimator

Consistency means a fixed-size estimation error becomes unlikely as the sample grows. Compare a biased but consistent return mean with an unbiased rule that never learns.

A consistent estimator is a sequence of rules for estimating a parameter whose probability of a fixed-size error tends to zero as the sample size grows. For a quant estimating expected return, consistency asks whether an ever-longer sample makes the estimate concentrate around the true mean, under the stated data model.

It is a large-sample property. It does not promise an accurate estimate from this year's data, and it does not require the estimator to be unbiased at every sample size.

What “concentrate” means

Let θ^n=Tn(X1,…,Xn)\hat\theta_n=T_n(X_1,\ldots,X_n) be an estimator of a fixed parameter θ\theta. It is consistent for θ\theta when
for every ε>0,lim⁡n→∞Pθ ⁣(∣θ^n−θ∣>ε)=0.\text{for every }\varepsilon>0,\qquad \lim_{n\to\infty}\mathbb{P}_\theta\!\left(\lvert\hat\theta_n-\theta\rvert>\varepsilon\right)=0.
This is convergence in probability, written θ^n→pθ\hat\theta_n\xrightarrow{p}\theta. The probability is calculated under the data-generating model with true parameter θ\theta. To call a procedure consistent throughout a model, this condition must hold for each parameter value in that model; the sample size needed can depend on θ\theta.

Equivalently, choose any positive error tolerance ε\varepsilon and any positive failure-probability tolerance δ\delta. Eventually, for every sufficiently large nn, the probability of an error exceeding ε\varepsilon is below δ\delta. You fix the tolerance first, then let the sample grow.

The statement concerns a sequence of sampling distributions. It does not say that every additional observation makes a particular realised estimate closer to the truth. A running return average can move away from its target before moving back.

A biased return estimate that still converges

Consider a synthetic model of independent, identically distributed one-period returns. Measure returns in percentage points (pp): a return of 1 in these units means 1%, not a decimal return of 1. Suppose
Xi∼N(μ,σ2),μ=1 pp,σ=2 pp.X_i\sim\mathcal{N}(\mu,\sigma^2),\qquad \mu=1\text{ pp},\qquad \sigma=2\text{ pp}.

The sample mean Xˉn=n−1∑i=1nXi\bar X_n=n^{-1}\sum_{i=1}^nX_i is unbiased, with variance 4/n4/n pp². Now deliberately add a small upward adjustment:

Tn=Xˉn+1 ppn.T_n=\bar X_n+\frac{1\text{ pp}}{n}.
This is a teaching device, not a proposed correction for trading data. Its bias is positive at every finite nn:
E[Tn]−μ=1 ppn,Var(Tn)=4n pp2.\mathbb{E}[T_n]-\mu=\frac{1\text{ pp}}{n},\qquad \text{Var}(T_n)=\frac{4}{n}\text{ pp}^2.

The deterministic adjustment changes the centre, not the variance. Both its bias and its dispersion vanish as the sample grows.

Observations nnMean of TnT_n (pp)Bias (pp)Standard deviation (pp)Variance (pp²)
41.250.2511
161.06250.06250.50.25
641.0156250.0156250.250.0625

These are properties across repeated samples, not three observed returns or a forecast path. Normality makes the plotted sampling distributions exact; a normal approximation is unnecessary here.

Exact synthetic IID normal example: mean plus 1/n pp has centres 1.25, 1.0625 and 1.015625 pp and standard deviations 1, 0.5 and 0.25 pp at n equal to 4, 16 and 64. Its probabilities of error greater than 0.5 pp are 62.79%, 32.11% and 4.59%. Using only the first return has an unchanged error probability of 80.26%.
Exact synthetic IID normal example: mean plus 1/n pp has centres 1.25, 1.0625 and 1.015625 pp and standard deviations 1, 0.5 and 0.25 pp at n equal to 4, 16 and 64. Its probabilities of error greater than 0.5 pp are 62.79%, 32.11% and 4.59%. Using only the first return has an unchanged error probability of 80.26%.
Original exact-model comparison. True one-period mean 1 pp; return standard deviation 2 pp. The shaded band is the true mean ± 0.5 pp. Increasing sample size narrows the estimator's distribution, not the distribution of an individual return.

To prove consistency, use mean squared error:

E[(Tn−μ)2]=Var(Tn)+(E[Tn]−μ)2=(4n+1n2) pp2⟶0.\mathbb{E}[(T_n-\mu)^2] =\text{Var}(T_n)+(\mathbb{E}[T_n]-\mu)^2 =\left(\frac4n+\frac1{n^2}\right)\text{ pp}^2 \longrightarrow0.

Markov's inequality applied to the nonnegative squared error gives, for any ε>0\varepsilon>0 measured in the same return units,

P(∣Tn−μ∣>ε)≤E[(Tn−μ)2]ε2⟶0.\mathbb{P}(\lvert T_n-\mu\rvert>\varepsilon) \le\frac{\mathbb{E}[(T_n-\mu)^2]}{\varepsilon^2} \longrightarrow0.
The variance and squared bias shrinking to zero are a sufficient condition for consistency. They are not its definition: convergence in probability alone need not control expectations or second moments. The law of large numbers also gives a direct route: the sample mean converges, and the added adjustment vanishes. IID sampling with a finite first absolute moment suffices for the usual sample-mean law; the finite variance here makes the MSE proof especially short.

Unbiasedness cannot replace consistency

Suppose another analyst reports only the first return, regardless of how much data arrives:

Un=X1for every n.U_n=X_1\quad\text{for every }n.
This is an unbiased estimator of μ\mu: E[Un]=μ\mathbb{E}[U_n]=\mu. But its variance stays at 4 pp². More decisively, in this normal model,
P(∣Un−μ∣>0.5 pp)=2[1−Φ(0.25)]≈0.8026\mathbb{P}(\lvert U_n-\mu\rvert>0.5\text{ pp}) =2[1-\Phi(0.25)]\approx0.8026
for every nn, where Φ\Phi is the standard normal cumulative distribution function. The error probability does not approach zero, so UnU_n is inconsistent. Compare the two questions: unbiasedness concerns the sampling mean at a given sample size; consistency concerns concentration as sample size grows. Neither property guarantees the other.

What changes with actual return histories

The IID model above is an assumption, not a description of every market. With finite second moments and a common mean μ\mu, the general variance calculation is

Var(Xˉn)=1n2∑i=1n∑j=1nCov(Xi,Xj).\text{Var}(\bar X_n) =\frac1{n^2}\sum_{i=1}^n\sum_{j=1}^n\text{Cov}(X_i,X_j).

Autocorrelation introduces off-diagonal terms. If this variance tends to zero, the common-mean sample average is still consistent by the same probability bound. Dependence therefore requires a suitable argument; it does not automatically defeat consistency.

Conversely, stationarity alone is insufficient. If Xi=μ+ZX_i=\mu+Z for every observation, with the same nondegenerate normal shock ZZ of mean zero and variance 4 pp², the entire stationary history repeats one shock. Its average remains μ+Z\mu+Z, with variance 4 pp² at every sample size. Counting more rows has added no independent information.

A changing expected return raises another issue: what fixed parameter is the longer history supposed to estimate? A consistent estimate of a historical model's mean need not estimate the next regime's mean. A fixed-length rolling window also does not acquire this growing-sample guarantee merely because the calendar advances.

For the proof behind averaging and the distinction between concentration and normal error approximations, read Laws of Large Numbers and the Central Limit Theorem (public preview; full lesson requires membership).

Sources

  • George Casella and Roger L. Berger, Statistical Inference, 2nd ed., Duxbury, 2002, §10.1.1: Definition 10.1.1, Theorem 10.1.3 and Theorem 10.1.5. Definitions, vanishing-bias/variance criterion and vanishing deterministic adjustments.
  • Cosma Shalizi, Carnegie Mellon: Inference I — Inference with Independent Data, especially “The basic ingredient for consistency is the law of large numbers” and “Backup: Modes of convergence.” Distinguishes convergence in probability from mean-square and almost-sure convergence.
  • Daniel McFadden, UC Berkeley: Statistical Tools, Chapter 6, Estimation, §6.1.12 and the preceding finite-sample caution. Consistency is a limit property and can coexist with poor accuracy at practically available sample sizes.
Last updated
  • estimation
  • consistency
  • asymptotics
  • bias
  • law of large numbers
← Back to the glossaryBack to top ↑