Skip to content

QLIKE loss

QLIKE scores variance forecasts against noisy variance proxies. Compare score conventions, asymmetric forecast penalties and the conditional-unbiasedness requirement.

QLIKE loss is a quasi-likelihood-based score for comparing positive variance forecasts with observed variance proxies. Lower average loss means a better volatility forecast under this scoring rule. Its practical appeal is that an appropriate noisy proxy can preserve an expected forecast comparison even when the variance being forecast is unobservable.

Score the variance, not its square root

For a positive variance proxy yy and positive forecast variance hh, a normalised convention is

L(y,h)=yh−log⁡(yh)−1.L(y,h)=\frac{y}{h}-\log\left(\frac{y}{h}\right)-1.
The score is nonnegative and zero at h=yh=y. Both inputs must describe the same return, horizon and variance units. A 2% standard deviation becomes 0.022=0.00040.02^2=0.0004 in decimal-return variance; inserting 0.020.02 directly would score a different object. Variance and volatility are different inputs.

Consider one fictional daily proxy y=0.0004y=0.0004:

ForecastDaily variance hhCorresponding standard deviationNormalised QLIKE
A0.00011%1.6137
B0.00042%0
C0.00164%0.6363

For A, y/h=4y/h=4, giving 4−log⁡(4)−1≈1.61374-\log(4)-1\approx1.6137. C overshoots variance by a factor of four, whereas A undershoots by that factor; these reciprocal errors receive different penalties. B matches this proxy exactly. That does not establish that B equals the unobserved conditional variance.

Fictional daily variance proxy 0.0004. Forecast A has variance 0.0001 and QLIKE 1.6137; B has variance 0.0004 and score 0; C has variance 0.0016 and score 0.6363. The curve plots normalised QLIKE against forecast variance divided by proxy variance.
Fictional daily variance proxy 0.0004. Forecast A has variance 0.0001 and QLIKE 1.6137; B has variance 0.0004 and score 0; C has variance 0.0016 and score 0.6363. The curve plots normalised QLIKE against forecast variance divided by proxy variance.
Original fictional one-period comparison. The curve holds the proxy fixed; reciprocal fourfold variance errors incur different scores. Standard deviations are shown only as translations of the variance inputs.

Why two QLIKE implementations can report different numbers

Patton uses the convention ℓ(y,h)=log⁡(h)+y/h\ell(y,h)=\log(h)+y/h in equation (6) of his forecast-comparison paper. For y>0y>0, simple algebra gives
L(y,h)=ℓ(y,h)−log⁡(y)−1.L(y,h)=\ell(y,h)-\log(y)-1.

The subtracted term is identical across forecasts for the same observation. The conventions therefore rank forecasts identically on the same dates with the same weights, but their reported loss levels differ. The unnormalised score can be negative; zero is not its universal benchmark.

If y=0y=0, the normalised expression is undefined. The unnormalised score remains finite for h>0h>0, with ℓ(0,h)=log⁡(h)\ell(0,h)=\log(h). Document that convention and investigate whether zeros are valid measurements. An arbitrary positive replacement changes the data. A zero or negative forecast variance is outside either scoring convention's domain.

What proxy robustness actually buys

Let F\mathcal F be the information available when both forecasts are issued. Suppose the nonnegative proxy YY satisfies E[Y∣F]=v\mathbb E[Y\mid\mathcal F]=v, where v>0v>0 is the target conditional variance. Both forecasts must be positive and measurable with respect to F\mathcal F, and the score differences below must be integrable.

The mechanism can be seen directly:

ℓ(Y,hA)−ℓ(Y,hB)=log⁡(hA/hB)+Y(1/hA−1/hB),E[ℓ(Y,hA)−ℓ(Y,hB)∣F]=log⁡(hA/hB)+v(1/hA−1/hB).\begin{aligned} \ell(Y,h_A)-\ell(Y,h_B) &=\log(h_A/h_B)+Y(1/h_A-1/h_B),\\ \mathbb E[\ell(Y,h_A)-\ell(Y,h_B)\mid\mathcal F] &=\log(h_A/h_B)+v(1/h_A-1/h_B). \end{aligned}

That is the difference obtained by inserting vv itself. Conditional unbiasedness does the work; unconditional unbiasedness alone is insufficient when forecasts vary with available information. Expected loss levels additionally require the relevant losses to be finite. Patton's §3 sets out the broader regularity conditions for robust loss functions.

For an original two-outcome illustration, keep v=0.0004v=0.0004 and forecasts A and B above. Let the proxy equal 0.0001 or 0.0007, each with conditional probability one-half. Its conditional mean is vv. The normalised loss difference, A minus B, is −0.6363 in the low-proxy outcome and 3.8637 in the high-proxy outcome. A wins the first observation, but the expected difference is 1.6137, favouring B. Robustness preserves the expected comparison, not every realised winner.
Squared returns are conditionally unbiased for variance when the conditional mean is zero, or when the true conditional mean has been removed. Estimating that mean introduces another issue. A realised-variance estimator also needs the appropriate coverage and measurement assumptions; calling it a proxy supplies no guarantee of unbiasedness. QLIKE does not repair a biased target, look-ahead bias, or an incorrect horizon.
Compare forecasts over identical later observations and report uncertainty in their average loss difference. The Forecast Evaluation lesson develops chronological evaluation and dependent loss comparisons; its preview is public and the full lesson requires membership.

Sources

Last updated
  • forecast evaluation
  • variance
  • volatility forecasting
  • loss functions
  • noisy proxies
← Back to the glossaryBack to top ↑