Skip to content

Double-selection LASSO

Double-selection LASSO tests a new factor against many controls by selecting for both mean returns and candidate covariances before an unpenalised refit.

Double-selection LASSO is a control-selection procedure that screens a large factor set twice before estimating the incremental pricing contribution of a candidate factor. In the Feng–Giglio–Xiu asset-pricing application, the two screens protect against a specific mistake: discarding a control that contributes modestly to explaining average returns but materially changes the candidate factor’s coefficient when omitted.

A factor surviving ordinary Lasso regression is not, by that fact alone, an independently priced source of risk.

Two questions for the same control set

Let rtr_t contain returns on nn test assets, gtg_t be one candidate factor and hth_t the existing factor set. Write Cg=Cov(rt,gt)C_g=\text{Cov}(r_t,g_t) and Ch=Cov(rt,ht)C_h=\text{Cov}(r_t,h_t). In the covariance representation,

E[rt]=1γ0+Cgλg+Chλh.\mathbb{E}[r_t]=\mathbf{1}\gamma_0+C_g\lambda_g+C_h\lambda_h.
The target λg\lambda_g is the candidate’s stochastic discount factor loading, rather than its mean return or its multivariate-beta risk premium. Those parameters can differ when factors are correlated.

Using sample means and covariances, the procedure is:

  1. Select for pricing: regress average asset returns on existing-factor covariance columns using Lasso. Keep the selected set SyS_y.
  2. Select for overlap: regress the candidate’s covariance column on the same controls using a second Lasso. Keep SgS_g.
  3. Refit: regress average returns on the candidate covariance column and the controls in Sy∪SgS_y\cup S_g, with an intercept and without a penalty.
These are cross-sectional regressions across test assets. The second screen compares covariance profiles; it is not a regression of factor returns through time. Feng, Giglio and Xiu, §I.E, equations (7)–(9).

A control that the first screen misses

Consider four fictional assets. The inputs below are stipulated, scaled covariance profiles and average excess returns over a common, unspecified horizon. They are not four dates of factor returns or sample estimates from a simulated return panel.

AssetControl profile h1h_1Control profile h2h_2Candidate profile cgc_gMean excess return yy (pp)
A−1−1−3−1.8
B−111−0.4
C1−111.0
D1111.2
Here h1,h2h_1,h_2 name the columns of the scaled control covariance matrix, rather than the underlying factor time series. Construct a third orthogonal column u=(−1,1,1,−1)⊤u=(-1,1,1,-1)^\top and set
cg=h1+h2+u,y=0.8h1+0.1h2+0.3cg.c_g=h_1+h_2+u,\qquad y=0.8h_1+0.1h_2+0.3c_g.

All columns are centred. For C=(h1  h2)C=(h_1\;h_2), C⊤C/4=IC^\top C/4=I, and C⊤u=0C^\top u=0. Use the explicit Lasso convention

min⁡a,b  ∥q−a1−Cb∥222n+ℓ∥b∥1,n=4,\min_{a,b}\;\frac{\lVert q-a\mathbf{1}-Cb\rVert_2^2}{2n} +\ell\lVert b\rVert_1,\qquad n=4,

where the intercept aa is unpenalised. The symbol ℓ\ell denotes the tuning penalty, keeping it distinct from the pricing loading λg\lambda_g.

For these orthonormal controls, let z=C⊤q/nz=C^\top q/n. Each coefficient is soft-thresholded:

b^j=sign(zj)max⁡(∣zj∣−ℓ,0).\widehat b_j=\text{sign}(z_j)\max(\lvert z_j\rvert-\ell,0).

For the first response, q=yq=y, the scores are (1.1,0.4)(1.1,0.4). A penalty ℓy=0.5\ell_y=0.5 pp gives coefficients (0.6,0)(0.6,0): only h1h_1 survives. The scores follow from y=1.1h1+0.4h2+0.3uy=1.1h_1+0.4h_2+0.3u, not from reading off the structural control coefficients 0.80.8 and 0.10.1.

For the second response, q=cgq=c_g, the scores are (1,1)(1,1). A separately specified penalty ℓg=0.5\ell_g=0.5 in candidate covariance units gives (0.5,0.5)(0.5,0.5): both controls survive. The two numerical penalties happen to match; their response units differ. They are illustrative tuning choices, not a prescription for empirical work.
Fictional four-asset covariance example: mean-return Lasso coefficients are 0.60 and 0 for h1 and h2; candidate-covariance Lasso coefficients are 0.50 and 0.50. The union retains both controls, giving a candidate coefficient of 0.30 versus 0.35 with h1 alone. The saturated full refit supplies no statistical inference.
Fictional four-asset covariance example: mean-return Lasso coefficients are 0.60 and 0 for h1 and h2; candidate-covariance Lasso coefficients are 0.50 and 0.50. The union retains both controls, giving a candidate coefficient of 0.30 versus 0.35 with h1 alone. The saturated full refit supplies no statistical inference.
Original synthetic selection geometry. The two Lasso responses have different units and separately specified penalties; the final coefficient is in percentage points per candidate covariance unit. No estimated time series or significance test is represented.
The union therefore includes h2h_2. The unpenalised ordinary least-squares refit recovers the stipulated candidate coefficient 0.300.30, in pp per candidate covariance unit.

Keeping only the first selection produces 0.350.35. To see exactly why, remove the component along h1h_1 from the candidate and response. The remaining vectors are h2+uh_2+u and 0.4h2+0.3u0.4h_2+0.3u, giving

λ^gsingle=(h2+u)⊤(0.4h2+0.3u)(h2+u)⊤(h2+u)=0.4+0.32=0.35.\widehat\lambda_g^{\mathrm{single}} =\frac{(h_2+u)^\top(0.4h_2+0.3u)}{(h_2+u)^\top(h_2+u)} =\frac{0.4+0.3}{2}=0.35.

After also controlling for h2h_2, the remaining vectors are uu and 0.3u0.3u, giving 0.300.30. The omitted h2h_2 raises the first coefficient by 0.050.05: a concrete omitted-variable bias mechanism, even though the first screen excluded it.

The full design has four assets and four linearly independent columns, counting the intercept. It is saturated, with zero residual degrees of freedom. This calculation demonstrates selection geometry and point estimates; it provides no standard error, confidence interval or pp-value.

What turns selection into inference?

The final paper’s §I.F uses jointly large asset and time dimensions, sparsity and further regularity conditions. Its asymptotic distribution is scaled by T\sqrt T, and its variance estimator is Newey–West-type. Computing that variance also involves a separate time-series Lasso/post-OLS projection of gtg_t on hth_t; that is not the second cross-sectional selection above. Merely attaching ordinary regression standard errors to the union refit does not implement this framework. Feng, Giglio and Xiu, Theorems 1–2 and equation (10).
The original Belloni–Chernozhukov–Hansen post-double-selection framework concerns treatment effects in approximately sparse models. Its causal interpretation requires its own identifying assumptions. Selecting controls twice does not make an asset-pricing coefficient a causal effect.
Double/debiased machine learning is a broader framework using orthogonal scores and cross-fitting; it is not simply another name for two Lasso fits. Chernozhukov and coauthors. Likewise, searching many candidate factors and reporting the best result introduces a separate multiple-testing problem. Double selection targets the choice of controls for a factor under evaluation.
For the penalty foundations, see Ridge, Lasso, and Elastic Net. For the two-pass distinction and estimated-exposure problem, see Time-series and cross-sectional tests. Both provide public previews; full lessons require membership.

Sources

Last updated
  • factor selection
  • asset pricing
  • lasso
  • post selection inference
  • factor zoo
← Back to the glossaryBack to top ↑