Advanced Search

Query:

Fill in the form and click »Search«...

Format:

Display: entries per page entries

Zbl 1109.62056
Leng, Chenlei; Lin, Yi; Wahba, Grace
A note on the Lasso and related procedures in model selection. (English)
[J] Stat. Sin. 16, No. 4, 1273-1284 (2006). ISSN 1017-0405

Summary: The Lasso, the Forward Stagewise regression and the Lars are closely related procedures recently proposed for linear regression problems. Each of them can produce sparse models and can be used both for estimation and variable selection. In practical implementations these algorithms are typically tuned to achieve optimal prediction accuracy. We show that, when the prediction accuracy is used as the criterion to choose the tuning parameter, in general these procedures are not consistent in terms of variable selection. That is, the sets of variables selected are not consistently the true set of important variables. \par In particular, we show that for any sample size $n$, when there are superfluous variables in the linear regression model and the desig matrix is orthogonal, the probability that these procedures correctly identify the true set of important variables is less than a constant (smaller than one) not depending on $n$. This result is also shown to hold for two-dimensional problems with general correlated design matrices. The results indicate that in problems where the main goal is variable selection, prediction-accuracy-based criteria alone are not sufficient for this purpose. Adjustments will be discussed to make the Lasso and related procedures useful/consistent for variable selection.

MSC 2000:: *62J05 Linear regression
62H12 Multivariate estimation

Keywords: consistent model selection; forward stagewise regression; variable selection

Comment on this Item PDF MathML XML ASCII DVI PS BibTeX Online Ordering Journal

	Scientific prize winners of the ICM 2010
	Overhang
	Lie groups, physics and geometry. An introduction for physicists, engineers and chemists.

Advanced Search

Zentralblatt MATH Berlin [Germany]