Chapter 3
Jerome Friedman, Trevor Hastie and Robert Tibshirani: Regularized Paths for Generalized Linear Models via Coordinate Descent. We use coordinate descent to develop regularization paths for linear, logistic and multinomial regression models. Our algorithms use the lasso and "elastic net" penalties of Zou and Hastie (2005), and create the path for a grid of values of the penalty parameter lambda. The R package glmnet has been submitted to CRAN

Chapter 11
A study of the NIPS feature selection challenge

Chapter 14
(Witten, Tibshirani, Hastie). A penalized matrix decomposition, with applications to sparse canonical correlation analysis and principal components. To appear, Biostatistics.

This paper proposes a novel penalized matrix decomposition. When applied to the covariance matrix, it produces a version of sparse principal components that is closely related to the methods described in the chapter. When applied to the cross-products matrix, a method for sparse canonical correlation analysis is obtained.



Robert Tibshirani (2009). Univariate shrinkage in the Cox model for high dimensional data
A simple method for predicting survival with high-dimensional features