Consistent bi-level variable selection via composite group bridge penalized regression

Date

2013-08-01

Journal Title

Journal ISSN

Volume Title

Publisher

Kansas State University

Abstract

We study the composite group bridge penalized regression methods for conducting bilevel variable selection in high dimensional linear regression models with a diverging number of predictors. The proposed method combines the ideas of bridge regression (Huang et al., 2008a) and group bridge regression (Huang et al., 2009), to achieve variable selection consistency in both individual and group levels simultaneously, i.e., the important groups and the important individual variables within each group can both be correctly identi ed with probability approaching to one as the sample size increases to in nity. The method takes full advantage of the prior grouping information, and the established bi-level oracle properties ensure that the method is immune to possible group misidenti cation. A related adaptive group bridge estimator, which uses adaptive penalization for improving bi-level selection, is also investigated. Simulation studies show that the proposed methods have superior performance in comparison to many existing methods.

Description

Keywords

Bi-level variable selection, High-dimensional data, Oracle property, Penalized regression, Sparse models

Graduation Month

August

Degree

Master of Science

Department

Department of Statistics

Major Professor

Kun Chen

Date

2013

Type

Report

Citation