A simulation evaluation of backward elimination and stepwise variable selection in regression analysis

Date

2012-07-27

Authors

Journal Title

Journal ISSN

Volume Title

Publisher

Kansas State University

Abstract

A first step in model building in regression analysis often consists of selecting a parsimonious set of independent variables from a pool of candidate independent variables. This report uses simulation to study and compare the performance of two widely used sequential, variable selection algorithms, stepwise and backward elimination. A score is developed to assess the ability of any variable selection method to terminate with the correct model. It is found that backward elimination performs slightly better than stepwise, increasing sample size leads to a relatively small improvement in both methods and that the magnitude of the variance of the error term is the major factor determining the performance of both.

Description

Keywords

Simulation, Backward elimination

Graduation Month

August

Degree

Master of Science

Department

Department of Statistics

Major Professor

Paul I. Nelson

Date

2012

Type

Report

Citation