Model selection


Model selection

Model selection is the task of selecting a statistical model from a set of candidate models, given data. In the simplest cases, a pre-existing set of data is considered. However, the task can also involve the design of experiments such that the data collected is well-suited to the problem of model selection.

Contents

Introduction

The scientific observation cycle.

In its most basic forms, model selection is one of the fundamental tasks of scientific inquiry. Determining the principle that explains a series of observations is often linked directly to a mathematical model predicting those observations. For example, when Galileo performed his inclined plane experiments, he demonstrated that the motion of the balls fitted the parabola predicted by his model.

Of the countless number of possible mechanisms and processes that could have produced the data, how can one even begin to choose the best model? The mathematical approach commonly taken decides among a set of candidate models; this set must be chosen by the researcher. Often simple models such as polynomials are used, at least initially. Burnham and Anderson (2002) emphasize the importance of choosing models based on sound scientific principles, modeling the underlying data throughout their book.

Once the set of candidate models has been chosen, the mathematical analysis allows us to select the best of these models. What is meant by best is controversial. A good model selection technique will balance goodness of fit with simplicity. More complex models will be better able to adapt their shape to fit the data (for example, a fifth-order polynomial can exactly fit six points), but the additional parameters may not represent anything useful. (Perhaps those six points are really just randomly distributed about a straight line.) Goodness of fit is generally determined using a likelihood ratio approach, or an approximation of this, leading to a chi-squared test. The complexity is generally measured by counting the number of parameters in the model.

Model selection techniques can be considered as estimators of some physical quantity, such as the probability of the model producing the given data. The bias and variance are both important measures of the quality of this estimator.

Asymptotic efficiency is also often considered.

A standard example of model selection is that of curve fitting, where, given a set of points and other background knowledge (e.g. points are a result of i.i.d. samples), we must select a curve that describes the function that generated the points.

Methods for choosing the set of candidate models

Experiments for choosing the set of candidate models

Criteria for model selection

See also

References

  • Anderson, D.R. (2008), Model Based Inference in the Life Sciences, Springer.
  • Aznar Grasa, A. (1989). Econometric Model Selection: A New Approach, Springer. ISBN 978-0-7923-0321-3
  • Burnham, K.P., and Anderson, D.R. (2002). Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach, 2nd ed. Springer-Verlag. ISBN 0-387-95364-7 [This has over 10000 citations on Google Scholar.]
  • Chamberlin, T.C. (1890) "The method of multiple working hypotheses", Science 15: 93. (Reprinted 1965, Science 148: 754–759 [1].)
  • Claeskens, G., and Hjort, N.L. (2008). Model Selection and Model Averaging, Cambridge University Press.
  • Phil C. Gregory (2005) Bayesian logical data analysis for the physical sciences: A comparative approach with Mathematica support (Cambridge U. Press, Cambridge UK) preview.
  • Lahiri, P. (2001). Model Selection, Institute of Mathematical Statistics.
  • Massart, P. (2007). Concentration Inequalities and Model Selection, Springer.



Wikimedia Foundation. 2010.

Look at other dictionaries:

  • Selection de parentele — Sélection de parentèle Les mécanismes de l évolution biologique Mécanismes non aléatoires: sélection naturelle sélection utilitaire sélection sexuelle sélection de parentèle sélection de groupe …   Wikipédia en Français

  • Sélection inter-sexe — Sélection intersexuelle La sélection intersexuelle est particulièrement visible au niveau des aires de parade. Chez le Tétras lyre, les mâles se regroupent et paradent dans des tourbières. Les femelles viennent les observer et s accouplent parfoi …   Wikipédia en Français

  • Sélection inter-sexuelle — Sélection intersexuelle La sélection intersexuelle est particulièrement visible au niveau des aires de parade. Chez le Tétras lyre, les mâles se regroupent et paradent dans des tourbières. Les femelles viennent les observer et s accouplent parfoi …   Wikipédia en Français

  • Model dwellings company — Model Dwellings Companies (MDCs) were a group of private companies in Victorian Britain that sought to improve the housing conditions of the working classes by building new homes for them, at the same time receiving a competitive rate of return… …   Wikipedia

  • Model organism — Escherichia coli is a gram negative prokaryotic model organism …   Wikipedia

  • Model (art) — For non artistic human models, see Model (person). Art model posing in a French painting school Art models are models who pose for photographers, painters, sculptors, and other artists as part of their work of art. Art models who pose in the nude …   Wikipedia

  • Model aircraft — A die cast Boeing 747 400 model. Model aircraft are flying or non flying models of existing or imaginary aircraft using a variety of materials including plastic, diecast metal, polystyrene, balsa wood, foam and fibreglass. Flying designs range… …   Wikipedia

  • Model (person) — For other uses, see Model (disambiguation). A model (from Middle French modèle),[1] sometimes called a mannequin, is a person who is employed to display, advertise and promote commercial products (notably fashion clothing) or to serve as a… …   Wikipedia

  • Sélection de parentèle — Les mécanismes de l évolution biologique Mécanismes non aléatoires : sélection naturelle sélection de survie sélection sexuelle sélection de parentèle sélection de groupe sélection s …   Wikipédia en Français

  • Sélection intersexuelle — La sélection intersexuelle est particulièrement visible au niveau des aires de parade. Chez le Tétras lyre, les mâles se regroupent et paradent dans des tourbières. Les femelles viennent les observer et s accouplent parfois avec l un d entre eux …   Wikipédia en Français


Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”

We are using cookies for the best presentation of our site. Continuing to use this site, you agree with this.