Potsdam Mind Research Repository

Reproducible Research

  • Increase font size
  • Default font size
  • Decrease font size
Home Research Topics Other Experiments and Analyses Balancing Type I Error and Power in Linear Mixed Models

Balancing Type I Error and Power in Linear Mixed Models


Matuschek, et al. (2017). Balancing Type I Error and Power in Linear Mixed Models

Hannes Matuschek, Reinhold Kliegl, Shravan Vasishth, Harald Baayen, Douglas Bates

Abstract: Linear mixed-effects models have increasingly replaced mixed-model analyses of variance for statistical inference in factorial psycholinguistic experiments. The advantages of LMMs over ANOVAs, however, come at a cost: Setting up an LMM is not as straightforward as running an ANOVA. One simple option, when numerically possible, is to fit the full variance-covariance structure of random effects (the maximal model; Barr et al., 2013), presumably to keep Type I error down to the nominal $\alpha$ in the presence of random effects. Although it is true that fitting a model with only random intercepts may lead to higher Type I error, fitting a maximal model also has a cost: it can lead to a significant loss of power. We demonstrate this with simulations and suggest that for typical psychological and psycholinguistic data, models with a random effect structure that is supported by the data have optimal Type I error and power properties.

Also available at arXiv.

To download, use right-click or CTRL-click and then "save as..."
Download this file (MatuschekPreprint2015.zip)MatuschekPreprint2015.zip[ ][ ]18307 Kb16/02/2017 15:02
Download this file (manuscript.pdf)manuscript.pdf[ ][ ]1945 Kb28/07/2016 14:56
Last Updated on Thursday, 20 April 2017 06:31  

See also

Copyright © 2017 Potsdam Mind Research Repository (PMR2). All Rights Reserved.
Joomla! is Free Software released under the GNU/GPL License.