Unknown

Dataset Information

Statistically Controlling for Confounding Constructs Is Harder than You Think.


ABSTRACT: Social scientists often seek to demonstrate that a construct has incremental validity over and above other related constructs. However, these claims are typically supported by measurement-level models that fail to consider the effects of measurement (un)reliability. We use intuitive examples, Monte Carlo simulations, and a novel analytical framework to demonstrate that common strategies for establishing incremental construct validity using multiple regression analysis exhibit extremely high Type I error rates under parameter regimes common in many psychological domains. Counterintuitively, we find that error rates are highest--in some cases approaching 100%--when sample sizes are large and reliability is moderate. Our findings suggest that a potentially large proportion of incremental vali

SUBMITTER: Westfall J 

PROVIDER: S-EPMC4816570 | biostudies-literature | 2016

REPOSITORIES: biostudies-literature