The reliability paradox: Why robust cognitive tasks do not produce reliable individual differences.

ABSTRACT: Individual differences in cognitive paradigms are increasingly employed to relate cognition to brain structure, chemistry, and function. However, such efforts are often unfruitful, even with the most well established tasks. Here we offer an explanation for failures in the application of robust cognitive paradigms to the study of individual differences. Experimental effects become well established - and thus those tasks become popular - when between-subject variability is low. However, low between-subject variability causes low reliability for individual differences, destroying replicable correlations with other factors and potentially undermining published conclusions drawn from correlational relationships. Though these statistical issues have a long history in psychology, they are widely

SUBMITTER: Hedge C 

PROVIDER: S-EPMC5990556 | biostudies-literature | 2018 Jun

REPOSITORIES: biostudies-literature