Dataset Information

Split-half reliability estimates of an online card sorting task in a community sample of young and elderly adults.

ABSTRACT: Executive function is vital for normal social, cognitive, and motor functions. Executive function decline due to aging increases the risk of disability and falls in older adults, which has become an urgent public health issue. Fast and convenient neuropsychological tools are thus needed to identify high-risk groups as early as possible to conduct a timely intervention. Card sorting tasks, such as Wisconsin Card Sorting Task (WCST) and its variants, are popular tools for measuring executive function. This study investigated the reliability of an open-source, self-administered, online, short-version card sorting task with a sample of young (n = 107, 65 females, age: M = 30.1 years, SD = 5.5 years) and elderly Chinese (n = 113, 53 females, age: M = 64.0 years, SD = 6.7 years). We developed an automated scoring and visualization procedure following the recent recommendations on scoring perseverative responses to make the results comparable to the standardized WCST. Reliability estimates of commonly used measures were calculated using the split-half method. All task indices' reliabilities were reasonably good in both old and young groups except for "failure-to-maintain-set." Elderly Chinese adults showed compromised task performance on all measures compared with the young Chinese adults at the group level. The R script of automated scoring and estimation of reliability is publicly available.

SUBMITTER: Zhang Z

PROVIDER: S-EPMC10030079 | biostudies-literature | 2023 Mar

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Split-half reliability estimates of an online card sorting task in a community sample of young and elderly adults.

Zhang Zhengkang Z Yang Li-Zhuang LZ Vékony Teodóra T Wang Changqing C Li Hai H

Behavior research methods 20230321 2

Executive function is vital for normal social, cognitive, and motor functions. Executive function decline due to aging increases the risk of disability and falls in older adults, which has become an urgent public health issue. Fast and convenient neuropsychological tools are thus needed to identify high-risk groups as early as possible to conduct a timely intervention. Card sorting tasks, such as Wisconsin Card Sorting Task (WCST) and its variants, are popular tools for measuring executive funct ...[more]

PMID: 36944861

Similar Datasets

Project description:Adaptive behavior emerges through a dynamic interaction between cognitive agents and changing environmental demands. The investigation of information processing underlying adaptive behavior relies on controlled experimental settings in which individuals are asked to accomplish demanding tasks whereby a hidden regularity or an abstract rule has to be learned dynamically. Although performance in such tasks is considered as a proxy for measuring high-level cognitive processes, the standard approach consists in summarizing observed response patterns by simple heuristic scoring measures. With this work, we propose and validate a new computational Bayesian model accounting for individual performance in the Wisconsin Card Sorting Test (WCST), a renowned clinical tool to measure set-shifting and deficient inhibitory processes on the basis of environmental feedback. We formalize the interaction between the task's structure, the received feedback, and the agent's behavior by building a model of the information processing mechanisms used to infer the hidden rules of the task environment. Furthermore, we embed the new model within the mathematical framework of the Bayesian Brain Theory (BBT), according to which beliefs about hidden environmental states are dynamically updated following the logic of Bayesian inference. Our computational model maps distinct cognitive processes into separable, neurobiologically plausible, information-theoretic constructs underlying observed response patterns. We assess model identification and expressiveness in accounting for meaningful human performance through extensive simulation studies. We then validate the model on real behavioral data in order to highlight the utility of the proposed model in recovering cognitive dynamics at an individual level. We highlight the potentials of our model in decomposing adaptive behavior in the WCST into several information-theoretic metrics revealing the trial-by-trial unfolding of information processing by focusing on two exemplary individuals whose behavior is examined in depth. Finally, we focus on the theoretical implications of our computational model by discussing the mapping between BBT constructs and functional neuroanatomical correlates of task performance. We further discuss the empirical benefit of recovering the assumed dynamics of information processing for both clinical and research practices, such as neurological assessment and model-based neuroscience.

Project description:BackgroundMany cancer survivors experience cancer-related cognitive impairment (CRCI), often with significant negative consequences across various life domains. Emerging evidence suggests that allowing additional time to process information before acting may be a useful strategy for those with CRCI to mitigate some of its impacts. The Wisconsin Card Sorting Task (WCST), a measure of general cognition, has shown that for some cancer survivors, longer task completion time facilitates similar task performance outcomes to control populations concerning perseveration errors; a key performance metric of the WCST. However, assessing if this strategy may be useful, as well as determining for whom it may be useful, with regard to strengths and weaknesses among select cognitive domains, is challenging due to factors such as the problem of task impurity. Accordingly, this study provides an initial computational and experimental assessment of whether additional time to process information before acting is a useful strategy for those with CRCI.MethodsWe simulated individual cognitive differences observed in humans by varying contributions of executive functioning components (updating, shifting, inhibition) to yield 48 distinct computational models of the WCST. Our main manipulation was then to provide these models with more or less time (at three levels of 20, 40 and 60 cycles) before models executed an action to sort a given card. We compared the number of perseveration errors on the WCST produced by the computational models. Additionally, we determined models that simulated the performance of cancer survivors on the WCST by comparing the number of perseveration errors produced by the models to human data.ResultsAdditional processing time resulted in the models producing significantly fewer perseveration errors, supporting our hypothesis. In addition, 8 unique models simulated the performance of cancer survivors on the WCST. Additional time appeared to have a positive influence on performance primarily by mitigating the impacts of severe inhibition impairments. For more severe global executive function impairments, a substantial amount of additional time was required to mitigate the impacts of the impairments. For the most severe impairments, additional time was unable to adequately mitigate the impact on performance.ConclusionAdditional processing time may be a useful strategy to rectify perseveration errors among cancer survivors with CRCI. Our findings have implications for the development of practical strategies, such as workload and deadline management in occupational settings, which may mitigate the negative effects of CRCI.

Project description:Insight problems are particularly interesting, because problems which require restructuring allow researchers to investigate the underpinnings of the Aha-experience, creativity and out of the box thinking. There is a need for new insight tasks to probe and extend the limits of existing theories and cognitive frameworks. To shed more light on this fascinating issue, we addressed the question: Is it possible to convey a well-known card sorting game into an insight task? We introduced different conditions and tested them via two online experiments (N = 546). Between the conditions we systematically varied the available perceptual features, and the existence of non-obvious rules. We found that our card sorting game elicited insight experience. In the first experiment, our data revealed that solution strategies and insight experience varied by the availability and saliency of perceptual features. The discovery of a non-obvious rule, which is not hinted at by perceptual features, was most difficult. With our new paradigm, we were able to construe ambiguous problems which allowed participants to find more than one solution strategy. Interestingly, we realized interindividual preferences for different strategies. The same problem drove strategies which either relied on feature integration or on more deliberate strategies. The second experiment varied the degree of independence of a sorting rule from the standard rules which were in accordance with prior knowledge. It was shown that the more independent the hidden rule was, the more difficult the task became. In sum, we demonstrated a new insight task which extended the available task domains and shed light on sequential and multi-step rule learning problems. Finally, we provided a first sketch of a cognitive model that should help to integrate the data within the existing literature on cognitive models and speculated about the generalizability of the interplay of prior knowledge modification and variation for problem solving.

Dataset Information

Split-half reliability estimates of an online card sorting task in a community sample of young and elderly adults.

Publications

Split-half reliability estimates of an online card sorting task in a community sample of young and elderly adults.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets