Dataset Information

What Stops Fairness from Emerging in Assessment? The Forces on a Complex Adaptive System.

ABSTRACT:

Introduction

Workplace-based assessment occurs in authentic, dynamic clinical environments where reproducible, measurement-based assessments can often not be implemented. In these environments, research approaches that respect these multiple dynamic interactions, such as complexity perspectives, are encouraged. Previous research has shown that fairness in assessment is a nonlinear phenomenon that emerges from interactions between its components and behaves like a complex adaptative system. The aim of this study was to understand the external forces on the complex adaptive system which may disrupt fairness from emerging.

Methods

We conducted online focus groups with a purposeful sample of nineteen academic leaders in the Netherlands. We used an iterative approach to collection, analysis and coding of the data and interpreted the results using a lens of complexity, focusing on how individual elements of fairness work in concert to create systems with complex behaviour.

Results

We identified three themes of forces which can disrupt fairness: forces impairing interactivity, forces impairing adaption and forces impairing embeddedness. Within each of these themes, we identified subthemes: assessor and student forces, tool forces and system forces.

Discussion

Consistent with complexity theory, this study suggests there are multiple forces which can hamper the emergence of fairness. Whilst complexity thinking does not reduce the scale of the challenge, viewing forces through this lens provides insight into why and how these forces are disrupting fairness. This allows for more purposeful, meaningful changes to support the use of fair judgement in assessment in dynamic authentic clinical workplaces.

SUBMITTER: Valentine N

PROVIDER: S-EPMC10453954 | biostudies-literature | 2023

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

What Stops Fairness from Emerging in Assessment? The Forces on a Complex Adaptive System.

Valentine Nyoli N Durning Steven J SJ Shanahan Ernst Michael EM Schuwirth Lambert L

Perspectives on medical education 20230824 1

<h4>Introduction</h4>Workplace-based assessment occurs in authentic, dynamic clinical environments where reproducible, measurement-based assessments can often not be implemented. In these environments, research approaches that respect these multiple dynamic interactions, such as complexity perspectives, are encouraged. Previous research has shown that fairness in assessment is a nonlinear phenomenon that emerges from interactions between its components and behaves like a complex adaptative syste ...[more]

PMID: 37636331

Similar Datasets

Project description:BackgroundThe concept of complexity is used in palliative care (PC) to describe the nature of patients' situations and the extent of resulting needs and care demands. However, the term or concept is not clearly defined and operationalised with respect to its particular application in PC. As a complex problem, a care situation in PC is characterized by reciprocal, nonlinear relations and uncertainties. Dealing with complex problems necessitates problem-solving methods tailored to specific situations. The theory of complex adaptive systems (CAS) provides a framework for locating problems and solutions. This study aims to describe criteria contributing to complexity of PC situations from the professionals' view and to develop a conceptual framework to improve understanding of the concept of "complexity" and related elements of a PC situation by locating the complex problem "PC situation" in a CAS.MethodsQualitative interview study with 42 semi-structured expert (clinical/economical/political) interviews. Data was analysed using the framework method. The thematic framework was developed inductively. Categories were reviewed, subsumed and connected considering CAS theory.ResultsThe CAS of a PC situation consists of three subsystems: patient, social system, and team. Agents in the "system patient" are allocated to further subsystems on patient level: physical, psycho-spiritual, and socio-cultural. The "social system" and the "system team" are composed of social agents, who affect the CAS as carriers of characteristics, roles, and relationships. Environmental factors interact with the care situation from outside the system. Agents within subsystems and subsystems themselves interact on all hierarchical system levels and shape the system behaviour of a PC situation.ConclusionsThis paper provides a conceptual framework and comprehensive understanding of complexity in PC. The systemic view can help to understand and shape situations and dynamics of individual care situations; on higher hierarchical level, it can support an understanding and framework for the development of care structures and concepts. The framework provides a foundation for the development of a model to differentiate PC situations by complexity of patients and care needs. To enable an operationalisation and classification of complexity, relevant outcome measures mirroring the identified system elements should be identified and implemented in clinical practice.

Dataset Information

What Stops Fairness from Emerging in Assessment? The Forces on a Complex Adaptive System.

Introduction

Methods

Results

Discussion

Publications

What Stops Fairness from Emerging in Assessment? The Forces on a Complex Adaptive System.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets