Dataset Information

A Delphi study to construct a CanMEDS competence based inventory applicable for workplace assessment.

ABSTRACT:

Background

During workplace based learning students develop professional competences and an appropriate performance. To gain insight in the learning process and to evaluate competences and performance, assessment tools are essential and need to be of good quality. We aimed to construct a competence inventory applicable as an instrument to measure the content validity of workplace based assessment tools, such as portfolio.

Methods

A Delphi study was carried out based on the CanMEDS Roles Framework. In three rounds, experts (N?=?25-30) were invited to score the key competences per CanMEDS role on relevance (6-point Likert-scale), and to comment on the content and formulation bearing in mind its use in workplace based assessment. A descriptive analysis of relevances and comments was performed.

Results

Although all competences were scored as relevant, many comments pointed at a lack of concrete, transparent and applicable descriptions of the key competences for the purpose of assessment. Therefore, the CanMEDS roles were reformulated in this Delphi procedure as concrete learning outcomes, observable and suitable for workplace based assessment.

Conclusions

A competence based inventory, ready for validating workplace based assessment tools, was constructed using a Delphi procedure and based on a clarification and concretisation of the CanMEDS roles.

SUBMITTER: Michels NR

PROVIDER: S-EPMC3599737 | biostudies-literature | 2012 Sep

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

A Delphi study to construct a CanMEDS competence based inventory applicable for workplace assessment.

Michels Nele R M NR Denekens Joke J Driessen Erik W EW Van Gaal Luc F LF Bossaert Leo L LL De Winter Benedicte Y BY

BMC medical education 20120914

<h4>Background</h4>During workplace based learning students develop professional competences and an appropriate performance. To gain insight in the learning process and to evaluate competences and performance, assessment tools are essential and need to be of good quality. We aimed to construct a competence inventory applicable as an instrument to measure the content validity of workplace based assessment tools, such as portfolio.<h4>Methods</h4>A Delphi study was carried out based on the CanMEDS ...[more]

PMID: 22973829

Similar Datasets

Project description:BackgroundIn view of the exponential use of the CanMEDS framework along with the lack of rigorous evidence about its applicability in workplace-based medical trainings, further exploring is necessary before accepting the framework as accurate and reliable competency outcomes for postgraduate medical trainings. Therefore, this study investigated whether the CanMEDS key competencies could be used, first, as outcome measures for assessing trainees' competence in the workplace, and second, as consistent outcome measures across different training settings and phases in a postgraduate General Practitioner's (GP) Training.MethodsIn a three-round web-based Delphi study, a panel of experts (n = 25-43) was asked to rate on a 5-point Likert scale whether the CanMEDS key competencies were feasible for workplace-based assessment, and whether they could be consistently assessed across different training settings and phases. Comments on each CanMEDS key competency were encouraged. Descriptive statistics of the ratings were calculated, while content analysis was used to analyse panellists' comments.ResultsOut of twenty-seven CanMEDS key competencies, consensus was not reached on six competencies for feasibility of assessment in the workplace, and on eleven for consistency of assessment across training settings and phases. Regarding feasibility, three out of four key competencies under the role "Leader", one out of two competencies under the role "Health Advocate", one out of four competencies under the role "Scholar", and one out of four competencies under the role "Professional" were deemed as not feasible for assessment in a workplace setting. Regarding consistency, consensus was not achieved for one out of five competencies under "Medical Expert", two out of five competencies under "Communicator",one out of three competencies under "Collaborator", one out of two under "Health Advocate", one out of four competencies under "Scholar", one out of four competencies under "Professional". No competency under the role "Leader" was deemed to be consistently assessed across training settings and phases.ConclusionsThe findings indicate a mismatch between the initial intent of the CanMEDS framework and its applicability in the context of workplace-based assessment. Although the CanMEDS framework could offer starting points, further contextualization of the framework is required before implementing in workplace-based postgraduate medical trainings.

Project description:IntroductionPeer-supported Open Dialogue (POD) is a novel approach to mental health care that is currently being practiced and researched in the United Kingdom. For POD to be successfully implemented, effective training must be provided to make sure trainees are prepared to deliver the approach as intended. Therefore, a specific instrument that can assess the development and competence of POD trainees, as well as the effectiveness of POD training is crucial. Therefore, the current study aimed to establish an inventory named the Peer-supported Open Dialogue Attitude and Competence Inventory (PODACI), measuring the changes in attributes and attitudes of trainees before and after training.Methods and resultsTo generate the inventory, a four-round modified Delphi approach was used. We first identified the dimensions that are essential and specific to POD through an extensive literature review and individual interviews with practitioners (n = 8). After generating the items, we further refined the items through two rounds of questionnaires, asking practitioners to rate the relevance of each item from 1 (not essential) to 4 (highly essential; n = 21 and n = 10), and finalized the inventory via a focus group interview with POD trainers (n = 4). In total, 76 items were included in the PODACI. A good consensus on the items was reached: the median score of the items was all above 3.00 (essential) and achieved an agreement level greater than 85%. The Kendall coordination coefficient W was 0.36 and 0.28 in the two questionnaires employed, indicating a fair level of agreement between participants.DiscussionThe PODACI provides a way to measure attitudinal and competency factors related to the treatment integrity of POD as well as the efficacy of the training courses being offered. This highly enriched instrument opens up a wide range of possibilities for POD research and application, facilitating the development of Open Dialogue services. The next step is to assess the psychometric properties of the inventory.

Project description:AimTo construct an evaluation index system for the core competence of nurses in sleep medicine specialties.BackgroundSpecialized nurses in sleep medicine must handle treatment, nursing, and management well, which requires nurses to have excellent competence in knowledge, skills, and ability. However, a competency evaluation system for sleep medicine nurses has not been established in China.MethodsWe used a literature review and an expert meeting to establish a draft indicator system. Subsequently, two rounds of correspondence were conducted with 27 experts from 5 provinces using the Delphi method to solicit their opinions on the core competency evaluation indicators for sleep medicine nurse specialists and to qualitatively evaluate the experts' scores. The consensus was defined in advance as a mean score of 4.0 or above, with at least 75% agreement among participants. In this way, the final indicator framework was determined.ResultsThe final evaluation indexes of the core competencies for sleep medicine Nurse Specialists included 6 first-level indexes (Practical ability, Theoretical Knowledge, Critical thinking, Communication and coordination, Nursing Management, and Professional Development), 16 s-level indexes, and 64 third-level indexes. The effective response rates of the two expert consultation rounds were 100%. The expert authority coefficients were 0.878 and 0.865 in the first and second rounds of consultation, respectively. In the second round of consultation, the first, second, and third indexes of Kendall's coefficient of concordance were 0.373, 0.351, and 0.286, respectively (P < 0.05).ConclusionThe core competence evaluation index system for sleep medicine nurses established in this study is scientific and reliable and can provide a theoretical reference for the training, assessment, and evaluation of sleep medicine nurses in the future.Implications for nursing managementThe evaluation index system of sleep medicine nurses' core competence will provide an effective practical framework for nursing management to evaluate, train, and examine the core competence of sleep medicine nurses.

Dataset Information

A Delphi study to construct a CanMEDS competence based inventory applicable for workplace assessment.

Background

Methods

Results

Conclusions

Publications

A Delphi study to construct a CanMEDS competence based inventory applicable for workplace assessment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets