Project description:BackgroundChart-stimulated recall (CSR) is a case-based interviewing technique, which is used in the assessment of clinical decision-making in medical education and professional certification. Increasingly, clinical decision-making is a concern for clinical research in primary care. In this study, we review the prior application and utility of CSR as a technique for research interviews in primary care.MethodsFollowing Arksey & O'Malley's method for scoping reviews, we searched seven databases, grey literature, reference lists, and contacted experts in the field. We excluded studies on medical education or competence assessment. Retrieved citations were screened by one reviewer and full texts were ordered for all potentially relevant abstracts. Two researchers independently reviewed full texts and performed data extraction and quality appraisal if inclusion criteria were met. Data were collated and summarised using a published framework on the reporting of qualitative interview techniques, which was chosen a priori. The preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines informed the review report.ResultsFrom an initial list of 789 citations, eight studies using CSR in research interviews were included in the review: six from North America, one from the Netherlands, and one from Ireland. The most common purpose of included studies was to examine the influence of guidelines on physicians' decisions. The number of interviewees ranged from seven to twenty nine, while the number of charts discussed per interview ranged from one to twelve. CSR gave insights into physicians' reasoning for actions taken or not taken; the unrecorded social and clinical influences on decisions; and discrepancies between physicians' real and perceived practice. Ethical concerns and the training and influence of the researcher were poorly discussed in most of the studies. Potential pitfalls included the risk of recall, selection and observation biases.ConclusionsDespite the proven validity, reliability and acceptability of CSR in assessment interviews in medical education, its use in clinical research is limited. Application of CSR in qualitative research brings interview data closer to the reality of practice. Although further development of the approach is required, we recommend a role for CSR in research interviews on decision-making in clinical practice.

Project description:BackgroundUncertainty is common and impacts both patients and clinicians. The approach to uncertainty in medical trainees may be distinct from that of practicing clinicians and has important implications for medical education.ObjectiveDescribe trainee approach to uncertainty with the use of chart-stimulated recall (CSR)-based interviews, as well as the utility of such interviews in promoting reflection about decision-making among senior internal medicine (IM) residents.DesignQualitative analysis of CSR-based interviews with IM residents.ParticipantsSenior IM residents rotating on inpatient night float at the University of Pittsburgh Medical Center from February to September 2019.InterventionEach participant completed one, 20-min CSR session based on a self-selected case in which there was uncertainty in decision-making. Interviews explored the sources of, approaches to, and feelings about uncertainty.ApproachTwo independent coders developed a codebook and independently coded all transcripts. Transcripts were then analyzed using thematic analysis.Key resultsThe perceived acuity of the patient presentation was the main driver of the approach to and stress related to uncertainty. Perceived level of responsibility in resolving uncertainty during the overnight shift also varied among individual participants. Attending expression of uncertainty provided comfort to residents and alleviated stress related to uncertainty. Residents felt comfortable discussing their uncertainty and felt that the opportunity to think aloud during the exercise was valuable.ConclusionsOur study demonstrated a novel approach to the exploration of uncertainty in medical decision-making, with the use of CSR. Variations in resident perceived level of responsibility in resolving uncertainty during the overnight shift suggest a need for curriculum development in approach to uncertainty during night shifts. Though residents often experienced stress related to uncertainty, attending expression of uncertainty was an important mitigator of that stress, emphasizing the important role that the trainee-attending interaction plays in the diagnostic process.

Project description:BackgroundVideo stimulated recall (VSR) is a method of enhancing participants' accounts of the consultation using a video recording of the event to encourage and prompt recall in a post consultation interview. VSR is used in education and education research, and to a lesser extent in medical and nursing research. Little is known about the sort of research questions that lend themselves best to the use of VSR or the impact of the specific VSR procedure on study quality. This systematic review describes studies in primary care that have used the method and aims to identify the strengths, weaknesses and role of VSR.MethodsA systematic literature search has been conducted to identify primary care consultation research using VSR. Two authors undertook data extraction and quality appraisal of identified papers and a narrative synthesis has been conducted to draw together the findings. In addition, theory on classifying VSR procedures derived from other disciplines is used as a lens through which to assess the relevance of VSR technique.ResultsTwenty eight publications were identified that reported VSR in primary care doctor-patient consultation research. VSR was identified as a useful method to explore specific events within the consultation, mundane or routine occurrences, non-spoken events and appears to particularly add value to doctor's post consultation accounts. However, studies frequently had insufficient description of methods to properly evaluate both the quality of the study, and the influence of VSR technique on findings.ConclusionsVSR is particularly useful for study of specific consultation events when a 'within case' approach is used in analysis, comparing and contrasting findings from the consultation and post-consultation interview. Alignment of the choice of VSR procedure and sampling to the study research question was established as particularly important in the quality of studies. Future researchers may consider the role of process evaluation to understand further the impact of research design on data yielded and the acceptability of the method to participants.

Project description:BACKGROUND:Social media are as popular as ever, and concerns regarding the effects of social media use on adolescent well-being and mental health have sparked many scientific studies into use effects. Social media research is currently at an important crossroads: conflicting results on social media use's effects on well-being are abundant, and recent work in the field suggests that a new approach is required. The field is in need of an approach involving objective data regarding use where necessary and attention to different kinds of detail such as the why and how of social media use. OBJECTIVE:We present a novel paradigm implementing a principle from educational sciences called stimulated recall and demonstrate how it can be applied to social media use research. Our stimulated recall paradigm implements a number of elements that can fill the gaps currently present in social media and well-being research. METHODS:Objective data are collected regarding users' social media behaviors through video footage and in-phone data and used for a structured stimulated recall interview to facilitate detailed and context-sensitive processing of these objective data. In this interview, objective data are reviewed with the participant in an act of co-research, in which details such as the reasons for their use (eg, boredom) and processes surrounding their use (eg, with whom) are discussed and visualized in a stimulated recall chart. RESULTS:Our ongoing study (N=53) implementing this paradigm suggests this method is experienced as pleasant by participants in spite of its personal and intensive nature. CONCLUSIONS:The stimulated recall paradigm offers interesting and necessary avenues for approaching social media use research from new angles, addressing aspects of use that have thus far remained underexposed. The answers to questions such as "Why do adolescents use social media?" "In what ways exactly do they use social media?" and "How does social media use make them feel in the moment?" are now within reach, an important step forward in the field of social media use and well-being research.

Project description:BackgroundDietary intake assessment is an integral part of addressing suboptimal dietary intakes. Existing food-based methods are time-consuming and burdensome for users to report the individual foods consumed at each meal. However, ease of use is the most important feature for individuals choosing a nutrition or diet app. Intakes of whole meals can be reported in a manner that is less burdensome than reporting individual foods. No study has developed a method of dietary intake assessment where individuals report their dietary intakes as whole meals rather than individual foods.ObjectiveThis study aims to develop a novel, meal-based method of dietary intake assessment and test its ability to estimate nutrient intakes compared with that of a web-based, 24-hour recall (24HR).MethodsParticipants completed a web-based, generic meal-based recall. This involved, for each meal type (breakfast, light meal, main meal, snack, and beverage), choosing from a selection of meal images those that most represented their intakes during the previous day. Meal images were based on generic meals from a previous study that were representative of the actual meal intakes in Ireland. Participants also completed a web-based 24HR. Both methods were completed on the same day, 3 hours apart. In a crossover design, participants were randomized in terms of which method they completed first. Then, 2 weeks after the first dietary assessments, participants repeated the process in the reverse order. Estimates of mean daily nutrient intakes and the categorization of individuals according to nutrient-based guidelines (eg, low, adequate, and high) were compared between the 2 methods. P values of less than .05 were considered statistically significant.ResultsIn total, 161 participants completed the study. For the 23 nutrient variables compared, the median percentage difference between the 2 methods was 7.6% (IQR 2.6%-13.2%), with P values ranging from <.001 to .97, and out of 23 variables, effect sizes for the differences were small for 19 (83%) variables, moderate for 2 (9%) variables, and large for 2 (9%) variables. Correlation coefficients were statistically significant (P<.05) for 18 (78%) of the 23 variables. Statistically significant correlations ranged from 0.16 to 0.45, with median correlation of 0.32 (IQR 0.25-0.40). When participants were classified according to nutrient-based guidelines, the proportion of individuals who were classified into the same category ranged from 52.8% (85/161) to 84.5% (136/161).ConclusionsA generic meal-based method of dietary intake assessment provides estimates of nutrient intake comparable with those provided by a web-based 24HR but with varying levels of agreement among nutrients. Further studies are required to refine and improve the generic recall across a range of nutrients. Future studies will consider user experience including the potential feasibility of incorporating image recognition of whole meals into the generic recall.

Project description:Importance:Entrustable professional activities (EPAs) are an emerging workplace-based, patient-oriented assessment approach with limited empirical evidence. Objective:To measure the development of pediatric trainees' clinical skills over time using EPA-based assessment data. Design, Setting, and Participants:Prospective cohort study of categorical pediatric residents over 3 academic years (2015-2016, 2016-2017, and 2017-2018) assessed on 17 American Board of Pediatrics EPAs. Residents in training at 23 pediatric residency programs in the Association of Pediatric Program Directors Longitudinal Educational Assessment Research Network were included. Assessment was conducted by clinical competency committee members, who made summative assessment decisions regarding levels of supervision required for each resident and each EPA. Data were collected from May 2016 to November 2018 and analyzed from November to December 2018. Interventions:Longitudinal, prospective assessment using EPAs. Main Outcomes and Measures:Trajectories of supervision levels by EPA during residency training and how often graduating residents were deemed ready for unsupervised practice in each EPA. Results:Across the 5 data collection cycles, 1987 residents from all 3 postgraduate years in 23 residency programs were assigned 25 503 supervision level reports for the 17 general pediatrics EPAs. The 4 EPAs that required the most supervision across training were EPA 14 (quality improvement) on the 5-level scale (estimated mean level at graduation, 3.7; 95% CI, 3.6-3.7) and EPAs 8 (transition to adult care; mean, 7.0; 95% CI, 7.0-7.1), 9 (behavioral and mental health; mean, 6.6; 95% CI, 6.5-6.6), and 10 (resuscitate and stabilize; mean, 6.9; 95% CI, 6.8-7.0) on the expanded 5-level scale. At the time of graduation (36 months), the percentage of trainees who were rated at a supervision level corresponding to "unsupervised practice" varied by EPA from 53% to 98%. If performance standards were set to align with 90% of trainees achieving the level of unsupervised practice, this standard would be met for only 8 of the 17 EPAs (although 89% met this standard for EPA 17, performing the common procedures of the general pediatrician). Conclusions and Relevance:This study presents initial evidence for empirically derived practice readiness and sets the stage for identifying curricular gaps that contribute to discrepancy between observed practice readiness and standards needed to produce physicians able to meet the health needs of the patient populations they serve. Future work should compare these findings with postgraduation outcomes data as a means of seeking validity evidence.

Dataset Information

Using Chart Review and Chart-Stimulated Recall for Resident Assessment.

Publications

Using Chart Review and Chart-Stimulated Recall for Resident Assessment.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets