Dataset Information

Correlation between physician assistant students' performance score of history taking and physical exam documentation and scores of Graduate Record Examination, clinical year grade point average, and score of Physician Assistant National Certifying Exam in the United States.

ABSTRACT:

Purpose

Learning to perform and document patient history taking and physical exam (H&P) entails a major component of the 1st year academic education of physician assistant (PA) students at Wayne State University, USA. The H&P is summative of multiple aspects of PA education, and students must master communication with patients and other health care providers. The objectives of this study were first, to determine if there was a correlation between scores on GRE component testing and scores on graded H&Ps. The second objective was to identify a correlation between proficiency with H&P documentation and academic and clinical year grade point average (GPA)s and Physician Assistant National Qualifying (PANCE) score.

Methods

Subjects included 147 PA students from Wayne State University from 2014-2016. PA students visited local hospitals or outpatient clinics during the academic year to perform and document patient H&Ps. Correlation between The H&P mean scores and GRE component scores, GPAs, and PANCE scores were analyzed.

Results

The subjects were 26.5 years-old (+ 6.5) and 111 female (75.5%). There was no correlation between the GRE component score and the H&P mean score. The H&P score was positively correlated with GPA 1 (r = 0.512, P<0.001), with GPA 2 (r = 0.425, P<0.001) and with PANCE score (r = 0.448, P<0.001).

Conclusion

PA student skill with H&P documentation was positively related to academic performance score during PA school and achievement score on the PANCE at Wayne State University, USA.

SUBMITTER: Lolar S

PROVIDER: S-EPMC7364023 | biostudies-literature | 2020

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Correlation between physician assistant students' performance score of history taking and physical exam documentation and scores of Graduate Record Examination, clinical year grade point average, and score of Physician Assistant National Certifying Exam in the United States.

Lolar Sara S McQueen Jamie L JL Maher Sara F SF

Journal of educational evaluation for health professions 20200527

<h4>Purpose</h4>Learning to perform and document patient history taking and physical exam (H&P) entails a major component of the 1st year academic education of physician assistant (PA) students at Wayne State University, USA. The H&P is summative of multiple aspects of PA education, and students must master communication with patients and other health care providers. The objectives of this study were first, to determine if there was a correlation between scores on GRE component testing and score ...[more]

PMID: 32455510

Similar Datasets

Project description:BackgroundQuality of health care needs to be improved in rural China. The Chinese government, based on the 1999 Law on Physicians, started implementing the Rural Doctor Practice Regulation in 2004 to increase the percentage of certified physicians among village doctors. Special exam-targeted training for rural doctors therefore was launched as a national initiative. This study examined these rural doctors' perceptions of whether that training helps them pass the exam and whether it improves their skills.MethodsThree counties were selected from the 4 counties in Changzhou City in eastern China, and 844 village doctors were surveyed by a questionnaire in July 2012. Chi-square test and Fisher exact test were used to identify differences of attitudes about the exam and training between the rural doctors and certified (assistant) doctors. Longitudinal annual statistics (1980-2014) of village doctors were further analyzed.ResultsEight hundred and forty-four village doctors were asked to participate, and 837 (99.17%) responded. Only 14.93% of the respondents had received physician (assistant) certification. Only 49.45% of the village doctors thought that the areas tested by the certification exam were closely related to the healthcare needs of rural populations. The majority (86.19%) felt that the training program was "very helpful" or "helpful" for preparing for the exam. More than half the village doctors (61.46%) attended the "weekly school". The village doctors considered the most effective method of learning was "continuous training (40.36%)" . The majority of the rural doctors (89.91%) said they would be willing to participate in the training and 96.87% stated that they could afford to pay up to 2000 yuan for it.ConclusionsThe majority of village doctors in Changzhou City perceived that neither the certification exam nor the training for it are closely related to the actual healthcare needs of rural residents. Policies and programs should focus on providing exam-preparation training for selected rural doctors, reducing training expenditures, and utilizing web-based methods. The training focused on rural practice should be provided to all village doctors, even certified physicians. The government should also adjust the local licensing requirements to attract and recruit new village doctors.

Project description:PurposeAccording to the Williams Institute, 1.4 million U.S. adults identify as transgender. Many experience health care disparities. Professional organizations call for medical education to improve transgender care, but what curricula are being delivered is unknown. The goal of this study was to conduct the first comprehensive, national survey of transgender health care curricula in physician assistant (PA) education.MethodThe authors sent a questionnaire to program directors (PDs) at all 236 U.S. PA programs in June 2018. They categorized programs as those that currently deliver at least 1 hour of transgender health content and those who do not (Teaching/Not Teaching). They examined differences between Teaching and Not Teaching programs using chi-square tests, and they evaluated comments for themes.ResultsThe response rate was 100%. Of the 236 programs, 202 (85.6%) teach transgender content and 34 (14.4%) do not. According to PDs, most transgender content was delivered in medical interviewing (44.1%) or women's health (31.4%) and the most common transgender health topics included differentiating between sex and gender and between behavior and identity (78.8%), followed by health disparities (77.5%) and barriers to care (75.0%). PDs most commonly cited a lack of time (51.3%) and faculty knowledge (35.6%) as barriers for teaching transgender health topics. Half of the PDs (50.4%) ranked transgender health as very or extremely important. The authors detected statistically significant differences between Teaching and Not Teaching programs based on geographic region (P = .01), perceived importance (P ≤ .001), and presence of knowledgeable faculty (P = .01). Presence of knowledgeable faculty was significantly associated with perceived importance (P = .01).ConclusionsThis is the first comprehensive, nationwide survey of transgender health education in U.S. PA programs. A key finding is that the presence of expert faculty is significantly associated with delivery and perceived importance of transgender health curricula.

Project description:BackgroundThe Kampala Trauma Score (KTS) has been proposed as a triage tool for use in low- and middle-income countries (LMICs). This study aimed to examine the diagnostic accuracy of KTS in predicting emergency department outcomes using timely injury estimation with Abbreviated Injury Scale (AIS) score and physician opinion to calculate KTS scores.MethodsThis was a diagnostic accuracy study of KTS among injured patients presenting to Komfo Anokye Teaching Hospital A&E, Ghana. South African Triage Scale (SATS); KTS component variables, including AIS scores and physician opinion for serious injury quantification; and ED disposition were collected. Agreement between estimated AIS score and physician opinion were analyzed with normal, linear weighted, and maximum kappa. Receiver operating characteristic (ROC) analysis of KTS-AIS and KTS-physician opinion was performed to evaluate each measure's ability to predict A&E mortality and need for hospital admission to the ward or theatre.ResultsA total of 1053 patients were sampled. There was moderate agreement between AIS criteria and physician opinion by normal (κ=0.41), weighted (κlin=0.47), and maximum (κmax=0.53) kappa. A&E mortality ROC area for KTS-AIS was 0.93, KTS-physician opinion 0.89, and SATS 0.88 with overlapping 95% confidence intervals (95%CI). Hospital admission ROC area for KTS-AIS was 0.73, KTS-physician opinion 0.79, and SATS 0.71 with statistical similarity. When evaluating only patients with serious injuries, KTS-AIS (ROC 0.88) and KTS-physician opinion (ROC 0.88) performed similarly to SATS (ROC 0.78) in predicting A&E mortality. The ROC area for KTS-AIS (ROC 0.71; 95%CI 0.66-0.75) and KTS-physician opinion (ROC 0.74; 95%CI 0.69-0.79) was significantly greater than SATS (ROC 0.57; 0.53-0.60) with regard to need for admission.ConclusionsKTS predicted mortality and need for admission from the ED well when early estimation of the number of serious injuries was used, regardless of method (i.e. AIS criteria or physician opinion). This study provides evidence for KTS to be used as a practical and valid triage tool to predict patient prognosis, ED outcomes and inform referral decision-making from first- or second-level hospitals in LMICs.

Project description:ImportanceThe underrepresentation of Black men in the health care workforce, particularly among physician assistants and associates (PAs), represents a missed opportunity to alleviate shortages of health care professionals and enhance workforce diversity. Increasing the number of Black men in the training pipeline could significantly benefit education, patient care, and overall health outcomes.ObjectiveTo analyze patterns from 2013 to 2021 among Black men applying to and matriculating into PA programs and compare these figures with the age-specific US population of Black men.Design, setting, and participantsThis cohort study assessed deidentified application and matriculation data from the Central Application Service for Physician Assistants (CASPA) for PA training programs in the US, alongside US Census data. CASPA applicants reporting race and gender identities as Black male were included. Data were obtained March 10, 2023, from the 2012-2013 to the 2020-2021 application cycles; data were analyzed from June 2023 to May 2024.ExposuresBlack male applicants and matriculation.Main outcomes and measuresPatterns and proportion of Black male applicants and matriculants to PA programs relative to total rates and expected numbers.ResultsFrom 2013 to 2021, PA programs grew 64.3%, with an increase in applicants from 19 761 to 30 196 and matriculants from 6192 to 11 115. Despite this growth, the representation of Black men among applicants (from 435 to 732) and matriculants (from 73 to 156) remained stagnant, averaging 2.2% and 1.2%, respectively, significantly lower than their 8.7% (3 920 231 individuals aged 20-29 years) representation in the US Census. In 2021, the matriculation rate for Black men (156 of 732 [21.3%]) was notably lower than the matriculation rate for all applicants (11 115 of 30 196 [36.8%]). Based on the expected proportion of Black men in the PA applicant age range, there should have been 2641 applicants (actual: 732) and 972 matriculants (actual: 156) across 308 PA programs in 2021; these numbers indicate that, per program, approximately 9 applicants would have to have been evaluated and 3 matriculated to achieve parity, in contrast to the mean of 2 applicants and 1 matriculant per 2 programs.Conclusions and relevanceIn this cohort study of PA applicants and matriculants, Black men remained substantially underrepresented despite overall growth of PA training programs. The low representation among matriculants was due in part to the low numbers of applicants but also to substantially lower matriculation success. This persistent underrepresentation highlights systemic barriers and underscores the need for targeted interventions to achieve a more representative health care workforce. To achieve equitable admissions, each PA program should aim to evaluate 9 Black male applicants and matriculate 3 Black men annually.

Project description:ImportanceLarge language models (LLMs) are crucial for medical tasks. Ensuring their reliability is vital to avoid false results. Our study assesses two state-of-the-art LLMs (ChatGPT and LlaMA-2) for extracting clinical information, focusing on cognitive tests like MMSE and CDR.ObjectiveEvaluate ChatGPT and LlaMA-2 performance in extracting MMSE and CDR scores, including their associated dates.MethodsOur data consisted of 135,307 clinical notes (Jan 12th, 2010 to May 24th, 2023) mentioning MMSE, CDR, or MoCA. After applying inclusion criteria 34,465 notes remained, of which 765 underwent ChatGPT (GPT-4) and LlaMA-2, and 22 experts reviewed the responses. ChatGPT successfully extracted MMSE and CDR instances with dates from 742 notes. We used 20 notes for fine-tuning and training the reviewers. The remaining 722 were assigned to reviewers, with 309 each assigned to two reviewers simultaneously. Inter-rater-agreement (Fleiss' Kappa), precision, recall, true/false negative rates, and accuracy were calculated. Our study follows TRIPOD reporting guidelines for model validation.ResultsFor MMSE information extraction, ChatGPT (vs. LlaMA-2) achieved accuracy of 83% (vs. 66.4%), sensitivity of 89.7% (vs. 69.9%), true-negative rates of 96% (vs 60.0%), and precision of 82.7% (vs 62.2%). For CDR the results were lower overall, with accuracy of 87.1% (vs. 74.5%), sensitivity of 84.3% (vs. 39.7%), true-negative rates of 99.8% (98.4%), and precision of 48.3% (vs. 16.1%). We qualitatively evaluated the MMSE errors of ChatGPT and LlaMA-2 on double-reviewed notes. LlaMA-2 errors included 27 cases of total hallucination, 19 cases of reporting other scores instead of MMSE, 25 missed scores, and 23 cases of reporting only the wrong date. In comparison, ChatGPT's errors included only 3 cases of total hallucination, 17 cases of wrong test reported instead of MMSE, and 19 cases of reporting a wrong date.ConclusionsIn this diagnostic/prognostic study of ChatGPT and LlaMA-2 for extracting cognitive exam dates and scores from clinical notes, ChatGPT exhibited high accuracy, with better performance compared to LlaMA-2. The use of LLMs could benefit dementia research and clinical care, by identifying eligible patients for treatments initialization or clinical trial enrollments. Rigorous evaluation of LLMs is crucial to understanding their capabilities and limitations.

Project description:Ensuring reliability of Large Language Models (LLMs) in clinical tasks is crucial. Our study assesses two state-of-the-art LLMs (ChatGPT and LlaMA-2) for extracting clinical information, focusing on cognitive tests like MMSE and CDR. Our data consisted of 135,307 clinical notes (Jan 12th, 2010 to May 24th, 2023) mentioning MMSE, CDR, or MoCA. After applying inclusion criteria 34,465 notes remained, of which 765 underwent ChatGPT (GPT-4) and LlaMA-2, and 22 experts reviewed the responses. ChatGPT successfully extracted MMSE and CDR instances with dates from 742 notes. We used 20 notes for fine-tuning and training the reviewers. The remaining 722 were assigned to reviewers, with 309 each assigned to two reviewers simultaneously. Inter-rater-agreement (Fleiss' Kappa), precision, recall, true/false negative rates, and accuracy were calculated. Our study follows TRIPOD reporting guidelines for model validation. For MMSE information extraction, ChatGPT (vs. LlaMA-2) achieved accuracy of 83% (vs. 66.4%), sensitivity of 89.7% (vs. 69.9%), true-negative rates of 96% (vs 60.0%), and precision of 82.7% (vs 62.2%). For CDR the results were lower overall, with accuracy of 87.1% (vs. 74.5%), sensitivity of 84.3% (vs. 39.7%), true-negative rates of 99.8% (98.4%), and precision of 48.3% (vs. 16.1%). We qualitatively evaluated the MMSE errors of ChatGPT and LlaMA-2 on double-reviewed notes. LlaMA-2 errors included 27 cases of total hallucination, 19 cases of reporting other scores instead of MMSE, 25 missed scores, and 23 cases of reporting only the wrong date. In comparison, ChatGPT's errors included only 3 cases of total hallucination, 17 cases of wrong test reported instead of MMSE, and 19 cases of reporting a wrong date. In this diagnostic/prognostic study of ChatGPT and LlaMA-2 for extracting cognitive exam dates and scores from clinical notes, ChatGPT exhibited high accuracy, with better performance compared to LlaMA-2. The use of LLMs could benefit dementia research and clinical care, by identifying eligible patients for treatments initialization or clinical trial enrollments. Rigorous evaluation of LLMs is crucial to understanding their capabilities and limitations.

Dataset Information

Correlation between physician assistant students' performance score of history taking and physical exam documentation and scores of Graduate Record Examination, clinical year grade point average, and score of Physician Assistant National Certifying Exam in the United States.

Purpose

Methods

Results

Conclusion

Publications

Correlation between physician assistant students' performance score of history taking and physical exam documentation and scores of Graduate Record Examination, clinical year grade point average, and score of Physician Assistant National Certifying Exam in the United States.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets