Dataset Information

Development of a self-report instrument for measuring online teaching practices and discussion facilitation.

ABSTRACT: Online learning in higher education has been increasing for many years. This is happening across all of higher education and it is happening more specifically within STEM fields. The growth of online learning has significantly accelerated the past couple of years during the COVID-19 pandemic as colleges and universities have sought ways to continue educating students while also keeping students, faculty and staff safe. As result, many college faculty and instructors across all fields of study including STEM fields have made and continue to make the transition to teaching online for the first time. Teaching in an online environment is different from traditional classroom teaching in many ways and presents a unique set of challenges to college instructors. This study documents the development of an instrument used for instructors to self-report their instructional techniques and practices. Data from 251 instructors is also used to examine how this instrument can be used to better understand particular practices, with a focus in this study on discussion facilitation. The results align with the Community of Inquiry framework, including indicating that teaching through discussion forums involves direct contribution and/or facilitation.

SUBMITTER: DeCamp W

PROVIDER: S-EPMC9543975 | biostudies-literature | 2022

REPOSITORIES: biostudies-literature

ACCESS DATA

Publications

Development of a self-report instrument for measuring online teaching practices and discussion facilitation.

DeCamp Whitney W Horvitz Brian B Garza Mitchell Regina L RL Kowalske Megan Grunert MG Singleton Cherrelle C

PloS one 20221007 10

Online learning in higher education has been increasing for many years. This is happening across all of higher education and it is happening more specifically within STEM fields. The growth of online learning has significantly accelerated the past couple of years during the COVID-19 pandemic as colleges and universities have sought ways to continue educating students while also keeping students, faculty and staff safe. As result, many college faculty and instructors across all fields of study in ...[more]

PMID: 36206277

Similar Datasets

Project description:Student engagement during classes includes behavioural, cognitive and emotional components, and is a pre-requisite for successful active learning environments. A novel approach to measuring student engagement was developed, involving triangulation of real-time student-self report, observation by trained observers and heart rate measurement. The self-report instrument was evaluated in four separate cohorts (n = 123) at Monash University and the University of North Carolina. The six item self-report demonstrated good reliability (Cronbach's alpha values ranged from 0.7-0.81). The self-report showed predictive validity in that small group activities were rated as significantly more engaging than didactic lecturing. Additionally, there was significant inter-instructor variability and within-class variability, indicating good discrimination between classroom activities. This self-report may prove useful to academic teaching staff in evaluating and refining their active learning activities. Independent observation was not found to correlate with student self-report, due in part to students who were pretending to engage being rated as engaged by an observer. Strikingly, students reported that they were pretending to engage for 23% of class time, even for highly regarded instructors. Individual participants were rated as engaged for 42 of the 46 intervals for which they reported that they had "pretended to engage", indicating that the two observers were unable to detect disengagement during periods in which students pretended to engage. Instructors should be aware that student cues such as eye contact and nodding may indicate pretending to engage. One particular self-report item; "I tried a new approach or way of thinking about the content", correlated positively with heart rates, and a controlled study reproduced this finding during two activities that required students to try a new approach to understanding a concept. Agreement with this item also correlated with superior performance on two in-class written assessment tasks (n = 101, p<0.01). Further use of this tool and related educational research may be useful to identify in-class activities that are engaging and likely to lead to improved student attainment of learning outcomes.

Project description:BackgroundTeamwork between clinical teachers is a challenge in postgraduate medical training. Although there are several instruments available for measuring teamwork in health care, none of them are appropriate for teaching teams. The aim of this study is to develop an instrument (TeamQ) for measuring teamwork, to investigate its psychometric properties and to explore how clinical teachers assess their teamwork.MethodTo select the items to be included in the TeamQ questionnaire, we conducted a content validation in 2011, using a Delphi procedure in which 40 experts were invited. Next, for pilot testing the preliminary tool, 1446 clinical teachers from 116 teaching teams were requested to complete the TeamQ questionnaire. For data analyses we used statistical strategies: principal component analysis, internal consistency reliability coefficient, and the number of evaluations needed to obtain reliable estimates. Lastly, the median TeamQ scores were calculated for teams to explore the levels of teamwork.ResultsIn total, 31 experts participated in the Delphi study. In total, 114 teams participated in the TeamQ pilot. The median team response was 7 evaluations per team. The principal component analysis revealed 11 factors; 8 were included. The reliability coefficients of the TeamQ scales ranged from 0.75 to 0.93. The generalizability analysis revealed that 5 to 7 evaluations were needed to obtain internal reliability coefficients of 0.70. In terms of teamwork, the clinical teachers scored residents' empowerment as the highest TeamQ scale and feedback culture as the area that would most benefit from improvement.ConclusionsThis study provides initial evidence of the validity of an instrument for measuring teamwork in teaching teams. The high response rates and the low number of evaluations needed for reliably measuring teamwork indicate that TeamQ is feasible for use by teaching teams. Future research could explore the effectiveness of feedback on teamwork in follow up measurements.

Dataset Information

Development of a self-report instrument for measuring online teaching practices and discussion facilitation.

Publications

Development of a self-report instrument for measuring online teaching practices and discussion facilitation.

Similar Datasets

OmicsDI is part of the ELIXIR infrastructure

Tweets